2023-05-24T03:15:35.289 INFO:root:teuthology version: 0.0.1.dev101+gc6e0984 2023-05-24T03:15:35.290 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/workunit/quota} --archive /home/teuthworker/archive/pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi/7284286 --verbose --name pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi --owner scheduled_pdonnell@teuthology -- /home/teuthworker/archive/pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi/7284286/orig.config.yaml 2023-05-24T03:15:35.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-05-24T03:15:35.444 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi/7284286 branch: wip-pdonnell-testing-20230523.134409 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/workunit/quota} email: pdonnell@redhat.com first_in_suite: false job_id: '7284286' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-pdonnell-testing-20230523.134409 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: fa0e62c4a1d8e4a737d9cbe50224f70009b79b28 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: fa0e62c4a1d8e4a737d9cbe50224f70009b79b28 kclient: syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20230523.134409 sha1: fa0e62c4a1d8e4a737d9cbe50224f70009b79b28 owner: scheduled_pdonnell@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 7650 sha1: fa0e62c4a1d8e4a737d9cbe50224f70009b79b28 sleep_before_teardown: 0 subset: 449/512 suite: fs suite_branch: wip-pdonnell-testing-20230523.134409 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: fa0e62c4a1d8e4a737d9cbe50224f70009b79b28 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi146.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= smithi151.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - workunit: clients: all: - fs/quota teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: stdin-killer teuthology_sha1: c6e0984e7e7716eedf6039f15c6a9d1043e0c5f2 timestamp: 2023-05-23_18:20:18 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-05-24T03:15:35.444 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/qa; will attempt to use it 2023-05-24T03:15:35.445 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/qa/tasks 2023-05-24T03:15:35.445 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-05-24T03:15:35.447 INFO:teuthology.task.internal:Checking packages... 2023-05-24T03:15:35.482 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash 'fa0e62c4a1d8e4a737d9cbe50224f70009b79b28' 2023-05-24T03:15:35.482 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-05-24T03:15:35.483 INFO:teuthology.packaging:ref: None 2023-05-24T03:15:35.483 INFO:teuthology.packaging:tag: None 2023-05-24T03:15:35.484 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20230523.134409 2023-05-24T03:15:35.485 INFO:teuthology.packaging:sha1: fa0e62c4a1d8e4a737d9cbe50224f70009b79b28 2023-05-24T03:15:35.485 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-pdonnell-testing-20230523.134409 2023-05-24T03:15:35.631 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-4167.gfa0e62c4 2023-05-24T03:15:35.632 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-05-24T03:15:35.640 INFO:teuthology.task.internal:no buildpackages task found 2023-05-24T03:15:35.641 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-05-24T03:15:35.651 INFO:teuthology.task.internal:Saving configuration 2023-05-24T03:15:35.672 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-05-24T03:15:35.681 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-05-24T03:15:35.710 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi146.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi/7284286', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-05-24 03:10:03.809855', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-05-24T03:15:35.738 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi151.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi/7284286', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-05-24 03:10:03.811407', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-05-24T03:15:35.739 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-05-24T03:15:35.746 INFO:teuthology.task.internal:roles: ubuntu@smithi146.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-05-24T03:15:35.747 INFO:teuthology.task.internal:roles: ubuntu@smithi151.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-05-24T03:15:35.747 INFO:teuthology.run_tasks:Running task console_log... 2023-05-24T03:15:35.836 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9d69d3bee0>, signals=[15]) 2023-05-24T03:15:35.837 INFO:teuthology.run_tasks:Running task internal.connect... 2023-05-24T03:15:35.846 INFO:teuthology.task.internal:Opening connections... 2023-05-24T03:15:35.847 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi146.front.sepia.ceph.com 2023-05-24T03:15:35.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-24T03:15:35.918 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi151.front.sepia.ceph.com 2023-05-24T03:15:35.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-24T03:15:35.985 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-05-24T03:15:35.993 DEBUG:teuthology.orchestra.run.smithi146:> uname -m 2023-05-24T03:15:36.013 INFO:teuthology.orchestra.run.smithi146.stdout:x86_64 2023-05-24T03:15:36.013 DEBUG:teuthology.orchestra.run.smithi146:> cat /etc/os-release 2023-05-24T03:15:36.071 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="Red Hat Enterprise Linux" 2023-05-24T03:15:36.071 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="8.6 (Ootpa)" 2023-05-24T03:15:36.072 INFO:teuthology.orchestra.run.smithi146.stdout:ID="rhel" 2023-05-24T03:15:36.072 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE="fedora" 2023-05-24T03:15:36.072 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="8.6" 2023-05-24T03:15:36.072 INFO:teuthology.orchestra.run.smithi146.stdout:PLATFORM_ID="platform:el8" 2023-05-24T03:15:36.072 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-05-24T03:15:36.072 INFO:teuthology.orchestra.run.smithi146.stdout:ANSI_COLOR="0;31" 2023-05-24T03:15:36.073 INFO:teuthology.orchestra.run.smithi146.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-05-24T03:15:36.073 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://www.redhat.com/" 2023-05-24T03:15:36.073 INFO:teuthology.orchestra.run.smithi146.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-05-24T03:15:36.073 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-05-24T03:15:36.073 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:15:36.073 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-05-24T03:15:36.073 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-05-24T03:15:36.073 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-05-24T03:15:36.074 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-05-24T03:15:36.074 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2023-05-24T03:15:36.102 DEBUG:teuthology.orchestra.run.smithi151:> uname -m 2023-05-24T03:15:36.122 INFO:teuthology.orchestra.run.smithi151.stdout:x86_64 2023-05-24T03:15:36.123 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release 2023-05-24T03:15:36.181 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="Red Hat Enterprise Linux" 2023-05-24T03:15:36.181 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="8.6 (Ootpa)" 2023-05-24T03:15:36.181 INFO:teuthology.orchestra.run.smithi151.stdout:ID="rhel" 2023-05-24T03:15:36.181 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE="fedora" 2023-05-24T03:15:36.182 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="8.6" 2023-05-24T03:15:36.182 INFO:teuthology.orchestra.run.smithi151.stdout:PLATFORM_ID="platform:el8" 2023-05-24T03:15:36.182 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-05-24T03:15:36.182 INFO:teuthology.orchestra.run.smithi151.stdout:ANSI_COLOR="0;31" 2023-05-24T03:15:36.182 INFO:teuthology.orchestra.run.smithi151.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-05-24T03:15:36.182 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://www.redhat.com/" 2023-05-24T03:15:36.182 INFO:teuthology.orchestra.run.smithi151.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-05-24T03:15:36.183 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-05-24T03:15:36.183 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-24T03:15:36.183 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-05-24T03:15:36.183 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-05-24T03:15:36.183 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-05-24T03:15:36.183 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-05-24T03:15:36.184 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2023-05-24T03:15:36.210 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-05-24T03:15:36.220 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-05-24T03:15:36.227 INFO:teuthology.task.internal:Checking for old test directory... 2023-05-24T03:15:36.228 DEBUG:teuthology.orchestra.run.smithi146:> test '!' -e /home/ubuntu/cephtest 2023-05-24T03:15:36.231 DEBUG:teuthology.orchestra.run.smithi151:> test '!' -e /home/ubuntu/cephtest 2023-05-24T03:15:36.249 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-05-24T03:15:36.256 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-05-24T03:15:36.257 DEBUG:teuthology.orchestra.run.smithi146:> test -z $(ls -A /var/lib/ceph) 2023-05-24T03:15:36.290 DEBUG:teuthology.orchestra.run.smithi151:> test -z $(ls -A /var/lib/ceph) 2023-05-24T03:15:36.318 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-05-24T03:15:36.383 INFO:teuthology.run_tasks:Running task kernel... 2023-05-24T03:15:36.400 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2023-05-24T03:15:36.401 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-05-24T03:15:36.401 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-05-24T03:15:36.402 DEBUG:teuthology.orchestra.run.smithi146:> test -f /run/.containerenv -o -f /.dockerenv 2023-05-24T03:15:36.402 DEBUG:teuthology.orchestra.run.smithi151:> test -f /run/.containerenv -o -f /.dockerenv 2023-05-24T03:15:36.420 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-24T03:15:36.421 DEBUG:teuthology.orchestra.run.smithi146:> uname -r 2023-05-24T03:15:36.422 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-24T03:15:36.423 DEBUG:teuthology.orchestra.run.smithi151:> uname -r 2023-05-24T03:15:36.480 INFO:teuthology.orchestra.run.smithi146.stdout:4.18.0-372.9.1.el8.x86_64 2023-05-24T03:15:36.481 INFO:teuthology.task.kernel:Running kernel on smithi146: 4.18.0-372.9.1.el8.x86_64 2023-05-24T03:15:36.481 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum install -y kernel 2023-05-24T03:15:36.482 INFO:teuthology.orchestra.run.smithi151.stdout:4.18.0-372.9.1.el8.x86_64 2023-05-24T03:15:36.482 INFO:teuthology.task.kernel:Running kernel on smithi151: 4.18.0-372.9.1.el8.x86_64 2023-05-24T03:15:36.482 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum install -y kernel 2023-05-24T03:15:37.655 INFO:teuthology.orchestra.run.smithi146.stdout:Updating Subscription Management repositories. 2023-05-24T03:15:37.655 INFO:teuthology.orchestra.run.smithi146.stdout:Unable to read consumer identity 2023-05-24T03:15:37.710 INFO:teuthology.orchestra.run.smithi151.stdout:Updating Subscription Management repositories. 2023-05-24T03:15:37.710 INFO:teuthology.orchestra.run.smithi151.stdout:Unable to read consumer identity 2023-05-24T03:15:39.106 INFO:teuthology.orchestra.run.smithi146.stdout:Copr repo for python3-asyncssh owned by ceph 17 kB/s | 3.5 kB 00:00 2023-05-24T03:15:39.153 INFO:teuthology.orchestra.run.smithi151.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2023-05-24T03:15:39.773 INFO:teuthology.orchestra.run.smithi146.stdout:Extra Packages for Enterprise Linux 21 MB/s | 14 MB 00:00 2023-05-24T03:15:40.112 INFO:teuthology.orchestra.run.smithi151.stdout:Extra Packages for Enterprise Linux 15 MB/s | 14 MB 00:00 2023-05-24T03:15:42.948 INFO:teuthology.orchestra.run.smithi146.stdout:lab-extras 376 kB/s | 24 kB 00:00 2023-05-24T03:15:43.229 INFO:teuthology.orchestra.run.smithi151.stdout:lab-extras 308 kB/s | 24 kB 00:00 2023-05-24T03:15:43.609 INFO:teuthology.orchestra.run.smithi146.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-05-24T03:15:43.677 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies resolved. 2023-05-24T03:15:43.678 INFO:teuthology.orchestra.run.smithi146.stdout:Nothing to do. 2023-05-24T03:15:43.678 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2023-05-24T03:15:43.801 DEBUG:teuthology.orchestra.run.smithi146:> echo no | sudo yum reinstall kernel || true 2023-05-24T03:15:43.906 INFO:teuthology.orchestra.run.smithi151.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-05-24T03:15:43.954 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2023-05-24T03:15:43.956 INFO:teuthology.orchestra.run.smithi151.stdout:Nothing to do. 2023-05-24T03:15:43.956 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2023-05-24T03:15:44.076 DEBUG:teuthology.orchestra.run.smithi151:> echo no | sudo yum reinstall kernel || true 2023-05-24T03:15:44.173 INFO:teuthology.orchestra.run.smithi146.stdout:Updating Subscription Management repositories. 2023-05-24T03:15:44.174 INFO:teuthology.orchestra.run.smithi146.stdout:Unable to read consumer identity 2023-05-24T03:15:44.409 INFO:teuthology.orchestra.run.smithi151.stdout:Updating Subscription Management repositories. 2023-05-24T03:15:44.410 INFO:teuthology.orchestra.run.smithi151.stdout:Unable to read consumer identity 2023-05-24T03:15:44.429 INFO:teuthology.orchestra.run.smithi146.stdout:Last metadata expiration check: 0:00:02 ago on Wed 24 May 2023 03:15:42 AM UTC. 2023-05-24T03:15:44.483 INFO:teuthology.orchestra.run.smithi146.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-05-24T03:15:44.510 INFO:teuthology.orchestra.run.smithi146.stderr:Error: No packages marked for reinstall. 2023-05-24T03:15:44.558 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum reinstall -y kernel || true 2023-05-24T03:15:44.670 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:00:01 ago on Wed 24 May 2023 03:15:43 AM UTC. 2023-05-24T03:15:44.714 INFO:teuthology.orchestra.run.smithi151.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-05-24T03:15:44.747 INFO:teuthology.orchestra.run.smithi151.stderr:Error: No packages marked for reinstall. 2023-05-24T03:15:44.795 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum reinstall -y kernel || true 2023-05-24T03:15:44.888 INFO:teuthology.orchestra.run.smithi146.stdout:Updating Subscription Management repositories. 2023-05-24T03:15:44.888 INFO:teuthology.orchestra.run.smithi146.stdout:Unable to read consumer identity 2023-05-24T03:15:45.124 INFO:teuthology.orchestra.run.smithi151.stdout:Updating Subscription Management repositories. 2023-05-24T03:15:45.124 INFO:teuthology.orchestra.run.smithi151.stdout:Unable to read consumer identity 2023-05-24T03:15:45.144 INFO:teuthology.orchestra.run.smithi146.stdout:Last metadata expiration check: 0:00:03 ago on Wed 24 May 2023 03:15:42 AM UTC. 2023-05-24T03:15:45.187 INFO:teuthology.orchestra.run.smithi146.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-05-24T03:15:45.209 INFO:teuthology.orchestra.run.smithi146.stderr:Error: No packages marked for reinstall. 2023-05-24T03:15:45.261 DEBUG:teuthology.orchestra.run.smithi146:> rpm -q kernel --last | head -n 1 2023-05-24T03:15:45.341 INFO:teuthology.orchestra.run.smithi146.stdout:kernel-4.18.0-372.9.1.el8.x86_64 Thu 14 Jul 2022 06:23:21 PM UTC 2023-05-24T03:15:45.343 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-05-24T03:15:45.343 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-05-24T03:15:45.343 DEBUG:teuthology.parallel:result is None 2023-05-24T03:15:45.373 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:00:02 ago on Wed 24 May 2023 03:15:43 AM UTC. 2023-05-24T03:15:45.416 INFO:teuthology.orchestra.run.smithi151.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-05-24T03:15:45.445 INFO:teuthology.orchestra.run.smithi151.stderr:Error: No packages marked for reinstall. 2023-05-24T03:15:45.492 DEBUG:teuthology.orchestra.run.smithi151:> rpm -q kernel --last | head -n 1 2023-05-24T03:15:45.572 INFO:teuthology.orchestra.run.smithi151.stdout:kernel-4.18.0-372.9.1.el8.x86_64 Thu 14 Jul 2022 06:23:21 PM UTC 2023-05-24T03:15:45.573 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-05-24T03:15:45.573 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-05-24T03:15:45.574 DEBUG:teuthology.parallel:result is None 2023-05-24T03:15:45.574 INFO:teuthology.run_tasks:Running task internal.base... 2023-05-24T03:15:45.587 INFO:teuthology.task.internal:Creating test directory... 2023-05-24T03:15:45.588 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-05-24T03:15:45.590 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-05-24T03:15:45.606 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-05-24T03:15:45.618 INFO:teuthology.run_tasks:Running task internal.archive... 2023-05-24T03:15:45.632 INFO:teuthology.task.internal:Creating archive directory... 2023-05-24T03:15:45.633 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-05-24T03:15:45.647 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-05-24T03:15:45.670 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-05-24T03:15:45.680 INFO:teuthology.task.internal:Enabling coredump saving... 2023-05-24T03:15:45.681 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-05-24T03:15:45.705 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-05-24T03:15:45.740 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-24T03:15:45.746 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-24T03:15:45.751 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-24T03:15:45.762 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-24T03:15:45.763 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-05-24T03:15:45.770 INFO:teuthology.task.internal:Configuring sudo... 2023-05-24T03:15:45.770 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-05-24T03:15:45.795 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-05-24T03:15:45.830 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-05-24T03:15:45.838 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-05-24T03:15:45.839 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-05-24T03:15:45.861 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-05-24T03:15:45.887 DEBUG:teuthology.orchestra.run.smithi146:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-24T03:15:45.963 DEBUG:teuthology.orchestra.run.smithi146:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-24T03:15:46.017 DEBUG:teuthology.orchestra.run.smithi146:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-24T03:15:46.103 DEBUG:teuthology.orchestra.run.smithi146:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-24T03:15:46.143 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-05-24T03:15:46.144 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-05-24T03:15:46.211 DEBUG:teuthology.orchestra.run.smithi151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-24T03:15:46.258 DEBUG:teuthology.orchestra.run.smithi151:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-24T03:15:46.325 DEBUG:teuthology.orchestra.run.smithi151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-24T03:15:46.370 DEBUG:teuthology.orchestra.run.smithi151:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-24T03:15:46.410 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-24T03:15:46.410 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-05-24T03:15:46.477 DEBUG:teuthology.orchestra.run.smithi146:> sudo service rsyslog restart 2023-05-24T03:15:46.479 DEBUG:teuthology.orchestra.run.smithi151:> sudo service rsyslog restart 2023-05-24T03:15:46.536 INFO:teuthology.orchestra.run.smithi146.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-05-24T03:15:46.570 INFO:teuthology.orchestra.run.smithi151.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-05-24T03:15:46.882 INFO:teuthology.run_tasks:Running task internal.timer... 2023-05-24T03:15:46.889 INFO:teuthology.task.internal:Starting timer... 2023-05-24T03:15:46.890 INFO:teuthology.run_tasks:Running task pcp... 2023-05-24T03:15:46.931 INFO:teuthology.run_tasks:Running task selinux... 2023-05-24T03:15:46.941 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2023-05-24T03:15:46.942 DEBUG:teuthology.orchestra.run.smithi146:> sudo service auditd rotate 2023-05-24T03:15:47.001 INFO:teuthology.orchestra.run.smithi146.stdout:Rotating logs: 2023-05-24T03:15:47.002 DEBUG:teuthology.orchestra.run.smithi151:> sudo service auditd rotate 2023-05-24T03:15:47.057 INFO:teuthology.orchestra.run.smithi151.stdout:Rotating logs: 2023-05-24T03:15:47.059 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-05-24T03:15:47.059 DEBUG:teuthology.orchestra.run.smithi146:> /usr/sbin/getenforce 2023-05-24T03:15:47.082 INFO:teuthology.orchestra.run.smithi146.stdout:Permissive 2023-05-24T03:15:47.082 DEBUG:teuthology.orchestra.run.smithi151:> /usr/sbin/getenforce 2023-05-24T03:15:47.108 INFO:teuthology.orchestra.run.smithi151.stdout:Permissive 2023-05-24T03:15:47.108 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi146.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi151.front.sepia.ceph.com': 'permissive'} 2023-05-24T03:15:47.109 DEBUG:teuthology.orchestra.run.smithi146:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-05-24T03:15:47.148 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-24T03:15:47.149 DEBUG:teuthology.orchestra.run.smithi151:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-05-24T03:15:47.177 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-24T03:15:47.177 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-05-24T03:15:47.178 DEBUG:teuthology.orchestra.run.smithi146:> sudo /usr/sbin/setenforce permissive 2023-05-24T03:15:47.216 DEBUG:teuthology.orchestra.run.smithi151:> sudo /usr/sbin/setenforce permissive 2023-05-24T03:15:47.244 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-05-24T03:15:47.255 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-05-24T03:15:47.255 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-05-24T03:15:47.274 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-05-24T03:15:47.275 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi146.front.sepia.ceph.com,smithi151.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-05-24T03:25:59.903 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi146.front.sepia.ceph.com'), Remote(name='ubuntu@smithi151.front.sepia.ceph.com')] 2023-05-24T03:25:59.904 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-05-24T03:25:59.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-24T03:25:59.974 DEBUG:teuthology.orchestra.run.smithi146:> true 2023-05-24T03:25:59.997 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-05-24T03:25:59.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-24T03:26:00.065 DEBUG:teuthology.orchestra.run.smithi151:> true 2023-05-24T03:26:00.134 INFO:teuthology.run_tasks:Running task clock... 2023-05-24T03:26:00.149 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-05-24T03:26:00.150 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-05-24T03:26:00.151 DEBUG:teuthology.orchestra.run.smithi146:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-05-24T03:26:00.153 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-05-24T03:26:00.153 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-05-24T03:26:00.183 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-05-24T03:26:00.199 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-05-24T03:26:00.205 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-05-24T03:26:00.219 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-05-24T03:26:00.263 INFO:teuthology.orchestra.run.smithi146.stderr:sudo: ntpd: command not found 2023-05-24T03:26:00.275 INFO:teuthology.orchestra.run.smithi146.stdout:506 Cannot talk to daemon 2023-05-24T03:26:00.289 INFO:teuthology.orchestra.run.smithi151.stderr:sudo: ntpd: command not found 2023-05-24T03:26:00.289 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-05-24T03:26:00.300 INFO:teuthology.orchestra.run.smithi151.stdout:506 Cannot talk to daemon 2023-05-24T03:26:00.303 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-05-24T03:26:00.314 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-05-24T03:26:00.328 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-05-24T03:26:00.369 INFO:teuthology.orchestra.run.smithi146.stderr:bash: ntpq: command not found 2023-05-24T03:26:00.372 INFO:teuthology.orchestra.run.smithi146.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-05-24T03:26:00.372 INFO:teuthology.orchestra.run.smithi146.stdout:=============================================================================== 2023-05-24T03:26:00.373 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-24T03:26:00.373 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-24T03:26:00.373 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-24T03:26:00.373 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-24T03:26:00.402 INFO:teuthology.orchestra.run.smithi151.stderr:bash: ntpq: command not found 2023-05-24T03:26:00.406 INFO:teuthology.orchestra.run.smithi151.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-05-24T03:26:00.407 INFO:teuthology.orchestra.run.smithi151.stdout:=============================================================================== 2023-05-24T03:26:00.407 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-24T03:26:00.408 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-24T03:26:00.408 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-24T03:26:00.408 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-24T03:26:00.409 INFO:teuthology.run_tasks:Running task install... 2023-05-24T03:26:00.417 DEBUG:teuthology.task.install:project ceph 2023-05-24T03:26:00.418 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'fa0e62c4a1d8e4a737d9cbe50224f70009b79b28'}} 2023-05-24T03:26:00.418 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'fa0e62c4a1d8e4a737d9cbe50224f70009b79b28'} 2023-05-24T03:26:00.419 INFO:teuthology.task.install:Using flavor: default 2023-05-24T03:26:00.429 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-05-24T03:26:00.430 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-05-24T03:26:00.430 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'fa0e62c4a1d8e4a737d9cbe50224f70009b79b28', 'tag': None, 'wait_for_package': False} 2023-05-24T03:26:00.431 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=fa0e62c4a1d8e4a737d9cbe50224f70009b79b28 2023-05-24T03:26:00.434 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'fa0e62c4a1d8e4a737d9cbe50224f70009b79b28', 'tag': None, 'wait_for_package': False} 2023-05-24T03:26:00.434 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=fa0e62c4a1d8e4a737d9cbe50224f70009b79b28 2023-05-24T03:26:00.622 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/centos/8/flavors/default/ 2023-05-24T03:26:00.623 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4167.gfa0e62c4 2023-05-24T03:26:00.643 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/centos/8/flavors/default/ 2023-05-24T03:26:00.644 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4167.gfa0e62c4 2023-05-24T03:26:00.780 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-05-24T03:26:00.781 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-05-24T03:26:00.781 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-05-24T03:26:00.792 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230523.134409/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-05-24T03:26:00.792 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-24T03:26:00.792 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-05-24T03:26:00.809 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-05-24T03:26:00.810 DEBUG:teuthology.orchestra.run.smithi146:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-05-24T03:26:00.821 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-05-24T03:26:00.821 DEBUG:teuthology.orchestra.run.smithi151:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-05-24T03:26:00.877 DEBUG:teuthology.orchestra.run.smithi146:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-05-24T03:26:00.888 DEBUG:teuthology.orchestra.run.smithi151:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-05-24T03:26:00.956 DEBUG:teuthology.orchestra.run.smithi146:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-05-24T03:26:00.965 DEBUG:teuthology.orchestra.run.smithi151:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-05-24T03:26:01.021 INFO:teuthology.orchestra.run.smithi146.stdout:check_obsoletes = 1 2023-05-24T03:26:01.023 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum clean all 2023-05-24T03:26:01.031 INFO:teuthology.orchestra.run.smithi151.stdout:check_obsoletes = 1 2023-05-24T03:26:01.032 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum clean all 2023-05-24T03:26:01.393 INFO:teuthology.orchestra.run.smithi146.stdout:Updating Subscription Management repositories. 2023-05-24T03:26:01.405 INFO:teuthology.orchestra.run.smithi151.stdout:Updating Subscription Management repositories. 2023-05-24T03:26:01.731 INFO:teuthology.orchestra.run.smithi151.stdout:44 files removed 2023-05-24T03:26:01.740 INFO:teuthology.orchestra.run.smithi146.stdout:44 files removed 2023-05-24T03:26:01.778 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-05-24T03:26:01.786 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-05-24T03:26:02.107 INFO:teuthology.orchestra.run.smithi151.stdout:Updating Subscription Management repositories. 2023-05-24T03:26:02.118 INFO:teuthology.orchestra.run.smithi146.stdout:Updating Subscription Management repositories. 2023-05-24T03:26:02.919 INFO:teuthology.orchestra.run.smithi151.stdout:ceph packages for x86_64 184 kB/s | 80 kB 00:00 2023-05-24T03:26:02.988 INFO:teuthology.orchestra.run.smithi146.stdout:ceph packages for x86_64 161 kB/s | 80 kB 00:00 2023-05-24T03:26:03.270 INFO:teuthology.orchestra.run.smithi151.stdout:ceph noarch packages 29 kB/s | 9.4 kB 00:00 2023-05-24T03:26:03.354 INFO:teuthology.orchestra.run.smithi146.stdout:ceph noarch packages 28 kB/s | 9.4 kB 00:00 2023-05-24T03:26:03.603 INFO:teuthology.orchestra.run.smithi151.stdout:ceph source packages 4.8 kB/s | 1.5 kB 00:00 2023-05-24T03:26:03.754 INFO:teuthology.orchestra.run.smithi151.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2023-05-24T03:26:03.813 INFO:teuthology.orchestra.run.smithi146.stdout:ceph source packages 3.4 kB/s | 1.5 kB 00:00 2023-05-24T03:26:03.947 INFO:teuthology.orchestra.run.smithi146.stdout:Copr repo for python3-asyncssh owned by ceph 31 kB/s | 3.5 kB 00:00 2023-05-24T03:26:04.681 INFO:teuthology.orchestra.run.smithi146.stdout:Extra Packages for Enterprise Linux 19 MB/s | 14 MB 00:00 2023-05-24T03:26:07.815 INFO:teuthology.orchestra.run.smithi146.stdout:lab-extras 432 kB/s | 24 kB 00:00 2023-05-24T03:26:08.641 INFO:teuthology.orchestra.run.smithi146.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 62 MB/s | 47 MB 00:00 2023-05-24T03:26:11.014 INFO:teuthology.orchestra.run.smithi151.stdout:Extra Packages for Enterprise Linux 1.9 MB/s | 14 MB 00:07 2023-05-24T03:26:14.221 INFO:teuthology.orchestra.run.smithi151.stdout:lab-extras 303 kB/s | 24 kB 00:00 2023-05-24T03:26:15.239 INFO:teuthology.orchestra.run.smithi151.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 56 MB/s | 53 MB 00:00 2023-05-24T03:26:16.742 INFO:teuthology.orchestra.run.smithi146.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 64 MB/s | 53 MB 00:00 2023-05-24T03:26:23.332 INFO:teuthology.orchestra.run.smithi151.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 58 MB/s | 47 MB 00:00 2023-05-24T03:26:27.872 INFO:teuthology.orchestra.run.smithi146.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-05-24T03:26:27.873 INFO:teuthology.orchestra.run.smithi146.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-05-24T03:26:27.887 INFO:teuthology.orchestra.run.smithi146.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-05-24T03:26:27.888 INFO:teuthology.orchestra.run.smithi146.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-05-24T03:26:27.890 INFO:teuthology.orchestra.run.smithi146.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-05-24T03:26:27.891 INFO:teuthology.orchestra.run.smithi146.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-05-24T03:26:27.893 INFO:teuthology.orchestra.run.smithi146.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-05-24T03:26:27.896 INFO:teuthology.orchestra.run.smithi146.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-05-24T03:26:27.897 INFO:teuthology.orchestra.run.smithi146.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-05-24T03:26:28.027 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies resolved. 2023-05-24T03:26:28.039 INFO:teuthology.orchestra.run.smithi146.stdout:=========================================================================================================================== 2023-05-24T03:26:28.040 INFO:teuthology.orchestra.run.smithi146.stdout: Package Arch Version Repository Size 2023-05-24T03:26:28.040 INFO:teuthology.orchestra.run.smithi146.stdout:=========================================================================================================================== 2023-05-24T03:26:28.040 INFO:teuthology.orchestra.run.smithi146.stdout:Installing: 2023-05-24T03:26:28.041 INFO:teuthology.orchestra.run.smithi146.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-05-24T03:26:28.041 INFO:teuthology.orchestra.run.smithi146.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-05-24T03:26:28.041 INFO:teuthology.orchestra.run.smithi146.stdout: ceph x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 6.4 k 2023-05-24T03:26:28.042 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-base x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 5.3 M 2023-05-24T03:26:28.042 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-fuse x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 848 k 2023-05-24T03:26:28.042 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 165 k 2023-05-24T03:26:28.042 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 1.5 M 2023-05-24T03:26:28.043 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4167.gfa0e62c4.el8 ceph-noarch 127 k 2023-05-24T03:26:28.043 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4167.gfa0e62c4.el8 ceph-noarch 1.7 M 2023-05-24T03:26:28.043 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4167.gfa0e62c4.el8 ceph-noarch 7.4 M 2023-05-24T03:26:28.044 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-rook noarch 2:18.0.0-4167.gfa0e62c4.el8 ceph-noarch 47 k 2023-05-24T03:26:28.044 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-radosgw x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 13 M 2023-05-24T03:26:28.044 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-test x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 41 M 2023-05-24T03:26:28.045 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-volume noarch 2:18.0.0-4167.gfa0e62c4.el8 ceph-noarch 258 k 2023-05-24T03:26:28.045 INFO:teuthology.orchestra.run.smithi146.stdout: cephadm noarch 2:18.0.0-4167.gfa0e62c4.el8 ceph-noarch 160 k 2023-05-24T03:26:28.045 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-mirror x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 259 k 2023-05-24T03:26:28.045 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-top noarch 2:18.0.0-4167.gfa0e62c4.el8 ceph-noarch 18 k 2023-05-24T03:26:28.046 INFO:teuthology.orchestra.run.smithi146.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-05-24T03:26:28.046 INFO:teuthology.orchestra.run.smithi146.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-05-24T03:26:28.046 INFO:teuthology.orchestra.run.smithi146.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-05-24T03:26:28.047 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs-devel x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 31 k 2023-05-24T03:26:28.047 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs2 x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 772 k 2023-05-24T03:26:28.047 INFO:teuthology.orchestra.run.smithi146.stdout: librados-devel x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 139 k 2023-05-24T03:26:28.047 INFO:teuthology.orchestra.run.smithi146.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-05-24T03:26:28.048 INFO:teuthology.orchestra.run.smithi146.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-05-24T03:26:28.048 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-05-24T03:26:28.048 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-05-24T03:26:28.049 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-05-24T03:26:28.049 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-05-24T03:26:28.049 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cephfs x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 197 k 2023-05-24T03:26:28.049 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rados x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 372 k 2023-05-24T03:26:28.050 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rbd x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 366 k 2023-05-24T03:26:28.050 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rgw x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 106 k 2023-05-24T03:26:28.050 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-fuse x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 94 k 2023-05-24T03:26:28.051 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-mirror x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 3.4 M 2023-05-24T03:26:28.051 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-nbd x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 179 k 2023-05-24T03:26:28.051 INFO:teuthology.orchestra.run.smithi146.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-05-24T03:26:28.051 INFO:teuthology.orchestra.run.smithi146.stdout:Upgrading: 2023-05-24T03:26:28.052 INFO:teuthology.orchestra.run.smithi146.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-05-24T03:26:28.052 INFO:teuthology.orchestra.run.smithi146.stdout: librados2 x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 3.7 M 2023-05-24T03:26:28.052 INFO:teuthology.orchestra.run.smithi146.stdout: librbd1 x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 3.6 M 2023-05-24T03:26:28.053 INFO:teuthology.orchestra.run.smithi146.stdout:Installing dependencies: 2023-05-24T03:26:28.053 INFO:teuthology.orchestra.run.smithi146.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-05-24T03:26:28.053 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-common x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 22 M 2023-05-24T03:26:28.053 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4167.gfa0e62c4.el8 ceph-noarch 23 k 2023-05-24T03:26:28.054 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mds x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 2.3 M 2023-05-24T03:26:28.054 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4167.gfa0e62c4.el8 ceph-noarch 240 k 2023-05-24T03:26:28.054 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mon x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 4.6 M 2023-05-24T03:26:28.054 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-osd x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 18 M 2023-05-24T03:26:28.055 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4167.gfa0e62c4.el8 ceph-noarch 15 k 2023-05-24T03:26:28.055 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-selinux x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 24 k 2023-05-24T03:26:28.056 INFO:teuthology.orchestra.run.smithi146.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-05-24T03:26:28.056 INFO:teuthology.orchestra.run.smithi146.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-05-24T03:26:28.056 INFO:teuthology.orchestra.run.smithi146.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-05-24T03:26:28.056 INFO:teuthology.orchestra.run.smithi146.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-05-24T03:26:28.056 INFO:teuthology.orchestra.run.smithi146.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-05-24T03:26:28.056 INFO:teuthology.orchestra.run.smithi146.stdout: libcephsqlite x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 137 k 2023-05-24T03:26:28.056 INFO:teuthology.orchestra.run.smithi146.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-05-24T03:26:28.057 INFO:teuthology.orchestra.run.smithi146.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-05-24T03:26:28.057 INFO:teuthology.orchestra.run.smithi146.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-05-24T03:26:28.057 INFO:teuthology.orchestra.run.smithi146.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-05-24T03:26:28.057 INFO:teuthology.orchestra.run.smithi146.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-05-24T03:26:28.057 INFO:teuthology.orchestra.run.smithi146.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-05-24T03:26:28.057 INFO:teuthology.orchestra.run.smithi146.stdout: libradosstriper1 x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 473 k 2023-05-24T03:26:28.057 INFO:teuthology.orchestra.run.smithi146.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-05-24T03:26:28.057 INFO:teuthology.orchestra.run.smithi146.stdout: librgw2 x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 6.5 M 2023-05-24T03:26:28.059 INFO:teuthology.orchestra.run.smithi146.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-05-24T03:26:28.059 INFO:teuthology.orchestra.run.smithi146.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-05-24T03:26:28.059 INFO:teuthology.orchestra.run.smithi146.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-05-24T03:26:28.059 INFO:teuthology.orchestra.run.smithi146.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-05-24T03:26:28.060 INFO:teuthology.orchestra.run.smithi146.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-05-24T03:26:28.060 INFO:teuthology.orchestra.run.smithi146.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-05-24T03:26:28.060 INFO:teuthology.orchestra.run.smithi146.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-05-24T03:26:28.060 INFO:teuthology.orchestra.run.smithi146.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-05-24T03:26:28.061 INFO:teuthology.orchestra.run.smithi146.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-05-24T03:26:28.061 INFO:teuthology.orchestra.run.smithi146.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-05-24T03:26:28.061 INFO:teuthology.orchestra.run.smithi146.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-05-24T03:26:28.061 INFO:teuthology.orchestra.run.smithi146.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-05-24T03:26:28.061 INFO:teuthology.orchestra.run.smithi146.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-05-24T03:26:28.061 INFO:teuthology.orchestra.run.smithi146.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-05-24T03:26:28.061 INFO:teuthology.orchestra.run.smithi146.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-05-24T03:26:28.062 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-05-24T03:26:28.062 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-argparse x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 45 k 2023-05-24T03:26:28.062 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-common x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 119 k 2023-05-24T03:26:28.062 INFO:teuthology.orchestra.run.smithi146.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-05-24T03:26:28.062 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-05-24T03:26:28.062 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-05-24T03:26:28.062 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-05-24T03:26:28.062 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-05-24T03:26:28.063 INFO:teuthology.orchestra.run.smithi146.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-05-24T03:26:28.063 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-05-24T03:26:28.063 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-05-24T03:26:28.063 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-05-24T03:26:28.063 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-05-24T03:26:28.063 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-05-24T03:26:28.063 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-05-24T03:26:28.063 INFO:teuthology.orchestra.run.smithi146.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-05-24T03:26:28.064 INFO:teuthology.orchestra.run.smithi146.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-05-24T03:26:28.064 INFO:teuthology.orchestra.run.smithi146.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-05-24T03:26:28.064 INFO:teuthology.orchestra.run.smithi146.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-05-24T03:26:28.064 INFO:teuthology.orchestra.run.smithi146.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-05-24T03:26:28.064 INFO:teuthology.orchestra.run.smithi146.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-05-24T03:26:28.064 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-05-24T03:26:28.064 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-05-24T03:26:28.065 INFO:teuthology.orchestra.run.smithi146.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-05-24T03:26:28.065 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-05-24T03:26:28.065 INFO:teuthology.orchestra.run.smithi146.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-05-24T03:26:28.065 INFO:teuthology.orchestra.run.smithi146.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-05-24T03:26:28.065 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-05-24T03:26:28.065 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-05-24T03:26:28.065 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-05-24T03:26:28.066 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-05-24T03:26:28.066 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-05-24T03:26:28.066 INFO:teuthology.orchestra.run.smithi146.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-05-24T03:26:28.066 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-05-24T03:26:28.066 INFO:teuthology.orchestra.run.smithi146.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-05-24T03:26:28.066 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-05-24T03:26:28.066 INFO:teuthology.orchestra.run.smithi146.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-05-24T03:26:28.066 INFO:teuthology.orchestra.run.smithi146.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-05-24T03:26:28.067 INFO:teuthology.orchestra.run.smithi146.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-05-24T03:26:28.067 INFO:teuthology.orchestra.run.smithi146.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-05-24T03:26:28.067 INFO:teuthology.orchestra.run.smithi146.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-05-24T03:26:28.067 INFO:teuthology.orchestra.run.smithi146.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-05-24T03:26:28.067 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-05-24T03:26:28.067 INFO:teuthology.orchestra.run.smithi146.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-05-24T03:26:28.067 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-05-24T03:26:28.067 INFO:teuthology.orchestra.run.smithi146.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-05-24T03:26:28.068 INFO:teuthology.orchestra.run.smithi146.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-05-24T03:26:28.068 INFO:teuthology.orchestra.run.smithi146.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-05-24T03:26:28.068 INFO:teuthology.orchestra.run.smithi146.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-05-24T03:26:28.068 INFO:teuthology.orchestra.run.smithi146.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-05-24T03:26:28.068 INFO:teuthology.orchestra.run.smithi146.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-05-24T03:26:28.068 INFO:teuthology.orchestra.run.smithi146.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-05-24T03:26:28.068 INFO:teuthology.orchestra.run.smithi146.stdout:Enabling module streams: 2023-05-24T03:26:28.069 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql 10 2023-05-24T03:26:28.069 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:26:28.069 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2023-05-24T03:26:28.069 INFO:teuthology.orchestra.run.smithi146.stdout:=========================================================================================================================== 2023-05-24T03:26:28.069 INFO:teuthology.orchestra.run.smithi146.stdout:Install 128 Packages 2023-05-24T03:26:28.069 INFO:teuthology.orchestra.run.smithi146.stdout:Upgrade 3 Packages 2023-05-24T03:26:28.069 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:26:28.070 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 197 M 2023-05-24T03:26:28.070 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading Packages: 2023-05-24T03:26:28.525 INFO:teuthology.orchestra.run.smithi146.stdout:(1/131): ceph-18.0.0-4167.gfa0e62c4.el8.x86_64. 41 kB/s | 6.4 kB 00:00 2023-05-24T03:26:28.967 INFO:teuthology.orchestra.run.smithi146.stdout:(2/131): ceph-fuse-18.0.0-4167.gfa0e62c4.el8.x8 1.9 MB/s | 848 kB 00:00 2023-05-24T03:26:29.059 INFO:teuthology.orchestra.run.smithi146.stdout:(3/131): ceph-immutable-object-cache-18.0.0-416 1.8 MB/s | 165 kB 00:00 2023-05-24T03:26:29.617 INFO:teuthology.orchestra.run.smithi146.stdout:(4/131): ceph-mds-18.0.0-4167.gfa0e62c4.el8.x86 4.1 MB/s | 2.3 MB 00:00 2023-05-24T03:26:29.959 INFO:teuthology.orchestra.run.smithi146.stdout:(5/131): ceph-mgr-18.0.0-4167.gfa0e62c4.el8.x86 4.5 MB/s | 1.5 MB 00:00 2023-05-24T03:26:30.126 INFO:teuthology.orchestra.run.smithi146.stdout:(6/131): ceph-base-18.0.0-4167.gfa0e62c4.el8.x8 3.0 MB/s | 5.3 MB 00:01 2023-05-24T03:26:30.985 INFO:teuthology.orchestra.run.smithi146.stdout:(7/131): ceph-mon-18.0.0-4167.gfa0e62c4.el8.x86 4.5 MB/s | 4.6 MB 00:01 2023-05-24T03:26:34.208 INFO:teuthology.orchestra.run.smithi151.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-05-24T03:26:34.209 INFO:teuthology.orchestra.run.smithi151.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-05-24T03:26:34.223 INFO:teuthology.orchestra.run.smithi151.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-05-24T03:26:34.224 INFO:teuthology.orchestra.run.smithi151.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-05-24T03:26:34.225 INFO:teuthology.orchestra.run.smithi151.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-05-24T03:26:34.226 INFO:teuthology.orchestra.run.smithi151.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-05-24T03:26:34.228 INFO:teuthology.orchestra.run.smithi151.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-05-24T03:26:34.231 INFO:teuthology.orchestra.run.smithi151.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-05-24T03:26:34.232 INFO:teuthology.orchestra.run.smithi151.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-05-24T03:26:34.365 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2023-05-24T03:26:34.377 INFO:teuthology.orchestra.run.smithi151.stdout:=========================================================================================================================== 2023-05-24T03:26:34.377 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2023-05-24T03:26:34.377 INFO:teuthology.orchestra.run.smithi151.stdout:=========================================================================================================================== 2023-05-24T03:26:34.377 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2023-05-24T03:26:34.377 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-05-24T03:26:34.378 INFO:teuthology.orchestra.run.smithi151.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-05-24T03:26:34.378 INFO:teuthology.orchestra.run.smithi151.stdout: ceph x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 6.4 k 2023-05-24T03:26:34.378 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-base x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 5.3 M 2023-05-24T03:26:34.378 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-fuse x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 848 k 2023-05-24T03:26:34.378 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 165 k 2023-05-24T03:26:34.379 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 1.5 M 2023-05-24T03:26:34.379 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4167.gfa0e62c4.el8 ceph-noarch 127 k 2023-05-24T03:26:34.379 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4167.gfa0e62c4.el8 ceph-noarch 1.7 M 2023-05-24T03:26:34.379 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4167.gfa0e62c4.el8 ceph-noarch 7.4 M 2023-05-24T03:26:34.379 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-rook noarch 2:18.0.0-4167.gfa0e62c4.el8 ceph-noarch 47 k 2023-05-24T03:26:34.379 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-radosgw x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 13 M 2023-05-24T03:26:34.379 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-test x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 41 M 2023-05-24T03:26:34.380 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-volume noarch 2:18.0.0-4167.gfa0e62c4.el8 ceph-noarch 258 k 2023-05-24T03:26:34.380 INFO:teuthology.orchestra.run.smithi151.stdout: cephadm noarch 2:18.0.0-4167.gfa0e62c4.el8 ceph-noarch 160 k 2023-05-24T03:26:34.380 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-mirror x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 259 k 2023-05-24T03:26:34.380 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-top noarch 2:18.0.0-4167.gfa0e62c4.el8 ceph-noarch 18 k 2023-05-24T03:26:34.380 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-05-24T03:26:34.380 INFO:teuthology.orchestra.run.smithi151.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-05-24T03:26:34.380 INFO:teuthology.orchestra.run.smithi151.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-05-24T03:26:34.381 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs-devel x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 31 k 2023-05-24T03:26:34.381 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs2 x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 772 k 2023-05-24T03:26:34.381 INFO:teuthology.orchestra.run.smithi151.stdout: librados-devel x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 139 k 2023-05-24T03:26:34.381 INFO:teuthology.orchestra.run.smithi151.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-05-24T03:26:34.381 INFO:teuthology.orchestra.run.smithi151.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-05-24T03:26:34.381 INFO:teuthology.orchestra.run.smithi151.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-05-24T03:26:34.381 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-05-24T03:26:34.381 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-05-24T03:26:34.382 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-05-24T03:26:34.382 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cephfs x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 197 k 2023-05-24T03:26:34.382 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rados x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 372 k 2023-05-24T03:26:34.382 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rbd x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 366 k 2023-05-24T03:26:34.382 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rgw x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 106 k 2023-05-24T03:26:34.382 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-fuse x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 94 k 2023-05-24T03:26:34.382 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-mirror x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 3.4 M 2023-05-24T03:26:34.382 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-nbd x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 179 k 2023-05-24T03:26:34.383 INFO:teuthology.orchestra.run.smithi151.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-05-24T03:26:34.383 INFO:teuthology.orchestra.run.smithi151.stdout:Upgrading: 2023-05-24T03:26:34.383 INFO:teuthology.orchestra.run.smithi151.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-05-24T03:26:34.383 INFO:teuthology.orchestra.run.smithi151.stdout: librados2 x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 3.7 M 2023-05-24T03:26:34.383 INFO:teuthology.orchestra.run.smithi151.stdout: librbd1 x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 3.6 M 2023-05-24T03:26:34.383 INFO:teuthology.orchestra.run.smithi151.stdout:Installing dependencies: 2023-05-24T03:26:34.383 INFO:teuthology.orchestra.run.smithi151.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-05-24T03:26:34.384 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-common x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 22 M 2023-05-24T03:26:34.384 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4167.gfa0e62c4.el8 ceph-noarch 23 k 2023-05-24T03:26:34.384 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mds x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 2.3 M 2023-05-24T03:26:34.384 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4167.gfa0e62c4.el8 ceph-noarch 240 k 2023-05-24T03:26:34.384 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mon x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 4.6 M 2023-05-24T03:26:34.384 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-osd x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 18 M 2023-05-24T03:26:34.384 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4167.gfa0e62c4.el8 ceph-noarch 15 k 2023-05-24T03:26:34.384 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-selinux x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 24 k 2023-05-24T03:26:34.385 INFO:teuthology.orchestra.run.smithi151.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-05-24T03:26:34.385 INFO:teuthology.orchestra.run.smithi151.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-05-24T03:26:34.385 INFO:teuthology.orchestra.run.smithi151.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-05-24T03:26:34.385 INFO:teuthology.orchestra.run.smithi151.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-05-24T03:26:34.385 INFO:teuthology.orchestra.run.smithi151.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-05-24T03:26:34.385 INFO:teuthology.orchestra.run.smithi151.stdout: libcephsqlite x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 137 k 2023-05-24T03:26:34.385 INFO:teuthology.orchestra.run.smithi151.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-05-24T03:26:34.386 INFO:teuthology.orchestra.run.smithi151.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-05-24T03:26:34.386 INFO:teuthology.orchestra.run.smithi151.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-05-24T03:26:34.386 INFO:teuthology.orchestra.run.smithi151.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-05-24T03:26:34.386 INFO:teuthology.orchestra.run.smithi151.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-05-24T03:26:34.386 INFO:teuthology.orchestra.run.smithi151.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-05-24T03:26:34.386 INFO:teuthology.orchestra.run.smithi151.stdout: libradosstriper1 x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 473 k 2023-05-24T03:26:34.386 INFO:teuthology.orchestra.run.smithi151.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-05-24T03:26:34.386 INFO:teuthology.orchestra.run.smithi151.stdout: librgw2 x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 6.5 M 2023-05-24T03:26:34.387 INFO:teuthology.orchestra.run.smithi151.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-05-24T03:26:34.387 INFO:teuthology.orchestra.run.smithi151.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-05-24T03:26:34.387 INFO:teuthology.orchestra.run.smithi151.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-05-24T03:26:34.387 INFO:teuthology.orchestra.run.smithi151.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-05-24T03:26:34.387 INFO:teuthology.orchestra.run.smithi151.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-05-24T03:26:34.387 INFO:teuthology.orchestra.run.smithi151.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-05-24T03:26:34.387 INFO:teuthology.orchestra.run.smithi151.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-05-24T03:26:34.388 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-05-24T03:26:34.388 INFO:teuthology.orchestra.run.smithi151.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-05-24T03:26:34.388 INFO:teuthology.orchestra.run.smithi151.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-05-24T03:26:34.388 INFO:teuthology.orchestra.run.smithi151.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-05-24T03:26:34.388 INFO:teuthology.orchestra.run.smithi151.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-05-24T03:26:34.388 INFO:teuthology.orchestra.run.smithi151.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-05-24T03:26:34.388 INFO:teuthology.orchestra.run.smithi151.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-05-24T03:26:34.388 INFO:teuthology.orchestra.run.smithi151.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-05-24T03:26:34.389 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-05-24T03:26:34.389 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-argparse x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 45 k 2023-05-24T03:26:34.389 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-common x86_64 2:18.0.0-4167.gfa0e62c4.el8 ceph 119 k 2023-05-24T03:26:34.389 INFO:teuthology.orchestra.run.smithi151.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-05-24T03:26:34.389 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-05-24T03:26:34.389 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-05-24T03:26:34.389 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-05-24T03:26:34.390 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-05-24T03:26:34.390 INFO:teuthology.orchestra.run.smithi151.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-05-24T03:26:34.390 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-05-24T03:26:34.390 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-05-24T03:26:34.390 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-05-24T03:26:34.390 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-05-24T03:26:34.390 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-05-24T03:26:34.390 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-05-24T03:26:34.391 INFO:teuthology.orchestra.run.smithi151.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-05-24T03:26:34.391 INFO:teuthology.orchestra.run.smithi151.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-05-24T03:26:34.391 INFO:teuthology.orchestra.run.smithi151.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-05-24T03:26:34.391 INFO:teuthology.orchestra.run.smithi151.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-05-24T03:26:34.391 INFO:teuthology.orchestra.run.smithi151.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-05-24T03:26:34.391 INFO:teuthology.orchestra.run.smithi151.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-05-24T03:26:34.391 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-05-24T03:26:34.391 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-05-24T03:26:34.392 INFO:teuthology.orchestra.run.smithi151.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-05-24T03:26:34.392 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-05-24T03:26:34.392 INFO:teuthology.orchestra.run.smithi151.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-05-24T03:26:34.392 INFO:teuthology.orchestra.run.smithi151.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-05-24T03:26:34.392 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-05-24T03:26:34.392 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-05-24T03:26:34.392 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-05-24T03:26:34.392 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-05-24T03:26:34.393 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-05-24T03:26:34.393 INFO:teuthology.orchestra.run.smithi151.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-05-24T03:26:34.393 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-05-24T03:26:34.393 INFO:teuthology.orchestra.run.smithi151.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-05-24T03:26:34.394 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-05-24T03:26:34.394 INFO:teuthology.orchestra.run.smithi151.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-05-24T03:26:34.394 INFO:teuthology.orchestra.run.smithi151.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-05-24T03:26:34.394 INFO:teuthology.orchestra.run.smithi151.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-05-24T03:26:34.394 INFO:teuthology.orchestra.run.smithi151.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-05-24T03:26:34.394 INFO:teuthology.orchestra.run.smithi151.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-05-24T03:26:34.394 INFO:teuthology.orchestra.run.smithi151.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-05-24T03:26:34.395 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-05-24T03:26:34.395 INFO:teuthology.orchestra.run.smithi151.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-05-24T03:26:34.395 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-05-24T03:26:34.395 INFO:teuthology.orchestra.run.smithi151.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-05-24T03:26:34.395 INFO:teuthology.orchestra.run.smithi151.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-05-24T03:26:34.395 INFO:teuthology.orchestra.run.smithi151.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-05-24T03:26:34.395 INFO:teuthology.orchestra.run.smithi151.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-05-24T03:26:34.396 INFO:teuthology.orchestra.run.smithi151.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-05-24T03:26:34.396 INFO:teuthology.orchestra.run.smithi151.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-05-24T03:26:34.396 INFO:teuthology.orchestra.run.smithi151.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-05-24T03:26:34.396 INFO:teuthology.orchestra.run.smithi151.stdout:Enabling module streams: 2023-05-24T03:26:34.396 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql 10 2023-05-24T03:26:34.396 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-24T03:26:34.397 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2023-05-24T03:26:34.397 INFO:teuthology.orchestra.run.smithi151.stdout:=========================================================================================================================== 2023-05-24T03:26:34.397 INFO:teuthology.orchestra.run.smithi151.stdout:Install 128 Packages 2023-05-24T03:26:34.397 INFO:teuthology.orchestra.run.smithi151.stdout:Upgrade 3 Packages 2023-05-24T03:26:34.397 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-24T03:26:34.398 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 197 M 2023-05-24T03:26:34.398 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2023-05-24T03:26:34.616 INFO:teuthology.orchestra.run.smithi151.stdout:(1/131): ceph-18.0.0-4167.gfa0e62c4.el8.x86_64. 39 kB/s | 6.4 kB 00:00 2023-05-24T03:26:35.074 INFO:teuthology.orchestra.run.smithi151.stdout:(2/131): ceph-fuse-18.0.0-4167.gfa0e62c4.el8.x8 1.8 MB/s | 848 kB 00:00 2023-05-24T03:26:35.174 INFO:teuthology.orchestra.run.smithi151.stdout:(3/131): ceph-immutable-object-cache-18.0.0-416 1.6 MB/s | 165 kB 00:00 2023-05-24T03:26:35.816 INFO:teuthology.orchestra.run.smithi151.stdout:(4/131): ceph-mds-18.0.0-4167.gfa0e62c4.el8.x86 3.6 MB/s | 2.3 MB 00:00 2023-05-24T03:26:36.124 INFO:teuthology.orchestra.run.smithi151.stdout:(5/131): ceph-base-18.0.0-4167.gfa0e62c4.el8.x8 3.2 MB/s | 5.3 MB 00:01 2023-05-24T03:26:36.233 INFO:teuthology.orchestra.run.smithi151.stdout:(6/131): ceph-mgr-18.0.0-4167.gfa0e62c4.el8.x86 3.7 MB/s | 1.5 MB 00:00 2023-05-24T03:26:36.793 INFO:teuthology.orchestra.run.smithi146.stdout:(8/131): ceph-osd-18.0.0-4167.gfa0e62c4.el8.x86 2.7 MB/s | 18 MB 00:06 2023-05-24T03:26:36.843 INFO:teuthology.orchestra.run.smithi146.stdout:(9/131): ceph-selinux-18.0.0-4167.gfa0e62c4.el8 492 kB/s | 24 kB 00:00 2023-05-24T03:26:37.343 INFO:teuthology.orchestra.run.smithi146.stdout:(10/131): ceph-common-18.0.0-4167.gfa0e62c4.el8 2.4 MB/s | 22 MB 00:08 2023-05-24T03:26:37.409 INFO:teuthology.orchestra.run.smithi151.stdout:(7/131): ceph-mon-18.0.0-4167.gfa0e62c4.el8.x86 3.6 MB/s | 4.6 MB 00:01 2023-05-24T03:26:37.535 INFO:teuthology.orchestra.run.smithi146.stdout:(11/131): cephfs-mirror-18.0.0-4167.gfa0e62c4.e 1.3 MB/s | 259 kB 00:00 2023-05-24T03:26:37.595 INFO:teuthology.orchestra.run.smithi146.stdout:(12/131): libcephfs-devel-18.0.0-4167.gfa0e62c4 531 kB/s | 31 kB 00:00 2023-05-24T03:26:37.869 INFO:teuthology.orchestra.run.smithi146.stdout:(13/131): ceph-radosgw-18.0.0-4167.gfa0e62c4.el 1.9 MB/s | 13 MB 00:06 2023-05-24T03:26:37.986 INFO:teuthology.orchestra.run.smithi146.stdout:(14/131): libcephsqlite-18.0.0-4167.gfa0e62c4.e 1.2 MB/s | 137 kB 00:00 2023-05-24T03:26:38.111 INFO:teuthology.orchestra.run.smithi146.stdout:(15/131): libcephfs2-18.0.0-4167.gfa0e62c4.el8. 1.5 MB/s | 772 kB 00:00 2023-05-24T03:26:38.137 INFO:teuthology.orchestra.run.smithi146.stdout:(16/131): librados-devel-18.0.0-4167.gfa0e62c4. 925 kB/s | 139 kB 00:00 2023-05-24T03:26:38.429 INFO:teuthology.orchestra.run.smithi146.stdout:(17/131): libradosstriper1-18.0.0-4167.gfa0e62c 1.5 MB/s | 473 kB 00:00 2023-05-24T03:26:38.487 INFO:teuthology.orchestra.run.smithi146.stdout:(18/131): python3-ceph-argparse-18.0.0-4167.gfa 771 kB/s | 45 kB 00:00 2023-05-24T03:26:38.571 INFO:teuthology.orchestra.run.smithi146.stdout:(19/131): python3-ceph-common-18.0.0-4167.gfa0e 1.4 MB/s | 119 kB 00:00 2023-05-24T03:26:38.688 INFO:teuthology.orchestra.run.smithi146.stdout:(20/131): python3-cephfs-18.0.0-4167.gfa0e62c4. 1.7 MB/s | 197 kB 00:00 2023-05-24T03:26:38.963 INFO:teuthology.orchestra.run.smithi146.stdout:(21/131): python3-rados-18.0.0-4167.gfa0e62c4.e 1.3 MB/s | 372 kB 00:00 2023-05-24T03:26:39.205 INFO:teuthology.orchestra.run.smithi146.stdout:(22/131): python3-rbd-18.0.0-4167.gfa0e62c4.el8 1.5 MB/s | 366 kB 00:00 2023-05-24T03:26:39.297 INFO:teuthology.orchestra.run.smithi146.stdout:(23/131): python3-rgw-18.0.0-4167.gfa0e62c4.el8 1.1 MB/s | 106 kB 00:00 2023-05-24T03:26:39.566 INFO:teuthology.orchestra.run.smithi146.stdout:(24/131): rbd-fuse-18.0.0-4167.gfa0e62c4.el8.x8 351 kB/s | 94 kB 00:00 2023-05-24T03:26:42.322 INFO:teuthology.orchestra.run.smithi146.stdout:(25/131): librgw2-18.0.0-4167.gfa0e62c4.el8.x86 1.6 MB/s | 6.5 MB 00:04 2023-05-24T03:26:42.485 INFO:teuthology.orchestra.run.smithi146.stdout:(26/131): rbd-nbd-18.0.0-4167.gfa0e62c4.el8.x86 1.1 MB/s | 179 kB 00:00 2023-05-24T03:26:42.539 INFO:teuthology.orchestra.run.smithi146.stdout:(27/131): ceph-grafana-dashboards-18.0.0-4167.g 395 kB/s | 23 kB 00:00 2023-05-24T03:26:42.614 INFO:teuthology.orchestra.run.smithi146.stdout:(28/131): rbd-mirror-18.0.0-4167.gfa0e62c4.el8. 1.1 MB/s | 3.4 MB 00:03 2023-05-24T03:26:42.707 INFO:teuthology.orchestra.run.smithi146.stdout:(29/131): ceph-mgr-cephadm-18.0.0-4167.gfa0e62c 762 kB/s | 127 kB 00:00 2023-05-24T03:26:43.334 INFO:teuthology.orchestra.run.smithi151.stdout:(8/131): ceph-radosgw-18.0.0-4167.gfa0e62c4.el8 2.2 MB/s | 13 MB 00:05 2023-05-24T03:26:43.392 INFO:teuthology.orchestra.run.smithi151.stdout:(9/131): ceph-selinux-18.0.0-4167.gfa0e62c4.el8 418 kB/s | 24 kB 00:00 2023-05-24T03:26:43.957 INFO:teuthology.orchestra.run.smithi146.stdout:(30/131): ceph-mgr-dashboard-18.0.0-4167.gfa0e6 1.3 MB/s | 1.7 MB 00:01 2023-05-24T03:26:44.157 INFO:teuthology.orchestra.run.smithi146.stdout:(31/131): ceph-mgr-modules-core-18.0.0-4167.gfa 1.2 MB/s | 240 kB 00:00 2023-05-24T03:26:44.241 INFO:teuthology.orchestra.run.smithi146.stdout:(32/131): ceph-mgr-rook-18.0.0-4167.gfa0e62c4.e 569 kB/s | 47 kB 00:00 2023-05-24T03:26:44.275 INFO:teuthology.orchestra.run.smithi151.stdout:(10/131): ceph-common-18.0.0-4167.gfa0e62c4.el8 2.2 MB/s | 22 MB 00:09 2023-05-24T03:26:44.291 INFO:teuthology.orchestra.run.smithi146.stdout:(33/131): ceph-prometheus-alerts-18.0.0-4167.gf 292 kB/s | 15 kB 00:00 2023-05-24T03:26:44.476 INFO:teuthology.orchestra.run.smithi151.stdout:(11/131): cephfs-mirror-18.0.0-4167.gfa0e62c4.e 1.3 MB/s | 259 kB 00:00 2023-05-24T03:26:44.516 INFO:teuthology.orchestra.run.smithi146.stdout:(34/131): ceph-volume-18.0.0-4167.gfa0e62c4.el8 1.1 MB/s | 258 kB 00:00 2023-05-24T03:26:44.534 INFO:teuthology.orchestra.run.smithi151.stdout:(12/131): libcephfs-devel-18.0.0-4167.gfa0e62c4 533 kB/s | 31 kB 00:00 2023-05-24T03:26:44.649 INFO:teuthology.orchestra.run.smithi146.stdout:(35/131): cephadm-18.0.0-4167.gfa0e62c4.el8.noa 1.2 MB/s | 160 kB 00:00 2023-05-24T03:26:44.692 INFO:teuthology.orchestra.run.smithi146.stdout:(36/131): cephfs-top-18.0.0-4167.gfa0e62c4.el8. 429 kB/s | 18 kB 00:00 2023-05-24T03:26:45.076 INFO:teuthology.orchestra.run.smithi151.stdout:(13/131): libcephfs2-18.0.0-4167.gfa0e62c4.el8. 1.4 MB/s | 772 kB 00:00 2023-05-24T03:26:45.237 INFO:teuthology.orchestra.run.smithi151.stdout:(14/131): libcephsqlite-18.0.0-4167.gfa0e62c4.e 855 kB/s | 137 kB 00:00 2023-05-24T03:26:45.309 INFO:teuthology.orchestra.run.smithi146.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 497 kB/s | 306 kB 00:00 2023-05-24T03:26:45.368 INFO:teuthology.orchestra.run.smithi151.stdout:(15/131): librados-devel-18.0.0-4167.gfa0e62c4. 1.0 MB/s | 139 kB 00:00 2023-05-24T03:26:45.409 INFO:teuthology.orchestra.run.smithi146.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 589 kB/s | 59 kB 00:00 2023-05-24T03:26:45.501 INFO:teuthology.orchestra.run.smithi146.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 818 kB/s | 75 kB 00:00 2023-05-24T03:26:45.684 INFO:teuthology.orchestra.run.smithi146.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 2.5 MB/s | 476 kB 00:00 2023-05-24T03:26:45.793 INFO:teuthology.orchestra.run.smithi146.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 402 kB/s | 44 kB 00:00 2023-05-24T03:26:45.819 INFO:teuthology.orchestra.run.smithi151.stdout:(16/131): ceph-osd-18.0.0-4167.gfa0e62c4.el8.x8 1.8 MB/s | 18 MB 00:09 2023-05-24T03:26:45.844 INFO:teuthology.orchestra.run.smithi151.stdout:(17/131): libradosstriper1-18.0.0-4167.gfa0e62c 996 kB/s | 473 kB 00:00 2023-05-24T03:26:45.902 INFO:teuthology.orchestra.run.smithi146.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.7 MB/s | 185 kB 00:00 2023-05-24T03:26:45.902 INFO:teuthology.orchestra.run.smithi151.stdout:(18/131): python3-ceph-argparse-18.0.0-4167.gfa 769 kB/s | 45 kB 00:00 2023-05-24T03:26:45.994 INFO:teuthology.orchestra.run.smithi146.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 360 kB/s | 33 kB 00:00 2023-05-24T03:26:45.995 INFO:teuthology.orchestra.run.smithi151.stdout:(19/131): python3-ceph-common-18.0.0-4167.gfa0e 1.3 MB/s | 119 kB 00:00 2023-05-24T03:26:46.086 INFO:teuthology.orchestra.run.smithi146.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 178 kB/s | 16 kB 00:00 2023-05-24T03:26:46.161 INFO:teuthology.orchestra.run.smithi151.stdout:(20/131): python3-cephfs-18.0.0-4167.gfa0e62c4. 1.2 MB/s | 197 kB 00:00 2023-05-24T03:26:46.202 INFO:teuthology.orchestra.run.smithi146.stdout:(45/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.4 MB/s | 173 kB 00:00 2023-05-24T03:26:46.303 INFO:teuthology.orchestra.run.smithi146.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 3.8 MB/s | 384 kB 00:00 2023-05-24T03:26:46.403 INFO:teuthology.orchestra.run.smithi151.stdout:(21/131): python3-rados-18.0.0-4167.gfa0e62c4.e 1.5 MB/s | 372 kB 00:00 2023-05-24T03:26:46.411 INFO:teuthology.orchestra.run.smithi146.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 752 kB/s | 81 kB 00:00 2023-05-24T03:26:46.528 INFO:teuthology.orchestra.run.smithi146.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 95 kB/s | 11 kB 00:00 2023-05-24T03:26:46.645 INFO:teuthology.orchestra.run.smithi146.stdout:(49/131): python3-jaraco-functools-2.0-4.el8.no 151 kB/s | 18 kB 00:00 2023-05-24T03:26:46.703 INFO:teuthology.orchestra.run.smithi151.stdout:(22/131): python3-rbd-18.0.0-4167.gfa0e62c4.el8 1.2 MB/s | 366 kB 00:00 2023-05-24T03:26:46.870 INFO:teuthology.orchestra.run.smithi151.stdout:(23/131): python3-rgw-18.0.0-4167.gfa0e62c4.el8 639 kB/s | 106 kB 00:00 2023-05-24T03:26:46.904 INFO:teuthology.orchestra.run.smithi146.stdout:(50/131): python3-kubernetes-11.0.0-6.el8.noarc 4.5 MB/s | 1.2 MB 00:00 2023-05-24T03:26:46.979 INFO:teuthology.orchestra.run.smithi151.stdout:(24/131): rbd-fuse-18.0.0-4167.gfa0e62c4.el8.x8 872 kB/s | 94 kB 00:00 2023-05-24T03:26:46.996 INFO:teuthology.orchestra.run.smithi146.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 533 kB/s | 49 kB 00:00 2023-05-24T03:26:47.096 INFO:teuthology.orchestra.run.smithi146.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 587 kB/s | 59 kB 00:00 2023-05-24T03:26:47.196 INFO:teuthology.orchestra.run.smithi146.stdout:(53/131): python3-natsort-7.1.1-2.el8.noarch.rp 603 kB/s | 60 kB 00:00 2023-05-24T03:26:47.297 INFO:teuthology.orchestra.run.smithi146.stdout:(54/131): python3-pecan-1.3.2-9.el8.noarch.rpm 2.8 MB/s | 283 kB 00:00 2023-05-24T03:26:47.397 INFO:teuthology.orchestra.run.smithi146.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 156 kB/s | 16 kB 00:00 2023-05-24T03:26:47.489 INFO:teuthology.orchestra.run.smithi146.stdout:(56/131): python3-repoze-lru-0.7-6.el8.noarch.r 367 kB/s | 34 kB 00:00 2023-05-24T03:26:47.589 INFO:teuthology.orchestra.run.smithi146.stdout:(57/131): python3-routes-2.4.1-12.el8.noarch.rp 1.9 MB/s | 196 kB 00:00 2023-05-24T03:26:47.690 INFO:teuthology.orchestra.run.smithi146.stdout:(58/131): python3-rsa-4.8-1.el8.noarch.rpm 616 kB/s | 61 kB 00:00 2023-05-24T03:26:47.781 INFO:teuthology.orchestra.run.smithi146.stdout:(59/131): python3-simplegeneric-0.8.1-17.el8.no 204 kB/s | 19 kB 00:00 2023-05-24T03:26:47.873 INFO:teuthology.orchestra.run.smithi146.stdout:(60/131): python3-singledispatch-3.4.0.3-18.el8 261 kB/s | 24 kB 00:00 2023-05-24T03:26:47.965 INFO:teuthology.orchestra.run.smithi146.stdout:(61/131): python3-tempora-1.14.1-5.el8.noarch.r 319 kB/s | 29 kB 00:00 2023-05-24T03:26:48.058 INFO:teuthology.orchestra.run.smithi146.stdout:(62/131): python3-trustme-0.6.0-4.el8.noarch.rp 300 kB/s | 27 kB 00:00 2023-05-24T03:26:48.158 INFO:teuthology.orchestra.run.smithi146.stdout:(63/131): python3-waitress-1.4.3-1.el8.noarch.r 2.5 MB/s | 255 kB 00:00 2023-05-24T03:26:48.267 INFO:teuthology.orchestra.run.smithi146.stdout:(64/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.3 MB/s | 251 kB 00:00 2023-05-24T03:26:48.392 INFO:teuthology.orchestra.run.smithi146.stdout:(65/131): ceph-mgr-diskprediction-local-18.0.0- 1.3 MB/s | 7.4 MB 00:05 2023-05-24T03:26:48.417 INFO:teuthology.orchestra.run.smithi146.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 407 kB/s | 61 kB 00:00 2023-05-24T03:26:48.509 INFO:teuthology.orchestra.run.smithi146.stdout:(67/131): python3-zc-lockfile-2.0-2.el8.noarch. 250 kB/s | 23 kB 00:00 2023-05-24T03:26:48.701 INFO:teuthology.orchestra.run.smithi146.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 276 kB/s | 85 kB 00:00 2023-05-24T03:26:48.751 INFO:teuthology.orchestra.run.smithi146.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 70 kB 00:00 2023-05-24T03:26:48.793 INFO:teuthology.orchestra.run.smithi146.stdout:(70/131): thrift-0.13.0-2.el8.x86_64.rpm 6.1 MB/s | 1.7 MB 00:00 2023-05-24T03:26:48.877 INFO:teuthology.orchestra.run.smithi146.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.4 MB/s | 110 kB 00:00 2023-05-24T03:26:48.919 INFO:teuthology.orchestra.run.smithi146.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2023-05-24T03:26:48.977 INFO:teuthology.orchestra.run.smithi146.stdout:(73/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 4.3 MB/s | 259 kB 00:00 2023-05-24T03:26:49.028 INFO:teuthology.orchestra.run.smithi146.stdout:(74/131): socat-1.7.4.1-1.el8.x86_64.rpm 6.3 MB/s | 323 kB 00:00 2023-05-24T03:26:49.070 INFO:teuthology.orchestra.run.smithi146.stdout:(75/131): python3-markupsafe-0.23-19.el8.x86_64 934 kB/s | 39 kB 00:00 2023-05-24T03:26:49.212 INFO:teuthology.orchestra.run.smithi146.stdout:(76/131): python3-scipy-1.0.0-21.module+el8.5.0 30 MB/s | 14 MB 00:00 2023-05-24T03:26:49.245 INFO:teuthology.orchestra.run.smithi146.stdout:(77/131): bison-3.0.4-10.el8.x86_64.rpm 3.8 MB/s | 688 kB 00:00 2023-05-24T03:26:49.279 INFO:teuthology.orchestra.run.smithi146.stdout:(78/131): python3-jinja2-2.10.1-3.el8.noarch.rp 7.9 MB/s | 538 kB 00:00 2023-05-24T03:26:49.304 INFO:teuthology.orchestra.run.smithi146.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-05-24T03:26:49.305 INFO:teuthology.orchestra.run.smithi151.stdout:(25/131): rbd-mirror-18.0.0-4167.gfa0e62c4.el8. 1.5 MB/s | 3.4 MB 00:02 2023-05-24T03:26:49.321 INFO:teuthology.orchestra.run.smithi146.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 4.4 MB/s | 187 kB 00:00 2023-05-24T03:26:49.363 INFO:teuthology.orchestra.run.smithi146.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 12 MB/s | 713 kB 00:00 2023-05-24T03:26:49.413 INFO:teuthology.orchestra.run.smithi146.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 533 kB/s | 27 kB 00:00 2023-05-24T03:26:49.471 INFO:teuthology.orchestra.run.smithi151.stdout:(26/131): rbd-nbd-18.0.0-4167.gfa0e62c4.el8.x86 1.1 MB/s | 179 kB 00:00 2023-05-24T03:26:49.497 INFO:teuthology.orchestra.run.smithi146.stdout:(83/131): python3-babel-2.5.1-7.el8.noarch.rpm 27 MB/s | 4.8 MB 00:00 2023-05-24T03:26:49.522 INFO:teuthology.orchestra.run.smithi146.stdout:(84/131): flex-2.6.1-9.el8.x86_64.rpm 2.9 MB/s | 320 kB 00:00 2023-05-24T03:26:49.530 INFO:teuthology.orchestra.run.smithi151.stdout:(27/131): ceph-grafana-dashboards-18.0.0-4167.g 395 kB/s | 23 kB 00:00 2023-05-24T03:26:49.547 INFO:teuthology.orchestra.run.smithi146.stdout:(85/131): python3-prettytable-0.7.2-14.el8.noar 876 kB/s | 44 kB 00:00 2023-05-24T03:26:49.606 INFO:teuthology.orchestra.run.smithi146.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 7.7 MB/s | 457 kB 00:00 2023-05-24T03:26:49.655 INFO:teuthology.orchestra.run.smithi151.stdout:(28/131): ceph-mgr-cephadm-18.0.0-4167.gfa0e62c 1.0 MB/s | 127 kB 00:00 2023-05-24T03:26:49.673 INFO:teuthology.orchestra.run.smithi146.stdout:(87/131): python3-numpy-1.14.3-10.el8.x86_64.rp 25 MB/s | 3.7 MB 00:00 2023-05-24T03:26:49.698 INFO:teuthology.orchestra.run.smithi146.stdout:(88/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.4 MB/s | 225 kB 00:00 2023-05-24T03:26:49.724 INFO:teuthology.orchestra.run.smithi146.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2023-05-24T03:26:49.749 INFO:teuthology.orchestra.run.smithi146.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.5 MB/s | 126 kB 00:00 2023-05-24T03:26:49.774 INFO:teuthology.orchestra.run.smithi146.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 398 kB/s | 20 kB 00:00 2023-05-24T03:26:49.828 INFO:teuthology.orchestra.run.smithi146.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.3 MB/s | 103 kB 00:00 2023-05-24T03:26:49.867 INFO:teuthology.orchestra.run.smithi146.stdout:(93/131): libtool-2.4.6-25.el8.x86_64.rpm 7.5 MB/s | 709 kB 00:00 2023-05-24T03:26:49.917 INFO:teuthology.orchestra.run.smithi146.stdout:(94/131): libpq-13.5-1.el8.x86_64.rpm 3.9 MB/s | 198 kB 00:00 2023-05-24T03:26:49.992 INFO:teuthology.orchestra.run.smithi146.stdout:(95/131): openblas-threads-0.3.15-3.el8.x86_64. 30 MB/s | 4.9 MB 00:00 2023-05-24T03:26:50.042 INFO:teuthology.orchestra.run.smithi146.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 3.9 MB/s | 202 kB 00:00 2023-05-24T03:26:50.126 INFO:teuthology.orchestra.run.smithi146.stdout:(97/131): openblas-0.3.15-3.el8.x86_64.rpm 23 MB/s | 4.7 MB 00:00 2023-05-24T03:26:50.152 INFO:teuthology.orchestra.run.smithi146.stdout:(98/131): librdkafka-0.11.4-3.el8.x86_64.rpm 3.2 MB/s | 354 kB 00:00 2023-05-24T03:26:50.210 INFO:teuthology.orchestra.run.smithi146.stdout:(99/131): postgresql-contrib-10.21-2.module+el8 14 MB/s | 808 kB 00:00 2023-05-24T03:26:50.285 INFO:teuthology.orchestra.run.smithi146.stdout:(100/131): postgresql-server-10.21-2.module+el8 32 MB/s | 5.1 MB 00:00 2023-05-24T03:26:50.335 INFO:teuthology.orchestra.run.smithi146.stdout:(101/131): postgresql-10.21-2.module+el8.6.0+15 12 MB/s | 1.5 MB 00:00 2023-05-24T03:26:50.360 INFO:teuthology.orchestra.run.smithi146.stdout:(102/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 623 kB/s | 47 kB 00:00 2023-05-24T03:26:50.386 INFO:teuthology.orchestra.run.smithi146.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 3.9 MB/s | 200 kB 00:00 2023-05-24T03:26:50.411 INFO:teuthology.orchestra.run.smithi146.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 845 kB/s | 43 kB 00:00 2023-05-24T03:26:50.436 INFO:teuthology.orchestra.run.smithi146.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-05-24T03:26:50.453 INFO:teuthology.orchestra.run.smithi146.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 1.1 MB/s | 48 kB 00:00 2023-05-24T03:26:50.487 INFO:teuthology.orchestra.run.smithi146.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-05-24T03:26:50.512 INFO:teuthology.orchestra.run.smithi146.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 726 kB/s | 43 kB 00:00 2023-05-24T03:26:50.537 INFO:teuthology.orchestra.run.smithi146.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 2.1 MB/s | 109 kB 00:00 2023-05-24T03:26:50.563 INFO:teuthology.orchestra.run.smithi146.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.4 MB/s | 229 kB 00:00 2023-05-24T03:26:50.596 INFO:teuthology.orchestra.run.smithi146.stdout:(111/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 9.3 MB/s | 560 kB 00:00 2023-05-24T03:26:50.613 INFO:teuthology.orchestra.run.smithi146.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 372 kB/s | 19 kB 00:00 2023-05-24T03:26:50.655 INFO:teuthology.orchestra.run.smithi151.stdout:(29/131): ceph-mgr-dashboard-18.0.0-4167.gfa0e6 1.7 MB/s | 1.7 MB 00:00 2023-05-24T03:26:50.714 INFO:teuthology.orchestra.run.smithi146.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 1.3 MB/s | 155 kB 00:00 2023-05-24T03:26:50.789 INFO:teuthology.orchestra.run.smithi146.stdout:(114/131): python3-cryptography-3.2.1-5.el8.x86 3.1 MB/s | 559 kB 00:00 2023-05-24T03:26:50.814 INFO:teuthology.orchestra.run.smithi146.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 178 kB/s | 18 kB 00:00 2023-05-24T03:26:50.848 INFO:teuthology.orchestra.run.smithi146.stdout:(116/131): pcre2-devel-10.32-2.el8.x86_64.rpm 10 MB/s | 605 kB 00:00 2023-05-24T03:26:50.873 INFO:teuthology.orchestra.run.smithi146.stdout:(117/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.0 MB/s | 238 kB 00:00 2023-05-24T03:26:50.940 INFO:teuthology.orchestra.run.smithi146.stdout:(118/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 25 MB/s | 2.3 MB 00:00 2023-05-24T03:26:50.965 INFO:teuthology.orchestra.run.smithi146.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 786 kB/s | 72 kB 00:00 2023-05-24T03:26:50.991 INFO:teuthology.orchestra.run.smithi146.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-05-24T03:26:51.016 INFO:teuthology.orchestra.run.smithi146.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.2 MB/s | 60 kB 00:00 2023-05-24T03:26:51.041 INFO:teuthology.orchestra.run.smithi146.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.9 MB/s | 98 kB 00:00 2023-05-24T03:26:51.067 INFO:teuthology.orchestra.run.smithi146.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2023-05-24T03:26:51.092 INFO:teuthology.orchestra.run.smithi146.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 766 kB/s | 39 kB 00:00 2023-05-24T03:26:51.134 INFO:teuthology.orchestra.run.smithi146.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 9.4 MB/s | 644 kB 00:00 2023-05-24T03:26:51.159 INFO:teuthology.orchestra.run.smithi146.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.5 MB/s | 171 kB 00:00 2023-05-24T03:26:51.184 INFO:teuthology.orchestra.run.smithi146.stdout:(127/131): NetworkManager-initscripts-updown-1. 2.7 MB/s | 138 kB 00:00 2023-05-24T03:26:51.439 INFO:teuthology.orchestra.run.smithi151.stdout:(30/131): librgw2-18.0.0-4167.gfa0e62c4.el8.x86 1.2 MB/s | 6.5 MB 00:05 2023-05-24T03:26:51.881 INFO:teuthology.orchestra.run.smithi151.stdout:(31/131): ceph-mgr-modules-core-18.0.0-4167.gfa 544 kB/s | 240 kB 00:00 2023-05-24T03:26:51.998 INFO:teuthology.orchestra.run.smithi151.stdout:(32/131): ceph-mgr-rook-18.0.0-4167.gfa0e62c4.e 407 kB/s | 47 kB 00:00 2023-05-24T03:26:52.056 INFO:teuthology.orchestra.run.smithi151.stdout:(33/131): ceph-prometheus-alerts-18.0.0-4167.gf 250 kB/s | 15 kB 00:00 2023-05-24T03:26:52.448 INFO:teuthology.orchestra.run.smithi151.stdout:(34/131): ceph-volume-18.0.0-4167.gfa0e62c4.el8 659 kB/s | 258 kB 00:00 2023-05-24T03:26:52.707 INFO:teuthology.orchestra.run.smithi151.stdout:(35/131): cephadm-18.0.0-4167.gfa0e62c4.el8.noa 619 kB/s | 160 kB 00:00 2023-05-24T03:26:52.966 INFO:teuthology.orchestra.run.smithi151.stdout:(36/131): cephfs-top-18.0.0-4167.gfa0e62c4.el8. 69 kB/s | 18 kB 00:00 2023-05-24T03:26:53.216 INFO:teuthology.orchestra.run.smithi151.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 1.2 MB/s | 306 kB 00:00 2023-05-24T03:26:53.341 INFO:teuthology.orchestra.run.smithi151.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 471 kB/s | 59 kB 00:00 2023-05-24T03:26:53.425 INFO:teuthology.orchestra.run.smithi151.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 901 kB/s | 75 kB 00:00 2023-05-24T03:26:53.592 INFO:teuthology.orchestra.run.smithi151.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 2.8 MB/s | 476 kB 00:00 2023-05-24T03:26:53.942 INFO:teuthology.orchestra.run.smithi151.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 125 kB/s | 44 kB 00:00 2023-05-24T03:26:53.968 INFO:teuthology.orchestra.run.smithi146.stdout:(128/131): librbd1-18.0.0-4167.gfa0e62c4.el8.x8 1.3 MB/s | 3.6 MB 00:02 2023-05-24T03:26:54.035 INFO:teuthology.orchestra.run.smithi146.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 12 MB/s | 798 kB 00:00 2023-05-24T03:26:54.076 INFO:teuthology.orchestra.run.smithi151.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.4 MB/s | 185 kB 00:00 2023-05-24T03:26:54.293 INFO:teuthology.orchestra.run.smithi146.stdout:(130/131): librados2-18.0.0-4167.gfa0e62c4.el8. 1.2 MB/s | 3.7 MB 00:03 2023-05-24T03:26:54.318 INFO:teuthology.orchestra.run.smithi151.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 136 kB/s | 33 kB 00:00 2023-05-24T03:26:54.518 INFO:teuthology.orchestra.run.smithi151.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 81 kB/s | 16 kB 00:00 2023-05-24T03:26:54.844 INFO:teuthology.orchestra.run.smithi151.stdout:(45/131): python3-cheroot-8.5.2-1.el8.noarch.rp 531 kB/s | 173 kB 00:00 2023-05-24T03:26:55.302 INFO:teuthology.orchestra.run.smithi151.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 839 kB/s | 384 kB 00:00 2023-05-24T03:26:55.510 INFO:teuthology.orchestra.run.smithi151.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 390 kB/s | 81 kB 00:00 2023-05-24T03:26:55.652 INFO:teuthology.orchestra.run.smithi151.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 78 kB/s | 11 kB 00:00 2023-05-24T03:26:55.819 INFO:teuthology.orchestra.run.smithi151.stdout:(49/131): python3-jaraco-functools-2.0-4.el8.no 105 kB/s | 18 kB 00:00 2023-05-24T03:26:56.245 INFO:teuthology.orchestra.run.smithi151.stdout:(50/131): python3-kubernetes-11.0.0-6.el8.noarc 2.7 MB/s | 1.2 MB 00:00 2023-05-24T03:26:56.362 INFO:teuthology.orchestra.run.smithi151.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 417 kB/s | 49 kB 00:00 2023-05-24T03:26:56.528 INFO:teuthology.orchestra.run.smithi151.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 352 kB/s | 59 kB 00:00 2023-05-24T03:26:56.635 INFO:teuthology.orchestra.run.smithi146.stdout:(131/131): ceph-test-18.0.0-4167.gfa0e62c4.el8. 2.1 MB/s | 41 MB 00:19 2023-05-24T03:26:56.638 INFO:teuthology.orchestra.run.smithi146.stdout:-------------------------------------------------------------------------------- 2023-05-24T03:26:56.638 INFO:teuthology.orchestra.run.smithi146.stdout:Total 6.9 MB/s | 197 MB 00:28 2023-05-24T03:26:56.737 INFO:teuthology.orchestra.run.smithi151.stdout:(53/131): python3-natsort-7.1.1-2.el8.noarch.rp 289 kB/s | 60 kB 00:00 2023-05-24T03:26:56.987 INFO:teuthology.orchestra.run.smithi151.stdout:(54/131): python3-pecan-1.3.2-9.el8.noarch.rpm 1.1 MB/s | 283 kB 00:00 2023-05-24T03:26:57.213 INFO:teuthology.orchestra.run.smithi151.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 69 kB/s | 16 kB 00:00 2023-05-24T03:26:57.396 INFO:teuthology.orchestra.run.smithi151.stdout:(56/131): python3-repoze-lru-0.7-6.el8.noarch.r 184 kB/s | 34 kB 00:00 2023-05-24T03:26:57.458 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2023-05-24T03:26:57.580 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction check succeeded. 2023-05-24T03:26:57.580 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2023-05-24T03:26:57.630 INFO:teuthology.orchestra.run.smithi151.stdout:(57/131): python3-routes-2.4.1-12.el8.noarch.rp 843 kB/s | 196 kB 00:00 2023-05-24T03:26:57.847 INFO:teuthology.orchestra.run.smithi151.stdout:(58/131): python3-rsa-4.8-1.el8.noarch.rpm 284 kB/s | 61 kB 00:00 2023-05-24T03:26:58.039 INFO:teuthology.orchestra.run.smithi151.stdout:(59/131): python3-simplegeneric-0.8.1-17.el8.no 98 kB/s | 19 kB 00:00 2023-05-24T03:26:58.272 INFO:teuthology.orchestra.run.smithi151.stdout:(60/131): python3-singledispatch-3.4.0.3-18.el8 102 kB/s | 24 kB 00:00 2023-05-24T03:26:58.389 INFO:teuthology.orchestra.run.smithi151.stdout:(61/131): python3-tempora-1.14.1-5.el8.noarch.r 250 kB/s | 29 kB 00:00 2023-05-24T03:26:58.590 INFO:teuthology.orchestra.run.smithi151.stdout:(62/131): ceph-mgr-diskprediction-local-18.0.0- 957 kB/s | 7.4 MB 00:07 2023-05-24T03:26:58.623 INFO:teuthology.orchestra.run.smithi151.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 118 kB/s | 27 kB 00:00 2023-05-24T03:26:58.661 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded. 2023-05-24T03:26:58.665 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2023-05-24T03:26:58.799 INFO:teuthology.orchestra.run.smithi151.stdout:(64/131): python3-webob-1.8.5-1.el8.1.noarch.rp 1.4 MB/s | 251 kB 00:00 2023-05-24T03:26:58.857 INFO:teuthology.orchestra.run.smithi151.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 959 kB/s | 255 kB 00:00 2023-05-24T03:26:58.883 INFO:teuthology.orchestra.run.smithi151.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 734 kB/s | 61 kB 00:00 2023-05-24T03:26:58.941 INFO:teuthology.orchestra.run.smithi151.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 1.0 MB/s | 85 kB 00:00 2023-05-24T03:26:58.966 INFO:teuthology.orchestra.run.smithi151.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 274 kB/s | 23 kB 00:00 2023-05-24T03:26:58.992 INFO:teuthology.orchestra.run.smithi151.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-05-24T03:26:59.077 INFO:teuthology.orchestra.run.smithi151.stdout:(70/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 555 kB/s | 47 kB 00:00 2023-05-24T03:26:59.126 INFO:teuthology.orchestra.run.smithi151.stdout:(71/131): libselinux-devel-2.9-5.el8.x86_64.rpm 4.0 MB/s | 200 kB 00:00 2023-05-24T03:26:59.168 INFO:teuthology.orchestra.run.smithi151.stdout:(72/131): python3-jwt-1.6.1-2.el8.noarch.rpm 1.0 MB/s | 43 kB 00:00 2023-05-24T03:26:59.210 INFO:teuthology.orchestra.run.smithi151.stdout:(73/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 5.2 MB/s | 220 kB 00:00 2023-05-24T03:26:59.251 INFO:teuthology.orchestra.run.smithi151.stdout:(74/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 1.1 MB/s | 48 kB 00:00 2023-05-24T03:26:59.293 INFO:teuthology.orchestra.run.smithi151.stdout:(75/131): thrift-0.13.0-2.el8.x86_64.rpm 4.9 MB/s | 1.7 MB 00:00 2023-05-24T03:26:59.310 INFO:teuthology.orchestra.run.smithi151.stdout:(76/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.5 MB/s | 87 kB 00:00 2023-05-24T03:26:59.352 INFO:teuthology.orchestra.run.smithi151.stdout:(77/131): python3-requests-oauthlib-1.0.0-1.el8 731 kB/s | 43 kB 00:00 2023-05-24T03:26:59.378 INFO:teuthology.orchestra.run.smithi151.stdout:(78/131): python3-pycparser-2.14-14.el8.noarch. 1.7 MB/s | 109 kB 00:00 2023-05-24T03:26:59.403 INFO:teuthology.orchestra.run.smithi151.stdout:(79/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.5 MB/s | 229 kB 00:00 2023-05-24T03:26:59.437 INFO:teuthology.orchestra.run.smithi151.stdout:(80/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 9.4 MB/s | 560 kB 00:00 2023-05-24T03:26:59.462 INFO:teuthology.orchestra.run.smithi151.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 319 kB/s | 19 kB 00:00 2023-05-24T03:26:59.487 INFO:teuthology.orchestra.run.smithi151.stdout:(82/131): python3-oauthlib-2.1.0-1.el8.noarch.r 3.0 MB/s | 155 kB 00:00 2023-05-24T03:26:59.521 INFO:teuthology.orchestra.run.smithi151.stdout:(83/131): python3-cryptography-3.2.1-5.el8.x86_ 9.4 MB/s | 559 kB 00:00 2023-05-24T03:26:59.572 INFO:teuthology.orchestra.run.smithi151.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 213 kB/s | 18 kB 00:00 2023-05-24T03:26:59.613 INFO:teuthology.orchestra.run.smithi151.stdout:(85/131): pcre2-devel-10.32-2.el8.x86_64.rpm 6.4 MB/s | 605 kB 00:00 2023-05-24T03:26:59.638 INFO:teuthology.orchestra.run.smithi151.stdout:(86/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.5 MB/s | 238 kB 00:00 2023-05-24T03:26:59.681 INFO:teuthology.orchestra.run.smithi151.stdout:(87/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.7 MB/s | 72 kB 00:00 2023-05-24T03:26:59.739 INFO:teuthology.orchestra.run.smithi151.stdout:(88/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 19 MB/s | 2.3 MB 00:00 2023-05-24T03:26:59.764 INFO:teuthology.orchestra.run.smithi151.stdout:(89/131): fuse-2.9.7-15.el8.x86_64.rpm 991 kB/s | 83 kB 00:00 2023-05-24T03:26:59.789 INFO:teuthology.orchestra.run.smithi151.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 1.2 MB/s | 60 kB 00:00 2023-05-24T03:26:59.815 INFO:teuthology.orchestra.run.smithi151.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.9 MB/s | 98 kB 00:00 2023-05-24T03:26:59.832 INFO:teuthology.orchestra.run.smithi151.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.3 MB/s | 58 kB 00:00 2023-05-24T03:26:59.849 INFO:teuthology.orchestra.run.smithi151.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 1.1 MB/s | 39 kB 00:00 2023-05-24T03:26:59.882 INFO:teuthology.orchestra.run.smithi151.stdout:(94/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 13 MB/s | 644 kB 00:00 2023-05-24T03:26:59.908 INFO:teuthology.orchestra.run.smithi151.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 2.9 MB/s | 171 kB 00:00 2023-05-24T03:26:59.934 INFO:teuthology.orchestra.run.smithi151.stdout:(96/131): NetworkManager-initscripts-updown-1.3 2.7 MB/s | 138 kB 00:00 2023-05-24T03:26:59.975 INFO:teuthology.orchestra.run.smithi151.stdout:(97/131): python3-pyasn1-modules-0.3.7-6.el8.no 2.6 MB/s | 110 kB 00:00 2023-05-24T03:27:00.018 INFO:teuthology.orchestra.run.smithi151.stdout:(98/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.2 MB/s | 54 kB 00:00 2023-05-24T03:27:00.084 INFO:teuthology.orchestra.run.smithi151.stdout:(99/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.8 MB/s | 259 kB 00:00 2023-05-24T03:27:00.126 INFO:teuthology.orchestra.run.smithi151.stdout:(100/131): socat-1.7.4.1-1.el8.x86_64.rpm 7.6 MB/s | 323 kB 00:00 2023-05-24T03:27:00.162 INFO:teuthology.orchestra.run.smithi151.stdout:(101/131): python3-markupsafe-0.23-19.el8.x86_6 1.1 MB/s | 39 kB 00:00 2023-05-24T03:27:00.269 INFO:teuthology.orchestra.run.smithi151.stdout:(102/131): bison-3.0.4-10.el8.x86_64.rpm 13 MB/s | 688 kB 00:00 2023-05-24T03:27:00.269 INFO:teuthology.orchestra.run.smithi151.stdout:(103/131): python3-jinja2-2.10.1-3.el8.noarch.r 13 MB/s | 538 kB 00:00 2023-05-24T03:27:00.294 INFO:teuthology.orchestra.run.smithi151.stdout:(104/131): python3-mako-1.0.6-13.el8.noarch.rpm 3.7 MB/s | 157 kB 00:00 2023-05-24T03:27:00.336 INFO:teuthology.orchestra.run.smithi151.stdout:(105/131): oniguruma-6.8.2-2.el8.x86_64.rpm 4.4 MB/s | 187 kB 00:00 2023-05-24T03:27:00.478 INFO:teuthology.orchestra.run.smithi151.stdout:(106/131): python3-scipy-1.0.0-21.module+el8.5. 24 MB/s | 14 MB 00:00 2023-05-24T03:27:00.511 INFO:teuthology.orchestra.run.smithi151.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 4.0 MB/s | 713 kB 00:00 2023-05-24T03:27:00.570 INFO:teuthology.orchestra.run.smithi151.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 454 kB/s | 27 kB 00:00 2023-05-24T03:27:00.612 INFO:teuthology.orchestra.run.smithi151.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-05-24T03:27:00.646 INFO:teuthology.orchestra.run.smithi151.stdout:(110/131): python3-prettytable-0.7.2-14.el8.noa 1.3 MB/s | 44 kB 00:00 2023-05-24T03:27:00.704 INFO:teuthology.orchestra.run.smithi151.stdout:(111/131): python3-babel-2.5.1-7.el8.noarch.rpm 21 MB/s | 4.8 MB 00:00 2023-05-24T03:27:00.746 INFO:teuthology.orchestra.run.smithi151.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 11 MB/s | 457 kB 00:00 2023-05-24T03:27:00.788 INFO:teuthology.orchestra.run.smithi151.stdout:(113/131): python3-numpy-f2py-1.14.3-10.el8.x86 5.3 MB/s | 225 kB 00:00 2023-05-24T03:27:00.847 INFO:teuthology.orchestra.run.smithi151.stdout:(114/131): python3-numpy-1.14.3-10.el8.x86_64.r 19 MB/s | 3.7 MB 00:00 2023-05-24T03:27:00.872 INFO:teuthology.orchestra.run.smithi151.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 765 kB/s | 64 kB 00:00 2023-05-24T03:27:00.897 INFO:teuthology.orchestra.run.smithi151.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 2.5 MB/s | 126 kB 00:00 2023-05-24T03:27:00.923 INFO:teuthology.orchestra.run.smithi151.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 398 kB/s | 20 kB 00:00 2023-05-24T03:27:00.948 INFO:teuthology.orchestra.run.smithi151.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.0 MB/s | 103 kB 00:00 2023-05-24T03:27:00.982 INFO:teuthology.orchestra.run.smithi151.stdout:(119/131): libtool-2.4.6-25.el8.x86_64.rpm 12 MB/s | 709 kB 00:00 2023-05-24T03:27:01.057 INFO:teuthology.orchestra.run.smithi151.stdout:(120/131): libpq-13.5-1.el8.x86_64.rpm 2.6 MB/s | 198 kB 00:00 2023-05-24T03:27:01.150 INFO:teuthology.orchestra.run.smithi151.stdout:(121/131): openblas-threads-0.3.15-3.el8.x86_64 24 MB/s | 4.9 MB 00:00 2023-05-24T03:27:01.191 INFO:teuthology.orchestra.run.smithi151.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-05-24T03:27:01.258 INFO:teuthology.orchestra.run.smithi151.stdout:(123/131): openblas-0.3.15-3.el8.x86_64.rpm 24 MB/s | 4.7 MB 00:00 2023-05-24T03:27:01.283 INFO:teuthology.orchestra.run.smithi151.stdout:(124/131): librdkafka-0.11.4-3.el8.x86_64.rpm 3.8 MB/s | 354 kB 00:00 2023-05-24T03:27:01.342 INFO:teuthology.orchestra.run.smithi151.stdout:(125/131): postgresql-contrib-10.21-2.module+el 14 MB/s | 808 kB 00:00 2023-05-24T03:27:01.434 INFO:teuthology.orchestra.run.smithi151.stdout:(126/131): postgresql-server-10.21-2.module+el8 29 MB/s | 5.1 MB 00:00 2023-05-24T03:27:01.468 INFO:teuthology.orchestra.run.smithi151.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 12 MB/s | 1.5 MB 00:00 2023-05-24T03:27:03.515 INFO:teuthology.orchestra.run.smithi146.stdout: Preparing : 1/1 2023-05-24T03:27:03.699 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-05-24T03:27:03.868 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-05-24T03:27:04.081 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-05-24T03:27:04.266 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-05-24T03:27:04.394 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-05-24T03:27:04.542 INFO:teuthology.orchestra.run.smithi151.stdout:(128/131): librados2-18.0.0-4167.gfa0e62c4.el8. 1.2 MB/s | 3.7 MB 00:03 2023-05-24T03:27:04.582 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-05-24T03:27:04.601 INFO:teuthology.orchestra.run.smithi151.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 13 MB/s | 798 kB 00:00 2023-05-24T03:27:04.776 INFO:teuthology.orchestra.run.smithi151.stdout:(130/131): librbd1-18.0.0-4167.gfa0e62c4.el8.x8 1.1 MB/s | 3.6 MB 00:03 2023-05-24T03:27:04.980 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-05-24T03:27:05.217 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : librados2-2:18.0.0-4167.gfa0e62c4.el8.x86_64 6/134 2023-05-24T03:27:05.608 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librados2-2:18.0.0-4167.gfa0e62c4.el8.x86_64 6/134 2023-05-24T03:27:05.807 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : librbd1-2:18.0.0-4167.gfa0e62c4.el8.x86_64 7/134 2023-05-24T03:27:05.935 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librbd1-2:18.0.0-4167.gfa0e62c4.el8.x86_64 7/134 2023-05-24T03:27:06.174 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libcephfs2-2:18.0.0-4167.gfa0e62c4.el8.x86_64 8/134 2023-05-24T03:27:06.273 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libcephfs2-2:18.0.0-4167.gfa0e62c4.el8.x86_64 8/134 2023-05-24T03:27:06.466 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rados-2:18.0.0-4167.gfa0e62c4.el8.x86_64 9/134 2023-05-24T03:27:06.894 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-05-24T03:27:07.085 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-05-24T03:27:07.486 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-05-24T03:27:07.760 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-05-24T03:27:07.949 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libcephsqlite-2:18.0.0-4167.gfa0e62c4.el8.x86_64 14/134 2023-05-24T03:27:08.056 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4167.gfa0e62c4.el8.x86_64 14/134 2023-05-24T03:27:08.223 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libradosstriper1-2:18.0.0-4167.gfa0e62c4.el8.x86 15/134 2023-05-24T03:27:08.304 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4167.gfa0e62c4.el8.x86 15/134 2023-05-24T03:27:08.448 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-05-24T03:27:08.577 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-05-24T03:27:08.732 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-05-24T03:27:09.345 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-05-24T03:27:09.548 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-05-24T03:27:10.129 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-05-24T03:27:10.298 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-05-24T03:27:11.005 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-05-24T03:27:11.274 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-05-24T03:27:11.507 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-05-24T03:27:11.735 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-05-24T03:27:11.903 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-05-24T03:27:12.094 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-05-24T03:27:12.341 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-05-24T03:27:12.512 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-ceph-common-2:18.0.0-4167.gfa0e62c4.el8. 26/134 2023-05-24T03:27:12.634 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-ceph-argparse-2:18.0.0-4167.gfa0e62c4.el 27/134 2023-05-24T03:27:13.548 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cephfs-2:18.0.0-4167.gfa0e62c4.el8.x86_6 28/134 2023-05-24T03:27:13.692 INFO:teuthology.orchestra.run.smithi151.stdout:(131/131): ceph-test-18.0.0-4167.gfa0e62c4.el8. 1.3 MB/s | 41 MB 00:30 2023-05-24T03:27:13.695 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2023-05-24T03:27:13.695 INFO:teuthology.orchestra.run.smithi151.stdout:Total 5.0 MB/s | 197 MB 00:39 2023-05-24T03:27:13.875 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-05-24T03:27:14.133 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-05-24T03:27:14.390 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-05-24T03:27:14.504 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2023-05-24T03:27:14.589 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-05-24T03:27:14.623 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2023-05-24T03:27:14.623 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2023-05-24T03:27:15.708 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2023-05-24T03:27:15.713 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2023-05-24T03:27:16.356 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-05-24T03:27:16.657 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-05-24T03:27:16.858 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/134 2023-05-24T03:27:17.063 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-05-24T03:27:17.236 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rbd-2:18.0.0-4167.gfa0e62c4.el8.x86_64 36/134 2023-05-24T03:27:17.392 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librados-devel-2:18.0.0-4167.gfa0e62c4.el8.x86_6 37/134 2023-05-24T03:27:17.548 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-05-24T03:27:17.723 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-05-24T03:27:17.882 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-05-24T03:27:18.024 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-05-24T03:27:18.259 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-05-24T03:27:18.458 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-05-24T03:27:18.811 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-05-24T03:27:19.091 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-05-24T03:27:19.315 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-05-24T03:27:19.526 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-05-24T03:27:19.752 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-05-24T03:27:20.054 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-05-24T03:27:20.329 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-05-24T03:27:20.530 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-05-24T03:27:20.630 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2023-05-24T03:27:20.753 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-05-24T03:27:20.829 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-05-24T03:27:20.911 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-05-24T03:27:21.003 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-05-24T03:27:21.091 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-05-24T03:27:21.180 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-05-24T03:27:21.312 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-05-24T03:27:21.406 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-05-24T03:27:21.514 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-05-24T03:27:21.659 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-05-24T03:27:21.892 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-05-24T03:27:21.911 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-05-24T03:27:22.119 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-05-24T03:27:22.147 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : librados2-2:18.0.0-4167.gfa0e62c4.el8.x86_64 5/134 2023-05-24T03:27:22.286 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-05-24T03:27:22.450 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-05-24T03:27:22.541 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librados2-2:18.0.0-4167.gfa0e62c4.el8.x86_64 5/134 2023-05-24T03:27:22.663 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-05-24T03:27:22.743 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-05-24T03:27:22.755 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : librbd1-2:18.0.0-4167.gfa0e62c4.el8.x86_64 6/134 2023-05-24T03:27:22.883 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librbd1-2:18.0.0-4167.gfa0e62c4.el8.x86_64 6/134 2023-05-24T03:27:22.967 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-05-24T03:27:23.080 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephfs2-2:18.0.0-4167.gfa0e62c4.el8.x86_64 7/134 2023-05-24T03:27:23.174 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-05-24T03:27:23.213 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libcephfs2-2:18.0.0-4167.gfa0e62c4.el8.x86_64 7/134 2023-05-24T03:27:23.329 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-05-24T03:27:23.368 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rados-2:18.0.0-4167.gfa0e62c4.el8.x86_64 8/134 2023-05-24T03:27:23.413 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-05-24T03:27:23.556 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-05-24T03:27:23.675 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-05-24T03:27:23.808 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-05-24T03:27:23.830 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-05-24T03:27:23.970 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-05-24T03:27:24.041 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-05-24T03:27:24.149 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-05-24T03:27:24.405 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-05-24T03:27:24.462 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-05-24T03:27:24.661 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-05-24T03:27:24.725 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-05-24T03:27:24.808 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-05-24T03:27:24.888 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephsqlite-2:18.0.0-4167.gfa0e62c4.el8.x86_64 14/134 2023-05-24T03:27:24.973 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-05-24T03:27:24.995 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4167.gfa0e62c4.el8.x86_64 14/134 2023-05-24T03:27:25.171 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-05-24T03:27:25.188 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libradosstriper1-2:18.0.0-4167.gfa0e62c4.el8.x86 15/134 2023-05-24T03:27:25.346 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4167.gfa0e62c4.el8.x86 15/134 2023-05-24T03:27:25.374 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-05-24T03:27:25.516 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-05-24T03:27:25.548 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-05-24T03:27:25.690 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-05-24T03:27:25.702 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-05-24T03:27:25.869 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-05-24T03:27:25.877 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-05-24T03:27:26.004 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-05-24T03:27:26.092 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-05-24T03:27:26.167 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-05-24T03:27:26.304 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-05-24T03:27:26.308 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-05-24T03:27:26.485 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-05-24T03:27:26.717 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-05-24T03:27:26.919 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-05-24T03:27:26.962 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-05-24T03:27:27.113 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-05-24T03:27:27.128 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-05-24T03:27:27.347 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-05-24T03:27:27.710 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-05-24T03:27:27.896 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-05-24T03:27:28.469 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-05-24T03:27:28.616 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-05-24T03:27:28.723 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-05-24T03:27:28.883 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-05-24T03:27:28.953 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-05-24T03:27:29.087 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-05-24T03:27:29.271 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-05-24T03:27:29.297 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-05-24T03:27:29.444 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-ceph-common-2:18.0.0-4167.gfa0e62c4.el8. 26/134 2023-05-24T03:27:29.545 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-05-24T03:27:29.598 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-ceph-argparse-2:18.0.0-4167.gfa0e62c4.el 27/134 2023-05-24T03:27:29.737 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-05-24T03:27:29.833 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cephfs-2:18.0.0-4167.gfa0e62c4.el8.x86_6 28/134 2023-05-24T03:27:30.054 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-05-24T03:27:30.515 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-05-24T03:27:30.670 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librgw2-2:18.0.0-4167.gfa0e62c4.el8.x86_64 92/134 2023-05-24T03:27:30.739 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librgw2-2:18.0.0-4167.gfa0e62c4.el8.x86_64 92/134 2023-05-24T03:27:30.912 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rgw-2:18.0.0-4167.gfa0e62c4.el8.x86_64 93/134 2023-05-24T03:27:31.810 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-05-24T03:27:32.856 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-05-24T03:27:33.209 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-05-24T03:27:33.455 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-05-24T03:27:33.673 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-05-24T03:27:33.856 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/134 2023-05-24T03:27:34.073 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-05-24T03:27:34.242 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rbd-2:18.0.0-4167.gfa0e62c4.el8.x86_64 36/134 2023-05-24T03:27:34.385 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librados-devel-2:18.0.0-4167.gfa0e62c4.el8.x86_6 37/134 2023-05-24T03:27:34.451 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-common-2:18.0.0-4167.gfa0e62c4.el8.x86_64 94/134 2023-05-24T03:27:34.560 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-05-24T03:27:34.704 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-05-24T03:27:34.720 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-common-2:18.0.0-4167.gfa0e62c4.el8.x86_64 94/134 2023-05-24T03:27:34.870 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-05-24T03:27:34.971 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-05-24T03:27:35.190 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-05-24T03:27:35.329 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-common-2:18.0.0-4167.gfa0e62c4.el8.x86_64 94/134 2023-05-24T03:27:35.398 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-05-24T03:27:35.584 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-base-2:18.0.0-4167.gfa0e62c4.el8.x86_64 95/134 2023-05-24T03:27:35.595 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-05-24T03:27:35.665 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-base-2:18.0.0-4167.gfa0e62c4.el8.x86_64 95/134 2023-05-24T03:27:35.674 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-05-24T03:27:35.852 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-selinux-2:18.0.0-4167.gfa0e62c4.el8.x86_64 96/134 2023-05-24T03:27:35.873 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-05-24T03:27:36.076 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-05-24T03:27:36.237 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-05-24T03:27:36.446 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-05-24T03:27:36.597 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-05-24T03:27:36.731 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-05-24T03:27:36.957 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-05-24T03:27:37.147 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-05-24T03:27:37.484 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-05-24T03:27:37.755 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-05-24T03:27:37.972 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-05-24T03:27:38.215 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-05-24T03:27:38.433 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-05-24T03:27:38.735 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-05-24T03:27:38.961 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-05-24T03:27:39.146 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-05-24T03:27:39.334 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-05-24T03:27:39.541 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-05-24T03:27:39.697 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-05-24T03:27:40.379 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-05-24T03:27:40.657 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-05-24T03:27:40.890 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-05-24T03:27:41.145 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-05-24T03:27:41.302 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-05-24T03:27:41.513 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-05-24T03:27:41.803 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-05-24T03:27:42.042 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-05-24T03:27:42.173 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-05-24T03:27:42.321 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-05-24T03:27:42.536 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-05-24T03:27:42.731 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-05-24T03:27:42.981 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-05-24T03:27:43.122 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-05-24T03:27:43.258 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-05-24T03:27:43.482 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-05-24T03:27:43.681 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-05-24T03:27:43.858 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-05-24T03:27:44.157 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-05-24T03:27:44.435 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-05-24T03:27:44.577 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-05-24T03:27:44.778 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-05-24T03:27:45.902 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-05-24T03:27:46.155 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-05-24T03:27:46.384 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-05-24T03:27:46.669 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-05-24T03:27:46.989 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-05-24T03:27:47.169 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-05-24T03:27:47.925 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-05-24T03:27:48.085 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librgw2-2:18.0.0-4167.gfa0e62c4.el8.x86_64 92/134 2023-05-24T03:27:48.139 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librgw2-2:18.0.0-4167.gfa0e62c4.el8.x86_64 92/134 2023-05-24T03:27:48.302 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rgw-2:18.0.0-4167.gfa0e62c4.el8.x86_64 93/134 2023-05-24T03:27:51.908 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-common-2:18.0.0-4167.gfa0e62c4.el8.x86_64 94/134 2023-05-24T03:27:52.118 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-common-2:18.0.0-4167.gfa0e62c4.el8.x86_64 94/134 2023-05-24T03:27:52.724 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-common-2:18.0.0-4167.gfa0e62c4.el8.x86_64 94/134 2023-05-24T03:27:53.019 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-base-2:18.0.0-4167.gfa0e62c4.el8.x86_64 95/134 2023-05-24T03:27:53.098 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-base-2:18.0.0-4167.gfa0e62c4.el8.x86_64 95/134 2023-05-24T03:27:53.250 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-selinux-2:18.0.0-4167.gfa0e62c4.el8.x86_64 96/134 2023-05-24T03:27:54.473 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4167.gfa0e62c4.el8.x86_64 96/134 2023-05-24T03:27:54.473 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /sys 2023-05-24T03:27:54.473 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /proc 2023-05-24T03:27:54.473 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /dev 2023-05-24T03:27:54.473 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /run 2023-05-24T03:27:54.473 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /mnt 2023-05-24T03:27:54.474 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /var/tmp 2023-05-24T03:27:54.474 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /home 2023-05-24T03:27:54.474 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /tmp 2023-05-24T03:27:54.474 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /dev 2023-05-24T03:27:54.474 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:27:54.833 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-volume-2:18.0.0-4167.gfa0e62c4.el8.noarch 97/134 2023-05-24T03:27:56.408 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-volume-2:18.0.0-4167.gfa0e62c4.el8.noarch 97/134 2023-05-24T03:27:56.580 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-osd-2:18.0.0-4167.gfa0e62c4.el8.x86_64 98/134 2023-05-24T03:27:56.798 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-osd-2:18.0.0-4167.gfa0e62c4.el8.x86_64 98/134 2023-05-24T03:27:56.941 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mds-2:18.0.0-4167.gfa0e62c4.el8.x86_64 99/134 2023-05-24T03:27:57.394 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mds-2:18.0.0-4167.gfa0e62c4.el8.x86_64 99/134 2023-05-24T03:27:57.567 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mon-2:18.0.0-4167.gfa0e62c4.el8.x86_64 100/134 2023-05-24T03:27:57.583 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mon-2:18.0.0-4167.gfa0e62c4.el8.x86_64 100/134 2023-05-24T03:27:59.187 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: cephadm-2:18.0.0-4167.gfa0e62c4.el8.noarch 101/134 2023-05-24T03:27:59.382 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : cephadm-2:18.0.0-4167.gfa0e62c4.el8.noarch 101/134 2023-05-24T03:27:59.513 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4167.gfa0e62c4.e 102/134 2023-05-24T03:27:59.704 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4167.gfa0e62c4. 103/134 2023-05-24T03:27:59.898 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4167.gfa0e62c4.el8.noa 104/134 2023-05-24T03:28:00.116 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4167.gfa0e62c4.el8.noa 104/134 2023-05-24T03:28:00.396 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4167.gfa0e62c4.el8.n 105/134 2023-05-24T03:28:01.355 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4167.gfa0e62c4.el8.n 105/134 2023-05-24T03:28:01.482 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4167.gfa0 106/134 2023-05-24T03:28:01.572 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4167.gfa0 106/134 2023-05-24T03:28:01.906 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4167.gfa0e62c4.el 107/134 2023-05-24T03:28:02.079 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-2:18.0.0-4167.gfa0e62c4.el8.x86_64 108/134 2023-05-24T03:28:02.114 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4167.gfa0e62c4.el8.x86_64 108/134 2023-05-24T03:28:02.298 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-rook-2:18.0.0-4167.gfa0e62c4.el8.noarch 109/134 2023-05-24T03:28:02.309 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4167.gfa0e62c4.el8.noarch 109/134 2023-05-24T03:28:03.559 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-2:18.0.0-4167.gfa0e62c4.el8.x86_64 110/134 2023-05-24T03:28:03.784 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-radosgw-2:18.0.0-4167.gfa0e62c4.el8.x86_64 111/134 2023-05-24T03:28:03.818 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4167.gfa0e62c4.el8.x86_64 111/134 2023-05-24T03:28:03.981 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4167.gfa0e6 112/134 2023-05-24T03:28:04.033 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4167.gfa0e6 112/134 2023-05-24T03:28:04.198 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : cephfs-mirror-2:18.0.0-4167.gfa0e62c4.el8.x86_64 113/134 2023-05-24T03:28:04.542 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4167.gfa0e62c4.el8.x86_64 113/134 2023-05-24T03:28:04.706 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : rbd-mirror-2:18.0.0-4167.gfa0e62c4.el8.x86_64 114/134 2023-05-24T03:28:08.617 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4167.gfa0e62c4.el8.x86_64 114/134 2023-05-24T03:28:08.942 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-test-2:18.0.0-4167.gfa0e62c4.el8.x86_64 115/134 2023-05-24T03:28:09.097 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-05-24T03:28:09.290 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-05-24T03:28:10.194 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-05-24T03:28:10.520 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-05-24T03:28:10.693 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-fuse-2:18.0.0-4167.gfa0e62c4.el8.x86_64 119/134 2023-05-24T03:28:10.876 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-05-24T03:28:11.068 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libcephfs-devel-2:18.0.0-4167.gfa0e62c4.el8.x86_ 121/134 2023-05-24T03:28:11.223 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-05-24T03:28:12.495 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4167.gfa0e62c4.el8.x86_64 96/134 2023-05-24T03:28:12.496 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /sys 2023-05-24T03:28:12.496 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /proc 2023-05-24T03:28:12.496 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /dev 2023-05-24T03:28:12.496 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /run 2023-05-24T03:28:12.497 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /mnt 2023-05-24T03:28:12.497 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /var/tmp 2023-05-24T03:28:12.497 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /home 2023-05-24T03:28:12.497 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /tmp 2023-05-24T03:28:12.497 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /dev 2023-05-24T03:28:12.497 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-24T03:28:12.856 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-volume-2:18.0.0-4167.gfa0e62c4.el8.noarch 97/134 2023-05-24T03:28:13.299 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-05-24T03:28:13.555 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-05-24T03:28:13.573 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-05-24T03:28:13.742 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : cephfs-top-2:18.0.0-4167.gfa0e62c4.el8.noarch 124/134 2023-05-24T03:28:13.996 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : rbd-fuse-2:18.0.0-4167.gfa0e62c4.el8.x86_64 125/134 2023-05-24T03:28:14.278 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : rbd-nbd-2:18.0.0-4167.gfa0e62c4.el8.x86_64 126/134 2023-05-24T03:28:14.424 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-volume-2:18.0.0-4167.gfa0e62c4.el8.noarch 97/134 2023-05-24T03:28:14.583 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-osd-2:18.0.0-4167.gfa0e62c4.el8.x86_64 98/134 2023-05-24T03:28:14.590 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-05-24T03:28:14.729 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-05-24T03:28:14.738 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-05-24T03:28:14.801 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-osd-2:18.0.0-4167.gfa0e62c4.el8.x86_64 98/134 2023-05-24T03:28:14.923 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-05-24T03:28:14.947 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mds-2:18.0.0-4167.gfa0e62c4.el8.x86_64 99/134 2023-05-24T03:28:15.088 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-05-24T03:28:15.169 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-05-24T03:28:15.396 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-05-24T03:28:15.400 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mds-2:18.0.0-4167.gfa0e62c4.el8.x86_64 99/134 2023-05-24T03:28:15.409 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-05-24T03:28:15.409 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-05-24T03:28:15.573 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mon-2:18.0.0-4167.gfa0e62c4.el8.x86_64 100/134 2023-05-24T03:28:15.589 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mon-2:18.0.0-4167.gfa0e62c4.el8.x86_64 100/134 2023-05-24T03:28:15.607 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-05-24T03:28:15.608 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-05-24T03:28:15.853 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-05-24T03:28:16.037 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-05-24T03:28:16.335 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-05-24T03:28:16.335 INFO:teuthology.orchestra.run.smithi146.stdout:[/usr/lib/tmpfiles.d/journal-nocow.conf:26] Failed to resolve specifier: uninitialized /etc detected, skipping 2023-05-24T03:28:16.335 INFO:teuthology.orchestra.run.smithi146.stdout:All rules containing unresolvable specifiers will be skipped. 2023-05-24T03:28:16.336 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:28:16.571 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-2:18.0.0-4167.gfa0e62c4.el8.x86_64 1/134 2023-05-24T03:28:16.572 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-base-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2/134 2023-05-24T03:28:16.572 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-common-2:18.0.0-4167.gfa0e62c4.el8.x86_64 3/134 2023-05-24T03:28:16.572 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-fuse-2:18.0.0-4167.gfa0e62c4.el8.x86_64 4/134 2023-05-24T03:28:16.573 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4167.gfa0e6 5/134 2023-05-24T03:28:16.573 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mds-2:18.0.0-4167.gfa0e62c4.el8.x86_64 6/134 2023-05-24T03:28:16.573 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-2:18.0.0-4167.gfa0e62c4.el8.x86_64 7/134 2023-05-24T03:28:16.574 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mon-2:18.0.0-4167.gfa0e62c4.el8.x86_64 8/134 2023-05-24T03:28:16.574 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-osd-2:18.0.0-4167.gfa0e62c4.el8.x86_64 9/134 2023-05-24T03:28:16.574 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-radosgw-2:18.0.0-4167.gfa0e62c4.el8.x86_64 10/134 2023-05-24T03:28:16.574 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-selinux-2:18.0.0-4167.gfa0e62c4.el8.x86_64 11/134 2023-05-24T03:28:16.575 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-test-2:18.0.0-4167.gfa0e62c4.el8.x86_64 12/134 2023-05-24T03:28:16.575 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : cephfs-mirror-2:18.0.0-4167.gfa0e62c4.el8.x86_64 13/134 2023-05-24T03:28:16.575 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcephfs-devel-2:18.0.0-4167.gfa0e62c4.el8.x86_ 14/134 2023-05-24T03:28:16.575 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcephfs2-2:18.0.0-4167.gfa0e62c4.el8.x86_64 15/134 2023-05-24T03:28:16.575 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcephsqlite-2:18.0.0-4167.gfa0e62c4.el8.x86_64 16/134 2023-05-24T03:28:16.576 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librados-devel-2:18.0.0-4167.gfa0e62c4.el8.x86_6 17/134 2023-05-24T03:28:16.576 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libradosstriper1-2:18.0.0-4167.gfa0e62c4.el8.x86 18/134 2023-05-24T03:28:16.576 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librgw2-2:18.0.0-4167.gfa0e62c4.el8.x86_64 19/134 2023-05-24T03:28:16.576 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4167.gfa0e62c4.el 20/134 2023-05-24T03:28:16.577 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-ceph-common-2:18.0.0-4167.gfa0e62c4.el8. 21/134 2023-05-24T03:28:16.577 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cephfs-2:18.0.0-4167.gfa0e62c4.el8.x86_6 22/134 2023-05-24T03:28:16.577 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rados-2:18.0.0-4167.gfa0e62c4.el8.x86_64 23/134 2023-05-24T03:28:16.577 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rbd-2:18.0.0-4167.gfa0e62c4.el8.x86_64 24/134 2023-05-24T03:28:16.578 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rgw-2:18.0.0-4167.gfa0e62c4.el8.x86_64 25/134 2023-05-24T03:28:16.578 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : rbd-fuse-2:18.0.0-4167.gfa0e62c4.el8.x86_64 26/134 2023-05-24T03:28:16.578 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : rbd-mirror-2:18.0.0-4167.gfa0e62c4.el8.x86_64 27/134 2023-05-24T03:28:16.590 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : rbd-nbd-2:18.0.0-4167.gfa0e62c4.el8.x86_64 28/134 2023-05-24T03:28:16.591 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4167.gfa0e62c4. 29/134 2023-05-24T03:28:16.591 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4167.gfa0e62c4.el8.noa 30/134 2023-05-24T03:28:16.591 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4167.gfa0e62c4.el8.n 31/134 2023-05-24T03:28:16.591 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4167.gfa0 32/134 2023-05-24T03:28:16.592 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4167.gfa0e62c4.el 33/134 2023-05-24T03:28:16.592 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4167.gfa0e62c4.el8.noarch 34/134 2023-05-24T03:28:16.592 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4167.gfa0e62c4.e 35/134 2023-05-24T03:28:16.592 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-volume-2:18.0.0-4167.gfa0e62c4.el8.noarch 36/134 2023-05-24T03:28:16.593 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : cephadm-2:18.0.0-4167.gfa0e62c4.el8.noarch 37/134 2023-05-24T03:28:16.593 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : cephfs-top-2:18.0.0-4167.gfa0e62c4.el8.noarch 38/134 2023-05-24T03:28:16.593 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-05-24T03:28:16.593 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-05-24T03:28:16.594 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-05-24T03:28:16.594 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-05-24T03:28:16.594 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-05-24T03:28:16.594 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-05-24T03:28:16.595 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-05-24T03:28:16.595 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-05-24T03:28:16.595 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-05-24T03:28:16.595 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-05-24T03:28:16.596 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-05-24T03:28:16.596 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-05-24T03:28:16.596 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-05-24T03:28:16.596 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-05-24T03:28:16.597 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-05-24T03:28:16.597 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-05-24T03:28:16.597 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-05-24T03:28:16.598 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-05-24T03:28:16.598 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-05-24T03:28:16.598 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-05-24T03:28:16.598 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-05-24T03:28:16.599 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/134 2023-05-24T03:28:16.599 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-05-24T03:28:16.599 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-05-24T03:28:16.599 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-05-24T03:28:16.600 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-05-24T03:28:16.600 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-05-24T03:28:16.600 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-05-24T03:28:16.600 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-05-24T03:28:16.601 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-05-24T03:28:16.601 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-05-24T03:28:16.601 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-05-24T03:28:16.601 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-05-24T03:28:16.602 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-05-24T03:28:16.602 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-05-24T03:28:16.602 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-05-24T03:28:16.603 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-05-24T03:28:16.603 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-05-24T03:28:16.603 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-05-24T03:28:16.603 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-05-24T03:28:16.604 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-05-24T03:28:16.604 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-05-24T03:28:16.604 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-05-24T03:28:16.604 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-05-24T03:28:16.605 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-05-24T03:28:16.605 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-05-24T03:28:16.605 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-05-24T03:28:16.605 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-05-24T03:28:16.606 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-05-24T03:28:16.606 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-05-24T03:28:16.606 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-05-24T03:28:16.606 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-05-24T03:28:16.607 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-05-24T03:28:16.607 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-05-24T03:28:16.607 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-05-24T03:28:16.607 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-05-24T03:28:16.608 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-05-24T03:28:16.608 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-05-24T03:28:16.608 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-05-24T03:28:16.608 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-05-24T03:28:16.609 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-05-24T03:28:16.609 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-05-24T03:28:16.609 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-05-24T03:28:16.609 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-05-24T03:28:16.610 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-05-24T03:28:16.610 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-05-24T03:28:16.610 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-05-24T03:28:16.610 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-05-24T03:28:16.611 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-05-24T03:28:16.611 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-05-24T03:28:16.611 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-05-24T03:28:16.611 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-05-24T03:28:16.612 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-05-24T03:28:16.612 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-05-24T03:28:16.612 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-05-24T03:28:16.612 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-05-24T03:28:16.613 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-05-24T03:28:16.613 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-05-24T03:28:16.613 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-05-24T03:28:16.613 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-05-24T03:28:16.614 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-05-24T03:28:16.614 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-05-24T03:28:16.614 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-05-24T03:28:16.614 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-05-24T03:28:16.614 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-05-24T03:28:16.615 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-05-24T03:28:16.615 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-05-24T03:28:16.615 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-05-24T03:28:16.615 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-05-24T03:28:16.616 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-05-24T03:28:16.616 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librados2-2:18.0.0-4167.gfa0e62c4.el8.x86_64 129/134 2023-05-24T03:28:16.616 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-05-24T03:28:16.616 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librbd1-2:18.0.0-4167.gfa0e62c4.el8.x86_64 131/134 2023-05-24T03:28:16.617 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-05-24T03:28:16.617 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-05-24T03:28:17.387 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: cephadm-2:18.0.0-4167.gfa0e62c4.el8.noarch 101/134 2023-05-24T03:28:17.585 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephadm-2:18.0.0-4167.gfa0e62c4.el8.noarch 101/134 2023-05-24T03:28:17.736 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4167.gfa0e62c4.e 102/134 2023-05-24T03:28:17.911 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4167.gfa0e62c4. 103/134 2023-05-24T03:28:18.088 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4167.gfa0e62c4.el8.noa 104/134 2023-05-24T03:28:18.304 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4167.gfa0e62c4.el8.noa 104/134 2023-05-24T03:28:18.615 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4167.gfa0e62c4.el8.n 105/134 2023-05-24T03:28:19.237 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-05-24T03:28:19.237 INFO:teuthology.orchestra.run.smithi146.stdout:Last metadata expiration check: 0:02:03 ago on Wed 24 May 2023 03:26:16 AM UTC. 2023-05-24T03:28:19.574 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4167.gfa0e62c4.el8.n 105/134 2023-05-24T03:28:19.763 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4167.gfa0 106/134 2023-05-24T03:28:19.854 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4167.gfa0 106/134 2023-05-24T03:28:20.210 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4167.gfa0e62c4.el 107/134 2023-05-24T03:28:20.390 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-2:18.0.0-4167.gfa0e62c4.el8.x86_64 108/134 2023-05-24T03:28:20.425 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4167.gfa0e62c4.el8.x86_64 108/134 2023-05-24T03:28:20.629 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-rook-2:18.0.0-4167.gfa0e62c4.el8.noarch 109/134 2023-05-24T03:28:20.640 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4167.gfa0e62c4.el8.noarch 109/134 2023-05-24T03:28:21.896 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-2:18.0.0-4167.gfa0e62c4.el8.x86_64 110/134 2023-05-24T03:28:21.916 INFO:teuthology.orchestra.run.smithi146.stdout:Installed products updated. 2023-05-24T03:28:22.137 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:28:22.137 INFO:teuthology.orchestra.run.smithi146.stdout:Upgraded: 2023-05-24T03:28:22.137 INFO:teuthology.orchestra.run.smithi146.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-05-24T03:28:22.138 INFO:teuthology.orchestra.run.smithi146.stdout: librados2-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:22.138 INFO:teuthology.orchestra.run.smithi146.stdout: librbd1-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:22.138 INFO:teuthology.orchestra.run.smithi146.stdout:Installed: 2023-05-24T03:28:22.138 INFO:teuthology.orchestra.run.smithi146.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-05-24T03:28:22.138 INFO:teuthology.orchestra.run.smithi146.stdout: automake-1.16.1-7.el8.noarch 2023-05-24T03:28:22.138 INFO:teuthology.orchestra.run.smithi146.stdout: bison-3.0.4-10.el8.x86_64 2023-05-24T03:28:22.138 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:22.139 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-base-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:22.139 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-common-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:22.139 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-fuse-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:22.139 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-grafana-dashboards-2:18.0.0-4167.gfa0e62c4.el8.noarch 2023-05-24T03:28:22.139 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-immutable-object-cache-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:22.139 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mds-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:22.139 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:22.140 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-cephadm-2:18.0.0-4167.gfa0e62c4.el8.noarch 2023-05-24T03:28:22.140 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-dashboard-2:18.0.0-4167.gfa0e62c4.el8.noarch 2023-05-24T03:28:22.140 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4167.gfa0e62c4.el8.noarch 2023-05-24T03:28:22.140 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-modules-core-2:18.0.0-4167.gfa0e62c4.el8.noarch 2023-05-24T03:28:22.140 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-rook-2:18.0.0-4167.gfa0e62c4.el8.noarch 2023-05-24T03:28:22.140 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mon-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:22.140 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-osd-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:22.140 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-prometheus-alerts-2:18.0.0-4167.gfa0e62c4.el8.noarch 2023-05-24T03:28:22.141 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-radosgw-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:22.141 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-selinux-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:22.141 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-test-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:22.141 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-volume-2:18.0.0-4167.gfa0e62c4.el8.noarch 2023-05-24T03:28:22.141 INFO:teuthology.orchestra.run.smithi146.stdout: cephadm-2:18.0.0-4167.gfa0e62c4.el8.noarch 2023-05-24T03:28:22.141 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-mirror-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:22.141 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-top-2:18.0.0-4167.gfa0e62c4.el8.noarch 2023-05-24T03:28:22.142 INFO:teuthology.orchestra.run.smithi146.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-05-24T03:28:22.142 INFO:teuthology.orchestra.run.smithi146.stdout: flex-2.6.1-9.el8.x86_64 2023-05-24T03:28:22.142 INFO:teuthology.orchestra.run.smithi146.stdout: fuse-2.9.7-15.el8.x86_64 2023-05-24T03:28:22.142 INFO:teuthology.orchestra.run.smithi146.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-05-24T03:28:22.142 INFO:teuthology.orchestra.run.smithi146.stdout: jq-1.6-3.el8.x86_64 2023-05-24T03:28:22.142 INFO:teuthology.orchestra.run.smithi146.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-05-24T03:28:22.142 INFO:teuthology.orchestra.run.smithi146.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-05-24T03:28:22.142 INFO:teuthology.orchestra.run.smithi146.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-05-24T03:28:22.143 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs-devel-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:22.143 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs2-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:22.143 INFO:teuthology.orchestra.run.smithi146.stdout: libcephsqlite-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:22.143 INFO:teuthology.orchestra.run.smithi146.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-05-24T03:28:22.143 INFO:teuthology.orchestra.run.smithi146.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-05-24T03:28:22.143 INFO:teuthology.orchestra.run.smithi146.stdout: liboath-2.6.2-3.el8.x86_64 2023-05-24T03:28:22.143 INFO:teuthology.orchestra.run.smithi146.stdout: libpq-13.5-1.el8.x86_64 2023-05-24T03:28:22.143 INFO:teuthology.orchestra.run.smithi146.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-05-24T03:28:22.144 INFO:teuthology.orchestra.run.smithi146.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-05-24T03:28:22.144 INFO:teuthology.orchestra.run.smithi146.stdout: librados-devel-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:22.144 INFO:teuthology.orchestra.run.smithi146.stdout: libradosstriper1-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:22.144 INFO:teuthology.orchestra.run.smithi146.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-05-24T03:28:22.144 INFO:teuthology.orchestra.run.smithi146.stdout: librgw2-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:22.144 INFO:teuthology.orchestra.run.smithi146.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-05-24T03:28:22.144 INFO:teuthology.orchestra.run.smithi146.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-05-24T03:28:22.145 INFO:teuthology.orchestra.run.smithi146.stdout: libtool-2.4.6-25.el8.x86_64 2023-05-24T03:28:22.145 INFO:teuthology.orchestra.run.smithi146.stdout: libunwind-1.3.1-3.el8.x86_64 2023-05-24T03:28:22.145 INFO:teuthology.orchestra.run.smithi146.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-05-24T03:28:22.145 INFO:teuthology.orchestra.run.smithi146.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-05-24T03:28:22.145 INFO:teuthology.orchestra.run.smithi146.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-05-24T03:28:22.145 INFO:teuthology.orchestra.run.smithi146.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-05-24T03:28:22.145 INFO:teuthology.orchestra.run.smithi146.stdout: openblas-0.3.15-3.el8.x86_64 2023-05-24T03:28:22.145 INFO:teuthology.orchestra.run.smithi146.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-05-24T03:28:22.146 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-05-24T03:28:22.146 INFO:teuthology.orchestra.run.smithi146.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-05-24T03:28:22.146 INFO:teuthology.orchestra.run.smithi146.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-05-24T03:28:22.146 INFO:teuthology.orchestra.run.smithi146.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-05-24T03:28:22.146 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-05-24T03:28:22.146 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-05-24T03:28:22.146 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-05-24T03:28:22.147 INFO:teuthology.orchestra.run.smithi146.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-05-24T03:28:22.147 INFO:teuthology.orchestra.run.smithi146.stdout: python3-babel-2.5.1-7.el8.noarch 2023-05-24T03:28:22.147 INFO:teuthology.orchestra.run.smithi146.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-05-24T03:28:22.147 INFO:teuthology.orchestra.run.smithi146.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-05-24T03:28:22.147 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-05-24T03:28:22.148 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-argparse-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:22.148 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-common-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:22.148 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cephfs-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:22.148 INFO:teuthology.orchestra.run.smithi146.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-05-24T03:28:22.148 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-05-24T03:28:22.148 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-05-24T03:28:22.148 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-05-24T03:28:22.148 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-05-24T03:28:22.149 INFO:teuthology.orchestra.run.smithi146.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-05-24T03:28:22.149 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-6.2-6.el8.noarch 2023-05-24T03:28:22.149 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-05-24T03:28:22.149 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-05-24T03:28:22.149 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-05-24T03:28:22.149 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-05-24T03:28:22.149 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-05-24T03:28:22.149 INFO:teuthology.orchestra.run.smithi146.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-05-24T03:28:22.150 INFO:teuthology.orchestra.run.smithi146.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-05-24T03:28:22.150 INFO:teuthology.orchestra.run.smithi146.stdout: python3-mako-1.0.6-13.el8.noarch 2023-05-24T03:28:22.150 INFO:teuthology.orchestra.run.smithi146.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-05-24T03:28:22.150 INFO:teuthology.orchestra.run.smithi146.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-05-24T03:28:22.150 INFO:teuthology.orchestra.run.smithi146.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-05-24T03:28:22.151 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-05-24T03:28:22.151 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-05-24T03:28:22.151 INFO:teuthology.orchestra.run.smithi146.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-05-24T03:28:22.151 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-05-24T03:28:22.151 INFO:teuthology.orchestra.run.smithi146.stdout: python3-portend-2.6-1.el8.noarch 2023-05-24T03:28:22.152 INFO:teuthology.orchestra.run.smithi146.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-05-24T03:28:22.152 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-05-24T03:28:22.152 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-05-24T03:28:22.152 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-05-24T03:28:22.152 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pycparser-2.14-14.el8.noarch 2023-05-24T03:28:22.152 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pytz-2017.2-9.el8.noarch 2023-05-24T03:28:22.152 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rados-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:22.153 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rbd-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:22.153 INFO:teuthology.orchestra.run.smithi146.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-05-24T03:28:22.153 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-05-24T03:28:22.153 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rgw-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:22.153 INFO:teuthology.orchestra.run.smithi146.stdout: python3-routes-2.4.1-12.el8.noarch 2023-05-24T03:28:22.154 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rsa-4.8-1.el8.noarch 2023-05-24T03:28:22.154 INFO:teuthology.orchestra.run.smithi146.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-05-24T03:28:22.154 INFO:teuthology.orchestra.run.smithi146.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-05-24T03:28:22.154 INFO:teuthology.orchestra.run.smithi146.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-05-24T03:28:22.154 INFO:teuthology.orchestra.run.smithi146.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-05-24T03:28:22.154 INFO:teuthology.orchestra.run.smithi146.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-05-24T03:28:22.154 INFO:teuthology.orchestra.run.smithi146.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-05-24T03:28:22.154 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-05-24T03:28:22.155 INFO:teuthology.orchestra.run.smithi146.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-05-24T03:28:22.155 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-05-24T03:28:22.155 INFO:teuthology.orchestra.run.smithi146.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-05-24T03:28:22.155 INFO:teuthology.orchestra.run.smithi146.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-05-24T03:28:22.155 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-fuse-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:22.155 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-mirror-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:22.155 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-nbd-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:22.155 INFO:teuthology.orchestra.run.smithi146.stdout: socat-1.7.4.1-1.el8.x86_64 2023-05-24T03:28:22.156 INFO:teuthology.orchestra.run.smithi146.stdout: thrift-0.13.0-2.el8.x86_64 2023-05-24T03:28:22.156 INFO:teuthology.orchestra.run.smithi146.stdout: uuid-1.6.2-43.el8.x86_64 2023-05-24T03:28:22.156 INFO:teuthology.orchestra.run.smithi146.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-05-24T03:28:22.156 INFO:teuthology.orchestra.run.smithi146.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-05-24T03:28:22.157 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-radosgw-2:18.0.0-4167.gfa0e62c4.el8.x86_64 111/134 2023-05-24T03:28:22.157 INFO:teuthology.orchestra.run.smithi146.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-05-24T03:28:22.157 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:28:22.157 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2023-05-24T03:28:22.182 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4167.gfa0e62c4.el8.x86_64 111/134 2023-05-24T03:28:22.338 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4167.gfa0e6 112/134 2023-05-24T03:28:22.350 DEBUG:teuthology.parallel:result is None 2023-05-24T03:28:22.391 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4167.gfa0e6 112/134 2023-05-24T03:28:22.538 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephfs-mirror-2:18.0.0-4167.gfa0e62c4.el8.x86_64 113/134 2023-05-24T03:28:22.882 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4167.gfa0e62c4.el8.x86_64 113/134 2023-05-24T03:28:23.030 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-mirror-2:18.0.0-4167.gfa0e62c4.el8.x86_64 114/134 2023-05-24T03:28:26.936 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4167.gfa0e62c4.el8.x86_64 114/134 2023-05-24T03:28:27.849 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-test-2:18.0.0-4167.gfa0e62c4.el8.x86_64 115/134 2023-05-24T03:28:28.202 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-05-24T03:28:28.358 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-fuse-2:18.0.0-4167.gfa0e62c4.el8.x86_64 117/134 2023-05-24T03:28:28.649 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-05-24T03:28:28.803 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-05-24T03:28:28.994 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-05-24T03:28:29.274 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-05-24T03:28:29.441 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephfs-devel-2:18.0.0-4167.gfa0e62c4.el8.x86_ 121/134 2023-05-24T03:28:29.613 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-05-24T03:28:31.766 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-05-24T03:28:32.045 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-05-24T03:28:32.062 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-05-24T03:28:32.275 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephfs-top-2:18.0.0-4167.gfa0e62c4.el8.noarch 124/134 2023-05-24T03:28:32.494 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-fuse-2:18.0.0-4167.gfa0e62c4.el8.x86_64 125/134 2023-05-24T03:28:32.777 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-nbd-2:18.0.0-4167.gfa0e62c4.el8.x86_64 126/134 2023-05-24T03:28:33.139 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-05-24T03:28:33.327 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-05-24T03:28:33.437 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-05-24T03:28:33.636 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-05-24T03:28:33.648 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-05-24T03:28:33.811 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-05-24T03:28:33.819 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-05-24T03:28:33.980 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-05-24T03:28:33.980 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-05-24T03:28:34.172 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-05-24T03:28:34.173 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-05-24T03:28:34.444 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-05-24T03:28:34.593 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-05-24T03:28:34.878 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-05-24T03:28:34.878 INFO:teuthology.orchestra.run.smithi151.stdout:[/usr/lib/tmpfiles.d/journal-nocow.conf:26] Failed to resolve specifier: uninitialized /etc detected, skipping 2023-05-24T03:28:34.878 INFO:teuthology.orchestra.run.smithi151.stdout:All rules containing unresolvable specifiers will be skipped. 2023-05-24T03:28:34.878 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-24T03:28:35.095 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-2:18.0.0-4167.gfa0e62c4.el8.x86_64 1/134 2023-05-24T03:28:35.095 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-base-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2/134 2023-05-24T03:28:35.095 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-common-2:18.0.0-4167.gfa0e62c4.el8.x86_64 3/134 2023-05-24T03:28:35.096 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-fuse-2:18.0.0-4167.gfa0e62c4.el8.x86_64 4/134 2023-05-24T03:28:35.096 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4167.gfa0e6 5/134 2023-05-24T03:28:35.096 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mds-2:18.0.0-4167.gfa0e62c4.el8.x86_64 6/134 2023-05-24T03:28:35.096 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-2:18.0.0-4167.gfa0e62c4.el8.x86_64 7/134 2023-05-24T03:28:35.096 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mon-2:18.0.0-4167.gfa0e62c4.el8.x86_64 8/134 2023-05-24T03:28:35.096 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-osd-2:18.0.0-4167.gfa0e62c4.el8.x86_64 9/134 2023-05-24T03:28:35.096 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-radosgw-2:18.0.0-4167.gfa0e62c4.el8.x86_64 10/134 2023-05-24T03:28:35.097 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-selinux-2:18.0.0-4167.gfa0e62c4.el8.x86_64 11/134 2023-05-24T03:28:35.097 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-test-2:18.0.0-4167.gfa0e62c4.el8.x86_64 12/134 2023-05-24T03:28:35.097 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephfs-mirror-2:18.0.0-4167.gfa0e62c4.el8.x86_64 13/134 2023-05-24T03:28:35.097 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephfs-devel-2:18.0.0-4167.gfa0e62c4.el8.x86_ 14/134 2023-05-24T03:28:35.097 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephfs2-2:18.0.0-4167.gfa0e62c4.el8.x86_64 15/134 2023-05-24T03:28:35.097 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephsqlite-2:18.0.0-4167.gfa0e62c4.el8.x86_64 16/134 2023-05-24T03:28:35.097 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados-devel-2:18.0.0-4167.gfa0e62c4.el8.x86_6 17/134 2023-05-24T03:28:35.097 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libradosstriper1-2:18.0.0-4167.gfa0e62c4.el8.x86 18/134 2023-05-24T03:28:35.098 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librgw2-2:18.0.0-4167.gfa0e62c4.el8.x86_64 19/134 2023-05-24T03:28:35.098 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4167.gfa0e62c4.el 20/134 2023-05-24T03:28:35.098 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-ceph-common-2:18.0.0-4167.gfa0e62c4.el8. 21/134 2023-05-24T03:28:35.098 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cephfs-2:18.0.0-4167.gfa0e62c4.el8.x86_6 22/134 2023-05-24T03:28:35.098 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rados-2:18.0.0-4167.gfa0e62c4.el8.x86_64 23/134 2023-05-24T03:28:35.098 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rbd-2:18.0.0-4167.gfa0e62c4.el8.x86_64 24/134 2023-05-24T03:28:35.105 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rgw-2:18.0.0-4167.gfa0e62c4.el8.x86_64 25/134 2023-05-24T03:28:35.106 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-fuse-2:18.0.0-4167.gfa0e62c4.el8.x86_64 26/134 2023-05-24T03:28:35.106 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-mirror-2:18.0.0-4167.gfa0e62c4.el8.x86_64 27/134 2023-05-24T03:28:35.106 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-nbd-2:18.0.0-4167.gfa0e62c4.el8.x86_64 28/134 2023-05-24T03:28:35.106 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4167.gfa0e62c4. 29/134 2023-05-24T03:28:35.106 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4167.gfa0e62c4.el8.noa 30/134 2023-05-24T03:28:35.106 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4167.gfa0e62c4.el8.n 31/134 2023-05-24T03:28:35.106 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4167.gfa0 32/134 2023-05-24T03:28:35.107 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4167.gfa0e62c4.el 33/134 2023-05-24T03:28:35.107 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4167.gfa0e62c4.el8.noarch 34/134 2023-05-24T03:28:35.107 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4167.gfa0e62c4.e 35/134 2023-05-24T03:28:35.107 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-volume-2:18.0.0-4167.gfa0e62c4.el8.noarch 36/134 2023-05-24T03:28:35.107 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephadm-2:18.0.0-4167.gfa0e62c4.el8.noarch 37/134 2023-05-24T03:28:35.107 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephfs-top-2:18.0.0-4167.gfa0e62c4.el8.noarch 38/134 2023-05-24T03:28:35.107 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-05-24T03:28:35.108 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-05-24T03:28:35.108 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-05-24T03:28:35.108 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-05-24T03:28:35.108 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-05-24T03:28:35.108 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-05-24T03:28:35.108 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-05-24T03:28:35.108 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-05-24T03:28:35.108 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-05-24T03:28:35.109 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-05-24T03:28:35.109 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-05-24T03:28:35.109 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-05-24T03:28:35.109 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-05-24T03:28:35.109 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-05-24T03:28:35.109 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-05-24T03:28:35.109 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-05-24T03:28:35.109 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-05-24T03:28:35.110 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-05-24T03:28:35.110 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-05-24T03:28:35.110 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-05-24T03:28:35.110 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-05-24T03:28:35.110 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/134 2023-05-24T03:28:35.110 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-05-24T03:28:35.110 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-05-24T03:28:35.111 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-05-24T03:28:35.111 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-05-24T03:28:35.111 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-05-24T03:28:35.111 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-05-24T03:28:35.111 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-05-24T03:28:35.111 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-05-24T03:28:35.111 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-05-24T03:28:35.111 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-05-24T03:28:35.112 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-05-24T03:28:35.112 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-05-24T03:28:35.112 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-05-24T03:28:35.112 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-05-24T03:28:35.112 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-05-24T03:28:35.112 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-05-24T03:28:35.112 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-05-24T03:28:35.113 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-05-24T03:28:35.113 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-05-24T03:28:35.113 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-05-24T03:28:35.113 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-05-24T03:28:35.113 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-05-24T03:28:35.113 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-05-24T03:28:35.113 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-05-24T03:28:35.113 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-05-24T03:28:35.114 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-05-24T03:28:35.114 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-05-24T03:28:35.114 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-05-24T03:28:35.114 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-05-24T03:28:35.114 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-05-24T03:28:35.114 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-05-24T03:28:35.114 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-05-24T03:28:35.114 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-05-24T03:28:35.115 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-05-24T03:28:35.115 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-05-24T03:28:35.115 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-05-24T03:28:35.115 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-05-24T03:28:35.115 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-05-24T03:28:35.115 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-05-24T03:28:35.115 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-05-24T03:28:35.115 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-05-24T03:28:35.116 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-05-24T03:28:35.116 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-05-24T03:28:35.116 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-05-24T03:28:35.116 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-05-24T03:28:35.116 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-05-24T03:28:35.116 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-05-24T03:28:35.116 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-05-24T03:28:35.116 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-05-24T03:28:35.117 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-05-24T03:28:35.117 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-05-24T03:28:35.117 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-05-24T03:28:35.117 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-05-24T03:28:35.117 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-05-24T03:28:35.117 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-05-24T03:28:35.118 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-05-24T03:28:35.118 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-05-24T03:28:35.118 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-05-24T03:28:35.118 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-05-24T03:28:35.118 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-05-24T03:28:35.118 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-05-24T03:28:35.118 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-05-24T03:28:35.118 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-05-24T03:28:35.119 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-05-24T03:28:35.119 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-05-24T03:28:35.119 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-05-24T03:28:35.119 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-05-24T03:28:35.119 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-05-24T03:28:35.119 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados2-2:18.0.0-4167.gfa0e62c4.el8.x86_64 129/134 2023-05-24T03:28:35.119 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-05-24T03:28:35.119 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librbd1-2:18.0.0-4167.gfa0e62c4.el8.x86_64 131/134 2023-05-24T03:28:35.120 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-05-24T03:28:35.120 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-05-24T03:28:37.824 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-05-24T03:28:37.825 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:15 ago on Wed 24 May 2023 03:26:22 AM UTC. 2023-05-24T03:28:40.401 INFO:teuthology.orchestra.run.smithi151.stdout:Installed products updated. 2023-05-24T03:28:40.626 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-24T03:28:40.626 INFO:teuthology.orchestra.run.smithi151.stdout:Upgraded: 2023-05-24T03:28:40.626 INFO:teuthology.orchestra.run.smithi151.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-05-24T03:28:40.626 INFO:teuthology.orchestra.run.smithi151.stdout: librados2-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:40.627 INFO:teuthology.orchestra.run.smithi151.stdout: librbd1-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:40.627 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2023-05-24T03:28:40.627 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-05-24T03:28:40.627 INFO:teuthology.orchestra.run.smithi151.stdout: automake-1.16.1-7.el8.noarch 2023-05-24T03:28:40.627 INFO:teuthology.orchestra.run.smithi151.stdout: bison-3.0.4-10.el8.x86_64 2023-05-24T03:28:40.627 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:40.628 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-base-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:40.628 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-common-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:40.628 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-fuse-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:40.628 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-grafana-dashboards-2:18.0.0-4167.gfa0e62c4.el8.noarch 2023-05-24T03:28:40.628 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-immutable-object-cache-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:40.628 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mds-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:40.629 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:40.629 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-cephadm-2:18.0.0-4167.gfa0e62c4.el8.noarch 2023-05-24T03:28:40.629 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-dashboard-2:18.0.0-4167.gfa0e62c4.el8.noarch 2023-05-24T03:28:40.629 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4167.gfa0e62c4.el8.noarch 2023-05-24T03:28:40.629 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-modules-core-2:18.0.0-4167.gfa0e62c4.el8.noarch 2023-05-24T03:28:40.629 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-rook-2:18.0.0-4167.gfa0e62c4.el8.noarch 2023-05-24T03:28:40.629 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mon-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:40.629 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-osd-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:40.630 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-prometheus-alerts-2:18.0.0-4167.gfa0e62c4.el8.noarch 2023-05-24T03:28:40.630 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-radosgw-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:40.630 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-selinux-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:40.630 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-test-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:40.630 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-volume-2:18.0.0-4167.gfa0e62c4.el8.noarch 2023-05-24T03:28:40.630 INFO:teuthology.orchestra.run.smithi151.stdout: cephadm-2:18.0.0-4167.gfa0e62c4.el8.noarch 2023-05-24T03:28:40.630 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-mirror-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:40.630 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-top-2:18.0.0-4167.gfa0e62c4.el8.noarch 2023-05-24T03:28:40.631 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-05-24T03:28:40.631 INFO:teuthology.orchestra.run.smithi151.stdout: flex-2.6.1-9.el8.x86_64 2023-05-24T03:28:40.631 INFO:teuthology.orchestra.run.smithi151.stdout: fuse-2.9.7-15.el8.x86_64 2023-05-24T03:28:40.631 INFO:teuthology.orchestra.run.smithi151.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-05-24T03:28:40.631 INFO:teuthology.orchestra.run.smithi151.stdout: jq-1.6-3.el8.x86_64 2023-05-24T03:28:40.631 INFO:teuthology.orchestra.run.smithi151.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-05-24T03:28:40.631 INFO:teuthology.orchestra.run.smithi151.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-05-24T03:28:40.632 INFO:teuthology.orchestra.run.smithi151.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-05-24T03:28:40.632 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs-devel-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:40.632 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs2-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:40.632 INFO:teuthology.orchestra.run.smithi151.stdout: libcephsqlite-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:40.632 INFO:teuthology.orchestra.run.smithi151.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-05-24T03:28:40.632 INFO:teuthology.orchestra.run.smithi151.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-05-24T03:28:40.632 INFO:teuthology.orchestra.run.smithi151.stdout: liboath-2.6.2-3.el8.x86_64 2023-05-24T03:28:40.632 INFO:teuthology.orchestra.run.smithi151.stdout: libpq-13.5-1.el8.x86_64 2023-05-24T03:28:40.633 INFO:teuthology.orchestra.run.smithi151.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-05-24T03:28:40.633 INFO:teuthology.orchestra.run.smithi151.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-05-24T03:28:40.633 INFO:teuthology.orchestra.run.smithi151.stdout: librados-devel-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:40.633 INFO:teuthology.orchestra.run.smithi151.stdout: libradosstriper1-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:40.633 INFO:teuthology.orchestra.run.smithi151.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-05-24T03:28:40.633 INFO:teuthology.orchestra.run.smithi151.stdout: librgw2-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:40.634 INFO:teuthology.orchestra.run.smithi151.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-05-24T03:28:40.634 INFO:teuthology.orchestra.run.smithi151.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-05-24T03:28:40.634 INFO:teuthology.orchestra.run.smithi151.stdout: libtool-2.4.6-25.el8.x86_64 2023-05-24T03:28:40.634 INFO:teuthology.orchestra.run.smithi151.stdout: libunwind-1.3.1-3.el8.x86_64 2023-05-24T03:28:40.634 INFO:teuthology.orchestra.run.smithi151.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-05-24T03:28:40.634 INFO:teuthology.orchestra.run.smithi151.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-05-24T03:28:40.634 INFO:teuthology.orchestra.run.smithi151.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-05-24T03:28:40.634 INFO:teuthology.orchestra.run.smithi151.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-05-24T03:28:40.635 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-0.3.15-3.el8.x86_64 2023-05-24T03:28:40.635 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-05-24T03:28:40.635 INFO:teuthology.orchestra.run.smithi151.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-05-24T03:28:40.635 INFO:teuthology.orchestra.run.smithi151.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-05-24T03:28:40.635 INFO:teuthology.orchestra.run.smithi151.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-05-24T03:28:40.635 INFO:teuthology.orchestra.run.smithi151.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-05-24T03:28:40.635 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-05-24T03:28:40.635 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-05-24T03:28:40.636 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-05-24T03:28:40.636 INFO:teuthology.orchestra.run.smithi151.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-05-24T03:28:40.636 INFO:teuthology.orchestra.run.smithi151.stdout: python3-babel-2.5.1-7.el8.noarch 2023-05-24T03:28:40.636 INFO:teuthology.orchestra.run.smithi151.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-05-24T03:28:40.636 INFO:teuthology.orchestra.run.smithi151.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-05-24T03:28:40.636 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-05-24T03:28:40.636 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-argparse-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:40.637 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-common-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:40.637 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cephfs-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:40.637 INFO:teuthology.orchestra.run.smithi151.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-05-24T03:28:40.637 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-05-24T03:28:40.637 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-05-24T03:28:40.637 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-05-24T03:28:40.637 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-05-24T03:28:40.638 INFO:teuthology.orchestra.run.smithi151.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-05-24T03:28:40.638 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-6.2-6.el8.noarch 2023-05-24T03:28:40.638 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-05-24T03:28:40.638 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-05-24T03:28:40.639 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-05-24T03:28:40.639 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-05-24T03:28:40.639 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-05-24T03:28:40.639 INFO:teuthology.orchestra.run.smithi151.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-05-24T03:28:40.639 INFO:teuthology.orchestra.run.smithi151.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-05-24T03:28:40.639 INFO:teuthology.orchestra.run.smithi151.stdout: python3-mako-1.0.6-13.el8.noarch 2023-05-24T03:28:40.639 INFO:teuthology.orchestra.run.smithi151.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-05-24T03:28:40.639 INFO:teuthology.orchestra.run.smithi151.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-05-24T03:28:40.640 INFO:teuthology.orchestra.run.smithi151.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-05-24T03:28:40.640 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-05-24T03:28:40.640 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-05-24T03:28:40.640 INFO:teuthology.orchestra.run.smithi151.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-05-24T03:28:40.640 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-05-24T03:28:40.640 INFO:teuthology.orchestra.run.smithi151.stdout: python3-portend-2.6-1.el8.noarch 2023-05-24T03:28:40.640 INFO:teuthology.orchestra.run.smithi151.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-05-24T03:28:40.641 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-05-24T03:28:40.641 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-05-24T03:28:40.641 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-05-24T03:28:40.641 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pycparser-2.14-14.el8.noarch 2023-05-24T03:28:40.641 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pytz-2017.2-9.el8.noarch 2023-05-24T03:28:40.641 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rados-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:40.641 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rbd-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:40.641 INFO:teuthology.orchestra.run.smithi151.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-05-24T03:28:40.642 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-05-24T03:28:40.642 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rgw-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:40.642 INFO:teuthology.orchestra.run.smithi151.stdout: python3-routes-2.4.1-12.el8.noarch 2023-05-24T03:28:40.642 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rsa-4.8-1.el8.noarch 2023-05-24T03:28:40.642 INFO:teuthology.orchestra.run.smithi151.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-05-24T03:28:40.642 INFO:teuthology.orchestra.run.smithi151.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-05-24T03:28:40.642 INFO:teuthology.orchestra.run.smithi151.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-05-24T03:28:40.643 INFO:teuthology.orchestra.run.smithi151.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-05-24T03:28:40.643 INFO:teuthology.orchestra.run.smithi151.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-05-24T03:28:40.643 INFO:teuthology.orchestra.run.smithi151.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-05-24T03:28:40.643 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-05-24T03:28:40.643 INFO:teuthology.orchestra.run.smithi151.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-05-24T03:28:40.643 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-05-24T03:28:40.643 INFO:teuthology.orchestra.run.smithi151.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-05-24T03:28:40.643 INFO:teuthology.orchestra.run.smithi151.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-05-24T03:28:40.644 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-fuse-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:40.644 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-mirror-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:40.644 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-nbd-2:18.0.0-4167.gfa0e62c4.el8.x86_64 2023-05-24T03:28:40.644 INFO:teuthology.orchestra.run.smithi151.stdout: socat-1.7.4.1-1.el8.x86_64 2023-05-24T03:28:40.644 INFO:teuthology.orchestra.run.smithi151.stdout: thrift-0.13.0-2.el8.x86_64 2023-05-24T03:28:40.645 INFO:teuthology.orchestra.run.smithi151.stdout: uuid-1.6.2-43.el8.x86_64 2023-05-24T03:28:40.645 INFO:teuthology.orchestra.run.smithi151.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-05-24T03:28:40.645 INFO:teuthology.orchestra.run.smithi151.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-05-24T03:28:40.645 INFO:teuthology.orchestra.run.smithi151.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-05-24T03:28:40.645 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-24T03:28:40.646 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2023-05-24T03:28:40.820 DEBUG:teuthology.parallel:result is None 2023-05-24T03:28:40.821 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=fa0e62c4a1d8e4a737d9cbe50224f70009b79b28 2023-05-24T03:28:41.033 DEBUG:teuthology.orchestra.run.smithi146:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-05-24T03:28:41.062 INFO:teuthology.orchestra.run.smithi146.stdout:18.0.0-4167.gfa0e62c4.el8 2023-05-24T03:28:41.063 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4167.gfa0e62c4.el8 2023-05-24T03:28:41.064 INFO:teuthology.task.install:The correct ceph version 18.0.0-4167.gfa0e62c4 is installed. 2023-05-24T03:28:41.065 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=fa0e62c4a1d8e4a737d9cbe50224f70009b79b28 2023-05-24T03:28:41.254 DEBUG:teuthology.orchestra.run.smithi151:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-05-24T03:28:41.278 INFO:teuthology.orchestra.run.smithi151.stdout:18.0.0-4167.gfa0e62c4.el8 2023-05-24T03:28:41.279 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4167.gfa0e62c4.el8 2023-05-24T03:28:41.279 INFO:teuthology.task.install:The correct ceph version 18.0.0-4167.gfa0e62c4 is installed. 2023-05-24T03:28:41.279 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-05-24T03:28:41.280 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-05-24T03:28:41.280 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-05-24T03:28:41.327 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-24T03:28:41.328 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-05-24T03:28:41.368 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-05-24T03:28:41.368 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-05-24T03:28:41.368 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/daemon-helper 2023-05-24T03:28:41.398 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-05-24T03:28:41.467 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-24T03:28:41.467 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/daemon-helper 2023-05-24T03:28:41.494 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-05-24T03:28:41.560 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-05-24T03:28:41.561 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-05-24T03:28:41.561 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/adjust-ulimits 2023-05-24T03:28:41.589 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-05-24T03:28:41.656 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-24T03:28:41.657 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/adjust-ulimits 2023-05-24T03:28:41.683 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-05-24T03:28:41.749 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-05-24T03:28:41.750 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-05-24T03:28:41.750 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/stdin-killer 2023-05-24T03:28:41.777 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-05-24T03:28:41.844 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-24T03:28:41.845 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/stdin-killer 2023-05-24T03:28:41.870 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-05-24T03:28:41.936 INFO:teuthology.run_tasks:Running task ceph... 2023-05-24T03:28:42.021 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-05-24T03:28:42.022 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 777 /var/log/ceph 2023-05-24T03:28:42.024 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 777 /var/log/ceph 2023-05-24T03:28:42.050 INFO:tasks.ceph:Disabling ceph logrotate... 2023-05-24T03:28:42.051 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /etc/logrotate.d/ceph 2023-05-24T03:28:42.093 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /etc/logrotate.d/ceph 2023-05-24T03:28:42.118 INFO:tasks.ceph:Creating extra log directories... 2023-05-24T03:28:42.119 DEBUG:teuthology.orchestra.run.smithi146:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-05-24T03:28:42.159 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-05-24T03:28:42.194 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-05-24T03:28:42.194 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-05-24T03:28:42.194 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-05-24T03:28:42.195 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-05-24T03:28:42.195 DEBUG:teuthology.orchestra.run.smithi146:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-05-24T03:28:42.242 DEBUG:teuthology.orchestra.run.smithi146:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-05-24T03:28:42.594 DEBUG:teuthology.orchestra.run.smithi146:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-05-24T03:28:42.621 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-24T03:28:42.622 DEBUG:teuthology.orchestra.run.smithi151:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-05-24T03:28:42.639 DEBUG:teuthology.orchestra.run.smithi151:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-05-24T03:28:42.774 DEBUG:teuthology.orchestra.run.smithi151:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-05-24T03:28:42.808 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-05-24T03:28:42.809 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-05-24T03:28:42.809 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi/7284286', 'branch': 'wip-pdonnell-testing-20230523.134409', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/workunit/quota}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7284286', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20230523.134409'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'fa0e62c4a1d8e4a737d9cbe50224f70009b79b28'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'fa0e62c4a1d8e4a737d9cbe50224f70009b79b28'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20230523.134409', 'sha1': 'fa0e62c4a1d8e4a737d9cbe50224f70009b79b28'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 7650, 'sha1': 'fa0e62c4a1d8e4a737d9cbe50224f70009b79b28', 'sleep_before_teardown': 0, 'subset': '449/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20230523.134409', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'fa0e62c4a1d8e4a737d9cbe50224f70009b79b28', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi146.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac=', 'smithi151.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'fa0e62c4a1d8e4a737d9cbe50224f70009b79b28'}}, {'ceph': None}, {'kclient': None}, {'workunit': {'clients': {'all': ['fs/quota']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'stdin-killer', 'teuthology_sha1': 'c6e0984e7e7716eedf6039f15c6a9d1043e0c5f2', 'timestamp': '2023-05-23_18:20:18', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-05-24T03:28:42.810 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-05-24T03:28:42.812 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-05-24T03:28:42.859 DEBUG:teuthology.orchestra.run.smithi146:> sudo install -d -m0777 -- /var/run/ceph 2023-05-24T03:28:42.869 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -d -m0777 -- /var/run/ceph 2023-05-24T03:28:42.926 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-05-24T03:28:42.927 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/scratch_devs of=/dev/stdout 2023-05-24T03:28:42.951 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-05-24T03:28:42.951 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_1 2023-05-24T03:28:43.009 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-05-24T03:28:43.009 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-24T03:28:43.009 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 6h/6d Inode: 370851 Links: 1 2023-05-24T03:28:43.010 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-24T03:28:43.010 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2023-05-24T03:28:43.010 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2023-05-24 03:28:16.240122209 +0000 2023-05-24T03:28:43.010 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2023-05-24 03:23:13.885752771 +0000 2023-05-24T03:28:43.010 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2023-05-24 03:23:13.885752771 +0000 2023-05-24T03:28:43.010 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: - 2023-05-24T03:28:43.011 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-05-24T03:28:43.075 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-05-24T03:28:43.075 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-05-24T03:28:43.075 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000253643 s, 2.0 MB/s 2023-05-24T03:28:43.077 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-05-24T03:28:43.134 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_2 2023-05-24T03:28:43.191 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-05-24T03:28:43.191 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-24T03:28:43.191 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 6h/6d Inode: 370893 Links: 1 2023-05-24T03:28:43.191 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-24T03:28:43.191 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2023-05-24T03:28:43.191 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2023-05-24 03:28:16.240122209 +0000 2023-05-24T03:28:43.192 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2023-05-24 03:23:14.421744608 +0000 2023-05-24T03:28:43.192 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2023-05-24 03:23:14.421744608 +0000 2023-05-24T03:28:43.192 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: - 2023-05-24T03:28:43.192 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-05-24T03:28:43.256 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-05-24T03:28:43.257 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-05-24T03:28:43.257 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000222947 s, 2.3 MB/s 2023-05-24T03:28:43.258 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-05-24T03:28:43.315 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_3 2023-05-24T03:28:43.372 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-05-24T03:28:43.372 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-24T03:28:43.372 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 6h/6d Inode: 369387 Links: 1 2023-05-24T03:28:43.372 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-24T03:28:43.372 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2023-05-24T03:28:43.372 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2023-05-24 03:28:16.241122194 +0000 2023-05-24T03:28:43.373 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2023-05-24 03:23:14.928736886 +0000 2023-05-24T03:28:43.373 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2023-05-24 03:23:14.928736886 +0000 2023-05-24T03:28:43.373 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: - 2023-05-24T03:28:43.373 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-05-24T03:28:43.438 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-05-24T03:28:43.438 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-05-24T03:28:43.439 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000273443 s, 1.9 MB/s 2023-05-24T03:28:43.440 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-05-24T03:28:43.498 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_4 2023-05-24T03:28:43.555 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-05-24T03:28:43.555 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-24T03:28:43.555 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 6h/6d Inode: 362371 Links: 1 2023-05-24T03:28:43.555 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-24T03:28:43.556 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2023-05-24T03:28:43.556 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2023-05-24 03:28:16.241122194 +0000 2023-05-24T03:28:43.556 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2023-05-24 03:23:15.441729073 +0000 2023-05-24T03:28:43.556 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2023-05-24 03:23:15.441729073 +0000 2023-05-24T03:28:43.556 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: - 2023-05-24T03:28:43.556 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-05-24T03:28:43.620 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-05-24T03:28:43.621 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-05-24T03:28:43.621 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000246583 s, 2.1 MB/s 2023-05-24T03:28:43.622 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-05-24T03:28:43.680 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-24T03:28:43.681 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-24T03:28:43.681 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/scratch_devs of=/dev/stdout 2023-05-24T03:28:43.702 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-05-24T03:28:43.703 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_1 2023-05-24T03:28:43.764 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-05-24T03:28:43.764 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-24T03:28:43.765 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 6h/6d Inode: 363193 Links: 1 2023-05-24T03:28:43.765 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-24T03:28:43.765 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2023-05-24T03:28:43.765 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2023-05-24 03:28:34.788284806 +0000 2023-05-24T03:28:43.765 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2023-05-24 03:25:32.017031177 +0000 2023-05-24T03:28:43.765 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2023-05-24 03:25:32.017031177 +0000 2023-05-24T03:28:43.765 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: - 2023-05-24T03:28:43.766 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-05-24T03:28:43.834 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2023-05-24T03:28:43.834 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2023-05-24T03:28:43.835 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000357131 s, 1.4 MB/s 2023-05-24T03:28:43.836 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-05-24T03:28:43.896 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_2 2023-05-24T03:28:43.955 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-05-24T03:28:43.955 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-24T03:28:43.955 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 6h/6d Inode: 371861 Links: 1 2023-05-24T03:28:43.955 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-24T03:28:43.955 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2023-05-24T03:28:43.955 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2023-05-24 03:28:34.788284806 +0000 2023-05-24T03:28:43.956 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2023-05-24 03:25:32.524024951 +0000 2023-05-24T03:28:43.956 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2023-05-24 03:25:32.524024951 +0000 2023-05-24T03:28:43.956 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: - 2023-05-24T03:28:43.956 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-05-24T03:28:44.023 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2023-05-24T03:28:44.023 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2023-05-24T03:28:44.023 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000266578 s, 1.9 MB/s 2023-05-24T03:28:44.025 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-05-24T03:28:44.083 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_3 2023-05-24T03:28:44.141 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-05-24T03:28:44.141 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-24T03:28:44.141 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 6h/6d Inode: 368986 Links: 1 2023-05-24T03:28:44.141 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-24T03:28:44.142 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2023-05-24T03:28:44.142 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2023-05-24 03:28:34.789284793 +0000 2023-05-24T03:28:44.142 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2023-05-24 03:25:33.049018505 +0000 2023-05-24T03:28:44.142 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2023-05-24 03:25:33.049018505 +0000 2023-05-24T03:28:44.142 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: - 2023-05-24T03:28:44.142 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-05-24T03:28:44.208 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2023-05-24T03:28:44.209 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2023-05-24T03:28:44.209 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000300052 s, 1.7 MB/s 2023-05-24T03:28:44.210 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-05-24T03:28:44.268 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_4 2023-05-24T03:28:44.325 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-05-24T03:28:44.326 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-24T03:28:44.326 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 6h/6d Inode: 369035 Links: 1 2023-05-24T03:28:44.326 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-24T03:28:44.326 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2023-05-24T03:28:44.327 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2023-05-24 03:28:34.789284793 +0000 2023-05-24T03:28:44.327 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2023-05-24 03:25:33.560012230 +0000 2023-05-24T03:28:44.327 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2023-05-24 03:25:33.560012230 +0000 2023-05-24T03:28:44.327 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: - 2023-05-24T03:28:44.328 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-05-24T03:28:44.391 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2023-05-24T03:28:44.391 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2023-05-24T03:28:44.391 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.00019707 s, 2.6 MB/s 2023-05-24T03:28:44.392 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-05-24T03:28:44.450 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-24T03:28:44.450 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi146.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi151.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-05-24T03:28:44.450 INFO:tasks.ceph:Generating config... 2023-05-24T03:28:44.452 INFO:tasks.ceph:[client] client mount timeout = 600 2023-05-24T03:28:44.452 INFO:tasks.ceph:[client] debug client = 20 2023-05-24T03:28:44.452 INFO:tasks.ceph:[client] debug ms = 1 2023-05-24T03:28:44.452 INFO:tasks.ceph:[client] pid file = 2023-05-24T03:28:44.453 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-05-24T03:28:44.453 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-05-24T03:28:44.453 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-05-24T03:28:44.453 INFO:tasks.ceph:[mds] debug mds = 20 2023-05-24T03:28:44.453 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-05-24T03:28:44.454 INFO:tasks.ceph:[mds] debug ms = 1 2023-05-24T03:28:44.454 INFO:tasks.ceph:[mds] mds debug frag = True 2023-05-24T03:28:44.454 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-05-24T03:28:44.454 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-05-24T03:28:44.454 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-05-24T03:28:44.455 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-05-24T03:28:44.455 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-05-24T03:28:44.455 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-05-24T03:28:44.455 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-05-24T03:28:44.455 INFO:tasks.ceph:[mgr] debug ms = 1 2023-05-24T03:28:44.456 INFO:tasks.ceph:[mon] debug mon = 20 2023-05-24T03:28:44.456 INFO:tasks.ceph:[mon] debug ms = 1 2023-05-24T03:28:44.456 INFO:tasks.ceph:[mon] debug paxos = 20 2023-05-24T03:28:44.456 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-05-24T03:28:44.456 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-05-24T03:28:44.456 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-05-24T03:28:44.457 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-05-24T03:28:44.457 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-05-24T03:28:44.457 INFO:tasks.ceph:[osd] debug ms = 1 2023-05-24T03:28:44.457 INFO:tasks.ceph:[osd] debug osd = 20 2023-05-24T03:28:44.457 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-05-24T03:28:44.458 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-05-24T03:28:44.458 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-05-24T03:28:44.458 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-05-24T03:28:44.458 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-05-24T03:28:44.459 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-05-24T03:28:44.459 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-05-24T03:28:44.459 INFO:tasks.ceph:Setting up mon.a... 2023-05-24T03:28:44.459 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-05-24T03:28:44.511 INFO:teuthology.orchestra.run.smithi146.stdout:creating /etc/ceph/ceph.keyring 2023-05-24T03:28:44.514 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-05-24T03:28:44.562 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-05-24T03:28:44.589 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.146'), ('mon.b', '172.21.15.151'), ('mon.c', '[v2:172.21.15.151:3301,v1:172.21.15.151:6790]')] 2023-05-24T03:28:44.590 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.146,172.21.15.151,[v2:172.21.15.151:3301,v1:172.21.15.151:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-05-24T03:28:44.591 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-05-24T03:28:44.591 DEBUG:teuthology.orchestra.run.smithi146:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-05-24T03:28:44.646 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.146 --add b 172.21.15.151 --addv c '[v2:172.21.15.151:3301,v1:172.21.15.151:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-05-24T03:28:44.733 INFO:teuthology.orchestra.run.smithi146.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-05-24T03:28:44.734 INFO:teuthology.orchestra.run.smithi146.stdout:monmaptool: generated fsid 11ca0adb-7672-4713-bde7-451e8b743ae9 2023-05-24T03:28:44.734 INFO:teuthology.orchestra.run.smithi146.stdout:setting min_mon_release = pacific 2023-05-24T03:28:44.734 INFO:teuthology.orchestra.run.smithi146.stdout:epoch 0 2023-05-24T03:28:44.734 INFO:teuthology.orchestra.run.smithi146.stdout:fsid 11ca0adb-7672-4713-bde7-451e8b743ae9 2023-05-24T03:28:44.734 INFO:teuthology.orchestra.run.smithi146.stdout:last_changed 2023-05-24T03:28:44.730528+0000 2023-05-24T03:28:44.735 INFO:teuthology.orchestra.run.smithi146.stdout:created 2023-05-24T03:28:44.730528+0000 2023-05-24T03:28:44.735 INFO:teuthology.orchestra.run.smithi146.stdout:min_mon_release 16 (pacific) 2023-05-24T03:28:44.735 INFO:teuthology.orchestra.run.smithi146.stdout:election_strategy: 1 2023-05-24T03:28:44.735 INFO:teuthology.orchestra.run.smithi146.stdout:0: [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] mon.a 2023-05-24T03:28:44.735 INFO:teuthology.orchestra.run.smithi146.stdout:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2023-05-24T03:28:44.736 INFO:teuthology.orchestra.run.smithi146.stdout:2: [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] mon.c 2023-05-24T03:28:44.736 INFO:teuthology.orchestra.run.smithi146.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-05-24T03:28:44.737 DEBUG:teuthology.orchestra.run.smithi146:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-05-24T03:28:44.753 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 11ca0adb-7672-4713-bde7-451e8b743ae9... 2023-05-24T03:28:44.754 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-05-24T03:28:44.795 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-05-24T03:28:44.838 INFO:teuthology.orchestra.run.smithi146.stdout:[global] 2023-05-24T03:28:44.838 INFO:teuthology.orchestra.run.smithi146.stdout: chdir = "" 2023-05-24T03:28:44.838 INFO:teuthology.orchestra.run.smithi146.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-05-24T03:28:44.839 INFO:teuthology.orchestra.run.smithi146.stdout: auth supported = cephx 2023-05-24T03:28:44.839 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:28:44.839 INFO:teuthology.orchestra.run.smithi146.stdout: filestore xattr use omap = true 2023-05-24T03:28:44.839 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:28:44.839 INFO:teuthology.orchestra.run.smithi146.stdout: mon clock drift allowed = 1.000 2023-05-24T03:28:44.839 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:28:44.839 INFO:teuthology.orchestra.run.smithi146.stdout: osd crush chooseleaf type = 0 2023-05-24T03:28:44.839 INFO:teuthology.orchestra.run.smithi146.stdout: auth debug = true 2023-05-24T03:28:44.840 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:28:44.840 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on old message = true 2023-05-24T03:28:44.840 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on bug = true 2023-05-24T03:28:44.840 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:28:44.840 INFO:teuthology.orchestra.run.smithi146.stdout: mon max pg per osd = 10000 # >= luminous 2023-05-24T03:28:44.840 INFO:teuthology.orchestra.run.smithi146.stdout: mon pg warn max object skew = 0 2023-05-24T03:28:44.840 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:28:44.841 INFO:teuthology.orchestra.run.smithi146.stdout: # disable pg_autoscaler by default for new pools 2023-05-24T03:28:44.841 INFO:teuthology.orchestra.run.smithi146.stdout: osd_pool_default_pg_autoscale_mode = off 2023-05-24T03:28:44.841 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:28:44.841 INFO:teuthology.orchestra.run.smithi146.stdout: osd pool default size = 2 2023-05-24T03:28:44.841 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:28:44.842 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd allow primary affinity = true 2023-05-24T03:28:44.843 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd allow pg remap = true 2023-05-24T03:28:44.843 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on legacy crush tunables = false 2023-05-24T03:28:44.843 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on crush straw calc version zero = false 2023-05-24T03:28:44.843 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on no sortbitwise = false 2023-05-24T03:28:44.843 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on osd down out interval zero = false 2023-05-24T03:28:44.844 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on too few osds = false 2023-05-24T03:28:44.844 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-05-24T03:28:44.844 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_pool_no_redundancy = false 2023-05-24T03:28:44.844 INFO:teuthology.orchestra.run.smithi146.stdout: mon_allow_pool_size_one = true 2023-05-24T03:28:44.844 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:28:44.844 INFO:teuthology.orchestra.run.smithi146.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-05-24T03:28:44.844 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:28:44.844 INFO:teuthology.orchestra.run.smithi146.stdout: osd default data pool replay window = 5 2023-05-24T03:28:44.845 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:28:44.845 INFO:teuthology.orchestra.run.smithi146.stdout: mon allow pool delete = true 2023-05-24T03:28:44.845 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:28:44.845 INFO:teuthology.orchestra.run.smithi146.stdout: mon cluster log file level = debug 2023-05-24T03:28:44.845 INFO:teuthology.orchestra.run.smithi146.stdout: debug asserts on shutdown = true 2023-05-24T03:28:44.845 INFO:teuthology.orchestra.run.smithi146.stdout: mon health detail to clog = false 2023-05-24T03:28:44.845 INFO:teuthology.orchestra.run.smithi146.stdout: mon host = "172.21.15.146,172.21.15.151,[v2:172.21.15.151:3301,v1:172.21.15.151:6790]" 2023-05-24T03:28:44.845 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on skipped message = False 2023-05-24T03:28:44.846 INFO:teuthology.orchestra.run.smithi146.stdout: fsid = 11ca0adb-7672-4713-bde7-451e8b743ae9 2023-05-24T03:28:44.846 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:28:44.846 INFO:teuthology.orchestra.run.smithi146.stdout:[osd] 2023-05-24T03:28:44.846 INFO:teuthology.orchestra.run.smithi146.stdout: osd journal size = 100 2023-05-24T03:28:44.846 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:28:44.846 INFO:teuthology.orchestra.run.smithi146.stdout: osd scrub load threshold = 5.0 2023-05-24T03:28:44.846 INFO:teuthology.orchestra.run.smithi146.stdout: osd scrub max interval = 600 2023-05-24T03:28:44.846 INFO:teuthology.orchestra.run.smithi146.stdout: osd mclock profile = high_recovery_ops 2023-05-24T03:28:44.847 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:28:44.847 INFO:teuthology.orchestra.run.smithi146.stdout: osd recover clone overlap = true 2023-05-24T03:28:44.847 INFO:teuthology.orchestra.run.smithi146.stdout: osd recovery max chunk = 1048576 2023-05-24T03:28:44.847 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:28:44.847 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug shutdown = true 2023-05-24T03:28:44.847 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug op order = true 2023-05-24T03:28:44.847 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug verify stray on activate = true 2023-05-24T03:28:44.848 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:28:44.848 INFO:teuthology.orchestra.run.smithi146.stdout: osd open classes on start = true 2023-05-24T03:28:44.848 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug pg log writeout = true 2023-05-24T03:28:44.848 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:28:44.848 INFO:teuthology.orchestra.run.smithi146.stdout: osd deep scrub update digest min age = 30 2023-05-24T03:28:44.848 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:28:44.848 INFO:teuthology.orchestra.run.smithi146.stdout: osd map max advance = 10 2023-05-24T03:28:44.848 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:28:44.849 INFO:teuthology.orchestra.run.smithi146.stdout: journal zero on create = true 2023-05-24T03:28:44.849 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:28:44.850 INFO:teuthology.orchestra.run.smithi146.stdout: filestore ondisk finisher threads = 3 2023-05-24T03:28:44.850 INFO:teuthology.orchestra.run.smithi146.stdout: filestore apply finisher threads = 3 2023-05-24T03:28:44.850 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:28:44.850 INFO:teuthology.orchestra.run.smithi146.stdout: bdev debug aio = true 2023-05-24T03:28:44.850 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug misdirected ops = true 2023-05-24T03:28:44.850 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore block size = 96636764160 2023-05-24T03:28:44.850 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore fsck on mount = True 2023-05-24T03:28:44.851 INFO:teuthology.orchestra.run.smithi146.stdout: debug bluefs = 20 2023-05-24T03:28:44.851 INFO:teuthology.orchestra.run.smithi146.stdout: debug bluestore = 20 2023-05-24T03:28:44.851 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-05-24T03:28:44.851 INFO:teuthology.orchestra.run.smithi146.stdout: debug osd = 20 2023-05-24T03:28:44.851 INFO:teuthology.orchestra.run.smithi146.stdout: debug rocksdb = 10 2023-05-24T03:28:44.851 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd backfillfull_ratio = 0.85 2023-05-24T03:28:44.851 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd full ratio = 0.9 2023-05-24T03:28:44.852 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd nearfull ratio = 0.8 2023-05-24T03:28:44.852 INFO:teuthology.orchestra.run.smithi146.stdout: osd failsafe full ratio = 0.95 2023-05-24T03:28:44.852 INFO:teuthology.orchestra.run.smithi146.stdout: osd objectstore = bluestore 2023-05-24T03:28:44.852 INFO:teuthology.orchestra.run.smithi146.stdout: osd op complaint time = 180 2023-05-24T03:28:44.852 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:28:44.852 INFO:teuthology.orchestra.run.smithi146.stdout:[mgr] 2023-05-24T03:28:44.852 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-05-24T03:28:44.853 INFO:teuthology.orchestra.run.smithi146.stdout: debug mgr = 20 2023-05-24T03:28:44.853 INFO:teuthology.orchestra.run.smithi146.stdout: debug mon = 20 2023-05-24T03:28:44.853 INFO:teuthology.orchestra.run.smithi146.stdout: debug auth = 20 2023-05-24T03:28:44.853 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min pgs per osd = 4 2023-05-24T03:28:44.853 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min bytes per osd = 10 2023-05-24T03:28:44.853 INFO:teuthology.orchestra.run.smithi146.stdout: mgr/telemetry/nag = false 2023-05-24T03:28:44.853 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:28:44.854 INFO:teuthology.orchestra.run.smithi146.stdout:[mon] 2023-05-24T03:28:44.854 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-05-24T03:28:44.854 INFO:teuthology.orchestra.run.smithi146.stdout: debug mon = 20 2023-05-24T03:28:44.854 INFO:teuthology.orchestra.run.smithi146.stdout: debug paxos = 20 2023-05-24T03:28:44.854 INFO:teuthology.orchestra.run.smithi146.stdout: debug auth = 20 2023-05-24T03:28:44.854 INFO:teuthology.orchestra.run.smithi146.stdout: mon data avail warn = 5 2023-05-24T03:28:44.854 INFO:teuthology.orchestra.run.smithi146.stdout: mon mgr mkfs grace = 240 2023-05-24T03:28:44.855 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min pgs per osd = 4 2023-05-24T03:28:44.855 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd reporter subtree level = osd 2023-05-24T03:28:44.855 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd prime pg temp = true 2023-05-24T03:28:44.855 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min bytes per osd = 10 2023-05-24T03:28:44.855 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:28:44.855 INFO:teuthology.orchestra.run.smithi146.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-05-24T03:28:44.855 INFO:teuthology.orchestra.run.smithi146.stdout: auth mon ticket ttl = 660 # 11m 2023-05-24T03:28:44.856 INFO:teuthology.orchestra.run.smithi146.stdout: auth service ticket ttl = 240 # 4m 2023-05-24T03:28:44.856 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:28:44.856 INFO:teuthology.orchestra.run.smithi146.stdout: # don't complain about insecure global_id in the test suite 2023-05-24T03:28:44.856 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-05-24T03:28:44.856 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-05-24T03:28:44.856 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:28:44.857 INFO:teuthology.orchestra.run.smithi146.stdout: # 1m isn't quite enough 2023-05-24T03:28:44.857 INFO:teuthology.orchestra.run.smithi146.stdout: mon_down_mkfs_grace = 2m 2023-05-24T03:28:44.857 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:28:44.857 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_filestore_osds = false 2023-05-24T03:28:44.857 INFO:teuthology.orchestra.run.smithi146.stdout: mon op complaint time = 120 2023-05-24T03:28:44.857 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:28:44.858 INFO:teuthology.orchestra.run.smithi146.stdout:[client] 2023-05-24T03:28:44.858 INFO:teuthology.orchestra.run.smithi146.stdout: rgw cache enabled = true 2023-05-24T03:28:44.858 INFO:teuthology.orchestra.run.smithi146.stdout: rgw enable ops log = true 2023-05-24T03:28:44.858 INFO:teuthology.orchestra.run.smithi146.stdout: rgw enable usage log = true 2023-05-24T03:28:44.859 INFO:teuthology.orchestra.run.smithi146.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-05-24T03:28:44.859 INFO:teuthology.orchestra.run.smithi146.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-05-24T03:28:44.859 INFO:teuthology.orchestra.run.smithi146.stdout: client mount timeout = 600 2023-05-24T03:28:44.859 INFO:teuthology.orchestra.run.smithi146.stdout: debug client = 20 2023-05-24T03:28:44.859 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-05-24T03:28:44.859 INFO:teuthology.orchestra.run.smithi146.stdout: pid file = "" 2023-05-24T03:28:44.860 INFO:teuthology.orchestra.run.smithi146.stdout: rados mon op timeout = 900 2023-05-24T03:28:44.860 INFO:teuthology.orchestra.run.smithi146.stdout: rados osd op timeout = 900 2023-05-24T03:28:44.860 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.a] 2023-05-24T03:28:44.860 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.b] 2023-05-24T03:28:44.860 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.c] 2023-05-24T03:28:44.860 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.a] 2023-05-24T03:28:44.860 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.c] 2023-05-24T03:28:44.861 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.b] 2023-05-24T03:28:44.861 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.d] 2023-05-24T03:28:44.861 INFO:teuthology.orchestra.run.smithi146.stdout:[mds] 2023-05-24T03:28:44.861 INFO:teuthology.orchestra.run.smithi146.stdout: debug mds = 20 2023-05-24T03:28:44.861 INFO:teuthology.orchestra.run.smithi146.stdout: debug mds balancer = 20 2023-05-24T03:28:44.861 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-05-24T03:28:44.861 INFO:teuthology.orchestra.run.smithi146.stdout: mds debug frag = True 2023-05-24T03:28:44.862 INFO:teuthology.orchestra.run.smithi146.stdout: mds debug scatterstat = True 2023-05-24T03:28:44.862 INFO:teuthology.orchestra.run.smithi146.stdout: mds op complaint time = 180 2023-05-24T03:28:44.862 INFO:teuthology.orchestra.run.smithi146.stdout: mds verify scatter = True 2023-05-24T03:28:44.862 INFO:teuthology.orchestra.run.smithi146.stdout: osd op complaint time = 180 2023-05-24T03:28:44.862 INFO:teuthology.orchestra.run.smithi146.stdout: rados mon op timeout = 900 2023-05-24T03:28:44.862 INFO:teuthology.orchestra.run.smithi146.stdout: rados osd op timeout = 900 2023-05-24T03:28:44.864 INFO:teuthology.orchestra.run.smithi151.stdout:[global] 2023-05-24T03:28:44.864 INFO:teuthology.orchestra.run.smithi151.stdout: chdir = "" 2023-05-24T03:28:44.864 INFO:teuthology.orchestra.run.smithi151.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-05-24T03:28:44.864 INFO:teuthology.orchestra.run.smithi151.stdout: auth supported = cephx 2023-05-24T03:28:44.864 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-24T03:28:44.864 INFO:teuthology.orchestra.run.smithi151.stdout: filestore xattr use omap = true 2023-05-24T03:28:44.865 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-24T03:28:44.865 INFO:teuthology.orchestra.run.smithi151.stdout: mon clock drift allowed = 1.000 2023-05-24T03:28:44.865 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-24T03:28:44.865 INFO:teuthology.orchestra.run.smithi151.stdout: osd crush chooseleaf type = 0 2023-05-24T03:28:44.865 INFO:teuthology.orchestra.run.smithi151.stdout: auth debug = true 2023-05-24T03:28:44.865 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-24T03:28:44.865 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on old message = true 2023-05-24T03:28:44.866 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on bug = true 2023-05-24T03:28:44.866 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-24T03:28:44.866 INFO:teuthology.orchestra.run.smithi151.stdout: mon max pg per osd = 10000 # >= luminous 2023-05-24T03:28:44.866 INFO:teuthology.orchestra.run.smithi151.stdout: mon pg warn max object skew = 0 2023-05-24T03:28:44.866 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-24T03:28:44.866 INFO:teuthology.orchestra.run.smithi151.stdout: # disable pg_autoscaler by default for new pools 2023-05-24T03:28:44.866 INFO:teuthology.orchestra.run.smithi151.stdout: osd_pool_default_pg_autoscale_mode = off 2023-05-24T03:28:44.867 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-24T03:28:44.867 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default size = 2 2023-05-24T03:28:44.867 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-24T03:28:44.867 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd allow primary affinity = true 2023-05-24T03:28:44.867 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd allow pg remap = true 2023-05-24T03:28:44.867 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on legacy crush tunables = false 2023-05-24T03:28:44.867 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on crush straw calc version zero = false 2023-05-24T03:28:44.868 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on no sortbitwise = false 2023-05-24T03:28:44.868 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on osd down out interval zero = false 2023-05-24T03:28:44.868 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on too few osds = false 2023-05-24T03:28:44.868 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-05-24T03:28:44.868 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_pool_no_redundancy = false 2023-05-24T03:28:44.868 INFO:teuthology.orchestra.run.smithi151.stdout: mon_allow_pool_size_one = true 2023-05-24T03:28:44.869 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-24T03:28:44.869 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-05-24T03:28:44.869 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-24T03:28:44.869 INFO:teuthology.orchestra.run.smithi151.stdout: osd default data pool replay window = 5 2023-05-24T03:28:44.869 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-24T03:28:44.869 INFO:teuthology.orchestra.run.smithi151.stdout: mon allow pool delete = true 2023-05-24T03:28:44.869 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-24T03:28:44.869 INFO:teuthology.orchestra.run.smithi151.stdout: mon cluster log file level = debug 2023-05-24T03:28:44.870 INFO:teuthology.orchestra.run.smithi151.stdout: debug asserts on shutdown = true 2023-05-24T03:28:44.870 INFO:teuthology.orchestra.run.smithi151.stdout: mon health detail to clog = false 2023-05-24T03:28:44.870 INFO:teuthology.orchestra.run.smithi151.stdout: mon host = "172.21.15.146,172.21.15.151,[v2:172.21.15.151:3301,v1:172.21.15.151:6790]" 2023-05-24T03:28:44.870 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on skipped message = False 2023-05-24T03:28:44.870 INFO:teuthology.orchestra.run.smithi151.stdout: fsid = 11ca0adb-7672-4713-bde7-451e8b743ae9 2023-05-24T03:28:44.870 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-24T03:28:44.870 INFO:teuthology.orchestra.run.smithi151.stdout:[osd] 2023-05-24T03:28:44.871 INFO:teuthology.orchestra.run.smithi151.stdout: osd journal size = 100 2023-05-24T03:28:44.871 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-24T03:28:44.871 INFO:teuthology.orchestra.run.smithi151.stdout: osd scrub load threshold = 5.0 2023-05-24T03:28:44.871 INFO:teuthology.orchestra.run.smithi151.stdout: osd scrub max interval = 600 2023-05-24T03:28:44.871 INFO:teuthology.orchestra.run.smithi151.stdout: osd mclock profile = high_recovery_ops 2023-05-24T03:28:44.871 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-24T03:28:44.871 INFO:teuthology.orchestra.run.smithi151.stdout: osd recover clone overlap = true 2023-05-24T03:28:44.872 INFO:teuthology.orchestra.run.smithi151.stdout: osd recovery max chunk = 1048576 2023-05-24T03:28:44.872 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-24T03:28:44.872 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug shutdown = true 2023-05-24T03:28:44.872 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug op order = true 2023-05-24T03:28:44.872 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug verify stray on activate = true 2023-05-24T03:28:44.872 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-24T03:28:44.872 INFO:teuthology.orchestra.run.smithi151.stdout: osd open classes on start = true 2023-05-24T03:28:44.873 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug pg log writeout = true 2023-05-24T03:28:44.873 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-24T03:28:44.873 INFO:teuthology.orchestra.run.smithi151.stdout: osd deep scrub update digest min age = 30 2023-05-24T03:28:44.873 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-24T03:28:44.873 INFO:teuthology.orchestra.run.smithi151.stdout: osd map max advance = 10 2023-05-24T03:28:44.873 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-24T03:28:44.873 INFO:teuthology.orchestra.run.smithi151.stdout: journal zero on create = true 2023-05-24T03:28:44.874 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-24T03:28:44.874 INFO:teuthology.orchestra.run.smithi151.stdout: filestore ondisk finisher threads = 3 2023-05-24T03:28:44.874 INFO:teuthology.orchestra.run.smithi151.stdout: filestore apply finisher threads = 3 2023-05-24T03:28:44.874 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-24T03:28:44.874 INFO:teuthology.orchestra.run.smithi151.stdout: bdev debug aio = true 2023-05-24T03:28:44.874 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug misdirected ops = true 2023-05-24T03:28:44.874 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore block size = 96636764160 2023-05-24T03:28:44.874 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore fsck on mount = True 2023-05-24T03:28:44.875 INFO:teuthology.orchestra.run.smithi151.stdout: debug bluefs = 20 2023-05-24T03:28:44.875 INFO:teuthology.orchestra.run.smithi151.stdout: debug bluestore = 20 2023-05-24T03:28:44.875 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-05-24T03:28:44.875 INFO:teuthology.orchestra.run.smithi151.stdout: debug osd = 20 2023-05-24T03:28:44.875 INFO:teuthology.orchestra.run.smithi151.stdout: debug rocksdb = 10 2023-05-24T03:28:44.875 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd backfillfull_ratio = 0.85 2023-05-24T03:28:44.875 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd full ratio = 0.9 2023-05-24T03:28:44.876 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd nearfull ratio = 0.8 2023-05-24T03:28:44.876 INFO:teuthology.orchestra.run.smithi151.stdout: osd failsafe full ratio = 0.95 2023-05-24T03:28:44.876 INFO:teuthology.orchestra.run.smithi151.stdout: osd objectstore = bluestore 2023-05-24T03:28:44.876 INFO:teuthology.orchestra.run.smithi151.stdout: osd op complaint time = 180 2023-05-24T03:28:44.876 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-24T03:28:44.876 INFO:teuthology.orchestra.run.smithi151.stdout:[mgr] 2023-05-24T03:28:44.876 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-05-24T03:28:44.877 INFO:teuthology.orchestra.run.smithi151.stdout: debug mgr = 20 2023-05-24T03:28:44.877 INFO:teuthology.orchestra.run.smithi151.stdout: debug mon = 20 2023-05-24T03:28:44.877 INFO:teuthology.orchestra.run.smithi151.stdout: debug auth = 20 2023-05-24T03:28:44.877 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min pgs per osd = 4 2023-05-24T03:28:44.877 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min bytes per osd = 10 2023-05-24T03:28:44.877 INFO:teuthology.orchestra.run.smithi151.stdout: mgr/telemetry/nag = false 2023-05-24T03:28:44.877 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-24T03:28:44.878 INFO:teuthology.orchestra.run.smithi151.stdout:[mon] 2023-05-24T03:28:44.878 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-05-24T03:28:44.878 INFO:teuthology.orchestra.run.smithi151.stdout: debug mon = 20 2023-05-24T03:28:44.878 INFO:teuthology.orchestra.run.smithi151.stdout: debug paxos = 20 2023-05-24T03:28:44.878 INFO:teuthology.orchestra.run.smithi151.stdout: debug auth = 20 2023-05-24T03:28:44.878 INFO:teuthology.orchestra.run.smithi151.stdout: mon data avail warn = 5 2023-05-24T03:28:44.878 INFO:teuthology.orchestra.run.smithi151.stdout: mon mgr mkfs grace = 240 2023-05-24T03:28:44.879 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min pgs per osd = 4 2023-05-24T03:28:44.879 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd reporter subtree level = osd 2023-05-24T03:28:44.879 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd prime pg temp = true 2023-05-24T03:28:44.879 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min bytes per osd = 10 2023-05-24T03:28:44.880 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-24T03:28:44.881 INFO:teuthology.orchestra.run.smithi151.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-05-24T03:28:44.881 INFO:teuthology.orchestra.run.smithi151.stdout: auth mon ticket ttl = 660 # 11m 2023-05-24T03:28:44.881 INFO:teuthology.orchestra.run.smithi151.stdout: auth service ticket ttl = 240 # 4m 2023-05-24T03:28:44.881 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-24T03:28:44.881 INFO:teuthology.orchestra.run.smithi151.stdout: # don't complain about insecure global_id in the test suite 2023-05-24T03:28:44.882 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-05-24T03:28:44.882 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-05-24T03:28:44.882 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-24T03:28:44.882 INFO:teuthology.orchestra.run.smithi151.stdout: # 1m isn't quite enough 2023-05-24T03:28:44.882 INFO:teuthology.orchestra.run.smithi151.stdout: mon_down_mkfs_grace = 2m 2023-05-24T03:28:44.882 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-24T03:28:44.882 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_filestore_osds = false 2023-05-24T03:28:44.882 INFO:teuthology.orchestra.run.smithi151.stdout: mon op complaint time = 120 2023-05-24T03:28:44.883 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-24T03:28:44.883 INFO:teuthology.orchestra.run.smithi151.stdout:[client] 2023-05-24T03:28:44.883 INFO:teuthology.orchestra.run.smithi151.stdout: rgw cache enabled = true 2023-05-24T03:28:44.883 INFO:teuthology.orchestra.run.smithi151.stdout: rgw enable ops log = true 2023-05-24T03:28:44.883 INFO:teuthology.orchestra.run.smithi151.stdout: rgw enable usage log = true 2023-05-24T03:28:44.883 INFO:teuthology.orchestra.run.smithi151.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-05-24T03:28:44.883 INFO:teuthology.orchestra.run.smithi151.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-05-24T03:28:44.883 INFO:teuthology.orchestra.run.smithi151.stdout: client mount timeout = 600 2023-05-24T03:28:44.884 INFO:teuthology.orchestra.run.smithi151.stdout: debug client = 20 2023-05-24T03:28:44.884 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-05-24T03:28:44.884 INFO:teuthology.orchestra.run.smithi151.stdout: pid file = "" 2023-05-24T03:28:44.884 INFO:teuthology.orchestra.run.smithi151.stdout: rados mon op timeout = 900 2023-05-24T03:28:44.884 INFO:teuthology.orchestra.run.smithi151.stdout: rados osd op timeout = 900 2023-05-24T03:28:44.884 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.a] 2023-05-24T03:28:44.884 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.b] 2023-05-24T03:28:44.885 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.c] 2023-05-24T03:28:44.885 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.a] 2023-05-24T03:28:44.885 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.c] 2023-05-24T03:28:44.885 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.b] 2023-05-24T03:28:44.885 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.d] 2023-05-24T03:28:44.885 INFO:teuthology.orchestra.run.smithi151.stdout:[mds] 2023-05-24T03:28:44.886 INFO:teuthology.orchestra.run.smithi151.stdout: debug mds = 20 2023-05-24T03:28:44.886 INFO:teuthology.orchestra.run.smithi151.stdout: debug mds balancer = 20 2023-05-24T03:28:44.886 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-05-24T03:28:44.886 INFO:teuthology.orchestra.run.smithi151.stdout: mds debug frag = True 2023-05-24T03:28:44.886 INFO:teuthology.orchestra.run.smithi151.stdout: mds debug scatterstat = True 2023-05-24T03:28:44.886 INFO:teuthology.orchestra.run.smithi151.stdout: mds op complaint time = 180 2023-05-24T03:28:44.886 INFO:teuthology.orchestra.run.smithi151.stdout: mds verify scatter = True 2023-05-24T03:28:44.886 INFO:teuthology.orchestra.run.smithi151.stdout: osd op complaint time = 180 2023-05-24T03:28:44.887 INFO:teuthology.orchestra.run.smithi151.stdout: rados mon op timeout = 900 2023-05-24T03:28:44.887 INFO:teuthology.orchestra.run.smithi151.stdout: rados osd op timeout = 900 2023-05-24T03:28:44.887 INFO:tasks.ceph:Creating admin key on mon.a... 2023-05-24T03:28:44.888 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-05-24T03:28:44.962 INFO:tasks.ceph:Copying monmap to all nodes... 2023-05-24T03:28:44.963 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-05-24T03:28:44.963 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-05-24T03:28:44.980 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-05-24T03:28:44.980 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-05-24T03:28:45.037 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi146.front.sepia.ceph.com 2023-05-24T03:28:45.038 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-05-24T03:28:45.038 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/ceph/ceph.keyring 2023-05-24T03:28:45.038 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-05-24T03:28:45.113 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-05-24T03:28:45.114 DEBUG:teuthology.orchestra.run.smithi146:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-05-24T03:28:45.171 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi151.front.sepia.ceph.com 2023-05-24T03:28:45.172 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-24T03:28:45.173 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/ceph/ceph.keyring 2023-05-24T03:28:45.173 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-05-24T03:28:45.212 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-24T03:28:45.212 DEBUG:teuthology.orchestra.run.smithi151:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-05-24T03:28:45.269 INFO:tasks.ceph:Setting up mon nodes... 2023-05-24T03:28:45.270 INFO:tasks.ceph:Setting up mgr nodes... 2023-05-24T03:28:45.270 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-05-24T03:28:45.323 INFO:teuthology.orchestra.run.smithi146.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-05-24T03:28:45.325 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-05-24T03:28:45.403 INFO:teuthology.orchestra.run.smithi151.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-05-24T03:28:45.406 INFO:tasks.ceph:Setting up mds nodes... 2023-05-24T03:28:45.406 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-05-24T03:28:45.460 INFO:teuthology.orchestra.run.smithi146.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-05-24T03:28:45.465 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-05-24T03:28:45.491 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-05-24T03:28:45.585 INFO:teuthology.orchestra.run.smithi146.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-05-24T03:28:45.587 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-05-24T03:28:45.614 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-05-24T03:28:45.668 INFO:teuthology.orchestra.run.smithi151.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-05-24T03:28:45.670 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-05-24T03:28:45.696 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-05-24T03:28:45.789 INFO:teuthology.orchestra.run.smithi151.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-05-24T03:28:45.792 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-05-24T03:28:45.817 INFO:tasks.ceph_client:Setting up client nodes... 2023-05-24T03:28:45.818 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-05-24T03:28:45.862 INFO:teuthology.orchestra.run.smithi146.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-05-24T03:28:45.875 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-05-24T03:28:45.918 INFO:teuthology.orchestra.run.smithi146.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-05-24T03:28:45.931 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-05-24T03:28:45.974 INFO:teuthology.orchestra.run.smithi151.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-05-24T03:28:45.987 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-05-24T03:28:46.070 INFO:teuthology.orchestra.run.smithi151.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-05-24T03:28:46.083 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-05-24T03:28:46.084 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi146.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi151.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-05-24T03:28:46.084 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-05-24T03:28:46.111 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-24T03:28:46.112 INFO:tasks.ceph:role: osd.0 2023-05-24T03:28:46.112 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi146.front.sepia.ceph.com 2023-05-24T03:28:46.112 DEBUG:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-05-24T03:28:46.185 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-05-24T03:28:46.185 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-24T03:28:46.185 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-24T03:28:46.185 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-24T03:28:46.185 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-24T03:28:46.186 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2023-05-24T03:28:46.186 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-24T03:28:46.186 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-24T03:28:46.186 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-24T03:28:46.186 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-24T03:28:46.626 INFO:teuthology.orchestra.run.smithi146.stdout:Discarding blocks...Done. 2023-05-24T03:28:46.628 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2023-05-24T03:28:46.628 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-05-24T03:28:46.791 DEBUG:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-05-24T03:28:46.825 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-05-24T03:28:46.892 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-24T03:28:46.892 INFO:tasks.ceph:role: osd.1 2023-05-24T03:28:46.893 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi146.front.sepia.ceph.com 2023-05-24T03:28:46.894 DEBUG:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-05-24T03:28:46.966 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-05-24T03:28:46.967 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-24T03:28:46.967 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-24T03:28:46.967 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-24T03:28:46.967 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-24T03:28:46.967 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2023-05-24T03:28:46.967 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-24T03:28:46.967 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-24T03:28:46.968 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-24T03:28:46.968 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-24T03:28:47.393 INFO:teuthology.orchestra.run.smithi146.stdout:Discarding blocks...Done. 2023-05-24T03:28:47.395 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2023-05-24T03:28:47.396 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-05-24T03:28:47.498 DEBUG:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-05-24T03:28:47.529 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-05-24T03:28:47.596 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-24T03:28:47.596 INFO:tasks.ceph:role: osd.2 2023-05-24T03:28:47.597 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi146.front.sepia.ceph.com 2023-05-24T03:28:47.597 DEBUG:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-05-24T03:28:47.669 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-05-24T03:28:47.670 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-24T03:28:47.670 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-24T03:28:47.670 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-24T03:28:47.670 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-24T03:28:47.670 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2023-05-24T03:28:47.670 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-24T03:28:47.671 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-24T03:28:47.671 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-24T03:28:47.671 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-24T03:28:48.117 INFO:teuthology.orchestra.run.smithi146.stdout:Discarding blocks...Done. 2023-05-24T03:28:48.119 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2023-05-24T03:28:48.119 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-05-24T03:28:48.280 DEBUG:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-05-24T03:28:48.316 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-05-24T03:28:48.385 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-24T03:28:48.386 INFO:tasks.ceph:role: osd.3 2023-05-24T03:28:48.386 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi146.front.sepia.ceph.com 2023-05-24T03:28:48.386 DEBUG:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-05-24T03:28:48.460 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-05-24T03:28:48.461 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-24T03:28:48.461 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-24T03:28:48.461 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-24T03:28:48.461 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-24T03:28:48.461 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2023-05-24T03:28:48.461 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-24T03:28:48.462 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-24T03:28:48.462 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-24T03:28:48.462 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-24T03:28:48.904 INFO:teuthology.orchestra.run.smithi146.stdout:Discarding blocks...Done. 2023-05-24T03:28:48.906 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2023-05-24T03:28:48.906 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-05-24T03:28:49.098 DEBUG:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-05-24T03:28:49.134 DEBUG:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-24T03:28:49.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:28:49.237+0000 7fab68fda640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-05-24T03:28:49.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:28:49.237+0000 7fab68fda640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-05-24T03:28:49.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:28:49.237+0000 7fab68fda640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-05-24T03:28:49.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:28:49.237+0000 7fab68fda640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-05-24T03:28:49.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:28:49.237+0000 7fab68fda640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-05-24T03:28:49.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:28:49.238+0000 7fab68fda640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-05-24T03:28:52.104 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-05-24T03:28:52.135 DEBUG:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-24T03:28:52.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:28:52.221+0000 7f37d2685640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-05-24T03:28:52.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:28:52.221+0000 7f37d2685640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-05-24T03:28:52.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:28:52.221+0000 7f37d2685640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-05-24T03:28:52.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:28:52.221+0000 7f37d2685640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-05-24T03:28:52.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:28:52.221+0000 7f37d2685640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-05-24T03:28:52.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:28:52.222+0000 7f37d2685640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-05-24T03:28:55.089 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-05-24T03:28:55.118 DEBUG:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-24T03:28:55.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:28:55.201+0000 7f74b3025640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-05-24T03:28:55.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:28:55.201+0000 7f74b3025640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-05-24T03:28:55.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:28:55.201+0000 7f74b3025640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-05-24T03:28:55.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:28:55.201+0000 7f74b3025640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-05-24T03:28:55.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:28:55.202+0000 7f74b3025640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-05-24T03:28:55.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:28:55.202+0000 7f74b3025640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-05-24T03:28:58.070 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-05-24T03:28:58.101 DEBUG:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-24T03:28:58.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:28:58.187+0000 7f805618f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-05-24T03:28:58.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:28:58.188+0000 7f805618f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-05-24T03:28:58.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:28:58.188+0000 7f805618f640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-05-24T03:28:58.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:28:58.188+0000 7f805618f640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-05-24T03:28:58.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:28:58.188+0000 7f805618f640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-05-24T03:28:58.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:28:58.188+0000 7f805618f640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-05-24T03:29:01.053 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-05-24T03:29:01.083 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-05-24T03:29:01.114 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-24T03:29:01.115 INFO:tasks.ceph:role: osd.4 2023-05-24T03:29:01.115 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi151.front.sepia.ceph.com 2023-05-24T03:29:01.115 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-05-24T03:29:01.190 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-05-24T03:29:01.191 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-24T03:29:01.191 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-24T03:29:01.191 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-24T03:29:01.191 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-24T03:29:01.192 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2023-05-24T03:29:01.192 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-24T03:29:01.192 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-24T03:29:01.192 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-24T03:29:01.192 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-24T03:29:01.617 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2023-05-24T03:29:01.619 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2023-05-24T03:29:01.620 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-05-24T03:29:01.780 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-05-24T03:29:01.816 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-05-24T03:29:01.884 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-24T03:29:01.885 INFO:tasks.ceph:role: osd.5 2023-05-24T03:29:01.885 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi151.front.sepia.ceph.com 2023-05-24T03:29:01.885 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-05-24T03:29:01.959 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-05-24T03:29:01.959 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-24T03:29:01.959 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-24T03:29:01.959 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-24T03:29:01.960 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-24T03:29:01.960 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2023-05-24T03:29:01.960 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-24T03:29:01.960 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-24T03:29:01.960 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-24T03:29:01.960 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-24T03:29:02.388 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2023-05-24T03:29:02.391 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2023-05-24T03:29:02.392 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-05-24T03:29:02.508 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-05-24T03:29:02.543 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-05-24T03:29:02.614 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-24T03:29:02.614 INFO:tasks.ceph:role: osd.6 2023-05-24T03:29:02.614 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi151.front.sepia.ceph.com 2023-05-24T03:29:02.614 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-05-24T03:29:02.690 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-05-24T03:29:02.691 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-24T03:29:02.691 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-24T03:29:02.691 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-24T03:29:02.691 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-24T03:29:02.692 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2023-05-24T03:29:02.692 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-24T03:29:02.692 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-24T03:29:02.692 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-24T03:29:02.693 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-24T03:29:03.140 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2023-05-24T03:29:03.142 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2023-05-24T03:29:03.142 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-05-24T03:29:03.294 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-05-24T03:29:03.326 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-05-24T03:29:03.395 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-24T03:29:03.395 INFO:tasks.ceph:role: osd.7 2023-05-24T03:29:03.395 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi151.front.sepia.ceph.com 2023-05-24T03:29:03.395 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-05-24T03:29:03.470 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-05-24T03:29:03.471 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-24T03:29:03.471 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-24T03:29:03.471 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-24T03:29:03.471 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-24T03:29:03.471 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2023-05-24T03:29:03.471 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-24T03:29:03.471 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-24T03:29:03.472 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-24T03:29:03.472 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-24T03:29:03.910 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2023-05-24T03:29:03.912 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2023-05-24T03:29:03.913 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-05-24T03:29:04.081 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-05-24T03:29:04.115 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-24T03:29:04.218 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:04.213+0000 7f661e090640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-05-24T03:29:04.218 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:04.213+0000 7f661e090640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-05-24T03:29:04.218 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:04.213+0000 7f661e090640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-05-24T03:29:04.219 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:04.213+0000 7f661e090640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-05-24T03:29:04.219 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:04.213+0000 7f661e090640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-05-24T03:29:04.219 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:04.214+0000 7f661e090640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-05-24T03:29:07.077 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-05-24T03:29:07.109 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-24T03:29:07.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:07.196+0000 7f5a1f7fe640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-05-24T03:29:07.202 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:07.196+0000 7f5a1f7fe640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-05-24T03:29:07.202 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:07.196+0000 7f5a1f7fe640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-05-24T03:29:07.202 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:07.196+0000 7f5a1f7fe640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-05-24T03:29:07.203 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:07.196+0000 7f5a1f7fe640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-05-24T03:29:07.203 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:07.197+0000 7f5a1f7fe640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-05-24T03:29:10.059 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-05-24T03:29:10.093 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-24T03:29:10.191 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:10.186+0000 7fd7a8cdd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-05-24T03:29:10.191 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:10.186+0000 7fd7a8cdd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-05-24T03:29:10.191 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:10.186+0000 7fd7a8cdd640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-05-24T03:29:10.192 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:10.186+0000 7fd7a8cdd640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-05-24T03:29:10.192 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:10.186+0000 7fd7a8cdd640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-05-24T03:29:10.192 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:10.187+0000 7fd7a8cdd640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-05-24T03:29:12.811 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T03:29:12.814 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T03:29:13.055 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-05-24T03:29:13.088 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-24T03:29:13.180 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:13.176+0000 7f6233f18640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-05-24T03:29:13.181 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:13.176+0000 7f6233f18640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-05-24T03:29:13.181 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:13.176+0000 7f6233f18640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-05-24T03:29:13.181 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:13.176+0000 7f6233f18640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-05-24T03:29:13.181 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:13.176+0000 7f6233f18640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-05-24T03:29:13.181 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:13.176+0000 7f6233f18640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-05-24T03:29:16.039 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-05-24T03:29:16.069 INFO:tasks.ceph:Reading keys from all nodes... 2023-05-24T03:29:16.070 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-05-24T03:29:16.070 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-05-24T03:29:16.102 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-05-24T03:29:16.102 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-05-24T03:29:16.172 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-05-24T03:29:16.173 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-05-24T03:29:16.241 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-05-24T03:29:16.242 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-05-24T03:29:16.310 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-05-24T03:29:16.310 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-05-24T03:29:16.379 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-05-24T03:29:16.379 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-05-24T03:29:16.447 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-05-24T03:29:16.448 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-05-24T03:29:16.514 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-24T03:29:16.514 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-05-24T03:29:16.546 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-24T03:29:16.546 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-05-24T03:29:16.616 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-24T03:29:16.616 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-05-24T03:29:16.686 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-24T03:29:16.686 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-05-24T03:29:16.755 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-24T03:29:16.755 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-05-24T03:29:16.823 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-24T03:29:16.823 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-05-24T03:29:16.891 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-24T03:29:16.891 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-05-24T03:29:16.958 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-05-24T03:29:16.959 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-05-24T03:29:16.977 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-05-24T03:29:16.978 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-05-24T03:29:17.035 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-24T03:29:17.035 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-05-24T03:29:17.052 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-24T03:29:17.052 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-05-24T03:29:17.109 INFO:tasks.ceph:Adding keys to all mons... 2023-05-24T03:29:17.109 DEBUG:teuthology.orchestra.run.smithi146:> sudo tee -a /etc/ceph/ceph.keyring 2023-05-24T03:29:17.111 DEBUG:teuthology.orchestra.run.smithi151:> sudo tee -a /etc/ceph/ceph.keyring 2023-05-24T03:29:17.152 INFO:teuthology.orchestra.run.smithi146.stdout:[mgr.y] 2023-05-24T03:29:17.152 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQBthG1knwYVExAA+ZsxlSZ6zwcr6+hiB0EZ8A== 2023-05-24T03:29:17.153 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.a] 2023-05-24T03:29:17.153 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQBthG1kaMpBGxAADTb37WGhCkN8xGpuzHBg4w== 2023-05-24T03:29:17.153 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.c] 2023-05-24T03:29:17.153 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQBthG1koo+zIhAAv2p9adnNksOHvV6RFyn2Wg== 2023-05-24T03:29:17.153 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.0] 2023-05-24T03:29:17.153 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQBxhG1kQF49DhAAfLLKxqhfnNaWK9Vj+CFI2g== 2023-05-24T03:29:17.153 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.1] 2023-05-24T03:29:17.153 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQB0hG1korpKDRAA2kft52Xfzfxkfm8nDNnfyw== 2023-05-24T03:29:17.154 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.2] 2023-05-24T03:29:17.154 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQB3hG1ksnoaDBAARgUMvFuCfk19n4x+v/wjug== 2023-05-24T03:29:17.154 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.3] 2023-05-24T03:29:17.154 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQB6hG1kngFJCxAAlwLavZTQnUjSe1pz0+PogQ== 2023-05-24T03:29:17.154 INFO:teuthology.orchestra.run.smithi146.stdout:[mgr.x] 2023-05-24T03:29:17.154 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQBthG1kW0zgFxAAYHYAHa9YY9ZqamI+pGe0qw== 2023-05-24T03:29:17.154 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.b] 2023-05-24T03:29:17.155 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQBthG1kOBWmJxAAc2q7+feJjzmWYsg9ctdeCQ== 2023-05-24T03:29:17.155 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.d] 2023-05-24T03:29:17.155 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQBthG1kwhvnLhAAMv7lYrac4TFVlqQkI+M+gg== 2023-05-24T03:29:17.155 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.4] 2023-05-24T03:29:17.155 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQCAhG1kGlPQDBAA0eLhmUxR/Qu46yaNSNiYYA== 2023-05-24T03:29:17.155 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.5] 2023-05-24T03:29:17.156 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQCDhG1kBSnHCxAAH/4iFqpdHeIGwwujxEkqug== 2023-05-24T03:29:17.156 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.6] 2023-05-24T03:29:17.156 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQCGhG1kEawxCxAAbsdqFTkM0jklZBuplU5L0Q== 2023-05-24T03:29:17.156 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.7] 2023-05-24T03:29:17.156 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQCJhG1kWc2RChAABjjvtow8BuuRwkC3zcGJew== 2023-05-24T03:29:17.156 INFO:teuthology.orchestra.run.smithi146.stdout:[client.0] 2023-05-24T03:29:17.156 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQBthG1ku1AwMxAAA8dTpFmFCrk7WiA6UsZr/Q== 2023-05-24T03:29:17.157 INFO:teuthology.orchestra.run.smithi146.stdout:[client.2] 2023-05-24T03:29:17.157 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQBthG1kbOOVNhAAJs80aNaizJj+AQkRRfKTAQ== 2023-05-24T03:29:17.157 INFO:teuthology.orchestra.run.smithi146.stdout:[client.1] 2023-05-24T03:29:17.157 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQBthG1kBwztORAAQ0IQhwDlbkhFgnRqSGyd+w== 2023-05-24T03:29:17.157 INFO:teuthology.orchestra.run.smithi146.stdout:[client.3] 2023-05-24T03:29:17.157 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQBuhG1kCKMHBBAAO0TjoM/4syUqlkGFHyaySQ== 2023-05-24T03:29:17.174 INFO:teuthology.orchestra.run.smithi151.stdout:[mgr.y] 2023-05-24T03:29:17.174 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBthG1knwYVExAA+ZsxlSZ6zwcr6+hiB0EZ8A== 2023-05-24T03:29:17.174 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.a] 2023-05-24T03:29:17.175 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBthG1kaMpBGxAADTb37WGhCkN8xGpuzHBg4w== 2023-05-24T03:29:17.175 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.c] 2023-05-24T03:29:17.175 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBthG1koo+zIhAAv2p9adnNksOHvV6RFyn2Wg== 2023-05-24T03:29:17.175 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.0] 2023-05-24T03:29:17.175 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBxhG1kQF49DhAAfLLKxqhfnNaWK9Vj+CFI2g== 2023-05-24T03:29:17.175 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.1] 2023-05-24T03:29:17.175 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQB0hG1korpKDRAA2kft52Xfzfxkfm8nDNnfyw== 2023-05-24T03:29:17.176 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.2] 2023-05-24T03:29:17.176 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQB3hG1ksnoaDBAARgUMvFuCfk19n4x+v/wjug== 2023-05-24T03:29:17.176 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.3] 2023-05-24T03:29:17.176 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQB6hG1kngFJCxAAlwLavZTQnUjSe1pz0+PogQ== 2023-05-24T03:29:17.176 INFO:teuthology.orchestra.run.smithi151.stdout:[mgr.x] 2023-05-24T03:29:17.176 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBthG1kW0zgFxAAYHYAHa9YY9ZqamI+pGe0qw== 2023-05-24T03:29:17.176 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.b] 2023-05-24T03:29:17.177 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBthG1kOBWmJxAAc2q7+feJjzmWYsg9ctdeCQ== 2023-05-24T03:29:17.177 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.d] 2023-05-24T03:29:17.177 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBthG1kwhvnLhAAMv7lYrac4TFVlqQkI+M+gg== 2023-05-24T03:29:17.177 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.4] 2023-05-24T03:29:17.177 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQCAhG1kGlPQDBAA0eLhmUxR/Qu46yaNSNiYYA== 2023-05-24T03:29:17.177 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.5] 2023-05-24T03:29:17.177 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQCDhG1kBSnHCxAAH/4iFqpdHeIGwwujxEkqug== 2023-05-24T03:29:17.177 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.6] 2023-05-24T03:29:17.178 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQCGhG1kEawxCxAAbsdqFTkM0jklZBuplU5L0Q== 2023-05-24T03:29:17.178 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.7] 2023-05-24T03:29:17.178 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQCJhG1kWc2RChAABjjvtow8BuuRwkC3zcGJew== 2023-05-24T03:29:17.178 INFO:teuthology.orchestra.run.smithi151.stdout:[client.0] 2023-05-24T03:29:17.178 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBthG1ku1AwMxAAA8dTpFmFCrk7WiA6UsZr/Q== 2023-05-24T03:29:17.178 INFO:teuthology.orchestra.run.smithi151.stdout:[client.2] 2023-05-24T03:29:17.178 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBthG1kbOOVNhAAJs80aNaizJj+AQkRRfKTAQ== 2023-05-24T03:29:17.179 INFO:teuthology.orchestra.run.smithi151.stdout:[client.1] 2023-05-24T03:29:17.179 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBthG1kBwztORAAQ0IQhwDlbkhFgnRqSGyd+w== 2023-05-24T03:29:17.179 INFO:teuthology.orchestra.run.smithi151.stdout:[client.3] 2023-05-24T03:29:17.179 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBuhG1kCKMHBBAAO0TjoM/4syUqlkGFHyaySQ== 2023-05-24T03:29:17.180 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-05-24T03:29:17.200 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-05-24T03:29:17.273 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-24T03:29:17.275 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-24T03:29:17.332 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-24T03:29:17.335 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-24T03:29:17.391 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-24T03:29:17.393 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-24T03:29:17.447 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-24T03:29:17.449 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-24T03:29:17.502 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-24T03:29:17.504 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-24T03:29:17.557 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-24T03:29:17.560 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-24T03:29:17.613 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-05-24T03:29:17.614 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-05-24T03:29:17.667 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-24T03:29:17.670 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-24T03:29:17.725 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-24T03:29:17.728 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-24T03:29:17.784 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-24T03:29:17.786 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-24T03:29:17.839 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-24T03:29:17.841 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-24T03:29:17.894 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-24T03:29:17.896 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-24T03:29:17.949 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-24T03:29:17.951 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-24T03:29:18.004 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-24T03:29:18.006 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-24T03:29:18.061 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-24T03:29:18.063 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-24T03:29:18.120 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-24T03:29:18.122 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-24T03:29:18.178 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-24T03:29:18.180 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-24T03:29:18.236 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-05-24T03:29:18.236 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-05-24T03:29:18.262 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-05-24T03:29:18.360 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-05-24T03:29:18.387 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-05-24T03:29:18.414 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-05-24T03:29:18.513 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-05-24T03:29:18.540 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-05-24T03:29:18.605 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-05-24T03:29:18.702 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-05-24T03:29:18.728 DEBUG:teuthology.orchestra.run.smithi146:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-05-24T03:29:18.730 DEBUG:teuthology.orchestra.run.smithi151:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-05-24T03:29:18.785 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-05-24T03:29:18.785 INFO:tasks.ceph.mon.a:Restarting daemon 2023-05-24T03:29:18.786 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-05-24T03:29:18.787 INFO:tasks.ceph.mon.a:Started 2023-05-24T03:29:18.788 INFO:tasks.ceph.mon.b:Restarting daemon 2023-05-24T03:29:18.788 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-05-24T03:29:18.826 INFO:tasks.ceph.mon.b:Started 2023-05-24T03:29:18.827 INFO:tasks.ceph.mon.c:Restarting daemon 2023-05-24T03:29:18.827 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-05-24T03:29:18.830 INFO:tasks.ceph.mon.c:Started 2023-05-24T03:29:18.830 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-05-24T03:29:18.831 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-05-24T03:29:18.831 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-05-24T03:29:18.833 INFO:tasks.ceph.mgr.y:Started 2023-05-24T03:29:18.834 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-05-24T03:29:18.834 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-05-24T03:29:18.835 INFO:tasks.ceph.mgr.x:Started 2023-05-24T03:29:18.836 INFO:tasks.ceph:Setting crush tunables to default 2023-05-24T03:29:18.836 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd crush tunables default 2023-05-24T03:29:18.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:18.953+0000 7f287c375700 1 Processor -- start 2023-05-24T03:29:18.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:18.953+0000 7f287c375700 1 -- start start 2023-05-24T03:29:18.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:18.954+0000 7f287c375700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28740d2a30 0x7f287406baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:18.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:18.954+0000 7f287c375700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f28740cf530 0x7f28740cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:18.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:18.954+0000 7f287c375700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28740cd960 con 0x7f28740d0070 2023-05-24T03:29:18.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:18.954+0000 7f287c375700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28741612b0 con 0x7f28740cf530 2023-05-24T03:29:18.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:18.954+0000 7f287c375700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28740cdc00 con 0x7f28740d2a30 2023-05-24T03:29:18.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:18.954+0000 7f287a912700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f28740d0070 0x7f28740b80e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44432/0 (socket says 172.21.15.146:44432) 2023-05-24T03:29:18.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:18.954+0000 7f287a912700 1 -- 172.21.15.146:0/3860894831 learned_addr learned my addr 172.21.15.146:0/3860894831 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:29:18.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:18.954+0000 7f2879910700 1 --2- 172.21.15.146:0/3860894831 >> v2:172.21.15.151:3300/0 conn(0x7f28740cf530 0x7f28740cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:18.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:18.954+0000 7f287a111700 1 --2- 172.21.15.146:0/3860894831 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28740d2a30 0x7f287406baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:18.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:18.955+0000 7f287a111700 1 -- 172.21.15.146:0/3860894831 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28740d2a30 msgr2=0x7f287406baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-05-24T03:29:18.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:18.955+0000 7f287a111700 1 -- 172.21.15.146:0/3860894831 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28740d2a30 msgr2=0x7f287406baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-24T03:29:18.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:18.955+0000 7f287a111700 1 --2- 172.21.15.146:0/3860894831 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28740d2a30 0x7f287406baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-24T03:29:18.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:18.955+0000 7f2879910700 1 -- 172.21.15.146:0/3860894831 >> v2:172.21.15.151:3300/0 conn(0x7f28740cf530 msgr2=0x7f28740cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-05-24T03:29:18.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:18.955+0000 7f2879910700 1 -- 172.21.15.146:0/3860894831 >> v2:172.21.15.151:3300/0 conn(0x7f28740cf530 msgr2=0x7f28740cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-24T03:29:18.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:18.955+0000 7f2879910700 1 --2- 172.21.15.146:0/3860894831 >> v2:172.21.15.151:3300/0 conn(0x7f28740cf530 0x7f28740cfb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-24T03:29:18.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:18.955+0000 7f287a111700 1 --2- 172.21.15.146:0/3860894831 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28740d2a30 0x7f287406baa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-05-24T03:29:18.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:18.955+0000 7f2879910700 1 --2- 172.21.15.146:0/3860894831 >> v2:172.21.15.151:3300/0 conn(0x7f28740cf530 0x7f28740cfb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-05-24T03:29:19.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.138+0000 7f287910f700 1 -- 172.21.15.146:0/3860894831 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1513057334 0 0) 0x7f28740cd960 con 0x7f28740d0070 2023-05-24T03:29:19.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.139+0000 7f287910f700 1 -- 172.21.15.146:0/3860894831 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f285c0035b0 con 0x7f28740d0070 2023-05-24T03:29:19.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.139+0000 7f287910f700 1 -- 172.21.15.146:0/3860894831 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2386089680 0 0) 0x7f285c0035b0 con 0x7f28740d0070 2023-05-24T03:29:19.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.139+0000 7f287910f700 1 -- 172.21.15.146:0/3860894831 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28740d2a30 msgr2=0x7f287406baa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-05-24T03:29:19.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.139+0000 7f287910f700 1 --2- 172.21.15.146:0/3860894831 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28740d2a30 0x7f287406baa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:19.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.139+0000 7f287910f700 1 -- 172.21.15.146:0/3860894831 >> v2:172.21.15.151:3300/0 conn(0x7f28740cf530 msgr2=0x7f28740cfb30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-05-24T03:29:19.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.139+0000 7f287910f700 1 --2- 172.21.15.146:0/3860894831 >> v2:172.21.15.151:3300/0 conn(0x7f28740cf530 0x7f28740cfb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:19.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.139+0000 7f287910f700 1 -- 172.21.15.146:0/3860894831 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2874161590 con 0x7f28740d0070 2023-05-24T03:29:19.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.139+0000 7f287910f700 1 -- 172.21.15.146:0/3860894831 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1301887351 0 0) 0x7f28640019f0 con 0x7f28740d0070 2023-05-24T03:29:19.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.139+0000 7f287910f700 1 -- 172.21.15.146:0/3860894831 >> v1:172.21.15.146:6789/0 conn(0x7f28740d0070 legacy=0x7f28740b80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:19.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.139+0000 7f287910f700 1 --2- 172.21.15.146:0/3860894831 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28740d2a30 0x7f285c003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:19.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.139+0000 7f287910f700 1 --2- 172.21.15.146:0/3860894831 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f285c004030 0x7f285c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:19.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.139+0000 7f287910f700 1 --2- 172.21.15.146:0/3860894831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f285c004d90 0x7f285c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:19.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.139+0000 7f287910f700 1 -- 172.21.15.146:0/3860894831 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28741612b0 con 0x7f285c004d90 2023-05-24T03:29:19.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.139+0000 7f287910f700 1 -- 172.21.15.146:0/3860894831 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28740cdc00 con 0x7f285c004030 2023-05-24T03:29:19.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.139+0000 7f287910f700 1 -- 172.21.15.146:0/3860894831 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f285c00bb10 con 0x7f28740d2a30 2023-05-24T03:29:19.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.139+0000 7f287a912700 1 --2- 172.21.15.146:0/3860894831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f285c004d90 0x7f285c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:19.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.139+0000 7f287a111700 1 --2- 172.21.15.146:0/3860894831 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28740d2a30 0x7f285c003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:19.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.139+0000 7f2879910700 1 --2- 172.21.15.146:0/3860894831 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f285c004030 0x7f285c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:19.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.139+0000 7f287a912700 1 -- 172.21.15.146:0/3860894831 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28740d2a30 msgr2=0x7f285c003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:19.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.139+0000 7f287a912700 1 --2- 172.21.15.146:0/3860894831 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28740d2a30 0x7f285c003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:19.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.139+0000 7f287a912700 1 -- 172.21.15.146:0/3860894831 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f285c004030 msgr2=0x7f285c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:19.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.139+0000 7f287a912700 1 --2- 172.21.15.146:0/3860894831 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f285c004030 0x7f285c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:19.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.139+0000 7f287a912700 1 -- 172.21.15.146:0/3860894831 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f285c0035b0 con 0x7f285c004d90 2023-05-24T03:29:19.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.139+0000 7f287a912700 1 --2- 172.21.15.146:0/3860894831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f285c004d90 0x7f285c005200 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f286400a8d0 tx=0x7f285c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b2875c00df7c17 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:19.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.139+0000 7f287910f700 1 -- 172.21.15.146:0/3860894831 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286400a340 con 0x7f285c004d90 2023-05-24T03:29:19.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.139+0000 7f287910f700 1 -- 172.21.15.146:0/3860894831 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2864012600 con 0x7f285c004d90 2023-05-24T03:29:19.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.139+0000 7f287910f700 1 -- 172.21.15.146:0/3860894831 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28640129b0 con 0x7f285c004d90 2023-05-24T03:29:19.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.140+0000 7f287c375700 1 -- 172.21.15.146:0/3860894831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f285c004d90 msgr2=0x7f285c005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:19.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.140+0000 7f287c375700 1 --2- 172.21.15.146:0/3860894831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f285c004d90 0x7f285c005200 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f286400a8d0 tx=0x7f285c005880 comp rx=0 tx=0).stop 2023-05-24T03:29:19.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.140+0000 7f287a912700 1 -- 172.21.15.146:0/3860894831 reap_dead start 2023-05-24T03:29:19.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.140+0000 7f287c375700 1 -- 172.21.15.146:0/3860894831 shutdown_connections 2023-05-24T03:29:19.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.140+0000 7f287c375700 1 -- 172.21.15.146:0/3860894831 >> 172.21.15.146:0/3860894831 conn(0x7f28740743a0 msgr2=0x7f287406af50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:19.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.140+0000 7f287c375700 1 -- 172.21.15.146:0/3860894831 shutdown_connections 2023-05-24T03:29:19.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.140+0000 7f287c375700 1 -- 172.21.15.146:0/3860894831 wait complete. 2023-05-24T03:29:19.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.141+0000 7f287c375700 1 Processor -- start 2023-05-24T03:29:19.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.142+0000 7f287c375700 1 -- start start 2023-05-24T03:29:19.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.142+0000 7f287c375700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f285c004d90 0x7f28740cc040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:19.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.142+0000 7f287c375700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f287414ff50 0x7f28741f1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:19.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.142+0000 7f287c375700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28740c8f70 0x7f287415dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:19.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.142+0000 7f287c375700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28740cbc20 con 0x7f285c004d90 2023-05-24T03:29:19.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.142+0000 7f287c375700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28741f21e0 con 0x7f28740c8f70 2023-05-24T03:29:19.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.142+0000 7f287c375700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28740c9950 con 0x7f287414ff50 2023-05-24T03:29:19.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.142+0000 7f287a111700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f285c004d90 0x7f28740cc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:19.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.142+0000 7f287a111700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f285c004d90 0x7f28740cc040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37996/0 (socket says 172.21.15.146:37996) 2023-05-24T03:29:19.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.142+0000 7f287a111700 1 -- 172.21.15.146:0/3064963436 learned_addr learned my addr 172.21.15.146:0/3064963436 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:19.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.142+0000 7f2879910700 1 --2- 172.21.15.146:0/3064963436 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f287414ff50 0x7f28741f1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:19.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.142+0000 7f287a912700 1 --2- 172.21.15.146:0/3064963436 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28740c8f70 0x7f287415dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:19.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.143+0000 7f287a111700 1 -- 172.21.15.146:0/3064963436 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f287414ff50 msgr2=0x7f28741f1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:19.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.143+0000 7f287a111700 1 --2- 172.21.15.146:0/3064963436 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f287414ff50 0x7f28741f1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:19.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.143+0000 7f287a111700 1 -- 172.21.15.146:0/3064963436 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28740c8f70 msgr2=0x7f287415dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:19.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.143+0000 7f287a111700 1 --2- 172.21.15.146:0/3064963436 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28740c8f70 0x7f287415dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:19.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.143+0000 7f287a111700 1 -- 172.21.15.146:0/3064963436 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2874146850 con 0x7f285c004d90 2023-05-24T03:29:19.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.143+0000 7f287a111700 1 --2- 172.21.15.146:0/3064963436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f285c004d90 0x7f28740cc040 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f286c010890 tx=0x7f286c010ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:19.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.144+0000 7f2872ffd700 1 -- 172.21.15.146:0/3064963436 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c005c20 con 0x7f285c004d90 2023-05-24T03:29:19.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.144+0000 7f2872ffd700 1 -- 172.21.15.146:0/3064963436 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286c00c050 con 0x7f285c004d90 2023-05-24T03:29:19.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.144+0000 7f287c375700 1 -- 172.21.15.146:0/3064963436 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28740d04f0 con 0x7f285c004d90 2023-05-24T03:29:19.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.144+0000 7f2872ffd700 1 -- 172.21.15.146:0/3064963436 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c014620 con 0x7f285c004d90 2023-05-24T03:29:19.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.144+0000 7f287c375700 1 -- 172.21.15.146:0/3064963436 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28741469e0 con 0x7f285c004d90 2023-05-24T03:29:19.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.144+0000 7f2872ffd700 1 -- 172.21.15.146:0/3064963436 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f286c014780 con 0x7f285c004d90 2023-05-24T03:29:19.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.144+0000 7f2872ffd700 1 -- 172.21.15.146:0/3064963436 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f286c0068f0 con 0x7f285c004d90 2023-05-24T03:29:19.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.145+0000 7f287c375700 1 -- 172.21.15.146:0/3064963436 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2874072ae0 con 0x7f285c004d90 2023-05-24T03:29:19.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.147+0000 7f2872ffd700 1 -- 172.21.15.146:0/3064963436 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f286c023060 con 0x7f285c004d90 2023-05-24T03:29:19.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.223+0000 7f287c375700 1 -- 172.21.15.146:0/3064963436 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f2874068d00 con 0x7f285c004d90 2023-05-24T03:29:19.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.226+0000 7f2872ffd700 1 -- 172.21.15.146:0/3064963436 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f286c019070 con 0x7f285c004d90 2023-05-24T03:29:19.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.227+0000 7f287c375700 1 -- 172.21.15.146:0/3064963436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f285c004d90 msgr2=0x7f28740cc040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:19.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.227+0000 7f287c375700 1 --2- 172.21.15.146:0/3064963436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f285c004d90 0x7f28740cc040 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f286c010890 tx=0x7f286c010ba0 comp rx=0 tx=0).stop 2023-05-24T03:29:19.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.227+0000 7f287c375700 1 -- 172.21.15.146:0/3064963436 shutdown_connections 2023-05-24T03:29:19.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.227+0000 7f287c375700 1 --2- 172.21.15.146:0/3064963436 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28740c8f70 0x7f287415dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:19.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.227+0000 7f287c375700 1 --2- 172.21.15.146:0/3064963436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f285c004d90 0x7f28740cc040 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:19.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.227+0000 7f287c375700 1 --2- 172.21.15.146:0/3064963436 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f287414ff50 0x7f28741f1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:19.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.227+0000 7f287c375700 1 -- 172.21.15.146:0/3064963436 >> 172.21.15.146:0/3064963436 conn(0x7f28740743a0 msgr2=0x7f287415c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:19.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.227+0000 7f287c375700 1 -- 172.21.15.146:0/3064963436 shutdown_connections 2023-05-24T03:29:19.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:19.227+0000 7f287c375700 1 -- 172.21.15.146:0/3064963436 wait complete. 2023-05-24T03:29:19.232 INFO:teuthology.orchestra.run.smithi146.stderr:adjusted tunables profile to default 2023-05-24T03:29:19.242 INFO:tasks.ceph:check_enable_crimson: False 2023-05-24T03:29:19.242 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-05-24T03:29:19.243 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-05-24T03:29:19.243 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-05-24T03:29:19.269 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-05-24T03:29:19.269 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-05-24T03:29:19.270 INFO:tasks.ceph.mgr.y.smithi146.stderr:2023-05-24T03:29:19.265+0000 7f25a1ed3200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-05-24T03:29:19.335 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-05-24T03:29:19.336 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-05-24T03:29:19.338 INFO:tasks.ceph.mgr.y.smithi146.stderr:2023-05-24T03:29:19.335+0000 7f25a1ed3200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-24T03:29:19.364 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-05-24T03:29:19.364 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-05-24T03:29:19.422 INFO:tasks.ceph.mgr.y.smithi146.stderr:2023-05-24T03:29:19.419+0000 7f25a1ed3200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-24T03:29:19.431 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-24T03:29:19.432 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-05-24T03:29:19.459 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-24T03:29:19.460 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-05-24T03:29:19.505 INFO:tasks.ceph.mgr.y.smithi146.stderr:2023-05-24T03:29:19.501+0000 7f25a1ed3200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-24T03:29:19.527 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-24T03:29:19.527 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-05-24T03:29:19.596 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-24T03:29:19.596 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-05-24T03:29:19.636 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-05-24T03:29:19.632+0000 7f364301f200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-05-24T03:29:19.649 INFO:tasks.ceph.mgr.y.smithi146.stderr:2023-05-24T03:29:19.646+0000 7f25a1ed3200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-24T03:29:19.662 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new f24b319b-fcc8-4385-b0cb-78138fc31417 0 2023-05-24T03:29:19.704 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-05-24T03:29:19.700+0000 7f364301f200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-24T03:29:19.785 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-05-24T03:29:19.780+0000 7f364301f200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-24T03:29:19.824 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.820+0000 7f4e83c71700 1 Processor -- start 2023-05-24T03:29:19.825 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.820+0000 7f4e83c71700 1 -- start start 2023-05-24T03:29:19.826 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.821+0000 7f4e83c71700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4e7c070fe0 0x7f4e7c0b21c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:19.826 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.821+0000 7f4e83c71700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e7c15ad80 con 0x7f4e7c159cd0 2023-05-24T03:29:19.826 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.821+0000 7f4e83c71700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e7c15a7c0 con 0x7f4e7c0cdfd0 2023-05-24T03:29:19.826 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.821+0000 7f4e83c71700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e7c15aaa0 con 0x7f4e7c070fe0 2023-05-24T03:29:19.827 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.821+0000 7f4e8120c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4e7c070fe0 0x7f4e7c0b21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:19.827 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.821+0000 7f4e8120c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4e7c070fe0 0x7f4e7c0b21c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:43568/0 (socket says 172.21.15.151:43568) 2023-05-24T03:29:19.827 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.821+0000 7f4e8120c700 1 -- 172.21.15.151:0/454385066 learned_addr learned my addr 172.21.15.151:0/454385066 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-05-24T03:29:19.827 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.821+0000 7f4e8120c700 1 -- 172.21.15.151:0/454385066 >> v1:172.21.15.151:6789/0 conn(0x7f4e7c0cdfd0 legacy=0x7f4e7c0ce3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:19.827 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.821+0000 7f4e8120c700 1 -- 172.21.15.151:0/454385066 >> v1:172.21.15.146:6789/0 conn(0x7f4e7c159cd0 legacy=0x7f4e7c06d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:19.827 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.821+0000 7f4e8120c700 1 -- 172.21.15.151:0/454385066 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e7c0b19c0 con 0x7f4e7c070fe0 2023-05-24T03:29:19.827 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.821+0000 7f4e8120c700 1 --2- 172.21.15.151:0/454385066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e7c070fe0 0x7f4e7c0b21c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c00bb90 tx=0x7f4e6c00bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d355f2be92130fd5 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:19.827 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.821+0000 7f4e80a0b700 1 -- 172.21.15.151:0/454385066 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e6c00dd50 con 0x7f4e7c070fe0 2023-05-24T03:29:19.828 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.821+0000 7f4e80a0b700 1 -- 172.21.15.151:0/454385066 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e6c010470 con 0x7f4e7c070fe0 2023-05-24T03:29:19.828 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.821+0000 7f4e80a0b700 1 -- 172.21.15.151:0/454385066 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e6c010800 con 0x7f4e7c070fe0 2023-05-24T03:29:19.830 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.822+0000 7f4e83c71700 1 -- 172.21.15.151:0/454385066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e7c070fe0 msgr2=0x7f4e7c0b21c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:19.830 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.822+0000 7f4e83c71700 1 --2- 172.21.15.151:0/454385066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e7c070fe0 0x7f4e7c0b21c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c00bb90 tx=0x7f4e6c00bea0 comp rx=0 tx=0).stop 2023-05-24T03:29:19.831 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.822+0000 7f4e83c71700 1 -- 172.21.15.151:0/454385066 shutdown_connections 2023-05-24T03:29:19.831 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.822+0000 7f4e83c71700 1 --2- 172.21.15.151:0/454385066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e7c070fe0 0x7f4e7c0b21c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:19.831 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.822+0000 7f4e83c71700 1 -- 172.21.15.151:0/454385066 >> 172.21.15.151:0/454385066 conn(0x7f4e7c0cfea0 msgr2=0x7f4e7c0d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:19.831 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.822+0000 7f4e83c71700 1 -- 172.21.15.151:0/454385066 shutdown_connections 2023-05-24T03:29:19.831 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.822+0000 7f4e83c71700 1 -- 172.21.15.151:0/454385066 wait complete. 2023-05-24T03:29:19.832 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.823+0000 7f4e83c71700 1 Processor -- start 2023-05-24T03:29:19.832 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.823+0000 7f4e83c71700 1 -- start start 2023-05-24T03:29:19.832 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.824+0000 7f4e83c71700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e7c070fe0 0x7f4e7c153d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:19.832 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.824+0000 7f4e83c71700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e7c0cdfd0 0x7f4e7c0b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:19.832 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.824+0000 7f4e83c71700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e7c159cd0 0x7f4e7c0b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:19.832 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.824+0000 7f4e83c71700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7c154240 con 0x7f4e7c159cd0 2023-05-24T03:29:19.832 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.824+0000 7f4e83c71700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7c0c68b0 con 0x7f4e7c070fe0 2023-05-24T03:29:19.833 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.824+0000 7f4e83c71700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7c15c0f0 con 0x7f4e7c0cdfd0 2023-05-24T03:29:19.833 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.824+0000 7f4e81a0d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e7c070fe0 0x7f4e7c153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:19.833 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.824+0000 7f4e8120c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e7c0cdfd0 0x7f4e7c0b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:19.833 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.824+0000 7f4e81a0d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e7c070fe0 0x7f4e7c153d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:43572/0 (socket says 172.21.15.151:43572) 2023-05-24T03:29:19.833 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.824+0000 7f4e81a0d700 1 -- 172.21.15.151:0/3617072850 learned_addr learned my addr 172.21.15.151:0/3617072850 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-05-24T03:29:19.833 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.824+0000 7f4e8220e700 1 --2- 172.21.15.151:0/3617072850 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e7c159cd0 0x7f4e7c0b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:19.833 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.824+0000 7f4e81a0d700 1 -- 172.21.15.151:0/3617072850 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e7c0cdfd0 msgr2=0x7f4e7c0b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:19.833 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.824+0000 7f4e81a0d700 1 --2- 172.21.15.151:0/3617072850 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e7c0cdfd0 0x7f4e7c0b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:19.834 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.824+0000 7f4e81a0d700 1 -- 172.21.15.151:0/3617072850 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e7c159cd0 msgr2=0x7f4e7c0b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:19.834 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.824+0000 7f4e81a0d700 1 --2- 172.21.15.151:0/3617072850 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e7c159cd0 0x7f4e7c0b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:19.834 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.824+0000 7f4e81a0d700 1 -- 172.21.15.151:0/3617072850 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e6c00b7f0 con 0x7f4e7c070fe0 2023-05-24T03:29:19.834 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.825+0000 7f4e81a0d700 1 --2- 172.21.15.151:0/3617072850 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e7c070fe0 0x7f4e7c153d00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4e7800c4b0 tx=0x7f4e7800c7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:19.834 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.825+0000 7f4e727fc700 1 -- 172.21.15.151:0/3617072850 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e780052d0 con 0x7f4e7c070fe0 2023-05-24T03:29:19.835 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.825+0000 7f4e727fc700 1 -- 172.21.15.151:0/3617072850 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e78005430 con 0x7f4e7c070fe0 2023-05-24T03:29:19.835 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.825+0000 7f4e727fc700 1 -- 172.21.15.151:0/3617072850 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e780038c0 con 0x7f4e7c070fe0 2023-05-24T03:29:19.835 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.825+0000 7f4e83c71700 1 -- 172.21.15.151:0/3617072850 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e7c0b2700 con 0x7f4e7c070fe0 2023-05-24T03:29:19.835 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.825+0000 7f4e83c71700 1 -- 172.21.15.151:0/3617072850 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e7c0b1ca0 con 0x7f4e7c070fe0 2023-05-24T03:29:19.835 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.825+0000 7f4e727fc700 1 -- 172.21.15.151:0/3617072850 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4e78003d20 con 0x7f4e7c070fe0 2023-05-24T03:29:19.836 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.825+0000 7f4e727fc700 1 -- 172.21.15.151:0/3617072850 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f4e7801c780 con 0x7f4e7c070fe0 2023-05-24T03:29:19.836 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.826+0000 7f4e83c71700 1 -- 172.21.15.151:0/3617072850 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e7c0b2890 con 0x7f4e7c070fe0 2023-05-24T03:29:19.836 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.828+0000 7f4e727fc700 1 -- 172.21.15.151:0/3617072850 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f4e78017070 con 0x7f4e7c070fe0 2023-05-24T03:29:19.869 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-05-24T03:29:19.864+0000 7f364301f200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-24T03:29:19.918 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.913+0000 7f4e83c71700 1 -- 172.21.15.151:0/3617072850 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f24b319b-fcc8-4385-b0cb-78138fc31417", "id": 0} v 0) v1 -- 0x7f4e7c068d00 con 0x7f4e7c070fe0 2023-05-24T03:29:19.921 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.917+0000 7f4e727fc700 1 -- 172.21.15.151:0/3617072850 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f24b319b-fcc8-4385-b0cb-78138fc31417", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4e7800ce40 con 0x7f4e7c070fe0 2023-05-24T03:29:19.922 INFO:teuthology.orchestra.run.smithi151.stdout:0 2023-05-24T03:29:19.922 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.918+0000 7f4e83c71700 1 -- 172.21.15.151:0/3617072850 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e7c070fe0 msgr2=0x7f4e7c153d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:19.923 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.918+0000 7f4e83c71700 1 --2- 172.21.15.151:0/3617072850 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e7c070fe0 0x7f4e7c153d00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4e7800c4b0 tx=0x7f4e7800c7c0 comp rx=0 tx=0).stop 2023-05-24T03:29:19.923 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.918+0000 7f4e83c71700 1 -- 172.21.15.151:0/3617072850 shutdown_connections 2023-05-24T03:29:19.923 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.918+0000 7f4e83c71700 1 --2- 172.21.15.151:0/3617072850 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e7c159cd0 0x7f4e7c0b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:19.923 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.918+0000 7f4e83c71700 1 --2- 172.21.15.151:0/3617072850 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e7c070fe0 0x7f4e7c153d00 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:19.924 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.918+0000 7f4e83c71700 1 --2- 172.21.15.151:0/3617072850 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e7c0cdfd0 0x7f4e7c0b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:19.924 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.918+0000 7f4e83c71700 1 -- 172.21.15.151:0/3617072850 >> 172.21.15.151:0/3617072850 conn(0x7f4e7c0cfea0 msgr2=0x7f4e7c0d0270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:19.924 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.918+0000 7f4e83c71700 1 -- 172.21.15.151:0/3617072850 shutdown_connections 2023-05-24T03:29:19.925 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:19.918+0000 7f4e83c71700 1 -- 172.21.15.151:0/3617072850 wait complete. 2023-05-24T03:29:19.934 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new c9639ea9-8f9b-498e-92c8-aa976edbf1da 1 2023-05-24T03:29:19.978 INFO:tasks.ceph.mgr.y.smithi146.stderr:2023-05-24T03:29:19.975+0000 7f25a1ed3200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-24T03:29:20.019 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-05-24T03:29:20.014+0000 7f364301f200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-24T03:29:20.053 INFO:tasks.ceph.mgr.y.smithi146.stderr:2023-05-24T03:29:20.049+0000 7f25a1ed3200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-24T03:29:20.095 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.091+0000 7f423d11f700 1 Processor -- start 2023-05-24T03:29:20.096 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.091+0000 7f423d11f700 1 -- start start 2023-05-24T03:29:20.097 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.092+0000 7f423d11f700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4238159cd0 0x7f423815a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:20.097 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.092+0000 7f423d11f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42380b28d0 con 0x7f4238070fe0 2023-05-24T03:29:20.097 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.092+0000 7f423d11f700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f423815ad80 con 0x7f42380cdfd0 2023-05-24T03:29:20.097 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.092+0000 7f423d11f700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f423815a7c0 con 0x7f4238159cd0 2023-05-24T03:29:20.097 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.092+0000 7f423759e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4238159cd0 0x7f423815a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:20.098 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.092+0000 7f423759e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4238159cd0 0x7f423815a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:43582/0 (socket says 172.21.15.151:43582) 2023-05-24T03:29:20.098 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.092+0000 7f423759e700 1 -- 172.21.15.151:0/2054595432 learned_addr learned my addr 172.21.15.151:0/2054595432 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-05-24T03:29:20.098 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.092+0000 7f423759e700 1 -- 172.21.15.151:0/2054595432 >> v1:172.21.15.151:6789/0 conn(0x7f42380cdfd0 legacy=0x7f42380ce3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:20.098 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.092+0000 7f423759e700 1 -- 172.21.15.151:0/2054595432 >> v1:172.21.15.146:6789/0 conn(0x7f4238070fe0 legacy=0x7f42380b21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:20.098 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.092+0000 7f423759e700 1 -- 172.21.15.151:0/2054595432 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f423815aaa0 con 0x7f4238159cd0 2023-05-24T03:29:20.098 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.092+0000 7f423759e700 1 --2- 172.21.15.151:0/2054595432 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4238159cd0 0x7f423815a150 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f423000d150 tx=0x7f423000d460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ec724812d40ee49 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:20.098 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.092+0000 7f4235d9b700 1 -- 172.21.15.151:0/2054595432 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4230010070 con 0x7f4238159cd0 2023-05-24T03:29:20.099 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.092+0000 7f4235d9b700 1 -- 172.21.15.151:0/2054595432 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423000ddc0 con 0x7f4238159cd0 2023-05-24T03:29:20.099 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.092+0000 7f4235d9b700 1 -- 172.21.15.151:0/2054595432 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423000b310 con 0x7f4238159cd0 2023-05-24T03:29:20.101 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.093+0000 7f423d11f700 1 -- 172.21.15.151:0/2054595432 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4238159cd0 msgr2=0x7f423815a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:20.102 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.093+0000 7f423d11f700 1 --2- 172.21.15.151:0/2054595432 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4238159cd0 0x7f423815a150 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f423000d150 tx=0x7f423000d460 comp rx=0 tx=0).stop 2023-05-24T03:29:20.102 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.093+0000 7f423d11f700 1 -- 172.21.15.151:0/2054595432 shutdown_connections 2023-05-24T03:29:20.102 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.093+0000 7f423d11f700 1 --2- 172.21.15.151:0/2054595432 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4238159cd0 0x7f423815a150 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:20.102 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.093+0000 7f423d11f700 1 -- 172.21.15.151:0/2054595432 >> 172.21.15.151:0/2054595432 conn(0x7f42380cfea0 msgr2=0x7f42380d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:20.102 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.093+0000 7f423d11f700 1 -- 172.21.15.151:0/2054595432 shutdown_connections 2023-05-24T03:29:20.102 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.093+0000 7f423d11f700 1 -- 172.21.15.151:0/2054595432 wait complete. 2023-05-24T03:29:20.102 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.094+0000 7f423d11f700 1 Processor -- start 2023-05-24T03:29:20.103 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.095+0000 7f423d11f700 1 -- start start 2023-05-24T03:29:20.103 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.095+0000 7f423d11f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4238070fe0 0x7f42380aec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:20.103 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.095+0000 7f423d11f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42380cdfd0 0x7f4238153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:20.103 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.095+0000 7f423d11f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4238159cd0 0x7f42380ae120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:20.103 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.095+0000 7f423d11f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42380cb600 con 0x7f4238070fe0 2023-05-24T03:29:20.103 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.095+0000 7f423d11f700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42380ad360 con 0x7f4238159cd0 2023-05-24T03:29:20.103 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.095+0000 7f423d11f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42380ad640 con 0x7f42380cdfd0 2023-05-24T03:29:20.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.095+0000 7f423759e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4238159cd0 0x7f42380ae120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:20.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.095+0000 7f423759e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4238159cd0 0x7f42380ae120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:43588/0 (socket says 172.21.15.151:43588) 2023-05-24T03:29:20.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.095+0000 7f423759e700 1 -- 172.21.15.151:0/3958180767 learned_addr learned my addr 172.21.15.151:0/3958180767 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-05-24T03:29:20.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.095+0000 7f423659c700 1 --2- 172.21.15.151:0/3958180767 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42380cdfd0 0x7f4238153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:20.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.095+0000 7f4236d9d700 1 --2- 172.21.15.151:0/3958180767 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4238070fe0 0x7f42380aec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:20.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.096+0000 7f423759e700 1 -- 172.21.15.151:0/3958180767 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42380cdfd0 msgr2=0x7f4238153620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:20.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.096+0000 7f423759e700 1 --2- 172.21.15.151:0/3958180767 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42380cdfd0 0x7f4238153620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:20.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.096+0000 7f423759e700 1 -- 172.21.15.151:0/3958180767 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4238070fe0 msgr2=0x7f42380aec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:20.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.096+0000 7f423759e700 1 --2- 172.21.15.151:0/3958180767 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4238070fe0 0x7f42380aec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:20.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.096+0000 7f423759e700 1 -- 172.21.15.151:0/3958180767 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f423000bd40 con 0x7f4238159cd0 2023-05-24T03:29:20.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.096+0000 7f423659c700 1 --2- 172.21.15.151:0/3958180767 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42380cdfd0 0x7f4238153620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T03:29:20.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.096+0000 7f423759e700 1 --2- 172.21.15.151:0/3958180767 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4238159cd0 0x7f42380ae120 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f423806ce70 tx=0x7f4230004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:20.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.096+0000 7f421f7fe700 1 -- 172.21.15.151:0/3958180767 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4230009a10 con 0x7f4238159cd0 2023-05-24T03:29:20.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.096+0000 7f421f7fe700 1 -- 172.21.15.151:0/3958180767 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4230009b70 con 0x7f4238159cd0 2023-05-24T03:29:20.106 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.096+0000 7f423d11f700 1 -- 172.21.15.151:0/3958180767 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42380b1ca0 con 0x7f4238159cd0 2023-05-24T03:29:20.106 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.096+0000 7f421f7fe700 1 -- 172.21.15.151:0/3958180767 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4230004040 con 0x7f4238159cd0 2023-05-24T03:29:20.106 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.096+0000 7f423d11f700 1 -- 172.21.15.151:0/3958180767 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42380b19c0 con 0x7f4238159cd0 2023-05-24T03:29:20.106 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.096+0000 7f421f7fe700 1 -- 172.21.15.151:0/3958180767 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f42300044a0 con 0x7f4238159cd0 2023-05-24T03:29:20.106 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.096+0000 7f421f7fe700 1 -- 172.21.15.151:0/3958180767 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f423001dd60 con 0x7f4238159cd0 2023-05-24T03:29:20.106 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.097+0000 7f423d11f700 1 -- 172.21.15.151:0/3958180767 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f423806d0f0 con 0x7f4238159cd0 2023-05-24T03:29:20.107 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.099+0000 7f421f7fe700 1 -- 172.21.15.151:0/3958180767 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f4230021020 con 0x7f4238159cd0 2023-05-24T03:29:20.187 INFO:tasks.ceph.mgr.y.smithi146.stderr:2023-05-24T03:29:20.183+0000 7f25a1ed3200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-24T03:29:20.190 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.185+0000 7f423d11f700 1 -- 172.21.15.151:0/3958180767 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c9639ea9-8f9b-498e-92c8-aa976edbf1da", "id": 1} v 0) v1 -- 0x7f4238068d00 con 0x7f4238159cd0 2023-05-24T03:29:20.200 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.195+0000 7f421f7fe700 1 -- 172.21.15.151:0/3958180767 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c9639ea9-8f9b-498e-92c8-aa976edbf1da", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f423001d460 con 0x7f4238159cd0 2023-05-24T03:29:20.201 INFO:teuthology.orchestra.run.smithi151.stdout:1 2023-05-24T03:29:20.202 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.196+0000 7f423d11f700 1 -- 172.21.15.151:0/3958180767 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4238159cd0 msgr2=0x7f42380ae120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:20.202 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.196+0000 7f423d11f700 1 --2- 172.21.15.151:0/3958180767 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4238159cd0 0x7f42380ae120 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f423806ce70 tx=0x7f4230004ad0 comp rx=0 tx=0).stop 2023-05-24T03:29:20.203 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.196+0000 7f423d11f700 1 -- 172.21.15.151:0/3958180767 shutdown_connections 2023-05-24T03:29:20.203 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.196+0000 7f423d11f700 1 --2- 172.21.15.151:0/3958180767 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4238159cd0 0x7f42380ae120 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:20.203 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.196+0000 7f423d11f700 1 --2- 172.21.15.151:0/3958180767 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4238070fe0 0x7f42380aec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:20.203 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.196+0000 7f423d11f700 1 --2- 172.21.15.151:0/3958180767 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42380cdfd0 0x7f4238153620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:20.204 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.196+0000 7f423d11f700 1 -- 172.21.15.151:0/3958180767 >> 172.21.15.151:0/3958180767 conn(0x7f42380cfea0 msgr2=0x7f42380c6ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:20.204 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.196+0000 7f423d11f700 1 -- 172.21.15.151:0/3958180767 shutdown_connections 2023-05-24T03:29:20.204 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.196+0000 7f423d11f700 1 -- 172.21.15.151:0/3958180767 wait complete. 2023-05-24T03:29:20.213 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 7a6cfc6d-b0ca-4cb6-a66d-4001ec184657 2 2023-05-24T03:29:20.275 INFO:tasks.ceph.mgr.y.smithi146.stderr:2023-05-24T03:29:20.272+0000 7f25a1ed3200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-24T03:29:20.343 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.338+0000 7fcffe682700 1 Processor -- start 2023-05-24T03:29:20.345 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.338+0000 7fcffe682700 1 -- start start 2023-05-24T03:29:20.350 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.339+0000 7fcffe682700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcff80b1920 0x7fcff80b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:20.350 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.339+0000 7fcffe682700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcff80c3960 0x7fcff80c3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:20.350 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.339+0000 7fcffe682700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcff80c4320 con 0x7fcff80cc0b0 2023-05-24T03:29:20.351 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.339+0000 7fcffe682700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcff806d7a0 con 0x7fcff80b1920 2023-05-24T03:29:20.351 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.339+0000 7fcffe682700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcff806d190 con 0x7fcff80c3960 2023-05-24T03:29:20.351 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.339+0000 7fcffcc1f700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcff80c3960 0x7fcff80c3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:20.351 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.339+0000 7fcffcc1f700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcff80c3960 0x7fcff80c3de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:43592/0 (socket says 172.21.15.151:43592) 2023-05-24T03:29:20.352 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.339+0000 7fcffcc1f700 1 -- 172.21.15.151:0/1667647657 learned_addr learned my addr 172.21.15.151:0/1667647657 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-05-24T03:29:20.355 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.339+0000 7fcff7fff700 1 --2- 172.21.15.151:0/1667647657 >> v2:172.21.15.146:3300/0 conn(0x7fcff80b1920 0x7fcff80b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:20.355 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.339+0000 7fcffcc1f700 1 -- 172.21.15.151:0/1667647657 >> v2:172.21.15.146:3300/0 conn(0x7fcff80b1920 msgr2=0x7fcff80b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:20.356 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.339+0000 7fcffcc1f700 1 --2- 172.21.15.151:0/1667647657 >> v2:172.21.15.146:3300/0 conn(0x7fcff80b1920 0x7fcff80b1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:20.356 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.339+0000 7fcffcc1f700 1 -- 172.21.15.151:0/1667647657 >> v1:172.21.15.146:6789/0 conn(0x7fcff80cc0b0 legacy=0x7fcff806dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:20.356 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.339+0000 7fcffcc1f700 1 -- 172.21.15.151:0/1667647657 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff80b2230 con 0x7fcff80c3960 2023-05-24T03:29:20.356 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.340+0000 7fcffcc1f700 1 --2- 172.21.15.151:0/1667647657 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcff80c3960 0x7fcff80c3de0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcff806b520 tx=0x7fcff000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3defe892ab5d3653 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:20.356 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.340+0000 7fcff6ffd700 1 -- 172.21.15.151:0/1667647657 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff000e070 con 0x7fcff80c3960 2023-05-24T03:29:20.356 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.340+0000 7fcff6ffd700 1 -- 172.21.15.151:0/1667647657 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff000b910 con 0x7fcff80c3960 2023-05-24T03:29:20.356 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.340+0000 7fcff6ffd700 1 -- 172.21.15.151:0/1667647657 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff000bcc0 con 0x7fcff80c3960 2023-05-24T03:29:20.357 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.340+0000 7fcffe682700 1 -- 172.21.15.151:0/1667647657 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcff80c3960 msgr2=0x7fcff80c3de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:20.357 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.340+0000 7fcffe682700 1 --2- 172.21.15.151:0/1667647657 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcff80c3960 0x7fcff80c3de0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcff806b520 tx=0x7fcff000b330 comp rx=0 tx=0).stop 2023-05-24T03:29:20.357 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.340+0000 7fcffe682700 1 -- 172.21.15.151:0/1667647657 shutdown_connections 2023-05-24T03:29:20.357 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.340+0000 7fcffe682700 1 --2- 172.21.15.151:0/1667647657 >> v2:172.21.15.146:3300/0 conn(0x7fcff80b1920 0x7fcff80b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:20.357 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.340+0000 7fcffe682700 1 --2- 172.21.15.151:0/1667647657 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcff80c3960 0x7fcff80c3de0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:20.357 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.340+0000 7fcffe682700 1 -- 172.21.15.151:0/1667647657 >> 172.21.15.151:0/1667647657 conn(0x7fcff80cfea0 msgr2=0x7fcff80d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:20.357 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.340+0000 7fcffe682700 1 -- 172.21.15.151:0/1667647657 shutdown_connections 2023-05-24T03:29:20.358 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.340+0000 7fcffe682700 1 -- 172.21.15.151:0/1667647657 wait complete. 2023-05-24T03:29:20.358 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.341+0000 7fcffe682700 1 Processor -- start 2023-05-24T03:29:20.358 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.342+0000 7fcffe682700 1 -- start start 2023-05-24T03:29:20.358 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.342+0000 7fcffe682700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcff80b1920 0x7fcff8152690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:20.358 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.342+0000 7fcffe682700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcff80c3960 0x7fcff80c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:20.358 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.342+0000 7fcffe682700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcff80cc0b0 0x7fcff81568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:20.358 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.342+0000 7fcffe682700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff8152bd0 con 0x7fcff80b1920 2023-05-24T03:29:20.358 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.342+0000 7fcffe682700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff80b3850 con 0x7fcff80cc0b0 2023-05-24T03:29:20.359 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.342+0000 7fcffe682700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcff80c7730 con 0x7fcff80c3960 2023-05-24T03:29:20.359 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.342+0000 7fcffcc1f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcff80cc0b0 0x7fcff81568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:20.359 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.342+0000 7fcff77fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcff80c3960 0x7fcff80c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:20.359 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.342+0000 7fcffcc1f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcff80cc0b0 0x7fcff81568c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:43598/0 (socket says 172.21.15.151:43598) 2023-05-24T03:29:20.359 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.342+0000 7fcffcc1f700 1 -- 172.21.15.151:0/3953941377 learned_addr learned my addr 172.21.15.151:0/3953941377 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-05-24T03:29:20.359 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.343+0000 7fcff7fff700 1 --2- 172.21.15.151:0/3953941377 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcff80b1920 0x7fcff8152690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:20.359 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.343+0000 7fcffcc1f700 1 -- 172.21.15.151:0/3953941377 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcff80c3960 msgr2=0x7fcff80c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:20.360 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.343+0000 7fcffcc1f700 1 --2- 172.21.15.151:0/3953941377 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcff80c3960 0x7fcff80c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:20.360 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.343+0000 7fcffcc1f700 1 -- 172.21.15.151:0/3953941377 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcff80b1920 msgr2=0x7fcff8152690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:20.360 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.343+0000 7fcffcc1f700 1 --2- 172.21.15.151:0/3953941377 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcff80b1920 0x7fcff8152690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:20.360 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.343+0000 7fcffcc1f700 1 -- 172.21.15.151:0/3953941377 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff0009b30 con 0x7fcff80cc0b0 2023-05-24T03:29:20.360 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.343+0000 7fcffcc1f700 1 --2- 172.21.15.151:0/3953941377 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcff80cc0b0 0x7fcff81568c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcff000b370 tx=0x7fcff0004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:20.360 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.343+0000 7fcff4ff9700 1 -- 172.21.15.151:0/3953941377 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff0004880 con 0x7fcff80cc0b0 2023-05-24T03:29:20.360 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.343+0000 7fcff4ff9700 1 -- 172.21.15.151:0/3953941377 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff00099b0 con 0x7fcff80cc0b0 2023-05-24T03:29:20.360 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.343+0000 7fcffe682700 1 -- 172.21.15.151:0/3953941377 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcff806d430 con 0x7fcff80cc0b0 2023-05-24T03:29:20.361 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.343+0000 7fcff4ff9700 1 -- 172.21.15.151:0/3953941377 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff001c680 con 0x7fcff80cc0b0 2023-05-24T03:29:20.361 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.343+0000 7fcffe682700 1 -- 172.21.15.151:0/3953941377 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcff8071de0 con 0x7fcff80cc0b0 2023-05-24T03:29:20.361 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.343+0000 7fcff4ff9700 1 -- 172.21.15.151:0/3953941377 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fcff001cae0 con 0x7fcff80cc0b0 2023-05-24T03:29:20.361 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.343+0000 7fcff4ff9700 1 -- 172.21.15.151:0/3953941377 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fcff001cd90 con 0x7fcff80cc0b0 2023-05-24T03:29:20.362 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.344+0000 7fcffe682700 1 -- 172.21.15.151:0/3953941377 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcff806e340 con 0x7fcff80cc0b0 2023-05-24T03:29:20.362 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.346+0000 7fcff4ff9700 1 -- 172.21.15.151:0/3953941377 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fcff0020070 con 0x7fcff80cc0b0 2023-05-24T03:29:20.395 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-05-24T03:29:20.390+0000 7f364301f200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-24T03:29:20.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.428+0000 7fcffe682700 1 -- 172.21.15.151:0/3953941377 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7a6cfc6d-b0ca-4cb6-a66d-4001ec184657", "id": 2} v 0) v1 -- 0x7fcff8068d00 con 0x7fcff80cc0b0 2023-05-24T03:29:20.441 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.436+0000 7fcff4ff9700 1 -- 172.21.15.151:0/3953941377 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7a6cfc6d-b0ca-4cb6-a66d-4001ec184657", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcff0034020 con 0x7fcff80cc0b0 2023-05-24T03:29:20.441 INFO:teuthology.orchestra.run.smithi151.stdout:2 2023-05-24T03:29:20.442 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.437+0000 7fcffe682700 1 -- 172.21.15.151:0/3953941377 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcff80cc0b0 msgr2=0x7fcff81568c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:20.442 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.437+0000 7fcffe682700 1 --2- 172.21.15.151:0/3953941377 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcff80cc0b0 0x7fcff81568c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcff000b370 tx=0x7fcff0004ad0 comp rx=0 tx=0).stop 2023-05-24T03:29:20.442 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.437+0000 7fcffe682700 1 -- 172.21.15.151:0/3953941377 shutdown_connections 2023-05-24T03:29:20.442 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.437+0000 7fcffe682700 1 --2- 172.21.15.151:0/3953941377 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcff80cc0b0 0x7fcff81568c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:20.442 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.437+0000 7fcffe682700 1 --2- 172.21.15.151:0/3953941377 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcff80b1920 0x7fcff8152690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:20.442 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.437+0000 7fcffe682700 1 --2- 172.21.15.151:0/3953941377 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcff80c3960 0x7fcff80c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:20.442 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.437+0000 7fcffe682700 1 -- 172.21.15.151:0/3953941377 >> 172.21.15.151:0/3953941377 conn(0x7fcff80cfea0 msgr2=0x7fcff80cb560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:20.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.437+0000 7fcffe682700 1 -- 172.21.15.151:0/3953941377 shutdown_connections 2023-05-24T03:29:20.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.437+0000 7fcffe682700 1 -- 172.21.15.151:0/3953941377 wait complete. 2023-05-24T03:29:20.454 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 401509f7-cecd-44a2-b0ae-22c81a5d93c4 3 2023-05-24T03:29:20.472 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-05-24T03:29:20.468+0000 7f364301f200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-24T03:29:20.576 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.571+0000 7fccea947700 1 Processor -- start 2023-05-24T03:29:20.576 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.571+0000 7fccea947700 1 -- start start 2023-05-24T03:29:20.578 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.572+0000 7fccea947700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcce40aefd0 0x7fcce40cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:20.578 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.572+0000 7fccea947700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcce40cfd00 con 0x7fcce406a460 2023-05-24T03:29:20.579 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.572+0000 7fccea947700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcce4072350 con 0x7fcce415cd90 2023-05-24T03:29:20.579 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.572+0000 7fccea947700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcce40cf460 con 0x7fcce40aefd0 2023-05-24T03:29:20.579 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.572+0000 7fcce37fe700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fcce415cd90 0x7fcce4160d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:47092/0 (socket says 172.21.15.151:47092) 2023-05-24T03:29:20.579 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.572+0000 7fcce37fe700 1 -- 172.21.15.151:0/1318303149 learned_addr learned my addr 172.21.15.151:0/1318303149 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-05-24T03:29:20.579 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.572+0000 7fcce8ee4700 1 --2- 172.21.15.151:0/1318303149 >> v2:172.21.15.146:3300/0 conn(0x7fcce40aefd0 0x7fcce40cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:20.579 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.572+0000 7fcce2ffd700 1 -- 172.21.15.151:0/1318303149 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1567825513 0 0) 0x7fcce4072350 con 0x7fcce415cd90 2023-05-24T03:29:20.579 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.572+0000 7fcce2ffd700 1 -- 172.21.15.151:0/1318303149 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcccc0035b0 con 0x7fcce415cd90 2023-05-24T03:29:20.580 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.573+0000 7fcce2ffd700 1 -- 172.21.15.151:0/1318303149 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2271425740 0 0) 0x7fccd4001110 con 0x7fcce406a460 2023-05-24T03:29:20.580 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.573+0000 7fcce2ffd700 1 -- 172.21.15.151:0/1318303149 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcce4072350 con 0x7fcce406a460 2023-05-24T03:29:20.580 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.573+0000 7fcce8ee4700 1 -- 172.21.15.151:0/1318303149 >> v1:172.21.15.151:6789/0 conn(0x7fcce415cd90 legacy=0x7fcce4160d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:20.580 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.573+0000 7fcce2ffd700 1 -- 172.21.15.151:0/1318303149 <== mon.1 v1:172.21.15.151:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1635228836 0 0) 0x7fcccc0035b0 con 0x7fcce415cd90 2023-05-24T03:29:20.581 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.573+0000 7fcce8ee4700 1 -- 172.21.15.151:0/1318303149 >> v1:172.21.15.146:6789/0 conn(0x7fcce406a460 legacy=0x7fcce406a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:20.581 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.573+0000 7fcce8ee4700 1 -- 172.21.15.151:0/1318303149 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce40cf740 con 0x7fcce40aefd0 2023-05-24T03:29:20.581 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.573+0000 7fcce8ee4700 1 --2- 172.21.15.151:0/1318303149 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcce40aefd0 0x7fcce40cede0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fccdc009d90 tx=0x7fccdc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=653d89a8c13cb44c server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:20.581 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.573+0000 7fcce2ffd700 1 -- 172.21.15.151:0/1318303149 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccdc00e070 con 0x7fcce40aefd0 2023-05-24T03:29:20.581 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.573+0000 7fcce2ffd700 1 -- 172.21.15.151:0/1318303149 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccdc003a20 con 0x7fcce40aefd0 2023-05-24T03:29:20.582 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.573+0000 7fcce2ffd700 1 -- 172.21.15.151:0/1318303149 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd8001670 con 0x7fcce40aefd0 2023-05-24T03:29:20.582 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.574+0000 7fccea947700 1 -- 172.21.15.151:0/1318303149 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcce40aefd0 msgr2=0x7fcce40cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:20.582 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.574+0000 7fccea947700 1 --2- 172.21.15.151:0/1318303149 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcce40aefd0 0x7fcce40cede0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fccdc009d90 tx=0x7fccdc00b330 comp rx=0 tx=0).stop 2023-05-24T03:29:20.582 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.574+0000 7fccea947700 1 -- 172.21.15.151:0/1318303149 shutdown_connections 2023-05-24T03:29:20.582 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.574+0000 7fccea947700 1 --2- 172.21.15.151:0/1318303149 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcce40aefd0 0x7fcce40cede0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:20.582 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.574+0000 7fccea947700 1 -- 172.21.15.151:0/1318303149 >> 172.21.15.151:0/1318303149 conn(0x7fcce40cfea0 msgr2=0x7fcce40d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:20.582 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.574+0000 7fccea947700 1 -- 172.21.15.151:0/1318303149 shutdown_connections 2023-05-24T03:29:20.582 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.574+0000 7fccea947700 1 -- 172.21.15.151:0/1318303149 wait complete. 2023-05-24T03:29:20.584 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.575+0000 7fccea947700 1 Processor -- start 2023-05-24T03:29:20.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.576+0000 7fccea947700 1 -- start start 2023-05-24T03:29:20.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.576+0000 7fccea947700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcce406a460 0x7fcce40c5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:20.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.576+0000 7fccea947700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcce40aefd0 0x7fcce40b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:20.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.576+0000 7fccea947700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcce415cd90 0x7fcce4159790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:20.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.576+0000 7fccea947700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce4158730 con 0x7fcce415cd90 2023-05-24T03:29:20.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.576+0000 7fccea947700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce41589d0 con 0x7fcce40aefd0 2023-05-24T03:29:20.586 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.576+0000 7fccea947700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce4158cb0 con 0x7fcce406a460 2023-05-24T03:29:20.586 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.577+0000 7fcce37fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcce40aefd0 0x7fcce40b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:20.586 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.577+0000 7fcce37fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcce40aefd0 0x7fcce40b1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:43608/0 (socket says 172.21.15.151:43608) 2023-05-24T03:29:20.586 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.577+0000 7fcce3fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcce406a460 0x7fcce40c5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:20.586 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.577+0000 7fcce37fe700 1 -- 172.21.15.151:0/2351105213 learned_addr learned my addr 172.21.15.151:0/2351105213 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-05-24T03:29:20.586 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.577+0000 7fcce8ee4700 1 --2- 172.21.15.151:0/2351105213 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcce415cd90 0x7fcce4159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:20.586 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.577+0000 7fcce8ee4700 1 -- 172.21.15.151:0/2351105213 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcce406a460 msgr2=0x7fcce40c5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:20.587 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.577+0000 7fcce8ee4700 1 --2- 172.21.15.151:0/2351105213 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcce406a460 0x7fcce40c5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:20.587 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.577+0000 7fcce8ee4700 1 -- 172.21.15.151:0/2351105213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcce40aefd0 msgr2=0x7fcce40b1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:20.587 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.577+0000 7fcce8ee4700 1 --2- 172.21.15.151:0/2351105213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcce40aefd0 0x7fcce40b1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:20.587 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.577+0000 7fcce8ee4700 1 -- 172.21.15.151:0/2351105213 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccdc009a70 con 0x7fcce415cd90 2023-05-24T03:29:20.587 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.577+0000 7fcce37fe700 1 --2- 172.21.15.151:0/2351105213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcce40aefd0 0x7fcce40b1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T03:29:20.587 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.577+0000 7fcce8ee4700 1 --2- 172.21.15.151:0/2351105213 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcce415cd90 0x7fcce4159790 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fccdc014000 tx=0x7fccdc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:20.587 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.577+0000 7fcce0ff9700 1 -- 172.21.15.151:0/2351105213 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccdc004440 con 0x7fcce415cd90 2023-05-24T03:29:20.587 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.577+0000 7fcce0ff9700 1 -- 172.21.15.151:0/2351105213 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccdc0045a0 con 0x7fcce415cd90 2023-05-24T03:29:20.588 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.577+0000 7fccea947700 1 -- 172.21.15.151:0/2351105213 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcce4160800 con 0x7fcce415cd90 2023-05-24T03:29:20.588 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.577+0000 7fcce0ff9700 1 -- 172.21.15.151:0/2351105213 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccdc004950 con 0x7fcce415cd90 2023-05-24T03:29:20.588 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.577+0000 7fccea947700 1 -- 172.21.15.151:0/2351105213 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcce40cfa20 con 0x7fcce415cd90 2023-05-24T03:29:20.588 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.577+0000 7fcce0ff9700 1 -- 172.21.15.151:0/2351105213 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fccdc01d770 con 0x7fcce415cd90 2023-05-24T03:29:20.588 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.577+0000 7fcce0ff9700 1 -- 172.21.15.151:0/2351105213 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fccdc012430 con 0x7fcce415cd90 2023-05-24T03:29:20.588 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.578+0000 7fccea947700 1 -- 172.21.15.151:0/2351105213 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcce40af620 con 0x7fcce415cd90 2023-05-24T03:29:20.589 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.581+0000 7fcce0ff9700 1 -- 172.21.15.151:0/2351105213 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fccdc021020 con 0x7fcce415cd90 2023-05-24T03:29:20.604 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-05-24T03:29:20.599+0000 7f364301f200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-24T03:29:20.668 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.663+0000 7fccea947700 1 -- 172.21.15.151:0/2351105213 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd new", "uuid": "401509f7-cecd-44a2-b0ae-22c81a5d93c4", "id": 3} v 0) v1 -- 0x7fcce4068d00 con 0x7fcce415cd90 2023-05-24T03:29:20.675 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.671+0000 7fcce0ff9700 1 -- 172.21.15.151:0/2351105213 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "401509f7-cecd-44a2-b0ae-22c81a5d93c4", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fccdc016020 con 0x7fcce415cd90 2023-05-24T03:29:20.675 INFO:teuthology.orchestra.run.smithi151.stdout:3 2023-05-24T03:29:20.676 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.672+0000 7fccea947700 1 -- 172.21.15.151:0/2351105213 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcce415cd90 msgr2=0x7fcce4159790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:20.676 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.672+0000 7fccea947700 1 --2- 172.21.15.151:0/2351105213 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcce415cd90 0x7fcce4159790 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fccdc014000 tx=0x7fccdc004ad0 comp rx=0 tx=0).stop 2023-05-24T03:29:20.677 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.672+0000 7fccea947700 1 -- 172.21.15.151:0/2351105213 shutdown_connections 2023-05-24T03:29:20.677 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.672+0000 7fccea947700 1 --2- 172.21.15.151:0/2351105213 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcce415cd90 0x7fcce4159790 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:20.677 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.672+0000 7fccea947700 1 --2- 172.21.15.151:0/2351105213 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcce406a460 0x7fcce40c5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:20.677 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.672+0000 7fccea947700 1 --2- 172.21.15.151:0/2351105213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcce40aefd0 0x7fcce40b1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:20.677 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.672+0000 7fccea947700 1 -- 172.21.15.151:0/2351105213 >> 172.21.15.151:0/2351105213 conn(0x7fcce40cfea0 msgr2=0x7fcce40711c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:20.677 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.672+0000 7fccea947700 1 -- 172.21.15.151:0/2351105213 shutdown_connections 2023-05-24T03:29:20.678 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.672+0000 7fccea947700 1 -- 172.21.15.151:0/2351105213 wait complete. 2023-05-24T03:29:20.687 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-05-24T03:29:20.682+0000 7f364301f200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-24T03:29:20.688 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 9d07f440-d125-4f99-a825-411fab894d5e 4 2023-05-24T03:29:20.720 INFO:tasks.ceph.mgr.y.smithi146.stderr:2023-05-24T03:29:20.716+0000 7f25a1ed3200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-24T03:29:20.852 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.848+0000 7f58df439700 1 Processor -- start 2023-05-24T03:29:20.853 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.848+0000 7f58df439700 1 -- start start 2023-05-24T03:29:20.855 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.848+0000 7f58df439700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f58d80cdfd0 0x7f58d80ce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:20.855 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.849+0000 7f58df439700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58d80b28d0 con 0x7f58d8159cd0 2023-05-24T03:29:20.855 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.849+0000 7f58df439700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58d815ad80 con 0x7f58d8070fe0 2023-05-24T03:29:20.855 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.849+0000 7f58df439700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58d815a7c0 con 0x7f58d80cdfd0 2023-05-24T03:29:20.855 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.849+0000 7f58dc9d4700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f58d8070fe0 0x7f58d80b21c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:47104/0 (socket says 172.21.15.151:47104) 2023-05-24T03:29:20.856 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.849+0000 7f58dc9d4700 1 -- 172.21.15.151:0/770015382 learned_addr learned my addr 172.21.15.151:0/770015382 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-05-24T03:29:20.856 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.849+0000 7f58dd1d5700 1 --2- 172.21.15.151:0/770015382 >> v2:172.21.15.146:3300/0 conn(0x7f58d80cdfd0 0x7f58d80ce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:20.856 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.849+0000 7f58cffff700 1 -- 172.21.15.151:0/770015382 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3191858810 0 0) 0x7f58d815ad80 con 0x7f58d8070fe0 2023-05-24T03:29:20.856 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.849+0000 7f58cffff700 1 -- 172.21.15.151:0/770015382 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58c40035b0 con 0x7f58d8070fe0 2023-05-24T03:29:20.856 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.849+0000 7f58dd1d5700 1 -- 172.21.15.151:0/770015382 >> v1:172.21.15.151:6789/0 conn(0x7f58d8070fe0 legacy=0x7f58d80b21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:20.856 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.849+0000 7f58dd1d5700 1 -- 172.21.15.151:0/770015382 >> v1:172.21.15.146:6789/0 conn(0x7f58d8159cd0 legacy=0x7f58d806d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:20.856 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.849+0000 7f58cffff700 1 -- 172.21.15.151:0/770015382 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1546845570 0 0) 0x7f58d80b28d0 con 0x7f58d8159cd0 2023-05-24T03:29:20.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.849+0000 7f58dd1d5700 1 -- 172.21.15.151:0/770015382 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d815aaa0 con 0x7f58d80cdfd0 2023-05-24T03:29:20.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.849+0000 7f58dd1d5700 1 --2- 172.21.15.151:0/770015382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58d80cdfd0 0x7f58d80ce3a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f58d4009840 tx=0x7f58d4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5643d695a66c288 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:20.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.849+0000 7f58cffff700 1 -- 172.21.15.151:0/770015382 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d4011830 con 0x7f58d80cdfd0 2023-05-24T03:29:20.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.849+0000 7f58cffff700 1 -- 172.21.15.151:0/770015382 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58d4011990 con 0x7f58d80cdfd0 2023-05-24T03:29:20.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.849+0000 7f58cffff700 1 -- 172.21.15.151:0/770015382 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d4011d00 con 0x7f58d80cdfd0 2023-05-24T03:29:20.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.850+0000 7f58df439700 1 -- 172.21.15.151:0/770015382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58d80cdfd0 msgr2=0x7f58d80ce3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:20.858 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.850+0000 7f58df439700 1 --2- 172.21.15.151:0/770015382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58d80cdfd0 0x7f58d80ce3a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f58d4009840 tx=0x7f58d4009b50 comp rx=0 tx=0).stop 2023-05-24T03:29:20.858 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.850+0000 7f58df439700 1 -- 172.21.15.151:0/770015382 shutdown_connections 2023-05-24T03:29:20.858 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.850+0000 7f58df439700 1 --2- 172.21.15.151:0/770015382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58d80cdfd0 0x7f58d80ce3a0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:20.858 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.850+0000 7f58df439700 1 -- 172.21.15.151:0/770015382 >> 172.21.15.151:0/770015382 conn(0x7f58d80cfea0 msgr2=0x7f58d80d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:20.858 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.850+0000 7f58df439700 1 -- 172.21.15.151:0/770015382 shutdown_connections 2023-05-24T03:29:20.858 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.850+0000 7f58df439700 1 -- 172.21.15.151:0/770015382 wait complete. 2023-05-24T03:29:20.860 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.852+0000 7f58df439700 1 Processor -- start 2023-05-24T03:29:20.860 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.852+0000 7f58df439700 1 -- start start 2023-05-24T03:29:20.860 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.853+0000 7f58df439700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58d8070fe0 0x7f58d80c5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:20.861 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.853+0000 7f58df439700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58d80cdfd0 0x7f58d814ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:20.861 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.853+0000 7f58df439700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58d8159cd0 0x7f58d81504c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:20.861 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.853+0000 7f58df439700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d80b00c0 con 0x7f58d8070fe0 2023-05-24T03:29:20.861 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.853+0000 7f58df439700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d80b03a0 con 0x7f58d80cdfd0 2023-05-24T03:29:20.861 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.853+0000 7f58df439700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d81581d0 con 0x7f58d8159cd0 2023-05-24T03:29:20.861 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.853+0000 7f58dc9d4700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58d80cdfd0 0x7f58d814ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:20.861 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.853+0000 7f58dc9d4700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58d80cdfd0 0x7f58d814ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:43620/0 (socket says 172.21.15.151:43620) 2023-05-24T03:29:20.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.853+0000 7f58dc9d4700 1 -- 172.21.15.151:0/1648154401 learned_addr learned my addr 172.21.15.151:0/1648154401 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-05-24T03:29:20.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.853+0000 7f58dd9d6700 1 --2- 172.21.15.151:0/1648154401 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58d8159cd0 0x7f58d81504c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:20.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.853+0000 7f58dd1d5700 1 --2- 172.21.15.151:0/1648154401 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58d8070fe0 0x7f58d80c5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:20.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.853+0000 7f58dc9d4700 1 -- 172.21.15.151:0/1648154401 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58d8159cd0 msgr2=0x7f58d81504c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:20.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.853+0000 7f58dc9d4700 1 --2- 172.21.15.151:0/1648154401 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58d8159cd0 0x7f58d81504c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:20.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.853+0000 7f58dc9d4700 1 -- 172.21.15.151:0/1648154401 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58d8070fe0 msgr2=0x7f58d80c5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:20.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.853+0000 7f58dc9d4700 1 --2- 172.21.15.151:0/1648154401 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58d8070fe0 0x7f58d80c5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:20.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.853+0000 7f58dc9d4700 1 -- 172.21.15.151:0/1648154401 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d40094a0 con 0x7f58d80cdfd0 2023-05-24T03:29:20.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.853+0000 7f58dd9d6700 1 --2- 172.21.15.151:0/1648154401 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58d8159cd0 0x7f58d81504c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T03:29:20.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.853+0000 7f58dd1d5700 1 --2- 172.21.15.151:0/1648154401 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58d8070fe0 0x7f58d80c5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T03:29:20.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.853+0000 7f58dc9d4700 1 --2- 172.21.15.151:0/1648154401 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58d80cdfd0 0x7f58d814ff80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f58c800c420 tx=0x7f58c800c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:20.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.853+0000 7f58cdffb700 1 -- 172.21.15.151:0/1648154401 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c8005d70 con 0x7f58d80cdfd0 2023-05-24T03:29:20.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.854+0000 7f58cdffb700 1 -- 172.21.15.151:0/1648154401 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58c800ce30 con 0x7f58d80cdfd0 2023-05-24T03:29:20.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.854+0000 7f58df439700 1 -- 172.21.15.151:0/1648154401 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58d80b1ca0 con 0x7f58d80cdfd0 2023-05-24T03:29:20.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.854+0000 7f58cdffb700 1 -- 172.21.15.151:0/1648154401 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c80072d0 con 0x7f58d80cdfd0 2023-05-24T03:29:20.864 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.854+0000 7f58cdffb700 1 -- 172.21.15.151:0/1648154401 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f58c8011470 con 0x7f58d80cdfd0 2023-05-24T03:29:20.864 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.854+0000 7f58df439700 1 -- 172.21.15.151:0/1648154401 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58d80b19c0 con 0x7f58d80cdfd0 2023-05-24T03:29:20.864 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.854+0000 7f58cdffb700 1 -- 172.21.15.151:0/1648154401 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f58c801a400 con 0x7f58d80cdfd0 2023-05-24T03:29:20.864 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.855+0000 7f58df439700 1 -- 172.21.15.151:0/1648154401 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58d80ce8e0 con 0x7f58d80cdfd0 2023-05-24T03:29:20.864 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.857+0000 7f58cdffb700 1 -- 172.21.15.151:0/1648154401 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f58c8015020 con 0x7f58d80cdfd0 2023-05-24T03:29:20.956 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.952+0000 7f58df439700 1 -- 172.21.15.151:0/1648154401 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9d07f440-d125-4f99-a825-411fab894d5e", "id": 4} v 0) v1 -- 0x7f58d80b0510 con 0x7f58d80cdfd0 2023-05-24T03:29:20.964 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.960+0000 7f58cdffb700 1 -- 172.21.15.151:0/1648154401 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9d07f440-d125-4f99-a825-411fab894d5e", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f58c8011950 con 0x7f58d80cdfd0 2023-05-24T03:29:20.965 INFO:teuthology.orchestra.run.smithi151.stdout:4 2023-05-24T03:29:20.966 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.961+0000 7f58df439700 1 -- 172.21.15.151:0/1648154401 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58d80cdfd0 msgr2=0x7f58d814ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:20.966 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.961+0000 7f58df439700 1 --2- 172.21.15.151:0/1648154401 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58d80cdfd0 0x7f58d814ff80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f58c800c420 tx=0x7f58c800c730 comp rx=0 tx=0).stop 2023-05-24T03:29:20.966 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.961+0000 7f58df439700 1 -- 172.21.15.151:0/1648154401 shutdown_connections 2023-05-24T03:29:20.966 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.961+0000 7f58df439700 1 --2- 172.21.15.151:0/1648154401 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58d8159cd0 0x7f58d81504c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:20.966 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.961+0000 7f58df439700 1 --2- 172.21.15.151:0/1648154401 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58d8070fe0 0x7f58d80c5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:20.967 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.961+0000 7f58df439700 1 --2- 172.21.15.151:0/1648154401 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58d80cdfd0 0x7f58d814ff80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:20.967 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.961+0000 7f58df439700 1 -- 172.21.15.151:0/1648154401 >> 172.21.15.151:0/1648154401 conn(0x7f58d80cfea0 msgr2=0x7f58d80ceb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:20.967 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.961+0000 7f58df439700 1 -- 172.21.15.151:0/1648154401 shutdown_connections 2023-05-24T03:29:20.967 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:20.961+0000 7f58df439700 1 -- 172.21.15.151:0/1648154401 wait complete. 2023-05-24T03:29:20.977 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 9b2266e2-9e52-4f0e-96da-e703a6c23a6d 5 2023-05-24T03:29:21.099 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.094+0000 7fdc32a19700 1 Processor -- start 2023-05-24T03:29:21.099 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.094+0000 7fdc32a19700 1 -- start start 2023-05-24T03:29:21.101 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.095+0000 7fdc32a19700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fdc2c0d2a30 0x7fdc2c06baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:21.101 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.095+0000 7fdc32a19700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc2c0cf530 0x7fdc2c0cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:21.102 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.095+0000 7fdc32a19700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdc2c0d0070 0x7fdc2c0b80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:21.102 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.095+0000 7fdc32a19700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc2c0cd960 con 0x7fdc2c0d0070 2023-05-24T03:29:21.102 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.095+0000 7fdc32a19700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc2c1612b0 con 0x7fdc2c0d2a30 2023-05-24T03:29:21.102 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.095+0000 7fdc32a19700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2c0cdc00 con 0x7fdc2c0cf530 2023-05-24T03:29:21.102 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.095+0000 7fdc2b7fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc2c0cf530 0x7fdc2c0cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:21.102 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.095+0000 7fdc2bfff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fdc2c0d2a30 0x7fdc2c06baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:21.102 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.095+0000 7fdc2b7fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc2c0cf530 0x7fdc2c0cfb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.151:50222/0 (socket says 172.21.15.151:50222) 2023-05-24T03:29:21.103 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.095+0000 7fdc2bfff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fdc2c0d2a30 0x7fdc2c06baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:43624/0 (socket says 172.21.15.151:43624) 2023-05-24T03:29:21.103 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.095+0000 7fdc2b7fe700 1 -- 172.21.15.151:0/3198387215 learned_addr learned my addr 172.21.15.151:0/3198387215 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-05-24T03:29:21.103 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.095+0000 7fdc30fb6700 1 --2- 172.21.15.151:0/3198387215 >> v2:172.21.15.146:3300/0 conn(0x7fdc2c0d0070 0x7fdc2c0b80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:21.103 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.095+0000 7fdc2bfff700 1 -- 172.21.15.151:0/3198387215 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc2c0cf530 msgr2=0x7fdc2c0cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:21.103 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.095+0000 7fdc2bfff700 1 --2- 172.21.15.151:0/3198387215 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc2c0cf530 0x7fdc2c0cfb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:21.103 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.095+0000 7fdc2bfff700 1 -- 172.21.15.151:0/3198387215 >> v2:172.21.15.146:3300/0 conn(0x7fdc2c0d0070 msgr2=0x7fdc2c0b80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:21.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.095+0000 7fdc2bfff700 1 --2- 172.21.15.151:0/3198387215 >> v2:172.21.15.146:3300/0 conn(0x7fdc2c0d0070 0x7fdc2c0b80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:21.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.095+0000 7fdc2bfff700 1 -- 172.21.15.151:0/3198387215 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc2c161590 con 0x7fdc2c0d2a30 2023-05-24T03:29:21.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.095+0000 7fdc2b7fe700 1 --2- 172.21.15.151:0/3198387215 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc2c0cf530 0x7fdc2c0cfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T03:29:21.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.095+0000 7fdc2bfff700 1 --2- 172.21.15.151:0/3198387215 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc2c0d2a30 0x7fdc2c06baa0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c0b5e00 tx=0x7fdc1c009b00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55ec20daab12ef0a server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:21.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.096+0000 7fdc2affd700 1 -- 172.21.15.151:0/3198387215 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c005e30 con 0x7fdc2c0d2a30 2023-05-24T03:29:21.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.096+0000 7fdc2affd700 1 -- 172.21.15.151:0/3198387215 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc1c006030 con 0x7fdc2c0d2a30 2023-05-24T03:29:21.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.096+0000 7fdc2affd700 1 -- 172.21.15.151:0/3198387215 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c0063c0 con 0x7fdc2c0d2a30 2023-05-24T03:29:21.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.096+0000 7fdc32a19700 1 -- 172.21.15.151:0/3198387215 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc2c0d2a30 msgr2=0x7fdc2c06baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:21.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.096+0000 7fdc32a19700 1 --2- 172.21.15.151:0/3198387215 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc2c0d2a30 0x7fdc2c06baa0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c0b5e00 tx=0x7fdc1c009b00 comp rx=0 tx=0).stop 2023-05-24T03:29:21.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.096+0000 7fdc32a19700 1 -- 172.21.15.151:0/3198387215 shutdown_connections 2023-05-24T03:29:21.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.096+0000 7fdc32a19700 1 --2- 172.21.15.151:0/3198387215 >> v2:172.21.15.146:3300/0 conn(0x7fdc2c0d0070 0x7fdc2c0b80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:21.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.096+0000 7fdc32a19700 1 --2- 172.21.15.151:0/3198387215 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc2c0d2a30 0x7fdc2c06baa0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:21.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.096+0000 7fdc32a19700 1 --2- 172.21.15.151:0/3198387215 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc2c0cf530 0x7fdc2c0cfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:21.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.096+0000 7fdc32a19700 1 -- 172.21.15.151:0/3198387215 >> 172.21.15.151:0/3198387215 conn(0x7fdc2c0743a0 msgr2=0x7fdc2c06af50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:21.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.096+0000 7fdc32a19700 1 -- 172.21.15.151:0/3198387215 shutdown_connections 2023-05-24T03:29:21.106 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.096+0000 7fdc32a19700 1 -- 172.21.15.151:0/3198387215 wait complete. 2023-05-24T03:29:21.107 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.097+0000 7fdc32a19700 1 Processor -- start 2023-05-24T03:29:21.108 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.098+0000 7fdc32a19700 1 -- start start 2023-05-24T03:29:21.108 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.098+0000 7fdc32a19700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc2c0cf530 0x7fdc2c0c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:21.108 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.098+0000 7fdc32a19700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc2c0d0070 0x7fdc2c0cc830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:21.108 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.098+0000 7fdc32a19700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc2c0d2a30 0x7fdc2c156510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:21.108 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.098+0000 7fdc32a19700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2c0b2e40 con 0x7fdc2c0d2a30 2023-05-24T03:29:21.108 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.098+0000 7fdc32a19700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2c0ccd70 con 0x7fdc2c0cf530 2023-05-24T03:29:21.109 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.098+0000 7fdc32a19700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2c0c8dc0 con 0x7fdc2c0d0070 2023-05-24T03:29:21.109 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.098+0000 7fdc2b7fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc2c0d0070 0x7fdc2c0cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:21.109 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.098+0000 7fdc2bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc2c0cf530 0x7fdc2c0c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:21.109 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.098+0000 7fdc2b7fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc2c0d0070 0x7fdc2c0cc830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.151:50230/0 (socket says 172.21.15.151:50230) 2023-05-24T03:29:21.109 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.098+0000 7fdc2b7fe700 1 -- 172.21.15.151:0/3828730279 learned_addr learned my addr 172.21.15.151:0/3828730279 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-05-24T03:29:21.109 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.098+0000 7fdc2bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc2c0cf530 0x7fdc2c0c87d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:43630/0 (socket says 172.21.15.151:43630) 2023-05-24T03:29:21.109 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.099+0000 7fdc30fb6700 1 --2- 172.21.15.151:0/3828730279 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc2c0d2a30 0x7fdc2c156510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:21.110 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.099+0000 7fdc2b7fe700 1 -- 172.21.15.151:0/3828730279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc2c0cf530 msgr2=0x7fdc2c0c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:21.110 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.099+0000 7fdc2b7fe700 1 --2- 172.21.15.151:0/3828730279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc2c0cf530 0x7fdc2c0c87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:21.110 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.099+0000 7fdc2b7fe700 1 -- 172.21.15.151:0/3828730279 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc2c0d2a30 msgr2=0x7fdc2c156510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:21.110 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.099+0000 7fdc2b7fe700 1 --2- 172.21.15.151:0/3828730279 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc2c0d2a30 0x7fdc2c156510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:21.110 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.099+0000 7fdc2b7fe700 1 -- 172.21.15.151:0/3828730279 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc20009550 con 0x7fdc2c0d0070 2023-05-24T03:29:21.110 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.099+0000 7fdc2b7fe700 1 --2- 172.21.15.151:0/3828730279 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc2c0d0070 0x7fdc2c0cc830 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdc2000e960 tx=0x7fdc2000ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:21.111 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.099+0000 7fdc28ff9700 1 -- 172.21.15.151:0/3828730279 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc20004030 con 0x7fdc2c0d0070 2023-05-24T03:29:21.111 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.099+0000 7fdc28ff9700 1 -- 172.21.15.151:0/3828730279 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc20004190 con 0x7fdc2c0d0070 2023-05-24T03:29:21.111 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.099+0000 7fdc32a19700 1 -- 172.21.15.151:0/3828730279 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc1c009430 con 0x7fdc2c0d0070 2023-05-24T03:29:21.111 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.099+0000 7fdc28ff9700 1 -- 172.21.15.151:0/3828730279 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc20004520 con 0x7fdc2c0d0070 2023-05-24T03:29:21.111 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.099+0000 7fdc32a19700 1 -- 172.21.15.151:0/3828730279 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc2c146850 con 0x7fdc2c0d0070 2023-05-24T03:29:21.111 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.099+0000 7fdc28ff9700 1 -- 172.21.15.151:0/3828730279 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fdc200039a0 con 0x7fdc2c0d0070 2023-05-24T03:29:21.111 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.099+0000 7fdc28ff9700 1 -- 172.21.15.151:0/3828730279 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fdc20013cc0 con 0x7fdc2c0d0070 2023-05-24T03:29:21.112 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.100+0000 7fdc32a19700 1 -- 172.21.15.151:0/3828730279 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc2c0d04f0 con 0x7fdc2c0d0070 2023-05-24T03:29:21.112 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.102+0000 7fdc28ff9700 1 -- 172.21.15.151:0/3828730279 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fdc20020060 con 0x7fdc2c0d0070 2023-05-24T03:29:21.153 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-05-24T03:29:21.149+0000 7f364301f200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-24T03:29:21.191 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.186+0000 7fdc32a19700 1 -- 172.21.15.151:0/3828730279 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9b2266e2-9e52-4f0e-96da-e703a6c23a6d", "id": 5} v 0) v1 -- 0x7fdc2c072ae0 con 0x7fdc2c0d0070 2023-05-24T03:29:21.199 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.195+0000 7fdc28ff9700 1 -- 172.21.15.151:0/3828730279 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9b2266e2-9e52-4f0e-96da-e703a6c23a6d", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdc20003c50 con 0x7fdc2c0d0070 2023-05-24T03:29:21.199 INFO:teuthology.orchestra.run.smithi151.stdout:5 2023-05-24T03:29:21.200 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.196+0000 7fdc32a19700 1 -- 172.21.15.151:0/3828730279 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc2c0d0070 msgr2=0x7fdc2c0cc830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:21.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.196+0000 7fdc32a19700 1 --2- 172.21.15.151:0/3828730279 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc2c0d0070 0x7fdc2c0cc830 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdc2000e960 tx=0x7fdc2000ec70 comp rx=0 tx=0).stop 2023-05-24T03:29:21.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.196+0000 7fdc32a19700 1 -- 172.21.15.151:0/3828730279 shutdown_connections 2023-05-24T03:29:21.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.196+0000 7fdc32a19700 1 --2- 172.21.15.151:0/3828730279 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc2c0d2a30 0x7fdc2c156510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:21.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.196+0000 7fdc32a19700 1 --2- 172.21.15.151:0/3828730279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc2c0cf530 0x7fdc2c0c87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:21.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.196+0000 7fdc32a19700 1 --2- 172.21.15.151:0/3828730279 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc2c0d0070 0x7fdc2c0cc830 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:21.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.196+0000 7fdc32a19700 1 -- 172.21.15.151:0/3828730279 >> 172.21.15.151:0/3828730279 conn(0x7fdc2c0743a0 msgr2=0x7fdc2c0d0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:21.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.196+0000 7fdc32a19700 1 -- 172.21.15.151:0/3828730279 shutdown_connections 2023-05-24T03:29:21.202 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.196+0000 7fdc32a19700 1 -- 172.21.15.151:0/3828730279 wait complete. 2023-05-24T03:29:21.213 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 5daedf77-0a83-49e7-b497-d9ed10436972 6 2023-05-24T03:29:21.280 INFO:tasks.ceph.mgr.y.smithi146.stderr:2023-05-24T03:29:21.276+0000 7f25a1ed3200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-24T03:29:21.335 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.330+0000 7ff0d9251700 1 Processor -- start 2023-05-24T03:29:21.335 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.330+0000 7ff0d9251700 1 -- start start 2023-05-24T03:29:21.337 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.331+0000 7ff0d9251700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff0d415cd90 0x7ff0d40cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:21.338 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.331+0000 7ff0d9251700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff0d40aefd0 0x7ff0d4160d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:21.338 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.331+0000 7ff0d9251700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0d40cfd00 con 0x7ff0d406a460 2023-05-24T03:29:21.338 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.331+0000 7ff0d9251700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0d4072350 con 0x7ff0d415cd90 2023-05-24T03:29:21.338 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.331+0000 7ff0d9251700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d40cf460 con 0x7ff0d40aefd0 2023-05-24T03:29:21.338 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.331+0000 7ff0d359e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff0d40aefd0 0x7ff0d4160d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:21.338 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.331+0000 7ff0d2d9d700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7ff0d406a460 0x7ff0d406a830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:47128/0 (socket says 172.21.15.151:47128) 2023-05-24T03:29:21.338 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.331+0000 7ff0d2d9d700 1 -- 172.21.15.151:0/4274894599 learned_addr learned my addr 172.21.15.151:0/4274894599 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-05-24T03:29:21.339 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.332+0000 7ff0d259c700 1 --2- 172.21.15.151:0/4274894599 >> v2:172.21.15.146:3300/0 conn(0x7ff0d415cd90 0x7ff0d40cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:21.339 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.332+0000 7ff0d1d9b700 1 -- 172.21.15.151:0/4274894599 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3593086190 0 0) 0x7ff0c4001110 con 0x7ff0d406a460 2023-05-24T03:29:21.339 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.332+0000 7ff0d359e700 1 -- 172.21.15.151:0/4274894599 >> v2:172.21.15.146:3300/0 conn(0x7ff0d415cd90 msgr2=0x7ff0d40cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:21.339 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.332+0000 7ff0d359e700 1 --2- 172.21.15.151:0/4274894599 >> v2:172.21.15.146:3300/0 conn(0x7ff0d415cd90 0x7ff0d40cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:21.339 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.332+0000 7ff0d359e700 1 -- 172.21.15.151:0/4274894599 >> v1:172.21.15.151:6789/0 conn(0x7ff0d406a460 legacy=0x7ff0d406a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:21.339 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.332+0000 7ff0d359e700 1 -- 172.21.15.151:0/4274894599 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d40cf740 con 0x7ff0d40aefd0 2023-05-24T03:29:21.339 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.332+0000 7ff0d359e700 1 --2- 172.21.15.151:0/4274894599 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff0d40aefd0 0x7ff0d4160d20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc009d90 tx=0x7ff0cc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ab9fbcc859d1dbd server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:21.339 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.332+0000 7ff0d1d9b700 1 -- 172.21.15.151:0/4274894599 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc00e070 con 0x7ff0d40aefd0 2023-05-24T03:29:21.340 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.332+0000 7ff0d1d9b700 1 -- 172.21.15.151:0/4274894599 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0cc00bb20 con 0x7ff0d40aefd0 2023-05-24T03:29:21.340 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.332+0000 7ff0d1d9b700 1 -- 172.21.15.151:0/4274894599 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc012430 con 0x7ff0d40aefd0 2023-05-24T03:29:21.340 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.333+0000 7ff0d9251700 1 -- 172.21.15.151:0/4274894599 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff0d40aefd0 msgr2=0x7ff0d4160d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:21.340 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.333+0000 7ff0d9251700 1 --2- 172.21.15.151:0/4274894599 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff0d40aefd0 0x7ff0d4160d20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc009d90 tx=0x7ff0cc00b330 comp rx=0 tx=0).stop 2023-05-24T03:29:21.340 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.333+0000 7ff0d9251700 1 -- 172.21.15.151:0/4274894599 shutdown_connections 2023-05-24T03:29:21.340 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.333+0000 7ff0d9251700 1 --2- 172.21.15.151:0/4274894599 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff0d40aefd0 0x7ff0d4160d20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:21.340 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.333+0000 7ff0d9251700 1 --2- 172.21.15.151:0/4274894599 >> v2:172.21.15.146:3300/0 conn(0x7ff0d415cd90 0x7ff0d40cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:21.340 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.333+0000 7ff0d9251700 1 -- 172.21.15.151:0/4274894599 >> 172.21.15.151:0/4274894599 conn(0x7ff0d40cfea0 msgr2=0x7ff0d40d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:21.341 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.333+0000 7ff0d9251700 1 -- 172.21.15.151:0/4274894599 shutdown_connections 2023-05-24T03:29:21.341 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.333+0000 7ff0d9251700 1 -- 172.21.15.151:0/4274894599 wait complete. 2023-05-24T03:29:21.343 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.335+0000 7ff0d9251700 1 Processor -- start 2023-05-24T03:29:21.343 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.335+0000 7ff0d9251700 1 -- start start 2023-05-24T03:29:21.343 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.336+0000 7ff0d9251700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0d406a460 0x7ff0d40b0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:21.343 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.336+0000 7ff0d9251700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0d40aefd0 0x7ff0d41513a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:21.343 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.336+0000 7ff0d9251700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff0d415cd90 0x7ff0d40afd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:21.343 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.336+0000 7ff0d9251700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d40b28b0 con 0x7ff0d406a460 2023-05-24T03:29:21.343 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.336+0000 7ff0d9251700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d41518e0 con 0x7ff0d40aefd0 2023-05-24T03:29:21.344 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.336+0000 7ff0d9251700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d40b1c30 con 0x7ff0d415cd90 2023-05-24T03:29:21.344 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.336+0000 7ff0d359e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff0d415cd90 0x7ff0d40afd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:21.344 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.336+0000 7ff0d359e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff0d415cd90 0x7ff0d40afd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.151:50244/0 (socket says 172.21.15.151:50244) 2023-05-24T03:29:21.344 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.336+0000 7ff0d359e700 1 -- 172.21.15.151:0/1203420635 learned_addr learned my addr 172.21.15.151:0/1203420635 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-05-24T03:29:21.344 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.336+0000 7ff0d259c700 1 --2- 172.21.15.151:0/1203420635 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0d40aefd0 0x7ff0d41513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:21.344 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.336+0000 7ff0d2d9d700 1 --2- 172.21.15.151:0/1203420635 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0d406a460 0x7ff0d40b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:21.344 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.337+0000 7ff0d259c700 1 -- 172.21.15.151:0/1203420635 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff0d415cd90 msgr2=0x7ff0d40afd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:21.345 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.337+0000 7ff0d259c700 1 --2- 172.21.15.151:0/1203420635 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff0d415cd90 0x7ff0d40afd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:21.345 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.337+0000 7ff0d259c700 1 -- 172.21.15.151:0/1203420635 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0d406a460 msgr2=0x7ff0d40b0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:21.345 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.337+0000 7ff0d259c700 1 --2- 172.21.15.151:0/1203420635 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0d406a460 0x7ff0d40b0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:21.345 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.337+0000 7ff0d259c700 1 -- 172.21.15.151:0/1203420635 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0cc009a70 con 0x7ff0d40aefd0 2023-05-24T03:29:21.345 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.337+0000 7ff0d359e700 1 --2- 172.21.15.151:0/1203420635 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff0d415cd90 0x7ff0d40afd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T03:29:21.345 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.337+0000 7ff0d259c700 1 --2- 172.21.15.151:0/1203420635 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0d40aefd0 0x7ff0d41513a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff0c800e900 tx=0x7ff0c800ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:21.345 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.337+0000 7ff0bb7fe700 1 -- 172.21.15.151:0/1203420635 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c8013680 con 0x7ff0d40aefd0 2023-05-24T03:29:21.345 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.337+0000 7ff0bb7fe700 1 -- 172.21.15.151:0/1203420635 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c80137e0 con 0x7ff0d40aefd0 2023-05-24T03:29:21.346 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.337+0000 7ff0d9251700 1 -- 172.21.15.151:0/1203420635 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0d4160800 con 0x7ff0d40aefd0 2023-05-24T03:29:21.346 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.337+0000 7ff0bb7fe700 1 -- 172.21.15.151:0/1203420635 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c8013b50 con 0x7ff0d40aefd0 2023-05-24T03:29:21.346 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.337+0000 7ff0d9251700 1 -- 172.21.15.151:0/1203420635 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0d40cfa20 con 0x7ff0d40aefd0 2023-05-24T03:29:21.346 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.337+0000 7ff0bb7fe700 1 -- 172.21.15.151:0/1203420635 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff0c8005a20 con 0x7ff0d40aefd0 2023-05-24T03:29:21.346 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.337+0000 7ff0bb7fe700 1 -- 172.21.15.151:0/1203420635 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7ff0c80067a0 con 0x7ff0d40aefd0 2023-05-24T03:29:21.346 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.338+0000 7ff0d9251700 1 -- 172.21.15.151:0/1203420635 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0d4158930 con 0x7ff0d40aefd0 2023-05-24T03:29:21.347 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.342+0000 7ff0bb7fe700 1 -- 172.21.15.151:0/1203420635 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7ff0c803ab10 con 0x7ff0d40aefd0 2023-05-24T03:29:21.429 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.424+0000 7ff0d9251700 1 -- 172.21.15.151:0/1203420635 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5daedf77-0a83-49e7-b497-d9ed10436972", "id": 6} v 0) v1 -- 0x7ff0d40af5e0 con 0x7ff0d40aefd0 2023-05-24T03:29:21.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.432+0000 7ff0bb7fe700 1 -- 172.21.15.151:0/1203420635 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5daedf77-0a83-49e7-b497-d9ed10436972", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff0c8029070 con 0x7ff0d40aefd0 2023-05-24T03:29:21.437 INFO:teuthology.orchestra.run.smithi151.stdout:6 2023-05-24T03:29:21.438 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.433+0000 7ff0d9251700 1 -- 172.21.15.151:0/1203420635 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0d40aefd0 msgr2=0x7ff0d41513a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:21.438 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.433+0000 7ff0d9251700 1 --2- 172.21.15.151:0/1203420635 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0d40aefd0 0x7ff0d41513a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff0c800e900 tx=0x7ff0c800ec10 comp rx=0 tx=0).stop 2023-05-24T03:29:21.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.434+0000 7ff0d9251700 1 -- 172.21.15.151:0/1203420635 shutdown_connections 2023-05-24T03:29:21.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.434+0000 7ff0d9251700 1 --2- 172.21.15.151:0/1203420635 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff0d415cd90 0x7ff0d40afd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:21.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.434+0000 7ff0d9251700 1 --2- 172.21.15.151:0/1203420635 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0d406a460 0x7ff0d40b0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:21.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.434+0000 7ff0d9251700 1 --2- 172.21.15.151:0/1203420635 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0d40aefd0 0x7ff0d41513a0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:21.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.434+0000 7ff0d9251700 1 -- 172.21.15.151:0/1203420635 >> 172.21.15.151:0/1203420635 conn(0x7ff0d40cfea0 msgr2=0x7ff0d406a830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:21.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.434+0000 7ff0d9251700 1 -- 172.21.15.151:0/1203420635 shutdown_connections 2023-05-24T03:29:21.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.434+0000 7ff0d9251700 1 -- 172.21.15.151:0/1203420635 wait complete. 2023-05-24T03:29:21.441 INFO:tasks.ceph.mgr.y.smithi146.stderr:2023-05-24T03:29:21.438+0000 7f25a1ed3200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-24T03:29:21.450 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 86ae4f7e-c01f-4c3d-a0dd-98160c209309 7 2023-05-24T03:29:21.602 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.598+0000 7f4e4395b700 1 Processor -- start 2023-05-24T03:29:21.616 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.610+0000 7f4e4395b700 1 -- start start 2023-05-24T03:29:21.616 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.611+0000 7f4e4395b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4e3c158bc0 0x7f4e3c06d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:21.616 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.611+0000 7f4e4395b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4e3c06df20 0x7f4e3c06c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:21.617 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.611+0000 7f4e4395b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e3c06ff60 con 0x7f4e3c0cc930 2023-05-24T03:29:21.617 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.611+0000 7f4e4395b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e3c070520 con 0x7f4e3c06df20 2023-05-24T03:29:21.617 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.611+0000 7f4e4395b700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e3c06e4a0 con 0x7f4e3c158bc0 2023-05-24T03:29:21.617 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.611+0000 7f4e416f7700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4e3c158bc0 0x7f4e3c06d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:21.617 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.611+0000 7f4e40ef6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4e3c06df20 0x7f4e3c06c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:21.617 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.611+0000 7f4e416f7700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4e3c158bc0 0x7f4e3c06d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:43648/0 (socket says 172.21.15.151:43648) 2023-05-24T03:29:21.617 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.611+0000 7f4e416f7700 1 -- 172.21.15.151:0/821647145 learned_addr learned my addr 172.21.15.151:0/821647145 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-05-24T03:29:21.618 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.612+0000 7f4e40ef6700 1 -- 172.21.15.151:0/821647145 >> v2:172.21.15.151:3300/0 conn(0x7f4e3c158bc0 msgr2=0x7f4e3c06d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:21.619 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.612+0000 7f4e40ef6700 1 --2- 172.21.15.151:0/821647145 >> v2:172.21.15.151:3300/0 conn(0x7f4e3c158bc0 0x7f4e3c06d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:21.619 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.612+0000 7f4e40ef6700 1 -- 172.21.15.151:0/821647145 >> v1:172.21.15.146:6789/0 conn(0x7f4e3c0cc930 legacy=0x7f4e3c15c7e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-05-24T03:29:21.619 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.612+0000 7f4e40ef6700 1 -- 172.21.15.151:0/821647145 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e3c06e780 con 0x7f4e3c06df20 2023-05-24T03:29:21.619 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.612+0000 7f4e416f7700 1 --2- 172.21.15.151:0/821647145 >> v2:172.21.15.151:3300/0 conn(0x7f4e3c158bc0 0x7f4e3c06d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T03:29:21.619 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.612+0000 7f4e40ef6700 1 --2- 172.21.15.151:0/821647145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e3c06df20 0x7f4e3c06c030 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c0b18d0 tx=0x7f4e38007640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a882fba03ca2564a server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:21.619 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.612+0000 7f4e33fff700 1 -- 172.21.15.151:0/821647145 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3800f070 con 0x7f4e3c06df20 2023-05-24T03:29:21.620 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.612+0000 7f4e33fff700 1 -- 172.21.15.151:0/821647145 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e380089e0 con 0x7f4e3c06df20 2023-05-24T03:29:21.620 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.612+0000 7f4e33fff700 1 -- 172.21.15.151:0/821647145 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e38008d70 con 0x7f4e3c06df20 2023-05-24T03:29:21.620 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.613+0000 7f4e4395b700 1 -- 172.21.15.151:0/821647145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e3c06df20 msgr2=0x7f4e3c06c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:21.620 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.613+0000 7f4e4395b700 1 --2- 172.21.15.151:0/821647145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e3c06df20 0x7f4e3c06c030 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c0b18d0 tx=0x7f4e38007640 comp rx=0 tx=0).stop 2023-05-24T03:29:21.620 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.614+0000 7f4e4395b700 1 -- 172.21.15.151:0/821647145 shutdown_connections 2023-05-24T03:29:21.620 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.614+0000 7f4e4395b700 1 --2- 172.21.15.151:0/821647145 >> v2:172.21.15.151:3300/0 conn(0x7f4e3c158bc0 0x7f4e3c06d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:21.620 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.614+0000 7f4e4395b700 1 --2- 172.21.15.151:0/821647145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e3c06df20 0x7f4e3c06c030 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:21.621 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.614+0000 7f4e4395b700 1 -- 172.21.15.151:0/821647145 >> 172.21.15.151:0/821647145 conn(0x7f4e3c0cc430 msgr2=0x7f4e3c0ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:21.621 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.614+0000 7f4e4395b700 1 -- 172.21.15.151:0/821647145 shutdown_connections 2023-05-24T03:29:21.621 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.614+0000 7f4e4395b700 1 -- 172.21.15.151:0/821647145 wait complete. 2023-05-24T03:29:21.623 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.615+0000 7f4e4395b700 1 Processor -- start 2023-05-24T03:29:21.623 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.615+0000 7f4e4395b700 1 -- start start 2023-05-24T03:29:21.623 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.616+0000 7f4e4395b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e3c06df20 0x7f4e3c1f2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:21.623 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.616+0000 7f4e4395b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e3c0cc930 0x7f4e3c15bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:21.623 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.616+0000 7f4e4395b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e3c158bc0 0x7f4e3c1f3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:21.623 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.616+0000 7f4e4395b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c1f3500 con 0x7f4e3c158bc0 2023-05-24T03:29:21.623 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.616+0000 7f4e4395b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c0c61d0 con 0x7f4e3c06df20 2023-05-24T03:29:21.624 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.616+0000 7f4e4395b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c0c64b0 con 0x7f4e3c0cc930 2023-05-24T03:29:21.624 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.616+0000 7f4e416f7700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e3c06df20 0x7f4e3c1f2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:21.624 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.616+0000 7f4e416f7700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e3c06df20 0x7f4e3c1f2fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:43650/0 (socket says 172.21.15.151:43650) 2023-05-24T03:29:21.624 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.616+0000 7f4e416f7700 1 -- 172.21.15.151:0/2040812929 learned_addr learned my addr 172.21.15.151:0/2040812929 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-05-24T03:29:21.624 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.616+0000 7f4e40ef6700 1 --2- 172.21.15.151:0/2040812929 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e3c0cc930 0x7f4e3c15bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:21.624 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.616+0000 7f4e41ef8700 1 --2- 172.21.15.151:0/2040812929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e3c158bc0 0x7f4e3c1f3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:21.624 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.616+0000 7f4e40ef6700 1 -- 172.21.15.151:0/2040812929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e3c06df20 msgr2=0x7f4e3c1f2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:21.625 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.616+0000 7f4e40ef6700 1 --2- 172.21.15.151:0/2040812929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e3c06df20 0x7f4e3c1f2fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:21.625 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.616+0000 7f4e40ef6700 1 -- 172.21.15.151:0/2040812929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e3c158bc0 msgr2=0x7f4e3c1f3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:21.625 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.616+0000 7f4e40ef6700 1 --2- 172.21.15.151:0/2040812929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e3c158bc0 0x7f4e3c1f3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:21.625 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.616+0000 7f4e40ef6700 1 -- 172.21.15.151:0/2040812929 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e34009b30 con 0x7f4e3c0cc930 2023-05-24T03:29:21.625 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.616+0000 7f4e416f7700 1 --2- 172.21.15.151:0/2040812929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e3c06df20 0x7f4e3c1f2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T03:29:21.625 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.616+0000 7f4e40ef6700 1 --2- 172.21.15.151:0/2040812929 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e3c0cc930 0x7f4e3c15bce0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4e38015000 tx=0x7f4e38004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:21.626 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.616+0000 7f4e31ffb700 1 -- 172.21.15.151:0/2040812929 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e380038a0 con 0x7f4e3c0cc930 2023-05-24T03:29:21.626 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.617+0000 7f4e31ffb700 1 -- 172.21.15.151:0/2040812929 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e38003a40 con 0x7f4e3c0cc930 2023-05-24T03:29:21.626 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.617+0000 7f4e4395b700 1 -- 172.21.15.151:0/2040812929 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e38007040 con 0x7f4e3c0cc930 2023-05-24T03:29:21.626 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.617+0000 7f4e31ffb700 1 -- 172.21.15.151:0/2040812929 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e38003df0 con 0x7f4e3c0cc930 2023-05-24T03:29:21.626 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.617+0000 7f4e4395b700 1 -- 172.21.15.151:0/2040812929 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e3c0c95e0 con 0x7f4e3c0cc930 2023-05-24T03:29:21.626 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.617+0000 7f4e31ffb700 1 -- 172.21.15.151:0/2040812929 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4e3801a040 con 0x7f4e3c0cc930 2023-05-24T03:29:21.626 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.617+0000 7f4e31ffb700 1 -- 172.21.15.151:0/2040812929 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f4e3800a730 con 0x7f4e3c0cc930 2023-05-24T03:29:21.627 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.618+0000 7f4e4395b700 1 -- 172.21.15.151:0/2040812929 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e3c158f90 con 0x7f4e3c0cc930 2023-05-24T03:29:21.627 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.621+0000 7f4e31ffb700 1 -- 172.21.15.151:0/2040812929 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f4e38020070 con 0x7f4e3c0cc930 2023-05-24T03:29:21.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.704+0000 7f4e4395b700 1 -- 172.21.15.151:0/2040812929 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd new", "uuid": "86ae4f7e-c01f-4c3d-a0dd-98160c209309", "id": 7} v 0) v1 -- 0x7f4e3c0b4570 con 0x7f4e3c0cc930 2023-05-24T03:29:21.717 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.712+0000 7f4e31ffb700 1 -- 172.21.15.151:0/2040812929 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "86ae4f7e-c01f-4c3d-a0dd-98160c209309", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4e380330b0 con 0x7f4e3c0cc930 2023-05-24T03:29:21.717 INFO:teuthology.orchestra.run.smithi151.stdout:7 2023-05-24T03:29:21.718 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.713+0000 7f4e4395b700 1 -- 172.21.15.151:0/2040812929 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e3c0cc930 msgr2=0x7f4e3c15bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:21.718 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.713+0000 7f4e4395b700 1 --2- 172.21.15.151:0/2040812929 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e3c0cc930 0x7f4e3c15bce0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4e38015000 tx=0x7f4e38004750 comp rx=0 tx=0).stop 2023-05-24T03:29:21.718 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.713+0000 7f4e4395b700 1 -- 172.21.15.151:0/2040812929 shutdown_connections 2023-05-24T03:29:21.719 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.713+0000 7f4e4395b700 1 --2- 172.21.15.151:0/2040812929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e3c158bc0 0x7f4e3c1f3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:21.719 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.713+0000 7f4e4395b700 1 --2- 172.21.15.151:0/2040812929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e3c06df20 0x7f4e3c1f2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:21.719 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.713+0000 7f4e4395b700 1 --2- 172.21.15.151:0/2040812929 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e3c0cc930 0x7f4e3c15bce0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:21.719 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.713+0000 7f4e4395b700 1 -- 172.21.15.151:0/2040812929 >> 172.21.15.151:0/2040812929 conn(0x7f4e3c0cc430 msgr2=0x7f4e3c0b3e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:21.719 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.713+0000 7f4e4395b700 1 -- 172.21.15.151:0/2040812929 shutdown_connections 2023-05-24T03:29:21.720 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-24T03:29:21.713+0000 7f4e4395b700 1 -- 172.21.15.151:0/2040812929 wait complete. 2023-05-24T03:29:21.730 INFO:tasks.ceph.osd.0:Restarting daemon 2023-05-24T03:29:21.731 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-05-24T03:29:21.733 INFO:tasks.ceph.osd.0:Started 2023-05-24T03:29:21.733 INFO:tasks.ceph.osd.1:Restarting daemon 2023-05-24T03:29:21.733 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-05-24T03:29:21.735 INFO:tasks.ceph.osd.1:Started 2023-05-24T03:29:21.735 INFO:tasks.ceph.osd.2:Restarting daemon 2023-05-24T03:29:21.736 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-05-24T03:29:21.737 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-05-24T03:29:21.732+0000 7f364301f200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-24T03:29:21.737 INFO:tasks.ceph.osd.2:Started 2023-05-24T03:29:21.738 INFO:tasks.ceph.osd.3:Restarting daemon 2023-05-24T03:29:21.738 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-05-24T03:29:21.740 INFO:tasks.ceph.osd.3:Started 2023-05-24T03:29:21.740 INFO:tasks.ceph.osd.4:Restarting daemon 2023-05-24T03:29:21.740 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-05-24T03:29:21.742 INFO:tasks.ceph.osd.4:Started 2023-05-24T03:29:21.743 INFO:tasks.ceph.osd.5:Restarting daemon 2023-05-24T03:29:21.743 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-05-24T03:29:21.744 INFO:tasks.ceph.osd.5:Started 2023-05-24T03:29:21.745 INFO:tasks.ceph.osd.6:Restarting daemon 2023-05-24T03:29:21.745 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-05-24T03:29:21.750 INFO:tasks.ceph.osd.6:Started 2023-05-24T03:29:21.751 INFO:tasks.ceph.osd.7:Restarting daemon 2023-05-24T03:29:21.751 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-05-24T03:29:21.754 INFO:tasks.ceph.osd.7:Started 2023-05-24T03:29:21.755 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-24T03:29:21.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.913+0000 7f89cec49700 1 Processor -- start 2023-05-24T03:29:21.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.913+0000 7f89cec49700 1 -- start start 2023-05-24T03:29:21.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.914+0000 7f89cec49700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f89c80b8a50 0x7f89c815daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:21.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.914+0000 7f89cec49700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89c806bb40 0x7f89c80cfe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:21.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.914+0000 7f89cec49700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89c80cf9d0 con 0x7f89c80d03a0 2023-05-24T03:29:21.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.914+0000 7f89cec49700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89c80cd790 con 0x7f89c80b8a50 2023-05-24T03:29:21.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.914+0000 7f89cec49700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89c815e030 con 0x7f89c806bb40 2023-05-24T03:29:21.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.914+0000 7f89cd1e6700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f89c80d03a0 0x7f89c80b4c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44494/0 (socket says 172.21.15.146:44494) 2023-05-24T03:29:21.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.914+0000 7f89cd1e6700 1 -- 172.21.15.146:0/3386084172 learned_addr learned my addr 172.21.15.146:0/3386084172 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:29:21.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.914+0000 7f89cc9e5700 1 --2- 172.21.15.146:0/3386084172 >> v2:172.21.15.151:3300/0 conn(0x7f89c80b8a50 0x7f89c815daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:21.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.914+0000 7f89c7fff700 1 --2- 172.21.15.146:0/3386084172 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89c806bb40 0x7f89c80cfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:21.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.915+0000 7f89c77fe700 1 -- 172.21.15.146:0/3386084172 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1424143545 0 0) 0x7f89c80cf9d0 con 0x7f89c80d03a0 2023-05-24T03:29:21.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.915+0000 7f89c77fe700 1 -- 172.21.15.146:0/3386084172 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89b80035b0 con 0x7f89c80d03a0 2023-05-24T03:29:21.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.915+0000 7f89cc9e5700 1 -- 172.21.15.146:0/3386084172 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89c806bb40 msgr2=0x7f89c80cfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:21.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.915+0000 7f89cc9e5700 1 --2- 172.21.15.146:0/3386084172 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89c806bb40 0x7f89c80cfe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:21.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.915+0000 7f89cc9e5700 1 -- 172.21.15.146:0/3386084172 >> v1:172.21.15.146:6789/0 conn(0x7f89c80d03a0 legacy=0x7f89c80b4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:21.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.915+0000 7f89cc9e5700 1 -- 172.21.15.146:0/3386084172 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c80cf400 con 0x7f89c80b8a50 2023-05-24T03:29:21.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.915+0000 7f89c7fff700 1 --2- 172.21.15.146:0/3386084172 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89c806bb40 0x7f89c80cfe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T03:29:21.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.915+0000 7f89cc9e5700 1 --2- 172.21.15.146:0/3386084172 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89c80b8a50 0x7f89c815daf0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f89bc009840 tx=0x7f89bc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a881289acd1f8631 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:21.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.915+0000 7f89c77fe700 1 -- 172.21.15.146:0/3386084172 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89bc011830 con 0x7f89c80b8a50 2023-05-24T03:29:21.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.915+0000 7f89c77fe700 1 -- 172.21.15.146:0/3386084172 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89bc011990 con 0x7f89c80b8a50 2023-05-24T03:29:21.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.915+0000 7f89c77fe700 1 -- 172.21.15.146:0/3386084172 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89bc011d20 con 0x7f89c80b8a50 2023-05-24T03:29:21.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.916+0000 7f89cec49700 1 -- 172.21.15.146:0/3386084172 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89c80b8a50 msgr2=0x7f89c815daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:21.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.916+0000 7f89cec49700 1 --2- 172.21.15.146:0/3386084172 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89c80b8a50 0x7f89c815daf0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f89bc009840 tx=0x7f89bc009b50 comp rx=0 tx=0).stop 2023-05-24T03:29:21.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.916+0000 7f89cec49700 1 -- 172.21.15.146:0/3386084172 shutdown_connections 2023-05-24T03:29:21.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.916+0000 7f89cec49700 1 --2- 172.21.15.146:0/3386084172 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89c80b8a50 0x7f89c815daf0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:21.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.916+0000 7f89cec49700 1 --2- 172.21.15.146:0/3386084172 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89c806bb40 0x7f89c80cfe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:21.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.916+0000 7f89cec49700 1 -- 172.21.15.146:0/3386084172 >> 172.21.15.146:0/3386084172 conn(0x7f89c806af30 msgr2=0x7f89c806b330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:21.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.916+0000 7f89cec49700 1 -- 172.21.15.146:0/3386084172 shutdown_connections 2023-05-24T03:29:21.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.916+0000 7f89cec49700 1 -- 172.21.15.146:0/3386084172 wait complete. 2023-05-24T03:29:21.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.917+0000 7f89cec49700 1 Processor -- start 2023-05-24T03:29:21.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.918+0000 7f89cec49700 1 -- start start 2023-05-24T03:29:21.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.919+0000 7f89cec49700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89c806bb40 0x7f89c80cd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:21.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.919+0000 7f89cec49700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89c80b8a50 0x7f89c80ca210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:21.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.919+0000 7f89cec49700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89c80d03a0 0x7f89c814d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:21.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.919+0000 7f89cec49700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c80ca750 con 0x7f89c806bb40 2023-05-24T03:29:21.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.919+0000 7f89cec49700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c80c8fb0 con 0x7f89c80b8a50 2023-05-24T03:29:21.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.919+0000 7f89cec49700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89c814dc50 con 0x7f89c80d03a0 2023-05-24T03:29:21.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.919+0000 7f89cc9e5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89c806bb40 0x7f89c80cd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:21.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.919+0000 7f89c7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89c80b8a50 0x7f89c80ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:21.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.919+0000 7f89cd1e6700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89c80d03a0 0x7f89c814d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:21.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.919+0000 7f89cc9e5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89c806bb40 0x7f89c80cd1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38044/0 (socket says 172.21.15.146:38044) 2023-05-24T03:29:21.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.919+0000 7f89cc9e5700 1 -- 172.21.15.146:0/2364535896 learned_addr learned my addr 172.21.15.146:0/2364535896 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:21.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.919+0000 7f89cc9e5700 1 -- 172.21.15.146:0/2364535896 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89c80d03a0 msgr2=0x7f89c814d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:21.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.919+0000 7f89cc9e5700 1 --2- 172.21.15.146:0/2364535896 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89c80d03a0 0x7f89c814d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:21.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.919+0000 7f89cc9e5700 1 -- 172.21.15.146:0/2364535896 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89c80b8a50 msgr2=0x7f89c80ca210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:21.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.919+0000 7f89cc9e5700 1 --2- 172.21.15.146:0/2364535896 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89c80b8a50 0x7f89c80ca210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:21.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.919+0000 7f89cc9e5700 1 -- 172.21.15.146:0/2364535896 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b40094a0 con 0x7f89c806bb40 2023-05-24T03:29:21.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.919+0000 7f89cd1e6700 1 --2- 172.21.15.146:0/2364535896 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89c80d03a0 0x7f89c814d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T03:29:21.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.919+0000 7f89c7fff700 1 --2- 172.21.15.146:0/2364535896 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89c80b8a50 0x7f89c80ca210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T03:29:21.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.919+0000 7f89cc9e5700 1 --2- 172.21.15.146:0/2364535896 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89c806bb40 0x7f89c80cd1f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f89bc0090b0 tx=0x7f89bc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:21.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.919+0000 7f89c57fa700 1 -- 172.21.15.146:0/2364535896 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89bc004590 con 0x7f89c806bb40 2023-05-24T03:29:21.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.919+0000 7f89c57fa700 1 -- 172.21.15.146:0/2364535896 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89bc01f070 con 0x7f89c806bb40 2023-05-24T03:29:21.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.919+0000 7f89cec49700 1 -- 172.21.15.146:0/2364535896 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89bc0094a0 con 0x7f89c806bb40 2023-05-24T03:29:21.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.919+0000 7f89c57fa700 1 -- 172.21.15.146:0/2364535896 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89bc0038e0 con 0x7f89c806bb40 2023-05-24T03:29:21.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.919+0000 7f89cec49700 1 -- 172.21.15.146:0/2364535896 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89c80cdf60 con 0x7f89c806bb40 2023-05-24T03:29:21.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.920+0000 7f89c57fa700 1 -- 172.21.15.146:0/2364535896 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f89bc003d40 con 0x7f89c806bb40 2023-05-24T03:29:21.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.920+0000 7f89c57fa700 1 -- 172.21.15.146:0/2364535896 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f89bc021070 con 0x7f89c806bb40 2023-05-24T03:29:21.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.921+0000 7f89cec49700 1 -- 172.21.15.146:0/2364535896 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89c80cf6a0 con 0x7f89c806bb40 2023-05-24T03:29:21.935 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-05-24T03:29:21.918+0000 7f364301f200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-24T03:29:21.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.923+0000 7f89c57fa700 1 -- 172.21.15.146:0/2364535896 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f89bc015020 con 0x7f89c806bb40 2023-05-24T03:29:21.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.992+0000 7f89cec49700 1 -- 172.21.15.146:0/2364535896 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89c8072ae0 con 0x7f89c806bb40 2023-05-24T03:29:21.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.993+0000 7f89c57fa700 1 -- 172.21.15.146:0/2364535896 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f89bc0266a0 con 0x7f89c806bb40 2023-05-24T03:29:21.997 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:29:21.997 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":10,"fsid":"11ca0adb-7672-4713-bde7-451e8b743ae9","created":"2023-05-24T03:29:19.113659+0000","modified":"2023-05-24T03:29:21.706540+0000","last_up_change":"0.000000","last_in_change":"2023-05-24T03:29:21.706540+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f24b319b-fcc8-4385-b0cb-78138fc31417","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c9639ea9-8f9b-498e-92c8-aa976edbf1da","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7a6cfc6d-b0ca-4cb6-a66d-4001ec184657","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"401509f7-cecd-44a2-b0ae-22c81a5d93c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9d07f440-d125-4f99-a825-411fab894d5e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9b2266e2-9e52-4f0e-96da-e703a6c23a6d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"5daedf77-0a83-49e7-b497-d9ed10436972","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"86ae4f7e-c01f-4c3d-a0dd-98160c209309","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-24T03:29:21.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.994+0000 7f89cec49700 1 -- 172.21.15.146:0/2364535896 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89c806bb40 msgr2=0x7f89c80cd1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:21.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.994+0000 7f89cec49700 1 --2- 172.21.15.146:0/2364535896 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89c806bb40 0x7f89c80cd1f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f89bc0090b0 tx=0x7f89bc004750 comp rx=0 tx=0).stop 2023-05-24T03:29:21.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.994+0000 7f89cec49700 1 -- 172.21.15.146:0/2364535896 shutdown_connections 2023-05-24T03:29:21.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.994+0000 7f89cec49700 1 --2- 172.21.15.146:0/2364535896 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89c80d03a0 0x7f89c814d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:21.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.994+0000 7f89cec49700 1 --2- 172.21.15.146:0/2364535896 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89c806bb40 0x7f89c80cd1f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:21.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.994+0000 7f89cec49700 1 --2- 172.21.15.146:0/2364535896 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89c80b8a50 0x7f89c80ca210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:21.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.994+0000 7f89cec49700 1 -- 172.21.15.146:0/2364535896 >> 172.21.15.146:0/2364535896 conn(0x7f89c806af30 msgr2=0x7f89c81e8040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:21.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.994+0000 7f89cec49700 1 -- 172.21.15.146:0/2364535896 shutdown_connections 2023-05-24T03:29:21.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:21.994+0000 7f89cec49700 1 -- 172.21.15.146:0/2364535896 wait complete. 2023-05-24T03:29:22.014 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-05-24T03:29:22.014 INFO:tasks.ceph:Waiting for OSDs to come up 2023-05-24T03:29:22.188 INFO:tasks.ceph.mgr.y.smithi146.stderr:2023-05-24T03:29:22.184+0000 7f25a1ed3200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-24T03:29:22.265 INFO:tasks.ceph.mgr.y.smithi146.stderr:2023-05-24T03:29:22.261+0000 7f25a1ed3200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-05-24T03:29:22.347 INFO:tasks.ceph.osd.0.smithi146.stderr:2023-05-24T03:29:22.343+0000 7fafe54f4640 -1 Falling back to public interface 2023-05-24T03:29:22.357 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-05-24T03:29:22.352+0000 7faba9998640 -1 Falling back to public interface 2023-05-24T03:29:22.360 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-05-24T03:29:22.355+0000 7f49ef210640 -1 Falling back to public interface 2023-05-24T03:29:22.361 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-05-24T03:29:22.355+0000 7ffb44bc3640 -1 Falling back to public interface 2023-05-24T03:29:22.368 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-05-24T03:29:22.363+0000 7f6579371640 -1 Falling back to public interface 2023-05-24T03:29:22.371 INFO:tasks.ceph.osd.2.smithi146.stderr:2023-05-24T03:29:22.367+0000 7f5a5220e640 -1 Falling back to public interface 2023-05-24T03:29:22.379 INFO:tasks.ceph.osd.3.smithi146.stderr:2023-05-24T03:29:22.375+0000 7f677017b640 -1 Falling back to public interface 2023-05-24T03:29:22.379 INFO:tasks.ceph.osd.1.smithi146.stderr:2023-05-24T03:29:22.376+0000 7f2ce0ab4640 -1 Falling back to public interface 2023-05-24T03:29:22.410 INFO:tasks.ceph.mgr.y.smithi146.stderr:2023-05-24T03:29:22.407+0000 7f25a1ed3200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-24T03:29:22.610 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-05-24T03:29:22.605+0000 7f364301f200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-24T03:29:22.643 INFO:tasks.ceph.mgr.y.smithi146.stderr:2023-05-24T03:29:22.640+0000 7f25a1ed3200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-05-24T03:29:22.689 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-05-24T03:29:22.684+0000 7f364301f200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-05-24T03:29:22.719 INFO:tasks.ceph.mgr.y.smithi146.stderr:2023-05-24T03:29:22.715+0000 7f25a1ed3200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-24T03:29:22.819 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-05-24T03:29:22.827 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-05-24T03:29:22.823+0000 7f364301f200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-24T03:29:22.934 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.930+0000 7f41128df700 1 Processor -- start 2023-05-24T03:29:22.934 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.930+0000 7f41128df700 1 -- start start 2023-05-24T03:29:22.935 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.931+0000 7f41128df700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f410c15acd0 0x7f410c0ce100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:22.935 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.931+0000 7f41128df700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f410c0d1260 0x7f410c0cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:22.935 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.931+0000 7f41128df700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f410c0cd940 con 0x7f410c0d06d0 2023-05-24T03:29:22.936 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.931+0000 7f41128df700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f410c0b33d0 con 0x7f410c15acd0 2023-05-24T03:29:22.936 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.931+0000 7f41128df700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f410c0b3690 con 0x7f410c0d1260 2023-05-24T03:29:22.936 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.931+0000 7f410bfff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f410c15acd0 0x7f410c0ce100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:22.936 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.931+0000 7f4110e7c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f410c0d1260 0x7f410c0cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:22.936 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.931+0000 7f410bfff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f410c15acd0 0x7f410c0ce100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:49232/0 (socket says 172.21.15.146:49232) 2023-05-24T03:29:22.936 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.931+0000 7f4110e7c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f410c0d1260 0x7f410c0cec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:50918/0 (socket says 172.21.15.146:50918) 2023-05-24T03:29:22.936 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.931+0000 7f410bfff700 1 -- 172.21.15.146:0/3157103413 learned_addr learned my addr 172.21.15.146:0/3157103413 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:22.937 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.932+0000 7f410bfff700 1 -- 172.21.15.146:0/3157103413 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f410c0d1260 msgr2=0x7f410c0cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:22.937 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.932+0000 7f410bfff700 1 --2- 172.21.15.146:0/3157103413 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f410c0d1260 0x7f410c0cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:22.937 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.932+0000 7f410bfff700 1 -- 172.21.15.146:0/3157103413 >> v1:172.21.15.151:6789/0 conn(0x7f410c0d06d0 legacy=0x7f410c0d0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:22.937 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.932+0000 7f410bfff700 1 -- 172.21.15.146:0/3157103413 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f410c0cdbe0 con 0x7f410c15acd0 2023-05-24T03:29:22.937 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.932+0000 7f4110e7c700 1 --2- 172.21.15.146:0/3157103413 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f410c0d1260 0x7f410c0cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T03:29:22.940 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.932+0000 7f410bfff700 1 --2- 172.21.15.146:0/3157103413 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f410c15acd0 0x7f410c0ce100 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f40fc0098f0 tx=0x7f40fc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d970a20ffd807827 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:22.940 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.932+0000 7f410affd700 1 -- 172.21.15.146:0/3157103413 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40fc011830 con 0x7f410c15acd0 2023-05-24T03:29:22.940 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.932+0000 7f410affd700 1 -- 172.21.15.146:0/3157103413 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40fc011990 con 0x7f410c15acd0 2023-05-24T03:29:22.940 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.932+0000 7f410affd700 1 -- 172.21.15.146:0/3157103413 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40fc011d20 con 0x7f410c15acd0 2023-05-24T03:29:22.940 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.933+0000 7f41128df700 1 -- 172.21.15.146:0/3157103413 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f410c15acd0 msgr2=0x7f410c0ce100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:22.940 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.933+0000 7f41128df700 1 --2- 172.21.15.146:0/3157103413 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f410c15acd0 0x7f410c0ce100 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f40fc0098f0 tx=0x7f40fc009c00 comp rx=0 tx=0).stop 2023-05-24T03:29:22.940 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.933+0000 7f41128df700 1 -- 172.21.15.146:0/3157103413 shutdown_connections 2023-05-24T03:29:22.941 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.933+0000 7f41128df700 1 --2- 172.21.15.146:0/3157103413 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f410c0d1260 0x7f410c0cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:22.941 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.933+0000 7f41128df700 1 --2- 172.21.15.146:0/3157103413 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f410c15acd0 0x7f410c0ce100 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:22.941 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.933+0000 7f41128df700 1 -- 172.21.15.146:0/3157103413 >> 172.21.15.146:0/3157103413 conn(0x7f410c06e2a0 msgr2=0x7f410c06e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:22.941 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.933+0000 7f41128df700 1 -- 172.21.15.146:0/3157103413 shutdown_connections 2023-05-24T03:29:22.941 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.933+0000 7f41128df700 1 -- 172.21.15.146:0/3157103413 wait complete. 2023-05-24T03:29:22.941 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.934+0000 7f41128df700 1 Processor -- start 2023-05-24T03:29:22.941 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.934+0000 7f41128df700 1 -- start start 2023-05-24T03:29:22.942 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.935+0000 7f41128df700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f410c0d06d0 0x7f410c145140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:22.942 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.935+0000 7f41128df700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f410c0d1260 0x7f410c1448b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:22.942 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.935+0000 7f41128df700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f410c15acd0 0x7f410c1441a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:22.942 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.935+0000 7f41128df700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f410c141ed0 con 0x7f410c0d1260 2023-05-24T03:29:22.942 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.935+0000 7f41128df700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f410c13ef60 con 0x7f410c15acd0 2023-05-24T03:29:22.942 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.935+0000 7f41128df700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f410c1446e0 con 0x7f410c0d06d0 2023-05-24T03:29:22.942 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.935+0000 7f410b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f410c0d1260 0x7f410c1448b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:22.942 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.935+0000 7f410b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f410c0d1260 0x7f410c1448b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38058/0 (socket says 172.21.15.146:38058) 2023-05-24T03:29:22.943 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.935+0000 7f410b7fe700 1 -- 172.21.15.146:0/3351111229 learned_addr learned my addr 172.21.15.146:0/3351111229 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:22.943 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.935+0000 7f410bfff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f410c0d06d0 0x7f410c145140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:22.943 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.935+0000 7f4110e7c700 1 --2- 172.21.15.146:0/3351111229 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f410c15acd0 0x7f410c1441a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:22.943 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.935+0000 7f410b7fe700 1 -- 172.21.15.146:0/3351111229 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f410c0d06d0 msgr2=0x7f410c145140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:22.943 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.935+0000 7f410b7fe700 1 --2- 172.21.15.146:0/3351111229 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f410c0d06d0 0x7f410c145140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:22.943 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.935+0000 7f410b7fe700 1 -- 172.21.15.146:0/3351111229 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f410c15acd0 msgr2=0x7f410c1441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:22.943 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.935+0000 7f410b7fe700 1 --2- 172.21.15.146:0/3351111229 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f410c15acd0 0x7f410c1441a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:22.944 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.935+0000 7f410b7fe700 1 -- 172.21.15.146:0/3351111229 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4104009a70 con 0x7f410c0d1260 2023-05-24T03:29:22.944 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.935+0000 7f410bfff700 1 --2- 172.21.15.146:0/3351111229 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f410c0d06d0 0x7f410c145140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T03:29:22.944 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.935+0000 7f410b7fe700 1 --2- 172.21.15.146:0/3351111229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f410c0d1260 0x7f410c1448b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f410000c480 tx=0x7f410000c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:22.944 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.936+0000 7f4108ff9700 1 -- 172.21.15.146:0/3351111229 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41000052d0 con 0x7f410c0d1260 2023-05-24T03:29:22.944 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.936+0000 7f4108ff9700 1 -- 172.21.15.146:0/3351111229 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4100005430 con 0x7f410c0d1260 2023-05-24T03:29:22.944 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.936+0000 7f4108ff9700 1 -- 172.21.15.146:0/3351111229 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41000038c0 con 0x7f410c0d1260 2023-05-24T03:29:22.944 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.936+0000 7f41128df700 1 -- 172.21.15.146:0/3351111229 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40fc009550 con 0x7f410c0d1260 2023-05-24T03:29:22.944 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.936+0000 7f41128df700 1 -- 172.21.15.146:0/3351111229 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f410c0d03b0 con 0x7f410c0d1260 2023-05-24T03:29:22.945 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.936+0000 7f4108ff9700 1 -- 172.21.15.146:0/3351111229 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4100003d20 con 0x7f410c0d1260 2023-05-24T03:29:22.945 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.936+0000 7f4108ff9700 1 -- 172.21.15.146:0/3351111229 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f410000ce40 con 0x7f410c0d1260 2023-05-24T03:29:22.945 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.937+0000 7f41128df700 1 -- 172.21.15.146:0/3351111229 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f410c0b3970 con 0x7f410c0d1260 2023-05-24T03:29:22.945 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:22.939+0000 7f4108ff9700 1 -- 172.21.15.146:0/3351111229 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f4100017070 con 0x7f410c0d1260 2023-05-24T03:29:23.001 INFO:tasks.ceph.mgr.y.smithi146.stderr:2023-05-24T03:29:22.998+0000 7f25a1ed3200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-24T03:29:23.012 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:23.008+0000 7f41128df700 1 -- 172.21.15.146:0/3351111229 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f410c15b0a0 con 0x7f410c0d1260 2023-05-24T03:29:23.012 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:23.009+0000 7f4108ff9700 1 -- 172.21.15.146:0/3351111229 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f4100011cc0 con 0x7f410c0d1260 2023-05-24T03:29:23.013 INFO:teuthology.misc.health.smithi146.stdout: 2023-05-24T03:29:23.013 INFO:teuthology.misc.health.smithi146.stdout:{"epoch":10,"fsid":"11ca0adb-7672-4713-bde7-451e8b743ae9","created":"2023-05-24T03:29:19.113659+0000","modified":"2023-05-24T03:29:21.706540+0000","last_up_change":"0.000000","last_in_change":"2023-05-24T03:29:21.706540+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f24b319b-fcc8-4385-b0cb-78138fc31417","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c9639ea9-8f9b-498e-92c8-aa976edbf1da","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7a6cfc6d-b0ca-4cb6-a66d-4001ec184657","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"401509f7-cecd-44a2-b0ae-22c81a5d93c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9d07f440-d125-4f99-a825-411fab894d5e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9b2266e2-9e52-4f0e-96da-e703a6c23a6d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"5daedf77-0a83-49e7-b497-d9ed10436972","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"86ae4f7e-c01f-4c3d-a0dd-98160c209309","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-24T03:29:23.014 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:23.010+0000 7f41128df700 1 -- 172.21.15.146:0/3351111229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f410c0d1260 msgr2=0x7f410c1448b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:23.014 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:23.010+0000 7f41128df700 1 --2- 172.21.15.146:0/3351111229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f410c0d1260 0x7f410c1448b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f410000c480 tx=0x7f410000c790 comp rx=0 tx=0).stop 2023-05-24T03:29:23.015 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:23.010+0000 7f41128df700 1 -- 172.21.15.146:0/3351111229 shutdown_connections 2023-05-24T03:29:23.015 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:23.010+0000 7f41128df700 1 --2- 172.21.15.146:0/3351111229 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f410c15acd0 0x7f410c1441a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:23.015 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:23.010+0000 7f41128df700 1 --2- 172.21.15.146:0/3351111229 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f410c0d06d0 0x7f410c145140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:23.015 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:23.010+0000 7f41128df700 1 --2- 172.21.15.146:0/3351111229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f410c0d1260 0x7f410c1448b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:23.015 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:23.010+0000 7f41128df700 1 -- 172.21.15.146:0/3351111229 >> 172.21.15.146:0/3351111229 conn(0x7f410c06e2a0 msgr2=0x7f410c0b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:23.015 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:23.010+0000 7f41128df700 1 -- 172.21.15.146:0/3351111229 shutdown_connections 2023-05-24T03:29:23.015 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:23.010+0000 7f41128df700 1 -- 172.21.15.146:0/3351111229 wait complete. 2023-05-24T03:29:23.024 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-05-24T03:29:23.061 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-05-24T03:29:23.057+0000 7f364301f200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-05-24T03:29:23.135 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-05-24T03:29:23.131+0000 7f364301f200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-24T03:29:23.224 INFO:tasks.ceph.mgr.y.smithi146.stderr:2023-05-24T03:29:23.220+0000 7f25a1ed3200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-24T03:29:23.378 INFO:tasks.ceph.mgr.y.smithi146.stderr:2023-05-24T03:29:23.375+0000 7f25a1ed3200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-24T03:29:23.409 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-05-24T03:29:23.405+0000 7f364301f200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-24T03:29:23.494 INFO:tasks.ceph.mgr.y.smithi146.stderr:2023-05-24T03:29:23.490+0000 7f25a1ed3200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-24T03:29:23.626 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-05-24T03:29:23.621+0000 7f364301f200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-24T03:29:23.782 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-05-24T03:29:23.777+0000 7f364301f200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-24T03:29:23.818 INFO:tasks.ceph.mgr.y.smithi146.stderr:2023-05-24T03:29:23.815+0000 7f25a1ed3200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-24T03:29:23.896 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-05-24T03:29:23.892+0000 7f364301f200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-24T03:29:23.918 INFO:tasks.ceph.mgr.y.smithi146.stderr:2023-05-24T03:29:23.914+0000 7f25a1ed3200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-24T03:29:24.102 INFO:tasks.ceph.mgr.y.smithi146.stderr:2023-05-24T03:29:24.099+0000 7f25a1ed3200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-24T03:29:24.220 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-05-24T03:29:24.216+0000 7f364301f200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-24T03:29:24.321 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-05-24T03:29:24.316+0000 7f364301f200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-24T03:29:24.502 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-05-24T03:29:24.497+0000 7f364301f200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-24T03:29:24.689 INFO:tasks.ceph.mgr.y.smithi146.stderr:2023-05-24T03:29:24.685+0000 7f25a1ed3200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-24T03:29:25.098 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-05-24T03:29:25.094+0000 7f364301f200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-24T03:29:25.712 INFO:tasks.ceph.mgr.y.smithi146.stderr:2023-05-24T03:29:25.708+0000 7f255a138700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-05-24T03:29:25.712 INFO:tasks.ceph.mgr.y.smithi146.stderr:2023-05-24T03:29:25.709+0000 7f255a138700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-05-24T03:29:25.880 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-05-24T03:29:25.875+0000 7f6579371640 -1 osd.6 0 log_to_monitors true 2023-05-24T03:29:25.894 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-05-24T03:29:25.890+0000 7faba9998640 -1 osd.5 0 log_to_monitors true 2023-05-24T03:29:25.907 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-05-24T03:29:25.903+0000 7f49ef210640 -1 osd.7 0 log_to_monitors true 2023-05-24T03:29:25.915 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-05-24T03:29:25.910+0000 7ffb44bc3640 -1 osd.4 0 log_to_monitors true 2023-05-24T03:29:25.920 INFO:tasks.ceph.osd.1.smithi146.stderr:2023-05-24T03:29:25.916+0000 7f2ce0ab4640 -1 osd.1 0 log_to_monitors true 2023-05-24T03:29:25.921 INFO:tasks.ceph.osd.0.smithi146.stderr:2023-05-24T03:29:25.918+0000 7fafe54f4640 -1 osd.0 0 log_to_monitors true 2023-05-24T03:29:25.929 INFO:tasks.ceph.osd.2.smithi146.stderr:2023-05-24T03:29:25.925+0000 7f5a5220e640 -1 osd.2 0 log_to_monitors true 2023-05-24T03:29:25.931 INFO:tasks.ceph.osd.3.smithi146.stderr:2023-05-24T03:29:25.928+0000 7f677017b640 -1 osd.3 0 log_to_monitors true 2023-05-24T03:29:29.831 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-05-24T03:29:29.936 INFO:tasks.ceph.osd.0.smithi146.stderr:2023-05-24T03:29:29.929+0000 7fafd98ac700 -1 osd.0 0 waiting for initial osdmap 2023-05-24T03:29:29.955 INFO:tasks.ceph.osd.0.smithi146.stderr:2023-05-24T03:29:29.950+0000 7fafd1486700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-24T03:29:29.959 INFO:tasks.ceph.osd.2.smithi146.stderr:2023-05-24T03:29:29.955+0000 7f5a465c6700 -1 osd.2 0 waiting for initial osdmap 2023-05-24T03:29:29.969 INFO:tasks.ceph.osd.3.smithi146.stderr:2023-05-24T03:29:29.965+0000 7f6764533700 -1 osd.3 0 waiting for initial osdmap 2023-05-24T03:29:29.970 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-05-24T03:29:29.965+0000 7ffb38f7b700 -1 osd.4 0 waiting for initial osdmap 2023-05-24T03:29:29.973 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-05-24T03:29:29.967+0000 7f656d729700 -1 osd.6 0 waiting for initial osdmap 2023-05-24T03:29:29.979 INFO:tasks.ceph.osd.2.smithi146.stderr:2023-05-24T03:29:29.975+0000 7f5a3e1a0700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-24T03:29:29.980 INFO:tasks.ceph.osd.3.smithi146.stderr:2023-05-24T03:29:29.975+0000 7f675c10d700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-24T03:29:29.982 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-05-24T03:29:29.976+0000 7f49e35c8700 -1 osd.7 0 waiting for initial osdmap 2023-05-24T03:29:29.990 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-05-24T03:29:29.986+0000 7f6565303700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-24T03:29:29.993 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-05-24T03:29:29.989+0000 7fab9dd50700 -1 osd.5 0 waiting for initial osdmap 2023-05-24T03:29:29.995 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-05-24T03:29:29.991+0000 7ffb30b55700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-24T03:29:29.995 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-05-24T03:29:29.991+0000 7f49db1a2700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-24T03:29:30.011 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-05-24T03:29:30.007+0000 7fab9592a700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-24T03:29:30.019 INFO:tasks.ceph.osd.1.smithi146.stderr:2023-05-24T03:29:30.015+0000 7f2cd4e6c700 -1 osd.1 0 waiting for initial osdmap 2023-05-24T03:29:30.024 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.019+0000 7fe1b45db700 1 Processor -- start 2023-05-24T03:29:30.024 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.019+0000 7fe1b45db700 1 -- start start 2023-05-24T03:29:30.025 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.020+0000 7fe1b45db700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe1ac15dcf0 0x7fe1ac06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:30.026 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.020+0000 7fe1b45db700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1ac15a120 con 0x7fe1ac159c80 2023-05-24T03:29:30.026 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.021+0000 7fe1b45db700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1ac15a3c0 con 0x7fe1ac0cdf10 2023-05-24T03:29:30.026 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.021+0000 7fe1b45db700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1ac15a6a0 con 0x7fe1ac15dcf0 2023-05-24T03:29:30.026 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.021+0000 7fe1b2b78700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe1ac15dcf0 0x7fe1ac06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:30.026 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.021+0000 7fe1b2b78700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe1ac15dcf0 0x7fe1ac06d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38162/0 (socket says 172.21.15.146:38162) 2023-05-24T03:29:30.026 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.021+0000 7fe1b2377700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fe1ac0cdf10 0x7fe1ac0ce2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:43644/0 (socket says 172.21.15.146:43644) 2023-05-24T03:29:30.027 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.021+0000 7fe1b2b78700 1 -- 172.21.15.146:0/1436694735 learned_addr learned my addr 172.21.15.146:0/1436694735 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:30.027 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.021+0000 7fe1b2b78700 1 -- 172.21.15.146:0/1436694735 >> v1:172.21.15.151:6789/0 conn(0x7fe1ac0cdf10 legacy=0x7fe1ac0ce2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:30.027 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.021+0000 7fe1b2b78700 1 -- 172.21.15.146:0/1436694735 >> v1:172.21.15.146:6789/0 conn(0x7fe1ac159c80 legacy=0x7fe1ac070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:30.027 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.021+0000 7fe1b2b78700 1 -- 172.21.15.146:0/1436694735 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ac15a980 con 0x7fe1ac15dcf0 2023-05-24T03:29:30.027 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.021+0000 7fe1b2b78700 1 --2- 172.21.15.146:0/1436694735 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1ac15dcf0 0x7fe1ac06d6b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe1a4009e50 tx=0x7fe1a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21f0a0a9f1c5d39b server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:30.028 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.022+0000 7fe1b1375700 1 -- 172.21.15.146:0/1436694735 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a400e070 con 0x7fe1ac15dcf0 2023-05-24T03:29:30.028 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.022+0000 7fe1b1375700 1 -- 172.21.15.146:0/1436694735 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a400b9c0 con 0x7fe1ac15dcf0 2023-05-24T03:29:30.029 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.022+0000 7fe1b1375700 1 -- 172.21.15.146:0/1436694735 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a400bd70 con 0x7fe1ac15dcf0 2023-05-24T03:29:30.029 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.023+0000 7fe1b45db700 1 -- 172.21.15.146:0/1436694735 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1ac15dcf0 msgr2=0x7fe1ac06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:30.029 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.023+0000 7fe1b45db700 1 --2- 172.21.15.146:0/1436694735 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1ac15dcf0 0x7fe1ac06d6b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe1a4009e50 tx=0x7fe1a400b330 comp rx=0 tx=0).stop 2023-05-24T03:29:30.029 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.023+0000 7fe1b45db700 1 -- 172.21.15.146:0/1436694735 shutdown_connections 2023-05-24T03:29:30.029 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.023+0000 7fe1b45db700 1 --2- 172.21.15.146:0/1436694735 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1ac15dcf0 0x7fe1ac06d6b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:30.029 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.023+0000 7fe1b45db700 1 -- 172.21.15.146:0/1436694735 >> 172.21.15.146:0/1436694735 conn(0x7fe1ac0cfea0 msgr2=0x7fe1ac0d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:30.029 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.023+0000 7fe1b45db700 1 -- 172.21.15.146:0/1436694735 shutdown_connections 2023-05-24T03:29:30.029 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.023+0000 7fe1b45db700 1 -- 172.21.15.146:0/1436694735 wait complete. 2023-05-24T03:29:30.031 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.024+0000 7fe1b45db700 1 Processor -- start 2023-05-24T03:29:30.031 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.024+0000 7fe1b45db700 1 -- start start 2023-05-24T03:29:30.032 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.025+0000 7fe1b45db700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe1ac0cdf10 0x7fe1ac155640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:30.032 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.025+0000 7fe1b45db700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe1ac159c80 0x7fe1ac0c96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:30.032 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.025+0000 7fe1b45db700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1ac15dcf0 0x7fe1ac06d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:30.032 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.025+0000 7fe1b45db700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac155b80 con 0x7fe1ac15dcf0 2023-05-24T03:29:30.032 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.025+0000 7fe1b45db700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac0afcc0 con 0x7fe1ac0cdf10 2023-05-24T03:29:30.032 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.025+0000 7fe1b45db700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac0affa0 con 0x7fe1ac159c80 2023-05-24T03:29:30.032 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.025+0000 7fe1b2b78700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1ac15dcf0 0x7fe1ac06d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:30.033 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.025+0000 7fe1b2b78700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1ac15dcf0 0x7fe1ac06d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38166/0 (socket says 172.21.15.146:38166) 2023-05-24T03:29:30.033 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.025+0000 7fe1b2b78700 1 -- 172.21.15.146:0/3964997040 learned_addr learned my addr 172.21.15.146:0/3964997040 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:30.033 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.025+0000 7fe1b2377700 1 --2- 172.21.15.146:0/3964997040 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe1ac0cdf10 0x7fe1ac155640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:30.033 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.025+0000 7fe1b1b76700 1 --2- 172.21.15.146:0/3964997040 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe1ac159c80 0x7fe1ac0c96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:30.033 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.025+0000 7fe1b2b78700 1 -- 172.21.15.146:0/3964997040 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe1ac159c80 msgr2=0x7fe1ac0c96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:30.033 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.025+0000 7fe1b2b78700 1 --2- 172.21.15.146:0/3964997040 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe1ac159c80 0x7fe1ac0c96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:30.034 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.025+0000 7fe1b2b78700 1 -- 172.21.15.146:0/3964997040 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe1ac0cdf10 msgr2=0x7fe1ac155640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:30.034 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.025+0000 7fe1b2b78700 1 --2- 172.21.15.146:0/3964997040 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe1ac0cdf10 0x7fe1ac155640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:30.034 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.025+0000 7fe1b2b78700 1 -- 172.21.15.146:0/3964997040 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a4009b30 con 0x7fe1ac15dcf0 2023-05-24T03:29:30.034 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.026+0000 7fe1b2b78700 1 --2- 172.21.15.146:0/3964997040 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1ac15dcf0 0x7fe1ac06d5b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac072ac0 tx=0x7fe1a4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:30.034 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.026+0000 7fe1a2ffd700 1 -- 172.21.15.146:0/3964997040 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a4004800 con 0x7fe1ac15dcf0 2023-05-24T03:29:30.034 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.026+0000 7fe1a2ffd700 1 -- 172.21.15.146:0/3964997040 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a4004960 con 0x7fe1ac15dcf0 2023-05-24T03:29:30.034 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.026+0000 7fe1a2ffd700 1 -- 172.21.15.146:0/3964997040 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a401b670 con 0x7fe1ac15dcf0 2023-05-24T03:29:30.035 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.026+0000 7fe1b45db700 1 -- 172.21.15.146:0/3964997040 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1ac06d190 con 0x7fe1ac15dcf0 2023-05-24T03:29:30.035 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.026+0000 7fe1b45db700 1 -- 172.21.15.146:0/3964997040 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1ac15ac60 con 0x7fe1ac15dcf0 2023-05-24T03:29:30.035 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.027+0000 7fe1b45db700 1 -- 172.21.15.146:0/3964997040 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1ac071660 con 0x7fe1ac15dcf0 2023-05-24T03:29:30.035 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.027+0000 7fe1a2ffd700 1 -- 172.21.15.146:0/3964997040 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7fe1a401b7d0 con 0x7fe1ac15dcf0 2023-05-24T03:29:30.036 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.027+0000 7fe1a2ffd700 1 --2- 172.21.15.146:0/3964997040 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fe19006ac50 0x7fe19006d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:30.036 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.028+0000 7fe1b2377700 1 --2- 172.21.15.146:0/3964997040 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fe19006ac50 0x7fe19006d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:30.036 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.028+0000 7fe1a2ffd700 1 -- 172.21.15.146:0/3964997040 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7fe1a4089d60 con 0x7fe1ac15dcf0 2023-05-24T03:29:30.037 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.028+0000 7fe1b2377700 1 --2- 172.21.15.146:0/3964997040 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fe19006ac50 0x7fe19006d100 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8000f60 tx=0x7fe1a8007eb0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:30.037 INFO:tasks.ceph.osd.1.smithi146.stderr:2023-05-24T03:29:30.030+0000 7f2ccca46700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-24T03:29:30.037 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.032+0000 7fe1a2ffd700 1 -- 172.21.15.146:0/3964997040 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fe1a4055e70 con 0x7fe1ac15dcf0 2023-05-24T03:29:30.226 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.222+0000 7fe1b45db700 1 -- 172.21.15.146:0/3964997040 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe1ac04e810 con 0x7fe1ac15dcf0 2023-05-24T03:29:30.227 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.222+0000 7fe1a2ffd700 1 -- 172.21.15.146:0/3964997040 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fe1a4059490 con 0x7fe1ac15dcf0 2023-05-24T03:29:30.227 INFO:teuthology.misc.health.smithi146.stdout: 2023-05-24T03:29:30.227 INFO:teuthology.misc.health.smithi146.stdout:{"epoch":12,"fsid":"11ca0adb-7672-4713-bde7-451e8b743ae9","created":"2023-05-24T03:29:19.113659+0000","modified":"2023-05-24T03:29:27.881873+0000","last_up_change":"0.000000","last_in_change":"2023-05-24T03:29:21.706540+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f24b319b-fcc8-4385-b0cb-78138fc31417","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c9639ea9-8f9b-498e-92c8-aa976edbf1da","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7a6cfc6d-b0ca-4cb6-a66d-4001ec184657","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"401509f7-cecd-44a2-b0ae-22c81a5d93c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9d07f440-d125-4f99-a825-411fab894d5e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9b2266e2-9e52-4f0e-96da-e703a6c23a6d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"5daedf77-0a83-49e7-b497-d9ed10436972","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"86ae4f7e-c01f-4c3d-a0dd-98160c209309","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-24T03:29:30.229 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.224+0000 7fe1b45db700 1 -- 172.21.15.146:0/3964997040 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fe19006ac50 msgr2=0x7fe19006d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:30.229 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.224+0000 7fe1b45db700 1 --2- 172.21.15.146:0/3964997040 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fe19006ac50 0x7fe19006d100 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8000f60 tx=0x7fe1a8007eb0 comp rx=0 tx=0).stop 2023-05-24T03:29:30.229 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.224+0000 7fe1b45db700 1 -- 172.21.15.146:0/3964997040 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1ac15dcf0 msgr2=0x7fe1ac06d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:30.229 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.224+0000 7fe1b45db700 1 --2- 172.21.15.146:0/3964997040 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1ac15dcf0 0x7fe1ac06d5b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac072ac0 tx=0x7fe1a4004ad0 comp rx=0 tx=0).stop 2023-05-24T03:29:30.230 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.224+0000 7fe1b45db700 1 -- 172.21.15.146:0/3964997040 shutdown_connections 2023-05-24T03:29:30.230 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.224+0000 7fe1b45db700 1 --2- 172.21.15.146:0/3964997040 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fe19006ac50 0x7fe19006d100 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:30.230 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.224+0000 7fe1b45db700 1 --2- 172.21.15.146:0/3964997040 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1ac15dcf0 0x7fe1ac06d5b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:30.230 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.224+0000 7fe1b45db700 1 --2- 172.21.15.146:0/3964997040 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe1ac0cdf10 0x7fe1ac155640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:30.230 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.224+0000 7fe1b45db700 1 --2- 172.21.15.146:0/3964997040 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe1ac159c80 0x7fe1ac0c96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:30.230 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.224+0000 7fe1b45db700 1 -- 172.21.15.146:0/3964997040 >> 172.21.15.146:0/3964997040 conn(0x7fe1ac0cfea0 msgr2=0x7fe1ac070f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:30.230 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.224+0000 7fe1b45db700 1 -- 172.21.15.146:0/3964997040 shutdown_connections 2023-05-24T03:29:30.231 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:30.224+0000 7fe1b45db700 1 -- 172.21.15.146:0/3964997040 wait complete. 2023-05-24T03:29:30.240 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-05-24T03:29:37.047 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-05-24T03:29:37.170 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.165+0000 7fceda9a9700 1 Processor -- start 2023-05-24T03:29:37.170 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.165+0000 7fceda9a9700 1 -- start start 2023-05-24T03:29:37.172 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.166+0000 7fceda9a9700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fced40b8a50 0x7fced415daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:37.172 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.166+0000 7fceda9a9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fced406bb40 0x7fced40cfe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:37.172 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.166+0000 7fceda9a9700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fced40cf9d0 con 0x7fced40d03a0 2023-05-24T03:29:37.172 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.166+0000 7fceda9a9700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fced40cd790 con 0x7fced406bb40 2023-05-24T03:29:37.172 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.166+0000 7fceda9a9700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fced415e030 con 0x7fced40b8a50 2023-05-24T03:29:37.172 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.166+0000 7fced37fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fced406bb40 0x7fced40cfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:37.173 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.166+0000 7fced8f46700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fced40d03a0 0x7fced40b4c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44854/0 (socket says 172.21.15.146:44854) 2023-05-24T03:29:37.173 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.166+0000 7fced37fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fced406bb40 0x7fced40cfe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38400/0 (socket says 172.21.15.146:38400) 2023-05-24T03:29:37.173 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.166+0000 7fced8f46700 1 -- 172.21.15.146:0/802316597 learned_addr learned my addr 172.21.15.146:0/802316597 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:29:37.173 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.167+0000 7fced3fff700 1 --2- 172.21.15.146:0/802316597 >> v2:172.21.15.151:3300/0 conn(0x7fced40b8a50 0x7fced415daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:37.173 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.167+0000 7fced37fe700 1 -- 172.21.15.146:0/802316597 >> v2:172.21.15.151:3300/0 conn(0x7fced40b8a50 msgr2=0x7fced415daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:37.173 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.167+0000 7fced37fe700 1 --2- 172.21.15.146:0/802316597 >> v2:172.21.15.151:3300/0 conn(0x7fced40b8a50 0x7fced415daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:37.173 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.167+0000 7fced37fe700 1 -- 172.21.15.146:0/802316597 >> v1:172.21.15.146:6789/0 conn(0x7fced40d03a0 legacy=0x7fced40b4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:37.174 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.167+0000 7fced37fe700 1 -- 172.21.15.146:0/802316597 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced40cf400 con 0x7fced406bb40 2023-05-24T03:29:37.174 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.167+0000 7fced37fe700 1 --2- 172.21.15.146:0/802316597 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fced406bb40 0x7fced40cfe60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fced408c160 tx=0x7fcec4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e4e0d92f383ef4b server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:37.174 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.167+0000 7fced2ffd700 1 -- 172.21.15.146:0/802316597 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec4011830 con 0x7fced406bb40 2023-05-24T03:29:37.174 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.167+0000 7fced2ffd700 1 -- 172.21.15.146:0/802316597 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec4011990 con 0x7fced406bb40 2023-05-24T03:29:37.174 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.167+0000 7fced2ffd700 1 -- 172.21.15.146:0/802316597 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec4011d20 con 0x7fced406bb40 2023-05-24T03:29:37.178 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.168+0000 7fceda9a9700 1 -- 172.21.15.146:0/802316597 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fced406bb40 msgr2=0x7fced40cfe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:37.179 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.168+0000 7fceda9a9700 1 --2- 172.21.15.146:0/802316597 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fced406bb40 0x7fced40cfe60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fced408c160 tx=0x7fcec4009b20 comp rx=0 tx=0).stop 2023-05-24T03:29:37.179 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.168+0000 7fceda9a9700 1 -- 172.21.15.146:0/802316597 shutdown_connections 2023-05-24T03:29:37.179 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.168+0000 7fceda9a9700 1 --2- 172.21.15.146:0/802316597 >> v2:172.21.15.151:3300/0 conn(0x7fced40b8a50 0x7fced415daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:37.179 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.168+0000 7fceda9a9700 1 --2- 172.21.15.146:0/802316597 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fced406bb40 0x7fced40cfe60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:37.180 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.168+0000 7fceda9a9700 1 -- 172.21.15.146:0/802316597 >> 172.21.15.146:0/802316597 conn(0x7fced406af30 msgr2=0x7fced406b330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:37.180 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.168+0000 7fceda9a9700 1 -- 172.21.15.146:0/802316597 shutdown_connections 2023-05-24T03:29:37.180 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.168+0000 7fceda9a9700 1 -- 172.21.15.146:0/802316597 wait complete. 2023-05-24T03:29:37.181 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.169+0000 7fceda9a9700 1 Processor -- start 2023-05-24T03:29:37.181 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.169+0000 7fceda9a9700 1 -- start start 2023-05-24T03:29:37.181 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.170+0000 7fceda9a9700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fced406bb40 0x7fced415c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:37.181 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.170+0000 7fceda9a9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fced40b8a50 0x7fced41524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:37.182 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.170+0000 7fceda9a9700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fced40d03a0 0x7fced4158ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:37.182 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.170+0000 7fceda9a9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced40c7f10 con 0x7fced40b8a50 2023-05-24T03:29:37.182 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.170+0000 7fceda9a9700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced4159410 con 0x7fced406bb40 2023-05-24T03:29:37.183 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.170+0000 7fceda9a9700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced41538a0 con 0x7fced40d03a0 2023-05-24T03:29:37.183 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.170+0000 7fced37fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fced40b8a50 0x7fced41524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:37.183 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.170+0000 7fced37fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fced40b8a50 0x7fced41524a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38406/0 (socket says 172.21.15.146:38406) 2023-05-24T03:29:37.184 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.170+0000 7fced37fe700 1 -- 172.21.15.146:0/4199916323 learned_addr learned my addr 172.21.15.146:0/4199916323 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:37.184 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.170+0000 7fced3fff700 1 --2- 172.21.15.146:0/4199916323 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fced406bb40 0x7fced415c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:37.185 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.170+0000 7fced8f46700 1 --2- 172.21.15.146:0/4199916323 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fced40d03a0 0x7fced4158ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:37.185 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.170+0000 7fced37fe700 1 -- 172.21.15.146:0/4199916323 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fced40d03a0 msgr2=0x7fced4158ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:37.185 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.170+0000 7fced37fe700 1 --2- 172.21.15.146:0/4199916323 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fced40d03a0 0x7fced4158ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:37.185 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.170+0000 7fced37fe700 1 -- 172.21.15.146:0/4199916323 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fced406bb40 msgr2=0x7fced415c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:37.185 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.170+0000 7fced37fe700 1 --2- 172.21.15.146:0/4199916323 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fced406bb40 0x7fced415c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:37.185 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.170+0000 7fced37fe700 1 -- 172.21.15.146:0/4199916323 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcec40094a0 con 0x7fced40b8a50 2023-05-24T03:29:37.185 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.170+0000 7fced8f46700 1 --2- 172.21.15.146:0/4199916323 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fced40d03a0 0x7fced4158ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:29:37.186 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.171+0000 7fced37fe700 1 --2- 172.21.15.146:0/4199916323 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fced40b8a50 0x7fced41524a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcec4009b60 tx=0x7fcec4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:37.186 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.171+0000 7fced0ff9700 1 -- 172.21.15.146:0/4199916323 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec40036a0 con 0x7fced40b8a50 2023-05-24T03:29:37.186 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.171+0000 7fced0ff9700 1 -- 172.21.15.146:0/4199916323 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec401f070 con 0x7fced40b8a50 2023-05-24T03:29:37.187 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.171+0000 7fceda9a9700 1 -- 172.21.15.146:0/4199916323 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fced40cdf60 con 0x7fced40b8a50 2023-05-24T03:29:37.187 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.171+0000 7fced0ff9700 1 -- 172.21.15.146:0/4199916323 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec4003a40 con 0x7fced40b8a50 2023-05-24T03:29:37.187 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.171+0000 7fceda9a9700 1 -- 172.21.15.146:0/4199916323 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fced40cf6a0 con 0x7fced40b8a50 2023-05-24T03:29:37.187 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.172+0000 7fceda9a9700 1 -- 172.21.15.146:0/4199916323 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fced40cd9a0 con 0x7fced40b8a50 2023-05-24T03:29:37.187 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.172+0000 7fced0ff9700 1 -- 172.21.15.146:0/4199916323 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcec4003ba0 con 0x7fced40b8a50 2023-05-24T03:29:37.187 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.172+0000 7fced0ff9700 1 --2- 172.21.15.146:0/4199916323 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fcec006ace0 0x7fcec006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:37.187 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.173+0000 7fced0ff9700 1 -- 172.21.15.146:0/4199916323 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcec4021070 con 0x7fced40b8a50 2023-05-24T03:29:37.188 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.173+0000 7fced3fff700 1 --2- 172.21.15.146:0/4199916323 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fcec006ace0 0x7fcec006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:37.188 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.173+0000 7fced3fff700 1 --2- 172.21.15.146:0/4199916323 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fcec006ace0 0x7fcec006d190 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcec8009be0 tx=0x7fcec8009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:37.188 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.177+0000 7fced0ff9700 1 -- 172.21.15.146:0/4199916323 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fcec4055d20 con 0x7fced40b8a50 2023-05-24T03:29:37.368 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.364+0000 7fceda9a9700 1 -- 172.21.15.146:0/4199916323 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fced4072ae0 con 0x7fced40b8a50 2023-05-24T03:29:37.369 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.365+0000 7fced0ff9700 1 -- 172.21.15.146:0/4199916323 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12886 (secure 0 0 0) 0x7fcec4059340 con 0x7fced40b8a50 2023-05-24T03:29:37.370 INFO:teuthology.misc.health.smithi146.stdout: 2023-05-24T03:29:37.370 INFO:teuthology.misc.health.smithi146.stdout:{"epoch":17,"fsid":"11ca0adb-7672-4713-bde7-451e8b743ae9","created":"2023-05-24T03:29:19.113659+0000","modified":"2023-05-24T03:29:34.984971+0000","last_up_change":"2023-05-24T03:29:30.962339+0000","last_in_change":"2023-05-24T03:29:21.706540+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-24T03:29:32.749984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f24b319b-fcc8-4385-b0cb-78138fc31417","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6801","nonce":3353593100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6803","nonce":3353593100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6807","nonce":3353593100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6805","nonce":3353593100}]},"public_addr":"172.21.15.146:6801/3353593100","cluster_addr":"172.21.15.146:6803/3353593100","heartbeat_back_addr":"172.21.15.146:6807/3353593100","heartbeat_front_addr":"172.21.15.146:6805/3353593100","state":["exists","up"]},{"osd":1,"uuid":"c9639ea9-8f9b-498e-92c8-aa976edbf1da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6821","nonce":2537488734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6825","nonce":2537488734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6831","nonce":2537488734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6827","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6829","nonce":2537488734}]},"public_addr":"172.21.15.146:6821/2537488734","cluster_addr":"172.21.15.146:6825/2537488734","heartbeat_back_addr":"172.21.15.146:6831/2537488734","heartbeat_front_addr":"172.21.15.146:6829/2537488734","state":["exists","up"]},{"osd":2,"uuid":"7a6cfc6d-b0ca-4cb6-a66d-4001ec184657","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6809","nonce":1800242932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6811","nonce":1800242932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6815","nonce":1800242932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6813","nonce":1800242932}]},"public_addr":"172.21.15.146:6809/1800242932","cluster_addr":"172.21.15.146:6811/1800242932","heartbeat_back_addr":"172.21.15.146:6815/1800242932","heartbeat_front_addr":"172.21.15.146:6813/1800242932","state":["exists","up"]},{"osd":3,"uuid":"401509f7-cecd-44a2-b0ae-22c81a5d93c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6817","nonce":1749783580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6820","nonce":1749783580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6828","nonce":1749783580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6824","nonce":1749783580}]},"public_addr":"172.21.15.146:6817/1749783580","cluster_addr":"172.21.15.146:6820/1749783580","heartbeat_back_addr":"172.21.15.146:6828/1749783580","heartbeat_front_addr":"172.21.15.146:6824/1749783580","state":["exists","up"]},{"osd":4,"uuid":"9d07f440-d125-4f99-a825-411fab894d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6811","nonce":163453435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6814","nonce":163453435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6819","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6821","nonce":163453435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6818","nonce":163453435}]},"public_addr":"172.21.15.151:6811/163453435","cluster_addr":"172.21.15.151:6814/163453435","heartbeat_back_addr":"172.21.15.151:6821/163453435","heartbeat_front_addr":"172.21.15.151:6818/163453435","state":["exists","up"]},{"osd":5,"uuid":"9b2266e2-9e52-4f0e-96da-e703a6c23a6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6801","nonce":3283474903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6803","nonce":3283474903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6807","nonce":3283474903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6805","nonce":3283474903}]},"public_addr":"172.21.15.151:6801/3283474903","cluster_addr":"172.21.15.151:6803/3283474903","heartbeat_back_addr":"172.21.15.151:6807/3283474903","heartbeat_front_addr":"172.21.15.151:6805/3283474903","state":["exists","up"]},{"osd":6,"uuid":"5daedf77-0a83-49e7-b497-d9ed10436972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6825","nonce":3889424178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6827","nonce":3889424178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6831","nonce":3889424178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6829","nonce":3889424178}]},"public_addr":"172.21.15.151:6825/3889424178","cluster_addr":"172.21.15.151:6827/3889424178","heartbeat_back_addr":"172.21.15.151:6831/3889424178","heartbeat_front_addr":"172.21.15.151:6829/3889424178","state":["exists","up"]},{"osd":7,"uuid":"86ae4f7e-c01f-4c3d-a0dd-98160c209309","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6810","nonce":563291208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6815","nonce":563291208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6823","nonce":563291208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6820","nonce":563291208}]},"public_addr":"172.21.15.151:6810/563291208","cluster_addr":"172.21.15.151:6815/563291208","heartbeat_back_addr":"172.21.15.151:6823/563291208","heartbeat_front_addr":"172.21.15.151:6820/563291208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.872472+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.937126+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.877234+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.884793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.881632+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.938293+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.857661+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.945883+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-24T03:29:37.372 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.367+0000 7fceda9a9700 1 -- 172.21.15.146:0/4199916323 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fcec006ace0 msgr2=0x7fcec006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:37.372 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.367+0000 7fceda9a9700 1 --2- 172.21.15.146:0/4199916323 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fcec006ace0 0x7fcec006d190 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcec8009be0 tx=0x7fcec8009210 comp rx=0 tx=0).stop 2023-05-24T03:29:37.373 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.367+0000 7fceda9a9700 1 -- 172.21.15.146:0/4199916323 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fced40b8a50 msgr2=0x7fced41524a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:37.373 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.367+0000 7fceda9a9700 1 --2- 172.21.15.146:0/4199916323 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fced40b8a50 0x7fced41524a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcec4009b60 tx=0x7fcec4004750 comp rx=0 tx=0).stop 2023-05-24T03:29:37.373 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.367+0000 7fceda9a9700 1 -- 172.21.15.146:0/4199916323 shutdown_connections 2023-05-24T03:29:37.373 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.367+0000 7fceda9a9700 1 --2- 172.21.15.146:0/4199916323 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fcec006ace0 0x7fcec006d190 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:37.374 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.367+0000 7fceda9a9700 1 --2- 172.21.15.146:0/4199916323 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fced40d03a0 0x7fced4158ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:37.374 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.367+0000 7fceda9a9700 1 --2- 172.21.15.146:0/4199916323 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fced406bb40 0x7fced415c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:37.374 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.367+0000 7fceda9a9700 1 --2- 172.21.15.146:0/4199916323 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fced40b8a50 0x7fced41524a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:37.374 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.367+0000 7fceda9a9700 1 -- 172.21.15.146:0/4199916323 >> 172.21.15.146:0/4199916323 conn(0x7fced406af30 msgr2=0x7fced40d3850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:37.375 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.367+0000 7fceda9a9700 1 -- 172.21.15.146:0/4199916323 shutdown_connections 2023-05-24T03:29:37.375 INFO:teuthology.misc.health.smithi146.stderr:2023-05-24T03:29:37.367+0000 7fceda9a9700 1 -- 172.21.15.146:0/4199916323 wait complete. 2023-05-24T03:29:37.383 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-05-24T03:29:37.384 INFO:tasks.ceph:Creating RBD pool 2023-05-24T03:29:37.385 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd pool create rbd 8 2023-05-24T03:29:37.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.499+0000 7f3fcfcb1700 1 Processor -- start 2023-05-24T03:29:37.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.500+0000 7f3fcfcb1700 1 -- start start 2023-05-24T03:29:37.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.500+0000 7f3fcfcb1700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3fc806a460 0x7f3fc80cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:37.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.500+0000 7f3fcfcb1700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fc815cd90 0x7f3fc806a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:37.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.500+0000 7f3fcfcb1700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fc80cfd00 con 0x7f3fc80aefd0 2023-05-24T03:29:37.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.501+0000 7f3fcfcb1700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fc8072350 con 0x7f3fc806a460 2023-05-24T03:29:37.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.501+0000 7f3fcfcb1700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc806ad70 con 0x7f3fc815cd90 2023-05-24T03:29:37.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.501+0000 7f3fcda4d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3fc806a460 0x7f3fc80cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:37.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.501+0000 7f3fcda4d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3fc806a460 0x7f3fc80cede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38412/0 (socket says 172.21.15.146:38412) 2023-05-24T03:29:37.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.501+0000 7f3fcda4d700 1 -- 172.21.15.146:0/911838041 learned_addr learned my addr 172.21.15.146:0/911838041 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:37.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.501+0000 7f3fcd24c700 1 --2- 172.21.15.146:0/911838041 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fc815cd90 0x7f3fc806a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:37.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.501+0000 7f3fcda4d700 1 -- 172.21.15.146:0/911838041 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fc815cd90 msgr2=0x7f3fc806a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:37.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.501+0000 7f3fcda4d700 1 --2- 172.21.15.146:0/911838041 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fc815cd90 0x7f3fc806a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:37.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.501+0000 7f3fcda4d700 1 -- 172.21.15.146:0/911838041 >> v1:172.21.15.151:6789/0 conn(0x7f3fc80aefd0 legacy=0x7f3fc8160d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:37.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.501+0000 7f3fcda4d700 1 -- 172.21.15.146:0/911838041 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc80cf460 con 0x7f3fc806a460 2023-05-24T03:29:37.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.501+0000 7f3fcda4d700 1 --2- 172.21.15.146:0/911838041 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fc806a460 0x7f3fc80cede0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3fb80098f0 tx=0x7f3fb8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=583d1300c264f2f server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:37.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.501+0000 7f3fcca4b700 1 -- 172.21.15.146:0/911838041 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb800b8a0 con 0x7f3fc806a460 2023-05-24T03:29:37.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.501+0000 7f3fcca4b700 1 -- 172.21.15.146:0/911838041 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb800ba00 con 0x7f3fc806a460 2023-05-24T03:29:37.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.501+0000 7f3fcca4b700 1 -- 172.21.15.146:0/911838041 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb800bd90 con 0x7f3fc806a460 2023-05-24T03:29:37.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.502+0000 7f3fcfcb1700 1 -- 172.21.15.146:0/911838041 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fc806a460 msgr2=0x7f3fc80cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:37.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.502+0000 7f3fcfcb1700 1 --2- 172.21.15.146:0/911838041 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fc806a460 0x7f3fc80cede0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3fb80098f0 tx=0x7f3fb8009c00 comp rx=0 tx=0).stop 2023-05-24T03:29:37.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.502+0000 7f3fcfcb1700 1 -- 172.21.15.146:0/911838041 shutdown_connections 2023-05-24T03:29:37.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.502+0000 7f3fcfcb1700 1 --2- 172.21.15.146:0/911838041 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fc806a460 0x7f3fc80cede0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:37.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.502+0000 7f3fcfcb1700 1 --2- 172.21.15.146:0/911838041 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fc815cd90 0x7f3fc806a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:37.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.502+0000 7f3fcfcb1700 1 -- 172.21.15.146:0/911838041 >> 172.21.15.146:0/911838041 conn(0x7f3fc80cfea0 msgr2=0x7f3fc80d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:37.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.502+0000 7f3fcfcb1700 1 -- 172.21.15.146:0/911838041 shutdown_connections 2023-05-24T03:29:37.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.502+0000 7f3fcfcb1700 1 -- 172.21.15.146:0/911838041 wait complete. 2023-05-24T03:29:37.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.503+0000 7f3fcfcb1700 1 Processor -- start 2023-05-24T03:29:37.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.503+0000 7f3fcfcb1700 1 -- start start 2023-05-24T03:29:37.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.504+0000 7f3fcfcb1700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fc806a460 0x7f3fc80c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:37.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.504+0000 7f3fcfcb1700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fc80aefd0 0x7f3fc8153fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:37.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.504+0000 7f3fcfcb1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fc815cd90 0x7f3fc8159e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:37.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.504+0000 7f3fcfcb1700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc80c6460 con 0x7f3fc815cd90 2023-05-24T03:29:37.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.504+0000 7f3fcfcb1700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc8154500 con 0x7f3fc806a460 2023-05-24T03:29:37.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.504+0000 7f3fcfcb1700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc80c4e80 con 0x7f3fc80aefd0 2023-05-24T03:29:37.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.504+0000 7f3fce24e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fc815cd90 0x7f3fc8159e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:37.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.504+0000 7f3fce24e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fc815cd90 0x7f3fc8159e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38422/0 (socket says 172.21.15.146:38422) 2023-05-24T03:29:37.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.504+0000 7f3fce24e700 1 -- 172.21.15.146:0/533182135 learned_addr learned my addr 172.21.15.146:0/533182135 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:37.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.504+0000 7f3fcda4d700 1 --2- 172.21.15.146:0/533182135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fc806a460 0x7f3fc80c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:37.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.504+0000 7f3fcd24c700 1 --2- 172.21.15.146:0/533182135 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fc80aefd0 0x7f3fc8153fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:37.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.504+0000 7f3fce24e700 1 -- 172.21.15.146:0/533182135 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fc80aefd0 msgr2=0x7f3fc8153fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:37.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.504+0000 7f3fce24e700 1 --2- 172.21.15.146:0/533182135 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fc80aefd0 0x7f3fc8153fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:37.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.504+0000 7f3fce24e700 1 -- 172.21.15.146:0/533182135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fc806a460 msgr2=0x7f3fc80c5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:37.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.504+0000 7f3fce24e700 1 --2- 172.21.15.146:0/533182135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fc806a460 0x7f3fc80c5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:37.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.504+0000 7f3fce24e700 1 -- 172.21.15.146:0/533182135 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb8009550 con 0x7f3fc815cd90 2023-05-24T03:29:37.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.504+0000 7f3fcd24c700 1 --2- 172.21.15.146:0/533182135 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fc80aefd0 0x7f3fc8153fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:29:37.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.504+0000 7f3fce24e700 1 --2- 172.21.15.146:0/533182135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fc815cd90 0x7f3fc8159e70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3fc000cc50 tx=0x7f3fc000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:37.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.504+0000 7f3fbe7fc700 1 -- 172.21.15.146:0/533182135 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc0003c00 con 0x7f3fc815cd90 2023-05-24T03:29:37.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.504+0000 7f3fbe7fc700 1 -- 172.21.15.146:0/533182135 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fc0003d60 con 0x7f3fc815cd90 2023-05-24T03:29:37.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.504+0000 7f3fcfcb1700 1 -- 172.21.15.146:0/533182135 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fc80cfa20 con 0x7f3fc815cd90 2023-05-24T03:29:37.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.504+0000 7f3fbe7fc700 1 -- 172.21.15.146:0/533182135 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc000ab60 con 0x7f3fc815cd90 2023-05-24T03:29:37.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.505+0000 7f3fcfcb1700 1 -- 172.21.15.146:0/533182135 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fc80cf740 con 0x7f3fc815cd90 2023-05-24T03:29:37.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.505+0000 7f3fcfcb1700 1 -- 172.21.15.146:0/533182135 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fc8160800 con 0x7f3fc815cd90 2023-05-24T03:29:37.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.506+0000 7f3fbe7fc700 1 -- 172.21.15.146:0/533182135 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3fc000acc0 con 0x7f3fc815cd90 2023-05-24T03:29:37.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.506+0000 7f3fbe7fc700 1 --2- 172.21.15.146:0/533182135 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f3fac06ace0 0x7f3fac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:37.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.506+0000 7f3fcda4d700 1 --2- 172.21.15.146:0/533182135 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f3fac06ace0 0x7f3fac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:37.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.506+0000 7f3fbe7fc700 1 -- 172.21.15.146:0/533182135 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3fc0088f20 con 0x7f3fc815cd90 2023-05-24T03:29:37.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.507+0000 7f3fcda4d700 1 --2- 172.21.15.146:0/533182135 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f3fac06ace0 0x7f3fac06d190 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3fb8014040 tx=0x7f3fb8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:37.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.511+0000 7f3fbe7fc700 1 -- 172.21.15.146:0/533182135 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3fc00543e0 con 0x7f3fc815cd90 2023-05-24T03:29:37.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:37.700+0000 7f3fcfcb1700 1 -- 172.21.15.146:0/533182135 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f3fc80cfd00 con 0x7f3fc815cd90 2023-05-24T03:29:38.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.040+0000 7f3fbe7fc700 1 -- 172.21.15.146:0/533182135 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v18) v1 ==== 109+0+0 (secure 0 0 0) 0x7f3fc80cfd00 con 0x7f3fc815cd90 2023-05-24T03:29:38.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.042+0000 7f3fcfcb1700 1 -- 172.21.15.146:0/533182135 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f3fac06ace0 msgr2=0x7f3fac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:38.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.042+0000 7f3fcfcb1700 1 --2- 172.21.15.146:0/533182135 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f3fac06ace0 0x7f3fac06d190 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3fb8014040 tx=0x7f3fb8008030 comp rx=0 tx=0).stop 2023-05-24T03:29:38.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.042+0000 7f3fcfcb1700 1 -- 172.21.15.146:0/533182135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fc815cd90 msgr2=0x7f3fc8159e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:38.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.043+0000 7f3fcfcb1700 1 --2- 172.21.15.146:0/533182135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fc815cd90 0x7f3fc8159e70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3fc000cc50 tx=0x7f3fc000cf60 comp rx=0 tx=0).stop 2023-05-24T03:29:38.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.043+0000 7f3fcfcb1700 1 -- 172.21.15.146:0/533182135 shutdown_connections 2023-05-24T03:29:38.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.043+0000 7f3fcfcb1700 1 --2- 172.21.15.146:0/533182135 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f3fac06ace0 0x7f3fac06d190 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:38.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.043+0000 7f3fcfcb1700 1 --2- 172.21.15.146:0/533182135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fc815cd90 0x7f3fc8159e70 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:38.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.043+0000 7f3fcfcb1700 1 --2- 172.21.15.146:0/533182135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fc806a460 0x7f3fc80c5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:38.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.043+0000 7f3fcfcb1700 1 --2- 172.21.15.146:0/533182135 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fc80aefd0 0x7f3fc8153fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:38.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.043+0000 7f3fcfcb1700 1 -- 172.21.15.146:0/533182135 >> 172.21.15.146:0/533182135 conn(0x7f3fc80cfea0 msgr2=0x7f3fc80ae710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:38.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.043+0000 7f3fcfcb1700 1 -- 172.21.15.146:0/533182135 shutdown_connections 2023-05-24T03:29:38.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.043+0000 7f3fcfcb1700 1 -- 172.21.15.146:0/533182135 wait complete. 2023-05-24T03:29:38.049 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'rbd' created 2023-05-24T03:29:38.060 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-05-24T03:29:38.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.179+0000 7f6dda74f700 1 Processor -- start 2023-05-24T03:29:38.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.179+0000 7f6dda74f700 1 -- start start 2023-05-24T03:29:38.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.180+0000 7f6dda74f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6dd40cdf10 0x7f6dd4159c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:38.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.180+0000 7f6dda74f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6dd415dcf0 0x7f6dd40ce2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:38.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.180+0000 7f6dda74f700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6dd4070f50 0x7f6dd406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:38.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.180+0000 7f6dda74f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dd415a1c0 con 0x7f6dd40cdf10 2023-05-24T03:29:38.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.180+0000 7f6dda74f700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dd40ce820 con 0x7f6dd4070f50 2023-05-24T03:29:38.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.180+0000 7f6dda74f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd415a3c0 con 0x7f6dd415dcf0 2023-05-24T03:29:38.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.180+0000 7f6dd3fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6dd40cdf10 0x7f6dd4159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:38.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.180+0000 7f6dd3fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6dd40cdf10 0x7f6dd4159c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38426/0 (socket says 172.21.15.146:38426) 2023-05-24T03:29:38.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.180+0000 7f6dd3fff700 1 -- 172.21.15.146:0/5410576 learned_addr learned my addr 172.21.15.146:0/5410576 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:38.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.180+0000 7f6dd37fe700 1 --2- 172.21.15.146:0/5410576 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6dd415dcf0 0x7f6dd40ce2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:38.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.180+0000 7f6dd8cec700 1 --2- 172.21.15.146:0/5410576 >> v2:172.21.15.151:3300/0 conn(0x7f6dd4070f50 0x7f6dd406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:38.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.180+0000 7f6dd3fff700 1 -- 172.21.15.146:0/5410576 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6dd415dcf0 msgr2=0x7f6dd40ce2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:38.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.180+0000 7f6dd3fff700 1 --2- 172.21.15.146:0/5410576 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6dd415dcf0 0x7f6dd40ce2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:38.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.180+0000 7f6dd3fff700 1 -- 172.21.15.146:0/5410576 >> v2:172.21.15.151:3300/0 conn(0x7f6dd4070f50 msgr2=0x7f6dd406d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:38.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.180+0000 7f6dd3fff700 1 --2- 172.21.15.146:0/5410576 >> v2:172.21.15.151:3300/0 conn(0x7f6dd4070f50 0x7f6dd406d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:38.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.180+0000 7f6dd3fff700 1 -- 172.21.15.146:0/5410576 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd415a6a0 con 0x7f6dd40cdf10 2023-05-24T03:29:38.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.180+0000 7f6dd8cec700 1 --2- 172.21.15.146:0/5410576 >> v2:172.21.15.151:3300/0 conn(0x7f6dd4070f50 0x7f6dd406d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:29:38.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.180+0000 7f6dd3fff700 1 --2- 172.21.15.146:0/5410576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dd40cdf10 0x7f6dd4159c80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6dd4072c00 tx=0x7f6dc400be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebb16200e6709b30 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:38.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.181+0000 7f6dd2ffd700 1 -- 172.21.15.146:0/5410576 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc400dd30 con 0x7f6dd40cdf10 2023-05-24T03:29:38.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.181+0000 7f6dd2ffd700 1 -- 172.21.15.146:0/5410576 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc400de90 con 0x7f6dd40cdf10 2023-05-24T03:29:38.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.181+0000 7f6dd2ffd700 1 -- 172.21.15.146:0/5410576 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc4010690 con 0x7f6dd40cdf10 2023-05-24T03:29:38.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.181+0000 7f6dda74f700 1 -- 172.21.15.146:0/5410576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dd40cdf10 msgr2=0x7f6dd4159c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:38.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.181+0000 7f6dda74f700 1 --2- 172.21.15.146:0/5410576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dd40cdf10 0x7f6dd4159c80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6dd4072c00 tx=0x7f6dc400be70 comp rx=0 tx=0).stop 2023-05-24T03:29:38.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.181+0000 7f6dda74f700 1 -- 172.21.15.146:0/5410576 shutdown_connections 2023-05-24T03:29:38.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.181+0000 7f6dda74f700 1 --2- 172.21.15.146:0/5410576 >> v2:172.21.15.151:3300/0 conn(0x7f6dd4070f50 0x7f6dd406d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:38.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.181+0000 7f6dda74f700 1 --2- 172.21.15.146:0/5410576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dd40cdf10 0x7f6dd4159c80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:38.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.181+0000 7f6dda74f700 1 --2- 172.21.15.146:0/5410576 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6dd415dcf0 0x7f6dd40ce2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:38.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.181+0000 7f6dda74f700 1 -- 172.21.15.146:0/5410576 >> 172.21.15.146:0/5410576 conn(0x7f6dd40cfea0 msgr2=0x7f6dd40d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:38.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.181+0000 7f6dda74f700 1 -- 172.21.15.146:0/5410576 shutdown_connections 2023-05-24T03:29:38.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.181+0000 7f6dda74f700 1 -- 172.21.15.146:0/5410576 wait complete. 2023-05-24T03:29:38.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.182+0000 7f6dda74f700 1 Processor -- start 2023-05-24T03:29:38.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.183+0000 7f6dda74f700 1 -- start start 2023-05-24T03:29:38.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.183+0000 7f6dda74f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6dd4070f50 0x7f6dd41e46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:38.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.183+0000 7f6dda74f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dd40cdf10 0x7f6dd40b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:38.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.183+0000 7f6dda74f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6dd415dcf0 0x7f6dd4140db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:38.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.183+0000 7f6dda74f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd40b0080 con 0x7f6dd40cdf10 2023-05-24T03:29:38.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.183+0000 7f6dda74f700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd41e4210 con 0x7f6dd4070f50 2023-05-24T03:29:38.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.183+0000 7f6dda74f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd40b5c30 con 0x7f6dd415dcf0 2023-05-24T03:29:38.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.183+0000 7f6dd37fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dd40cdf10 0x7f6dd40b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:38.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.183+0000 7f6dd37fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dd40cdf10 0x7f6dd40b56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38434/0 (socket says 172.21.15.146:38434) 2023-05-24T03:29:38.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.183+0000 7f6dd37fe700 1 -- 172.21.15.146:0/3195689280 learned_addr learned my addr 172.21.15.146:0/3195689280 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:38.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.183+0000 7f6dd3fff700 1 --2- 172.21.15.146:0/3195689280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6dd4070f50 0x7f6dd41e46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:38.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.183+0000 7f6dd8cec700 1 --2- 172.21.15.146:0/3195689280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6dd415dcf0 0x7f6dd4140db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:38.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.184+0000 7f6dd37fe700 1 -- 172.21.15.146:0/3195689280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6dd415dcf0 msgr2=0x7f6dd4140db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:38.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.184+0000 7f6dd37fe700 1 --2- 172.21.15.146:0/3195689280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6dd415dcf0 0x7f6dd4140db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:38.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.184+0000 7f6dd37fe700 1 -- 172.21.15.146:0/3195689280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6dd4070f50 msgr2=0x7f6dd41e46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:38.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.184+0000 7f6dd37fe700 1 --2- 172.21.15.146:0/3195689280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6dd4070f50 0x7f6dd41e46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:38.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.184+0000 7f6dd37fe700 1 -- 172.21.15.146:0/3195689280 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc400b7f0 con 0x7f6dd40cdf10 2023-05-24T03:29:38.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.184+0000 7f6dd37fe700 1 --2- 172.21.15.146:0/3195689280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dd40cdf10 0x7f6dd40b56f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc00d830 tx=0x7f6dbc00db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:38.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.184+0000 7f6dd0ff9700 1 -- 172.21.15.146:0/3195689280 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc0125f0 con 0x7f6dd40cdf10 2023-05-24T03:29:38.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.184+0000 7f6dd0ff9700 1 -- 172.21.15.146:0/3195689280 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dbc012750 con 0x7f6dd40cdf10 2023-05-24T03:29:38.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.184+0000 7f6dda74f700 1 -- 172.21.15.146:0/3195689280 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dd415ac60 con 0x7f6dd40cdf10 2023-05-24T03:29:38.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.184+0000 7f6dd0ff9700 1 -- 172.21.15.146:0/3195689280 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc012b00 con 0x7f6dd40cdf10 2023-05-24T03:29:38.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.184+0000 7f6dda74f700 1 -- 172.21.15.146:0/3195689280 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dd415a980 con 0x7f6dd40cdf10 2023-05-24T03:29:38.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.185+0000 7f6dda74f700 1 -- 172.21.15.146:0/3195689280 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dd406d190 con 0x7f6dd40cdf10 2023-05-24T03:29:38.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.186+0000 7f6dd0ff9700 1 -- 172.21.15.146:0/3195689280 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6dbc012c60 con 0x7f6dd40cdf10 2023-05-24T03:29:38.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.186+0000 7f6dd0ff9700 1 --2- 172.21.15.146:0/3195689280 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f6db406ad10 0x7f6db406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:38.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.186+0000 7f6dd0ff9700 1 -- 172.21.15.146:0/3195689280 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5199+0+0 (secure 0 0 0) 0x7f6dbc089140 con 0x7f6dd40cdf10 2023-05-24T03:29:38.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.186+0000 7f6dd3fff700 1 --2- 172.21.15.146:0/3195689280 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f6db406ad10 0x7f6db406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:38.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.186+0000 7f6dd3fff700 1 --2- 172.21.15.146:0/3195689280 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f6db406ad10 0x7f6db406d1c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6dc400beb0 tx=0x7f6dc4012000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:38.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.190+0000 7f6dd0ff9700 1 -- 172.21.15.146:0/3195689280 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f6dbc054550 con 0x7f6dd40cdf10 2023-05-24T03:29:38.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:38.378+0000 7f6dda74f700 1 -- 172.21.15.146:0/3195689280 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6dd404e810 con 0x7f6dd40cdf10 2023-05-24T03:29:39.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.040+0000 7f6dd0ff9700 1 -- 172.21.15.146:0/3195689280 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v19) v1 ==== 173+0+0 (secure 0 0 0) 0x7f6dbc057b70 con 0x7f6dd40cdf10 2023-05-24T03:29:39.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.043+0000 7f6dda74f700 1 -- 172.21.15.146:0/3195689280 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f6db406ad10 msgr2=0x7f6db406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:39.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.043+0000 7f6dda74f700 1 --2- 172.21.15.146:0/3195689280 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f6db406ad10 0x7f6db406d1c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6dc400beb0 tx=0x7f6dc4012000 comp rx=0 tx=0).stop 2023-05-24T03:29:39.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.043+0000 7f6dda74f700 1 -- 172.21.15.146:0/3195689280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dd40cdf10 msgr2=0x7f6dd40b56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:39.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.043+0000 7f6dda74f700 1 --2- 172.21.15.146:0/3195689280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dd40cdf10 0x7f6dd40b56f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc00d830 tx=0x7f6dbc00db40 comp rx=0 tx=0).stop 2023-05-24T03:29:39.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.043+0000 7f6dda74f700 1 -- 172.21.15.146:0/3195689280 shutdown_connections 2023-05-24T03:29:39.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.043+0000 7f6dda74f700 1 --2- 172.21.15.146:0/3195689280 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f6db406ad10 0x7f6db406d1c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:39.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.043+0000 7f6dda74f700 1 --2- 172.21.15.146:0/3195689280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6dd415dcf0 0x7f6dd4140db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:39.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.043+0000 7f6dda74f700 1 --2- 172.21.15.146:0/3195689280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6dd4070f50 0x7f6dd41e46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:39.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.043+0000 7f6dda74f700 1 --2- 172.21.15.146:0/3195689280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dd40cdf10 0x7f6dd40b56f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:39.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.043+0000 7f6dda74f700 1 -- 172.21.15.146:0/3195689280 >> 172.21.15.146:0/3195689280 conn(0x7f6dd40cfea0 msgr2=0x7f6dd40ca5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:39.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.043+0000 7f6dda74f700 1 -- 172.21.15.146:0/3195689280 shutdown_connections 2023-05-24T03:29:39.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.043+0000 7f6dda74f700 1 -- 172.21.15.146:0/3195689280 wait complete. 2023-05-24T03:29:39.050 INFO:teuthology.orchestra.run.smithi146.stderr:enabled application 'rbd' on pool 'rbd' 2023-05-24T03:29:39.064 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-05-24T03:29:39.064 INFO:tasks.ceph.mds.a:Restarting daemon 2023-05-24T03:29:39.065 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-05-24T03:29:39.067 INFO:tasks.ceph.mds.a:Started 2023-05-24T03:29:39.067 INFO:tasks.ceph.mds.c:Restarting daemon 2023-05-24T03:29:39.067 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-05-24T03:29:39.069 INFO:tasks.ceph.mds.c:Started 2023-05-24T03:29:39.070 INFO:tasks.ceph.mds.b:Restarting daemon 2023-05-24T03:29:39.070 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-05-24T03:29:39.072 INFO:tasks.ceph.mds.b:Started 2023-05-24T03:29:39.072 INFO:tasks.ceph.mds.d:Restarting daemon 2023-05-24T03:29:39.073 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-05-24T03:29:39.074 INFO:tasks.ceph.mds.d:Started 2023-05-24T03:29:39.075 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-05-24T03:29:39.075 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-24T03:29:39.153 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2023-05-24T03:29:39.154 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2023-05-24T03:29:39.163 INFO:tasks.ceph.mds.b.smithi151.stdout:starting mds.b at 2023-05-24T03:29:39.165 INFO:tasks.ceph.mds.d.smithi151.stdout:starting mds.d at 2023-05-24T03:29:39.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.203+0000 7f351c909700 1 Processor -- start 2023-05-24T03:29:39.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.203+0000 7f351c909700 1 -- start start 2023-05-24T03:29:39.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.204+0000 7f351c909700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f35180cb8c0 0x7f3518161030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:39.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.204+0000 7f351c909700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35180cbc90 0x7f351806a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:39.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.204+0000 7f351c909700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35180b27e0 con 0x7f35180cc1d0 2023-05-24T03:29:39.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.204+0000 7f351c909700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35180b2030 con 0x7f35180cb8c0 2023-05-24T03:29:39.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.204+0000 7f351c909700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35180b2220 con 0x7f35180cbc90 2023-05-24T03:29:39.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.204+0000 7f3515d9b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f35180cc1d0 0x7f35180b1920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44918/0 (socket says 172.21.15.146:44918) 2023-05-24T03:29:39.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.204+0000 7f3516d9d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35180cbc90 0x7f351806a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:39.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.204+0000 7f351659c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f35180cb8c0 0x7f3518161030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:39.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.204+0000 7f3515d9b700 1 -- 172.21.15.146:0/1200473823 learned_addr learned my addr 172.21.15.146:0/1200473823 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:29:39.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.205+0000 7f351559a700 1 -- 172.21.15.146:0/1200473823 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3186837732 0 0) 0x7f35180b27e0 con 0x7f35180cc1d0 2023-05-24T03:29:39.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.205+0000 7f351559a700 1 -- 172.21.15.146:0/1200473823 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35000035b0 con 0x7f35180cc1d0 2023-05-24T03:29:39.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.205+0000 7f351659c700 1 -- 172.21.15.146:0/1200473823 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35180cbc90 msgr2=0x7f351806a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:39.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.205+0000 7f351659c700 1 --2- 172.21.15.146:0/1200473823 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35180cbc90 0x7f351806a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:39.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.205+0000 7f351659c700 1 -- 172.21.15.146:0/1200473823 >> v1:172.21.15.146:6789/0 conn(0x7f35180cc1d0 legacy=0x7f35180b1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:39.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.205+0000 7f351659c700 1 -- 172.21.15.146:0/1200473823 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35180b2500 con 0x7f35180cb8c0 2023-05-24T03:29:39.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.205+0000 7f3516d9d700 1 --2- 172.21.15.146:0/1200473823 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35180cbc90 0x7f351806a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T03:29:39.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.205+0000 7f351659c700 1 --2- 172.21.15.146:0/1200473823 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35180cb8c0 0x7f3518161030 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f350c009840 tx=0x7f350c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2ce95a3e64df89a server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:39.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.205+0000 7f351559a700 1 -- 172.21.15.146:0/1200473823 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c011830 con 0x7f35180cb8c0 2023-05-24T03:29:39.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.205+0000 7f351559a700 1 -- 172.21.15.146:0/1200473823 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350c011990 con 0x7f35180cb8c0 2023-05-24T03:29:39.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.205+0000 7f351559a700 1 -- 172.21.15.146:0/1200473823 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c011d20 con 0x7f35180cb8c0 2023-05-24T03:29:39.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.205+0000 7f351c909700 1 -- 172.21.15.146:0/1200473823 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35180cb8c0 msgr2=0x7f3518161030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:39.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.205+0000 7f351c909700 1 --2- 172.21.15.146:0/1200473823 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35180cb8c0 0x7f3518161030 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f350c009840 tx=0x7f350c009b50 comp rx=0 tx=0).stop 2023-05-24T03:29:39.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.206+0000 7f351c909700 1 -- 172.21.15.146:0/1200473823 shutdown_connections 2023-05-24T03:29:39.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.206+0000 7f351c909700 1 --2- 172.21.15.146:0/1200473823 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35180cbc90 0x7f351806a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:39.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.206+0000 7f351c909700 1 --2- 172.21.15.146:0/1200473823 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35180cb8c0 0x7f3518161030 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:39.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.206+0000 7f351c909700 1 -- 172.21.15.146:0/1200473823 >> 172.21.15.146:0/1200473823 conn(0x7f35180cfea0 msgr2=0x7f35180d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:39.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.206+0000 7f351c909700 1 -- 172.21.15.146:0/1200473823 shutdown_connections 2023-05-24T03:29:39.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.206+0000 7f351c909700 1 -- 172.21.15.146:0/1200473823 wait complete. 2023-05-24T03:29:39.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.207+0000 7f351c909700 1 Processor -- start 2023-05-24T03:29:39.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.207+0000 7f351c909700 1 -- start start 2023-05-24T03:29:39.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.208+0000 7f351c909700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35180cb8c0 0x7f35180c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:39.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.208+0000 7f351c909700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35180cbc90 0x7f351814b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:39.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.208+0000 7f351c909700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35180cc1d0 0x7f35180b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:39.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.208+0000 7f351c909700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35180b5a30 con 0x7f35180cbc90 2023-05-24T03:29:39.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.208+0000 7f351c909700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351814cac0 con 0x7f35180cc1d0 2023-05-24T03:29:39.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.208+0000 7f351c909700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f351814beb0 con 0x7f35180cb8c0 2023-05-24T03:29:39.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.208+0000 7f3515d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35180cbc90 0x7f351814b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:39.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.208+0000 7f3515d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35180cbc90 0x7f351814b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38474/0 (socket says 172.21.15.146:38474) 2023-05-24T03:29:39.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.208+0000 7f3515d9b700 1 -- 172.21.15.146:0/3179432141 learned_addr learned my addr 172.21.15.146:0/3179432141 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:39.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.208+0000 7f351659c700 1 --2- 172.21.15.146:0/3179432141 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35180cb8c0 0x7f35180c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:39.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.208+0000 7f3516d9d700 1 --2- 172.21.15.146:0/3179432141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35180cc1d0 0x7f35180b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:39.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.208+0000 7f3515d9b700 1 -- 172.21.15.146:0/3179432141 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35180cb8c0 msgr2=0x7f35180c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:39.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.208+0000 7f3515d9b700 1 --2- 172.21.15.146:0/3179432141 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35180cb8c0 0x7f35180c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:39.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.208+0000 7f3515d9b700 1 -- 172.21.15.146:0/3179432141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35180cc1d0 msgr2=0x7f35180b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:39.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.208+0000 7f3515d9b700 1 --2- 172.21.15.146:0/3179432141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35180cc1d0 0x7f35180b54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:39.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.208+0000 7f3515d9b700 1 -- 172.21.15.146:0/3179432141 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3510009a70 con 0x7f35180cbc90 2023-05-24T03:29:39.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.208+0000 7f351659c700 1 --2- 172.21.15.146:0/3179432141 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35180cb8c0 0x7f35180c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:29:39.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.208+0000 7f3515d9b700 1 --2- 172.21.15.146:0/3179432141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35180cbc90 0x7f351814b7a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3508005910 tx=0x7f350800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:39.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.208+0000 7f3506ffd700 1 -- 172.21.15.146:0/3179432141 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3508005d70 con 0x7f35180cbc90 2023-05-24T03:29:39.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.208+0000 7f3506ffd700 1 -- 172.21.15.146:0/3179432141 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35080070d0 con 0x7f35180cbc90 2023-05-24T03:29:39.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.208+0000 7f351c909700 1 -- 172.21.15.146:0/3179432141 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f350c0094a0 con 0x7f35180cbc90 2023-05-24T03:29:39.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.208+0000 7f3506ffd700 1 -- 172.21.15.146:0/3179432141 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3508007440 con 0x7f35180cbc90 2023-05-24T03:29:39.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.208+0000 7f351c909700 1 -- 172.21.15.146:0/3179432141 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3518160b10 con 0x7f35180cbc90 2023-05-24T03:29:39.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.209+0000 7f351c909700 1 -- 172.21.15.146:0/3179432141 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3518160830 con 0x7f35180cbc90 2023-05-24T03:29:39.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.210+0000 7f3506ffd700 1 -- 172.21.15.146:0/3179432141 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f35080075a0 con 0x7f35180cbc90 2023-05-24T03:29:39.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.210+0000 7f3506ffd700 1 --2- 172.21.15.146:0/3179432141 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f34f806ace0 0x7f34f806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:39.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.210+0000 7f3506ffd700 1 -- 172.21.15.146:0/3179432141 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3508088500 con 0x7f35180cbc90 2023-05-24T03:29:39.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.210+0000 7f351659c700 1 --2- 172.21.15.146:0/3179432141 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f34f806ace0 0x7f34f806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:39.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.210+0000 7f351659c700 1 --2- 172.21.15.146:0/3179432141 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f34f806ace0 0x7f34f806d190 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f350c000c00 tx=0x7f350c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:39.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.214+0000 7f3506ffd700 1 -- 172.21.15.146:0/3179432141 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f35080539b0 con 0x7f35180cbc90 2023-05-24T03:29:39.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.403+0000 7f351c909700 1 -- 172.21.15.146:0/3179432141 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f351804e840 con 0x7f35180cbc90 2023-05-24T03:29:39.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.404+0000 7f3506ffd700 1 -- 172.21.15.146:0/3179432141 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+14685 (secure 0 0 0) 0x7f3508056fd0 con 0x7f35180cbc90 2023-05-24T03:29:39.409 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:29:39.409 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":19,"fsid":"11ca0adb-7672-4713-bde7-451e8b743ae9","created":"2023-05-24T03:29:19.113659+0000","modified":"2023-05-24T03:29:39.037126+0000","last_up_change":"2023-05-24T03:29:30.962339+0000","last_in_change":"2023-05-24T03:29:21.706540+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-24T03:29:32.749984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-24T03:29:37.719623+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f24b319b-fcc8-4385-b0cb-78138fc31417","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6801","nonce":3353593100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6803","nonce":3353593100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6807","nonce":3353593100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6805","nonce":3353593100}]},"public_addr":"172.21.15.146:6801/3353593100","cluster_addr":"172.21.15.146:6803/3353593100","heartbeat_back_addr":"172.21.15.146:6807/3353593100","heartbeat_front_addr":"172.21.15.146:6805/3353593100","state":["exists","up"]},{"osd":1,"uuid":"c9639ea9-8f9b-498e-92c8-aa976edbf1da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6821","nonce":2537488734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6825","nonce":2537488734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6831","nonce":2537488734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6827","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6829","nonce":2537488734}]},"public_addr":"172.21.15.146:6821/2537488734","cluster_addr":"172.21.15.146:6825/2537488734","heartbeat_back_addr":"172.21.15.146:6831/2537488734","heartbeat_front_addr":"172.21.15.146:6829/2537488734","state":["exists","up"]},{"osd":2,"uuid":"7a6cfc6d-b0ca-4cb6-a66d-4001ec184657","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6809","nonce":1800242932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6811","nonce":1800242932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6815","nonce":1800242932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6813","nonce":1800242932}]},"public_addr":"172.21.15.146:6809/1800242932","cluster_addr":"172.21.15.146:6811/1800242932","heartbeat_back_addr":"172.21.15.146:6815/1800242932","heartbeat_front_addr":"172.21.15.146:6813/1800242932","state":["exists","up"]},{"osd":3,"uuid":"401509f7-cecd-44a2-b0ae-22c81a5d93c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6817","nonce":1749783580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6820","nonce":1749783580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6828","nonce":1749783580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6824","nonce":1749783580}]},"public_addr":"172.21.15.146:6817/1749783580","cluster_addr":"172.21.15.146:6820/1749783580","heartbeat_back_addr":"172.21.15.146:6828/1749783580","heartbeat_front_addr":"172.21.15.146:6824/1749783580","state":["exists","up"]},{"osd":4,"uuid":"9d07f440-d125-4f99-a825-411fab894d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6811","nonce":163453435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6814","nonce":163453435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6819","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6821","nonce":163453435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6818","nonce":163453435}]},"public_addr":"172.21.15.151:6811/163453435","cluster_addr":"172.21.15.151:6814/163453435","heartbeat_back_addr":"172.21.15.151:6821/163453435","heartbeat_front_addr":"172.21.15.151:6818/163453435","state":["exists","up"]},{"osd":5,"uuid":"9b2266e2-9e52-4f0e-96da-e703a6c23a6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6801","nonce":3283474903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6803","nonce":3283474903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6807","nonce":3283474903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6805","nonce":3283474903}]},"public_addr":"172.21.15.151:6801/3283474903","cluster_addr":"172.21.15.151:6803/3283474903","heartbeat_back_addr":"172.21.15.151:6807/3283474903","heartbeat_front_addr":"172.21.15.151:6805/3283474903","state":["exists","up"]},{"osd":6,"uuid":"5daedf77-0a83-49e7-b497-d9ed10436972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6825","nonce":3889424178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6827","nonce":3889424178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6831","nonce":3889424178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6829","nonce":3889424178}]},"public_addr":"172.21.15.151:6825/3889424178","cluster_addr":"172.21.15.151:6827/3889424178","heartbeat_back_addr":"172.21.15.151:6831/3889424178","heartbeat_front_addr":"172.21.15.151:6829/3889424178","state":["exists","up"]},{"osd":7,"uuid":"86ae4f7e-c01f-4c3d-a0dd-98160c209309","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6810","nonce":563291208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6815","nonce":563291208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6823","nonce":563291208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6820","nonce":563291208}]},"public_addr":"172.21.15.151:6810/563291208","cluster_addr":"172.21.15.151:6815/563291208","heartbeat_back_addr":"172.21.15.151:6823/563291208","heartbeat_front_addr":"172.21.15.151:6820/563291208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.872472+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.937126+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.877234+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.884793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.881632+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.938293+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.857661+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.945883+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-24T03:29:39.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.406+0000 7f351c909700 1 -- 172.21.15.146:0/3179432141 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f34f806ace0 msgr2=0x7f34f806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:39.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.406+0000 7f351c909700 1 --2- 172.21.15.146:0/3179432141 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f34f806ace0 0x7f34f806d190 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f350c000c00 tx=0x7f350c008030 comp rx=0 tx=0).stop 2023-05-24T03:29:39.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.406+0000 7f351c909700 1 -- 172.21.15.146:0/3179432141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35180cbc90 msgr2=0x7f351814b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:39.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.406+0000 7f351c909700 1 --2- 172.21.15.146:0/3179432141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35180cbc90 0x7f351814b7a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3508005910 tx=0x7f350800c860 comp rx=0 tx=0).stop 2023-05-24T03:29:39.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.406+0000 7f351c909700 1 -- 172.21.15.146:0/3179432141 shutdown_connections 2023-05-24T03:29:39.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.406+0000 7f351c909700 1 --2- 172.21.15.146:0/3179432141 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f34f806ace0 0x7f34f806d190 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:39.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.406+0000 7f351c909700 1 --2- 172.21.15.146:0/3179432141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35180cc1d0 0x7f35180b54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:39.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.406+0000 7f351c909700 1 --2- 172.21.15.146:0/3179432141 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35180cb8c0 0x7f35180c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:39.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.406+0000 7f351c909700 1 --2- 172.21.15.146:0/3179432141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35180cbc90 0x7f351814b7a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:39.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.406+0000 7f351c909700 1 -- 172.21.15.146:0/3179432141 >> 172.21.15.146:0/3179432141 conn(0x7f35180cfea0 msgr2=0x7f35180cb130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:39.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.407+0000 7f351c909700 1 -- 172.21.15.146:0/3179432141 shutdown_connections 2023-05-24T03:29:39.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.407+0000 7f351c909700 1 -- 172.21.15.146:0/3179432141 wait complete. 2023-05-24T03:29:39.423 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-24T03:29:32.749984+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-24T03:29:37.719623+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-24T03:29:39.424 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-24T03:29:39.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.543+0000 7f92fe5dc700 1 Processor -- start 2023-05-24T03:29:39.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.543+0000 7f92fe5dc700 1 -- start start 2023-05-24T03:29:39.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.544+0000 7f92fe5dc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f92f815cf50 0x7f92f80707b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:39.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.544+0000 7f92fe5dc700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f92f806b850 0x7f92f8070cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:39.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.544+0000 7f92fe5dc700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f92f806a460 0x7f92f806a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:39.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.544+0000 7f92fe5dc700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92f8072060 con 0x7f92f815cf50 2023-05-24T03:29:39.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.544+0000 7f92fe5dc700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92f80ca330 con 0x7f92f806b850 2023-05-24T03:29:39.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.544+0000 7f92fe5dc700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92f80ca050 con 0x7f92f806a460 2023-05-24T03:29:39.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.544+0000 7f92f7fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f92f815cf50 0x7f92f80707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:39.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.544+0000 7f92f7fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f92f815cf50 0x7f92f80707b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38482/0 (socket says 172.21.15.146:38482) 2023-05-24T03:29:39.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.544+0000 7f92f7fff700 1 -- 172.21.15.146:0/895673460 learned_addr learned my addr 172.21.15.146:0/895673460 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:39.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.544+0000 7f92fcb79700 1 --2- 172.21.15.146:0/895673460 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f92f806a460 0x7f92f806a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:39.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.544+0000 7f92f77fe700 1 --2- 172.21.15.146:0/895673460 >> v2:172.21.15.151:3300/0 conn(0x7f92f806b850 0x7f92f8070cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:39.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.544+0000 7f92f7fff700 1 -- 172.21.15.146:0/895673460 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f92f806a460 msgr2=0x7f92f806a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:39.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.544+0000 7f92f7fff700 1 --2- 172.21.15.146:0/895673460 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f92f806a460 0x7f92f806a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:39.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.544+0000 7f92f7fff700 1 -- 172.21.15.146:0/895673460 >> v2:172.21.15.151:3300/0 conn(0x7f92f806b850 msgr2=0x7f92f8070cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:39.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.544+0000 7f92f7fff700 1 --2- 172.21.15.146:0/895673460 >> v2:172.21.15.151:3300/0 conn(0x7f92f806b850 0x7f92f8070cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:39.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.544+0000 7f92f7fff700 1 -- 172.21.15.146:0/895673460 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f80ca610 con 0x7f92f815cf50 2023-05-24T03:29:39.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.545+0000 7f92f7fff700 1 --2- 172.21.15.146:0/895673460 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92f815cf50 0x7f92f80707b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f92f8070260 tx=0x7f92ec009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2d88c5d226f823c server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:39.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.545+0000 7f92f6ffd700 1 -- 172.21.15.146:0/895673460 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ec00b870 con 0x7f92f815cf50 2023-05-24T03:29:39.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.545+0000 7f92f6ffd700 1 -- 172.21.15.146:0/895673460 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92ec00b9d0 con 0x7f92f815cf50 2023-05-24T03:29:39.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.545+0000 7f92f6ffd700 1 -- 172.21.15.146:0/895673460 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ec00bd60 con 0x7f92f815cf50 2023-05-24T03:29:39.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.545+0000 7f92fe5dc700 1 -- 172.21.15.146:0/895673460 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92f815cf50 msgr2=0x7f92f80707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:39.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.545+0000 7f92fe5dc700 1 --2- 172.21.15.146:0/895673460 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92f815cf50 0x7f92f80707b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f92f8070260 tx=0x7f92ec009bd0 comp rx=0 tx=0).stop 2023-05-24T03:29:39.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.545+0000 7f92fe5dc700 1 -- 172.21.15.146:0/895673460 shutdown_connections 2023-05-24T03:29:39.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.545+0000 7f92fe5dc700 1 --2- 172.21.15.146:0/895673460 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f92f806a460 0x7f92f806a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:39.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.545+0000 7f92fe5dc700 1 --2- 172.21.15.146:0/895673460 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92f815cf50 0x7f92f80707b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:39.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.545+0000 7f92fe5dc700 1 --2- 172.21.15.146:0/895673460 >> v2:172.21.15.151:3300/0 conn(0x7f92f806b850 0x7f92f8070cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:39.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.545+0000 7f92fe5dc700 1 -- 172.21.15.146:0/895673460 >> 172.21.15.146:0/895673460 conn(0x7f92f80cf6c0 msgr2=0x7f92f80cfa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:39.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.545+0000 7f92fe5dc700 1 -- 172.21.15.146:0/895673460 shutdown_connections 2023-05-24T03:29:39.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.545+0000 7f92fe5dc700 1 -- 172.21.15.146:0/895673460 wait complete. 2023-05-24T03:29:39.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.546+0000 7f92fe5dc700 1 Processor -- start 2023-05-24T03:29:39.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.547+0000 7f92fe5dc700 1 -- start start 2023-05-24T03:29:39.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.547+0000 7f92fe5dc700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f92f806a460 0x7f92f81f2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:39.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.547+0000 7f92fe5dc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92f806b850 0x7f92f80cd490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:39.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.547+0000 7f92fe5dc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92f815cf50 0x7f92f80c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:39.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.547+0000 7f92fe5dc700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f80cd0a0 con 0x7f92f806b850 2023-05-24T03:29:39.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.547+0000 7f92fe5dc700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f81f32b0 con 0x7f92f815cf50 2023-05-24T03:29:39.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.547+0000 7f92fe5dc700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92f80cc490 con 0x7f92f806a460 2023-05-24T03:29:39.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.547+0000 7f92f77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92f806b850 0x7f92f80cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:39.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.547+0000 7f92f77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92f806b850 0x7f92f80cd490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38488/0 (socket says 172.21.15.146:38488) 2023-05-24T03:29:39.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.547+0000 7f92f77fe700 1 -- 172.21.15.146:0/1747256184 learned_addr learned my addr 172.21.15.146:0/1747256184 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:39.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.548+0000 7f92fcb79700 1 --2- 172.21.15.146:0/1747256184 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92f815cf50 0x7f92f80c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:39.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.548+0000 7f92f7fff700 1 --2- 172.21.15.146:0/1747256184 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f92f806a460 0x7f92f81f2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:39.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.548+0000 7f92f77fe700 1 -- 172.21.15.146:0/1747256184 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f92f806a460 msgr2=0x7f92f81f2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:39.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.548+0000 7f92f77fe700 1 --2- 172.21.15.146:0/1747256184 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f92f806a460 0x7f92f81f2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:39.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.548+0000 7f92f77fe700 1 -- 172.21.15.146:0/1747256184 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92f815cf50 msgr2=0x7f92f80c8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:39.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.548+0000 7f92f77fe700 1 --2- 172.21.15.146:0/1747256184 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92f815cf50 0x7f92f80c8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:39.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.548+0000 7f92f77fe700 1 -- 172.21.15.146:0/1747256184 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92ec009550 con 0x7f92f806b850 2023-05-24T03:29:39.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.548+0000 7f92f77fe700 1 --2- 172.21.15.146:0/1747256184 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92f806b850 0x7f92f80cd490 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f92e800e810 tx=0x7f92e800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:39.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.548+0000 7f92f4ff9700 1 -- 172.21.15.146:0/1747256184 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e800c070 con 0x7f92f806b850 2023-05-24T03:29:39.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.548+0000 7f92f4ff9700 1 -- 172.21.15.146:0/1747256184 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92e8013610 con 0x7f92f806b850 2023-05-24T03:29:39.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.548+0000 7f92fe5dc700 1 -- 172.21.15.146:0/1747256184 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92f8071ca0 con 0x7f92f806b850 2023-05-24T03:29:39.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.548+0000 7f92f4ff9700 1 -- 172.21.15.146:0/1747256184 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e80139c0 con 0x7f92f806b850 2023-05-24T03:29:39.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.548+0000 7f92fe5dc700 1 -- 172.21.15.146:0/1747256184 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92f80ca8f0 con 0x7f92f806b850 2023-05-24T03:29:39.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.549+0000 7f92fe5dc700 1 -- 172.21.15.146:0/1747256184 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92f8071e30 con 0x7f92f806b850 2023-05-24T03:29:39.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.550+0000 7f92f4ff9700 1 -- 172.21.15.146:0/1747256184 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f92e8013b20 con 0x7f92f806b850 2023-05-24T03:29:39.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.550+0000 7f92f4ff9700 1 --2- 172.21.15.146:0/1747256184 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f92e406ace0 0x7f92e406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:39.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.550+0000 7f92f4ff9700 1 -- 172.21.15.146:0/1747256184 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f92e8088ea0 con 0x7f92f806b850 2023-05-24T03:29:39.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.550+0000 7f92f7fff700 1 --2- 172.21.15.146:0/1747256184 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f92e406ace0 0x7f92e406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:39.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.550+0000 7f92f7fff700 1 --2- 172.21.15.146:0/1747256184 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f92e406ace0 0x7f92e406d190 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f92ec000c00 tx=0x7f92ec008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:39.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.554+0000 7f92f4ff9700 1 -- 172.21.15.146:0/1747256184 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f92e8057d40 con 0x7f92f806b850 2023-05-24T03:29:39.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.740+0000 7f92fe5dc700 1 -- 172.21.15.146:0/1747256184 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f92f8068d00 con 0x7f92f806b850 2023-05-24T03:29:39.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.740+0000 7f92f4ff9700 1 -- 172.21.15.146:0/1747256184 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f92e80578d0 con 0x7f92f806b850 2023-05-24T03:29:39.745 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2023-05-24T03:29:39.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.742+0000 7f92fe5dc700 1 -- 172.21.15.146:0/1747256184 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f92e406ace0 msgr2=0x7f92e406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:39.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.742+0000 7f92fe5dc700 1 --2- 172.21.15.146:0/1747256184 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f92e406ace0 0x7f92e406d190 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f92ec000c00 tx=0x7f92ec008030 comp rx=0 tx=0).stop 2023-05-24T03:29:39.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.742+0000 7f92fe5dc700 1 -- 172.21.15.146:0/1747256184 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92f806b850 msgr2=0x7f92f80cd490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:39.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.742+0000 7f92fe5dc700 1 --2- 172.21.15.146:0/1747256184 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92f806b850 0x7f92f80cd490 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f92e800e810 tx=0x7f92e800eb20 comp rx=0 tx=0).stop 2023-05-24T03:29:39.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.742+0000 7f92fe5dc700 1 -- 172.21.15.146:0/1747256184 shutdown_connections 2023-05-24T03:29:39.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.742+0000 7f92fe5dc700 1 --2- 172.21.15.146:0/1747256184 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f92e406ace0 0x7f92e406d190 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:39.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.742+0000 7f92fe5dc700 1 --2- 172.21.15.146:0/1747256184 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92f815cf50 0x7f92f80c8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:39.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.742+0000 7f92fe5dc700 1 --2- 172.21.15.146:0/1747256184 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f92f806a460 0x7f92f81f2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:39.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.742+0000 7f92fe5dc700 1 --2- 172.21.15.146:0/1747256184 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92f806b850 0x7f92f80cd490 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:39.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.742+0000 7f92fe5dc700 1 -- 172.21.15.146:0/1747256184 >> 172.21.15.146:0/1747256184 conn(0x7f92f80cf6c0 msgr2=0x7f92f80b46c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:39.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.742+0000 7f92fe5dc700 1 -- 172.21.15.146:0/1747256184 shutdown_connections 2023-05-24T03:29:39.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.742+0000 7f92fe5dc700 1 -- 172.21.15.146:0/1747256184 wait complete. 2023-05-24T03:29:39.759 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-24T03:29:39.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.878+0000 7f6082c90700 1 Processor -- start 2023-05-24T03:29:39.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.878+0000 7f6082c90700 1 -- start start 2023-05-24T03:29:39.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.879+0000 7f6082c90700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f607c06a460 0x7f607c0cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:39.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.879+0000 7f6082c90700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f607c15cd90 0x7f607c06a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:39.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.879+0000 7f6082c90700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f607c0cfd00 con 0x7f607c0aefd0 2023-05-24T03:29:39.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.879+0000 7f6082c90700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f607c072350 con 0x7f607c06a460 2023-05-24T03:29:39.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.879+0000 7f6082c90700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f607c06ad70 con 0x7f607c15cd90 2023-05-24T03:29:39.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.879+0000 7f608122d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f607c0aefd0 0x7f607c160d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44950/0 (socket says 172.21.15.146:44950) 2023-05-24T03:29:39.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.879+0000 7f608122d700 1 -- 172.21.15.146:0/2497476940 learned_addr learned my addr 172.21.15.146:0/2497476940 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:29:39.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.879+0000 7f607bfff700 1 --2- 172.21.15.146:0/2497476940 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f607c15cd90 0x7f607c06a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:39.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.879+0000 7f6080a2c700 1 --2- 172.21.15.146:0/2497476940 >> v2:172.21.15.151:3300/0 conn(0x7f607c06a460 0x7f607c0cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:39.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.879+0000 7f607b7fe700 1 -- 172.21.15.146:0/2497476940 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2334018345 0 0) 0x7f6074001490 con 0x7f607c0aefd0 2023-05-24T03:29:39.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.880+0000 7f607b7fe700 1 -- 172.21.15.146:0/2497476940 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f606c0035b0 con 0x7f607c0aefd0 2023-05-24T03:29:39.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.880+0000 7f607b7fe700 1 -- 172.21.15.146:0/2497476940 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 118272067 0 0) 0x7f606c0035b0 con 0x7f607c0aefd0 2023-05-24T03:29:39.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.880+0000 7f607b7fe700 1 -- 172.21.15.146:0/2497476940 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f607c15cd90 msgr2=0x7f607c06a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:39.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.880+0000 7f607b7fe700 1 --2- 172.21.15.146:0/2497476940 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f607c15cd90 0x7f607c06a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:39.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.880+0000 7f607b7fe700 1 -- 172.21.15.146:0/2497476940 >> v2:172.21.15.151:3300/0 conn(0x7f607c06a460 msgr2=0x7f607c0cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:39.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.880+0000 7f607b7fe700 1 --2- 172.21.15.146:0/2497476940 >> v2:172.21.15.151:3300/0 conn(0x7f607c06a460 0x7f607c0cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:39.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.880+0000 7f607b7fe700 1 -- 172.21.15.146:0/2497476940 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f607c0cf460 con 0x7f607c0aefd0 2023-05-24T03:29:39.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.880+0000 7f607b7fe700 1 -- 172.21.15.146:0/2497476940 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1301887351 0 0) 0x7f6074001b80 con 0x7f607c0aefd0 2023-05-24T03:29:39.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.880+0000 7f607b7fe700 1 -- 172.21.15.146:0/2497476940 >> v1:172.21.15.146:6789/0 conn(0x7f607c0aefd0 legacy=0x7f607c160d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:39.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.880+0000 7f607b7fe700 1 --2- 172.21.15.146:0/2497476940 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f607c15cd90 0x7f606c003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:39.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.880+0000 7f607b7fe700 1 --2- 172.21.15.146:0/2497476940 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f606c003f80 0x7f606c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:39.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.880+0000 7f607b7fe700 1 --2- 172.21.15.146:0/2497476940 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f606c004d90 0x7f606c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:39.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.880+0000 7f607b7fe700 1 -- 172.21.15.146:0/2497476940 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607c072350 con 0x7f606c004d90 2023-05-24T03:29:39.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.880+0000 7f607b7fe700 1 -- 172.21.15.146:0/2497476940 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607c06ad70 con 0x7f606c003f80 2023-05-24T03:29:39.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.880+0000 7f607b7fe700 1 -- 172.21.15.146:0/2497476940 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f606c00ba10 con 0x7f607c15cd90 2023-05-24T03:29:39.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.880+0000 7f608122d700 1 --2- 172.21.15.146:0/2497476940 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f606c004d90 0x7f606c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:39.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.880+0000 7f6080a2c700 1 --2- 172.21.15.146:0/2497476940 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f607c15cd90 0x7f606c003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:39.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.880+0000 7f607bfff700 1 --2- 172.21.15.146:0/2497476940 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f606c003f80 0x7f606c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:39.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.880+0000 7f608122d700 1 -- 172.21.15.146:0/2497476940 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f607c15cd90 msgr2=0x7f606c003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:39.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.880+0000 7f608122d700 1 --2- 172.21.15.146:0/2497476940 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f607c15cd90 0x7f606c003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:39.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.880+0000 7f608122d700 1 -- 172.21.15.146:0/2497476940 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f606c003f80 msgr2=0x7f606c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:39.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.880+0000 7f608122d700 1 --2- 172.21.15.146:0/2497476940 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f606c003f80 0x7f606c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:39.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.880+0000 7f608122d700 1 -- 172.21.15.146:0/2497476940 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f606c0035b0 con 0x7f606c004d90 2023-05-24T03:29:39.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.880+0000 7f608122d700 1 --2- 172.21.15.146:0/2497476940 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f606c004d90 0x7f606c005200 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f607400a830 tx=0x7f606c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f81cc986f37626a9 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:39.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.880+0000 7f607b7fe700 1 -- 172.21.15.146:0/2497476940 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6074012600 con 0x7f606c004d90 2023-05-24T03:29:39.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.881+0000 7f607b7fe700 1 -- 172.21.15.146:0/2497476940 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6074012780 con 0x7f606c004d90 2023-05-24T03:29:39.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.881+0000 7f607b7fe700 1 -- 172.21.15.146:0/2497476940 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6074012b30 con 0x7f606c004d90 2023-05-24T03:29:39.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.881+0000 7f6082c90700 1 -- 172.21.15.146:0/2497476940 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f606c004d90 msgr2=0x7f606c005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:39.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.881+0000 7f6082c90700 1 --2- 172.21.15.146:0/2497476940 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f606c004d90 0x7f606c005200 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f607400a830 tx=0x7f606c005880 comp rx=0 tx=0).stop 2023-05-24T03:29:39.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.881+0000 7f608122d700 1 -- 172.21.15.146:0/2497476940 reap_dead start 2023-05-24T03:29:39.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.881+0000 7f6082c90700 1 -- 172.21.15.146:0/2497476940 shutdown_connections 2023-05-24T03:29:39.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.881+0000 7f6082c90700 1 -- 172.21.15.146:0/2497476940 >> 172.21.15.146:0/2497476940 conn(0x7f607c0cfea0 msgr2=0x7f607c0d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:39.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.881+0000 7f6082c90700 1 -- 172.21.15.146:0/2497476940 shutdown_connections 2023-05-24T03:29:39.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.881+0000 7f6082c90700 1 -- 172.21.15.146:0/2497476940 wait complete. 2023-05-24T03:29:39.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.882+0000 7f6082c90700 1 Processor -- start 2023-05-24T03:29:39.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.882+0000 7f6082c90700 1 -- start start 2023-05-24T03:29:39.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.883+0000 7f6082c90700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f607c0b1e50 0x7f607c1f5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:39.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.883+0000 7f6082c90700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f607c0b2220 0x7f607c1f2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:39.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.883+0000 7f6082c90700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f607c0b1600 0x7f607c0ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:39.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.883+0000 7f6082c90700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607c1f6a20 con 0x7f607c0b2220 2023-05-24T03:29:39.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.883+0000 7f6082c90700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607c154c40 con 0x7f607c0b1e50 2023-05-24T03:29:39.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.883+0000 7f6082c90700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f607c1f2430 con 0x7f607c0b1600 2023-05-24T03:29:39.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.883+0000 7f607bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f607c0b2220 0x7f607c1f2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:39.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.883+0000 7f607bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f607c0b2220 0x7f607c1f2bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38508/0 (socket says 172.21.15.146:38508) 2023-05-24T03:29:39.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.883+0000 7f607bfff700 1 -- 172.21.15.146:0/1629646811 learned_addr learned my addr 172.21.15.146:0/1629646811 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:39.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.883+0000 7f6080a2c700 1 --2- 172.21.15.146:0/1629646811 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f607c0b1e50 0x7f607c1f5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:39.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.884+0000 7f608122d700 1 --2- 172.21.15.146:0/1629646811 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f607c0b1600 0x7f607c0ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:39.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.884+0000 7f607bfff700 1 -- 172.21.15.146:0/1629646811 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f607c0b1600 msgr2=0x7f607c0ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:39.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.884+0000 7f607bfff700 1 --2- 172.21.15.146:0/1629646811 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f607c0b1600 0x7f607c0ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:39.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.884+0000 7f607bfff700 1 -- 172.21.15.146:0/1629646811 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f607c0b1e50 msgr2=0x7f607c1f5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:39.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.884+0000 7f607bfff700 1 --2- 172.21.15.146:0/1629646811 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f607c0b1e50 0x7f607c1f5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:39.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.884+0000 7f607bfff700 1 -- 172.21.15.146:0/1629646811 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f607c0cfa20 con 0x7f607c0b2220 2023-05-24T03:29:39.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.884+0000 7f608122d700 1 --2- 172.21.15.146:0/1629646811 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f607c0b1600 0x7f607c0ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:29:39.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.884+0000 7f607bfff700 1 --2- 172.21.15.146:0/1629646811 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f607c0b2220 0x7f607c1f2bc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f60680119d0 tx=0x7f6068011d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:39.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.884+0000 7f60797fa700 1 -- 172.21.15.146:0/1629646811 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606800f940 con 0x7f607c0b2220 2023-05-24T03:29:39.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.884+0000 7f60797fa700 1 -- 172.21.15.146:0/1629646811 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f606800faa0 con 0x7f607c0b2220 2023-05-24T03:29:39.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.884+0000 7f6082c90700 1 -- 172.21.15.146:0/1629646811 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f607c0cf740 con 0x7f607c0b2220 2023-05-24T03:29:39.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.884+0000 7f60797fa700 1 -- 172.21.15.146:0/1629646811 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606800fe30 con 0x7f607c0b2220 2023-05-24T03:29:39.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.884+0000 7f6082c90700 1 -- 172.21.15.146:0/1629646811 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f607c160800 con 0x7f607c0b2220 2023-05-24T03:29:39.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.885+0000 7f6082c90700 1 -- 172.21.15.146:0/1629646811 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f607c068d00 con 0x7f607c0b2220 2023-05-24T03:29:39.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.885+0000 7f60797fa700 1 -- 172.21.15.146:0/1629646811 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6068014440 con 0x7f607c0b2220 2023-05-24T03:29:39.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.886+0000 7f60797fa700 1 --2- 172.21.15.146:0/1629646811 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f606006ace0 0x7f606006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:39.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.886+0000 7f60797fa700 1 -- 172.21.15.146:0/1629646811 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6068089860 con 0x7f607c0b2220 2023-05-24T03:29:39.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.886+0000 7f6080a2c700 1 --2- 172.21.15.146:0/1629646811 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f606006ace0 0x7f606006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:39.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.886+0000 7f6080a2c700 1 --2- 172.21.15.146:0/1629646811 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f606006ace0 0x7f606006d190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f607c15a380 tx=0x7f6070008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:39.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:39.890+0000 7f60797fa700 1 -- 172.21.15.146:0/1629646811 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f6068054c60 con 0x7f607c0b2220 2023-05-24T03:29:40.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.080+0000 7f6082c90700 1 -- 172.21.15.146:0/1629646811 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f607c0b5dc0 con 0x7f607c0b2220 2023-05-24T03:29:40.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.080+0000 7f60797fa700 1 -- 172.21.15.146:0/1629646811 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6068058280 con 0x7f607c0b2220 2023-05-24T03:29:40.085 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2023-05-24T03:29:40.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.082+0000 7f6082c90700 1 -- 172.21.15.146:0/1629646811 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f606006ace0 msgr2=0x7f606006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:40.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.082+0000 7f6082c90700 1 --2- 172.21.15.146:0/1629646811 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f606006ace0 0x7f606006d190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f607c15a380 tx=0x7f6070008040 comp rx=0 tx=0).stop 2023-05-24T03:29:40.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.082+0000 7f6082c90700 1 -- 172.21.15.146:0/1629646811 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f607c0b2220 msgr2=0x7f607c1f2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:40.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.082+0000 7f6082c90700 1 --2- 172.21.15.146:0/1629646811 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f607c0b2220 0x7f607c1f2bc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f60680119d0 tx=0x7f6068011d90 comp rx=0 tx=0).stop 2023-05-24T03:29:40.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.082+0000 7f6082c90700 1 -- 172.21.15.146:0/1629646811 shutdown_connections 2023-05-24T03:29:40.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.082+0000 7f6082c90700 1 --2- 172.21.15.146:0/1629646811 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f606006ace0 0x7f606006d190 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:40.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.082+0000 7f6082c90700 1 --2- 172.21.15.146:0/1629646811 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f607c0b1600 0x7f607c0ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:40.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.082+0000 7f6082c90700 1 --2- 172.21.15.146:0/1629646811 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f607c0b1e50 0x7f607c1f5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:40.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.082+0000 7f6082c90700 1 --2- 172.21.15.146:0/1629646811 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f607c0b2220 0x7f607c1f2bc0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:40.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.082+0000 7f6082c90700 1 -- 172.21.15.146:0/1629646811 >> 172.21.15.146:0/1629646811 conn(0x7f607c0cfea0 msgr2=0x7f607c0b3bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:40.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.082+0000 7f6082c90700 1 -- 172.21.15.146:0/1629646811 shutdown_connections 2023-05-24T03:29:40.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.082+0000 7f6082c90700 1 -- 172.21.15.146:0/1629646811 wait complete. 2023-05-24T03:29:40.099 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-24T03:29:40.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.216+0000 7f669af0b700 1 Processor -- start 2023-05-24T03:29:40.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.217+0000 7f669af0b700 1 -- start start 2023-05-24T03:29:40.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.217+0000 7f669af0b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6694071e30 0x7f6694165550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:40.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.217+0000 7f669af0b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66940cb740 con 0x7f669415a9c0 2023-05-24T03:29:40.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.217+0000 7f669af0b700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66940cba20 con 0x7f66940cc500 2023-05-24T03:29:40.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.217+0000 7f669af0b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66940cbd00 con 0x7f6694071e30 2023-05-24T03:29:40.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.217+0000 7f66994a8700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6694071e30 0x7f6694165550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:40.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.217+0000 7f6698ca7700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f669415a9c0 0x7f66940b52e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44968/0 (socket says 172.21.15.146:44968) 2023-05-24T03:29:40.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.217+0000 7f6698ca7700 1 -- 172.21.15.146:0/706156977 learned_addr learned my addr 172.21.15.146:0/706156977 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:29:40.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.218+0000 7f66994a8700 1 -- 172.21.15.146:0/706156977 >> v1:172.21.15.151:6789/0 conn(0x7f66940cc500 legacy=0x7f6694071720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:40.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.218+0000 7f66994a8700 1 -- 172.21.15.146:0/706156977 >> v1:172.21.15.146:6789/0 conn(0x7f669415a9c0 legacy=0x7f66940b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:40.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.218+0000 7f66994a8700 1 -- 172.21.15.146:0/706156977 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66940cbfe0 con 0x7f6694071e30 2023-05-24T03:29:40.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.218+0000 7f66937fe700 1 -- 172.21.15.146:0/706156977 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3269199235 0 0) 0x7f66940cb740 con 0x7f669415a9c0 2023-05-24T03:29:40.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.218+0000 7f66994a8700 1 --2- 172.21.15.146:0/706156977 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6694071e30 0x7f6694165550 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f668c009d90 tx=0x7f668c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe85e62e17822c28 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:40.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.218+0000 7f66937fe700 1 -- 172.21.15.146:0/706156977 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c00e070 con 0x7f6694071e30 2023-05-24T03:29:40.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.218+0000 7f66937fe700 1 -- 172.21.15.146:0/706156977 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f668c00bbd0 con 0x7f6694071e30 2023-05-24T03:29:40.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.218+0000 7f66937fe700 1 -- 172.21.15.146:0/706156977 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c012430 con 0x7f6694071e30 2023-05-24T03:29:40.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.218+0000 7f669af0b700 1 -- 172.21.15.146:0/706156977 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6694071e30 msgr2=0x7f6694165550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:40.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.218+0000 7f669af0b700 1 --2- 172.21.15.146:0/706156977 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6694071e30 0x7f6694165550 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f668c009d90 tx=0x7f668c00b330 comp rx=0 tx=0).stop 2023-05-24T03:29:40.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.219+0000 7f669af0b700 1 -- 172.21.15.146:0/706156977 shutdown_connections 2023-05-24T03:29:40.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.219+0000 7f669af0b700 1 --2- 172.21.15.146:0/706156977 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6694071e30 0x7f6694165550 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:40.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.219+0000 7f669af0b700 1 -- 172.21.15.146:0/706156977 >> 172.21.15.146:0/706156977 conn(0x7f66940cfea0 msgr2=0x7f66940d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:40.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.219+0000 7f669af0b700 1 -- 172.21.15.146:0/706156977 shutdown_connections 2023-05-24T03:29:40.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.219+0000 7f669af0b700 1 -- 172.21.15.146:0/706156977 wait complete. 2023-05-24T03:29:40.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.220+0000 7f669af0b700 1 Processor -- start 2023-05-24T03:29:40.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.220+0000 7f669af0b700 1 -- start start 2023-05-24T03:29:40.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.221+0000 7f669af0b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6694071e30 0x7f6694152360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:40.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.221+0000 7f669af0b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66940cc500 0x7f66940ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:40.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.221+0000 7f669af0b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f669415a9c0 0x7f66940cd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:40.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.221+0000 7f669af0b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66940b1380 con 0x7f66940cc500 2023-05-24T03:29:40.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.221+0000 7f669af0b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66940cea20 con 0x7f6694071e30 2023-05-24T03:29:40.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.221+0000 7f669af0b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66940b0d00 con 0x7f669415a9c0 2023-05-24T03:29:40.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.221+0000 7f6693fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66940cc500 0x7f66940ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:40.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.221+0000 7f6693fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66940cc500 0x7f66940ac8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38524/0 (socket says 172.21.15.146:38524) 2023-05-24T03:29:40.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.221+0000 7f6693fff700 1 -- 172.21.15.146:0/466684734 learned_addr learned my addr 172.21.15.146:0/466684734 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:40.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.221+0000 7f6698ca7700 1 --2- 172.21.15.146:0/466684734 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6694071e30 0x7f6694152360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:40.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.221+0000 7f66994a8700 1 --2- 172.21.15.146:0/466684734 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f669415a9c0 0x7f66940cd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:40.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.221+0000 7f6693fff700 1 -- 172.21.15.146:0/466684734 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f669415a9c0 msgr2=0x7f66940cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:40.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.221+0000 7f6693fff700 1 --2- 172.21.15.146:0/466684734 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f669415a9c0 0x7f66940cd9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:40.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.221+0000 7f6693fff700 1 -- 172.21.15.146:0/466684734 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6694071e30 msgr2=0x7f6694152360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:40.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.221+0000 7f6693fff700 1 --2- 172.21.15.146:0/466684734 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6694071e30 0x7f6694152360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:40.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.221+0000 7f6693fff700 1 -- 172.21.15.146:0/466684734 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f668c009a70 con 0x7f66940cc500 2023-05-24T03:29:40.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.221+0000 7f6693fff700 1 --2- 172.21.15.146:0/466684734 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66940cc500 0x7f66940ac8b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f668000c4b0 tx=0x7f668000c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:40.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.221+0000 7f66917fa700 1 -- 172.21.15.146:0/466684734 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66800052d0 con 0x7f66940cc500 2023-05-24T03:29:40.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.221+0000 7f66917fa700 1 -- 172.21.15.146:0/466684734 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6680005430 con 0x7f66940cc500 2023-05-24T03:29:40.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.221+0000 7f669af0b700 1 -- 172.21.15.146:0/466684734 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66940b5da0 con 0x7f66940cc500 2023-05-24T03:29:40.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.221+0000 7f66917fa700 1 -- 172.21.15.146:0/466684734 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66800038c0 con 0x7f66940cc500 2023-05-24T03:29:40.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.221+0000 7f669af0b700 1 -- 172.21.15.146:0/466684734 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f669415ad90 con 0x7f66940cc500 2023-05-24T03:29:40.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.222+0000 7f669af0b700 1 -- 172.21.15.146:0/466684734 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66940b14c0 con 0x7f66940cc500 2023-05-24T03:29:40.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.223+0000 7f66917fa700 1 -- 172.21.15.146:0/466684734 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6680003a20 con 0x7f66940cc500 2023-05-24T03:29:40.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.223+0000 7f66917fa700 1 --2- 172.21.15.146:0/466684734 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f667806ace0 0x7f667806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:40.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.223+0000 7f6698ca7700 1 --2- 172.21.15.146:0/466684734 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f667806ace0 0x7f667806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:40.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.223+0000 7f66917fa700 1 -- 172.21.15.146:0/466684734 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6680088580 con 0x7f66940cc500 2023-05-24T03:29:40.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.223+0000 7f6698ca7700 1 --2- 172.21.15.146:0/466684734 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f667806ace0 0x7f667806d190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6688000f60 tx=0x7f6688007d90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:40.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.227+0000 7f66917fa700 1 -- 172.21.15.146:0/466684734 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f66940b14c0 con 0x7f66940cc500 2023-05-24T03:29:40.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.455+0000 7f669af0b700 1 -- 172.21.15.146:0/466684734 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f66940b14c0 con 0x7f66940cc500 2023-05-24T03:29:40.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.456+0000 7f66917fa700 1 -- 172.21.15.146:0/466684734 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3706 (secure 0 0 0) 0x7f66940b14c0 con 0x7f66940cc500 2023-05-24T03:29:40.461 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:29:40.461 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1500590330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1500590330},{"type":"v1","addr":"172.21.15.151:6835","nonce":1500590330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/3574684057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3574684057},{"type":"v1","addr":"172.21.15.146:6837","nonce":3574684057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/3420469594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3420469594},{"type":"v1","addr":"172.21.15.151:6833","nonce":3420469594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/4012487240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":4012487240},{"type":"v1","addr":"172.21.15.146:6836","nonce":4012487240}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-05-24T03:29:40.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.458+0000 7f669af0b700 1 -- 172.21.15.146:0/466684734 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f667806ace0 msgr2=0x7f667806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:40.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.458+0000 7f669af0b700 1 --2- 172.21.15.146:0/466684734 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f667806ace0 0x7f667806d190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6688000f60 tx=0x7f6688007d90 comp rx=0 tx=0).stop 2023-05-24T03:29:40.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.458+0000 7f669af0b700 1 -- 172.21.15.146:0/466684734 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66940cc500 msgr2=0x7f66940ac8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:40.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.458+0000 7f669af0b700 1 --2- 172.21.15.146:0/466684734 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66940cc500 0x7f66940ac8b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f668000c4b0 tx=0x7f668000c870 comp rx=0 tx=0).stop 2023-05-24T03:29:40.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.458+0000 7f669af0b700 1 -- 172.21.15.146:0/466684734 shutdown_connections 2023-05-24T03:29:40.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.458+0000 7f669af0b700 1 --2- 172.21.15.146:0/466684734 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f667806ace0 0x7f667806d190 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:40.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.458+0000 7f669af0b700 1 --2- 172.21.15.146:0/466684734 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f669415a9c0 0x7f66940cd9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:40.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.458+0000 7f669af0b700 1 --2- 172.21.15.146:0/466684734 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6694071e30 0x7f6694152360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:40.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.458+0000 7f669af0b700 1 --2- 172.21.15.146:0/466684734 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66940cc500 0x7f66940ac8b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:40.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.458+0000 7f669af0b700 1 -- 172.21.15.146:0/466684734 >> 172.21.15.146:0/466684734 conn(0x7f66940cfea0 msgr2=0x7f6694157bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:40.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.458+0000 7f669af0b700 1 -- 172.21.15.146:0/466684734 shutdown_connections 2023-05-24T03:29:40.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.458+0000 7f669af0b700 1 -- 172.21.15.146:0/466684734 wait complete. 2023-05-24T03:29:40.464 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 3 2023-05-24T03:29:40.474 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-24T03:29:40.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.591+0000 7efcad7b5700 1 Processor -- start 2023-05-24T03:29:40.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.591+0000 7efcad7b5700 1 -- start start 2023-05-24T03:29:40.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.592+0000 7efcad7b5700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7efca80b0ac0 0x7efca80ce490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:40.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.592+0000 7efcad7b5700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efca80cca60 0x7efca8159cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:40.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.592+0000 7efcad7b5700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efca806bf00 con 0x7efca80b0e90 2023-05-24T03:29:40.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.592+0000 7efcad7b5700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efca80c9430 con 0x7efca80b0ac0 2023-05-24T03:29:40.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.592+0000 7efcad7b5700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca80c9710 con 0x7efca80cca60 2023-05-24T03:29:40.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.592+0000 7efca67fc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7efca80b0e90 0x7efca815d410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44982/0 (socket says 172.21.15.146:44982) 2023-05-24T03:29:40.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.592+0000 7efca67fc700 1 -- 172.21.15.146:0/767047919 learned_addr learned my addr 172.21.15.146:0/767047919 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:29:40.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.592+0000 7efca5ffb700 1 -- 172.21.15.146:0/767047919 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 179563783 0 0) 0x7efca806bf00 con 0x7efca80b0e90 2023-05-24T03:29:40.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.592+0000 7efca6ffd700 1 --2- 172.21.15.146:0/767047919 >> v2:172.21.15.151:3300/0 conn(0x7efca80b0ac0 0x7efca80ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:40.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.592+0000 7efca77fe700 1 --2- 172.21.15.146:0/767047919 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efca80cca60 0x7efca8159cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:40.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.592+0000 7efca5ffb700 1 -- 172.21.15.146:0/767047919 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc900035b0 con 0x7efca80b0e90 2023-05-24T03:29:40.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.592+0000 7efca5ffb700 1 -- 172.21.15.146:0/767047919 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 220664409 0 0) 0x7efc900035b0 con 0x7efca80b0e90 2023-05-24T03:29:40.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.592+0000 7efca5ffb700 1 -- 172.21.15.146:0/767047919 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efca80cca60 msgr2=0x7efca8159cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:40.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.592+0000 7efca5ffb700 1 --2- 172.21.15.146:0/767047919 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efca80cca60 0x7efca8159cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:40.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.592+0000 7efca5ffb700 1 -- 172.21.15.146:0/767047919 >> v2:172.21.15.151:3300/0 conn(0x7efca80b0ac0 msgr2=0x7efca80ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:40.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.592+0000 7efca5ffb700 1 --2- 172.21.15.146:0/767047919 >> v2:172.21.15.151:3300/0 conn(0x7efca80b0ac0 0x7efca80ce490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:40.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.592+0000 7efca5ffb700 1 -- 172.21.15.146:0/767047919 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca80c99f0 con 0x7efca80b0e90 2023-05-24T03:29:40.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.592+0000 7efca5ffb700 1 -- 172.21.15.146:0/767047919 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1301887351 0 0) 0x7efc98001670 con 0x7efca80b0e90 2023-05-24T03:29:40.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.592+0000 7efca77fe700 1 --2- 172.21.15.146:0/767047919 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efca80cca60 0x7efca8159cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:29:40.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.592+0000 7efca5ffb700 1 -- 172.21.15.146:0/767047919 >> v1:172.21.15.146:6789/0 conn(0x7efca80b0e90 legacy=0x7efca815d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:40.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.592+0000 7efca5ffb700 1 --2- 172.21.15.146:0/767047919 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efc90003a00 0x7efc90003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:40.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.592+0000 7efca5ffb700 1 --2- 172.21.15.146:0/767047919 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efca80cca60 0x7efc90004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:40.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.592+0000 7efca5ffb700 1 --2- 172.21.15.146:0/767047919 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc90004d90 0x7efc90005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:40.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.592+0000 7efca5ffb700 1 -- 172.21.15.146:0/767047919 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca80c9430 con 0x7efc90004d90 2023-05-24T03:29:40.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.592+0000 7efca5ffb700 1 -- 172.21.15.146:0/767047919 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca80c9710 con 0x7efc90003a00 2023-05-24T03:29:40.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.592+0000 7efca5ffb700 1 -- 172.21.15.146:0/767047919 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc9000ba10 con 0x7efca80cca60 2023-05-24T03:29:40.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.593+0000 7efca77fe700 1 --2- 172.21.15.146:0/767047919 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc90004d90 0x7efc90005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:40.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.593+0000 7efca67fc700 1 --2- 172.21.15.146:0/767047919 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efca80cca60 0x7efc90004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:40.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.593+0000 7efca6ffd700 1 --2- 172.21.15.146:0/767047919 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efc90003a00 0x7efc90003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:40.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.593+0000 7efca77fe700 1 -- 172.21.15.146:0/767047919 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efca80cca60 msgr2=0x7efc90004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:40.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.593+0000 7efca77fe700 1 --2- 172.21.15.146:0/767047919 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efca80cca60 0x7efc90004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:40.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.593+0000 7efca77fe700 1 -- 172.21.15.146:0/767047919 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efc90003a00 msgr2=0x7efc90003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:40.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.593+0000 7efca77fe700 1 --2- 172.21.15.146:0/767047919 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efc90003a00 0x7efc90003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:40.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.593+0000 7efca77fe700 1 -- 172.21.15.146:0/767047919 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc900035b0 con 0x7efc90004d90 2023-05-24T03:29:40.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.593+0000 7efca77fe700 1 --2- 172.21.15.146:0/767047919 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc90004d90 0x7efc90005200 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7efca0009c40 tx=0x7efc90005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7114e43c61034a1 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:40.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.593+0000 7efca5ffb700 1 -- 172.21.15.146:0/767047919 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca0007e40 con 0x7efc90004d90 2023-05-24T03:29:40.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.593+0000 7efca5ffb700 1 -- 172.21.15.146:0/767047919 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efca0013470 con 0x7efc90004d90 2023-05-24T03:29:40.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.593+0000 7efca5ffb700 1 -- 172.21.15.146:0/767047919 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca0013800 con 0x7efc90004d90 2023-05-24T03:29:40.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.593+0000 7efcad7b5700 1 -- 172.21.15.146:0/767047919 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc90004d90 msgr2=0x7efc90005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:40.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.593+0000 7efcad7b5700 1 --2- 172.21.15.146:0/767047919 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc90004d90 0x7efc90005200 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7efca0009c40 tx=0x7efc90005880 comp rx=0 tx=0).stop 2023-05-24T03:29:40.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.593+0000 7efca77fe700 1 -- 172.21.15.146:0/767047919 reap_dead start 2023-05-24T03:29:40.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.594+0000 7efcad7b5700 1 -- 172.21.15.146:0/767047919 shutdown_connections 2023-05-24T03:29:40.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.594+0000 7efcad7b5700 1 -- 172.21.15.146:0/767047919 >> 172.21.15.146:0/767047919 conn(0x7efca806b0b0 msgr2=0x7efca80cedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:40.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.594+0000 7efcad7b5700 1 -- 172.21.15.146:0/767047919 shutdown_connections 2023-05-24T03:29:40.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.594+0000 7efcad7b5700 1 -- 172.21.15.146:0/767047919 wait complete. 2023-05-24T03:29:40.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.595+0000 7efcad7b5700 1 Processor -- start 2023-05-24T03:29:40.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.595+0000 7efcad7b5700 1 -- start start 2023-05-24T03:29:40.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.596+0000 7efcad7b5700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efca80708b0 0x7efca80c8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:40.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.596+0000 7efcad7b5700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efca8070c80 0x7efca81f2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:40.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.596+0000 7efcad7b5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efca81f5ef0 0x7efca814f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:40.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.596+0000 7efcad7b5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca81f2990 con 0x7efca81f5ef0 2023-05-24T03:29:40.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.596+0000 7efcad7b5700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca81f2c70 con 0x7efca80708b0 2023-05-24T03:29:40.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.596+0000 7efcad7b5700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca81f2f50 con 0x7efca8070c80 2023-05-24T03:29:40.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.596+0000 7efca77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efca81f5ef0 0x7efca814f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:40.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.596+0000 7efca77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efca81f5ef0 0x7efca814f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38544/0 (socket says 172.21.15.146:38544) 2023-05-24T03:29:40.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.596+0000 7efca77fe700 1 -- 172.21.15.146:0/947883855 learned_addr learned my addr 172.21.15.146:0/947883855 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:40.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.596+0000 7efca6ffd700 1 --2- 172.21.15.146:0/947883855 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efca80708b0 0x7efca80c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:40.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.596+0000 7efca67fc700 1 --2- 172.21.15.146:0/947883855 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efca8070c80 0x7efca81f2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:40.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.596+0000 7efca77fe700 1 -- 172.21.15.146:0/947883855 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efca8070c80 msgr2=0x7efca81f2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:40.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.596+0000 7efca77fe700 1 --2- 172.21.15.146:0/947883855 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efca8070c80 0x7efca81f2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:40.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.596+0000 7efca77fe700 1 -- 172.21.15.146:0/947883855 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efca80708b0 msgr2=0x7efca80c8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:40.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.596+0000 7efca77fe700 1 --2- 172.21.15.146:0/947883855 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efca80708b0 0x7efca80c8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:40.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.596+0000 7efca77fe700 1 -- 172.21.15.146:0/947883855 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca80cce60 con 0x7efca81f5ef0 2023-05-24T03:29:40.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.596+0000 7efca77fe700 1 --2- 172.21.15.146:0/947883855 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efca81f5ef0 0x7efca814f2a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efca0002230 tx=0x7efca0004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:40.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.596+0000 7efc8f7fe700 1 -- 172.21.15.146:0/947883855 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca0007000 con 0x7efca81f5ef0 2023-05-24T03:29:40.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.596+0000 7efc8f7fe700 1 -- 172.21.15.146:0/947883855 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efca0003c20 con 0x7efca81f5ef0 2023-05-24T03:29:40.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.596+0000 7efc8f7fe700 1 -- 172.21.15.146:0/947883855 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca0009470 con 0x7efca81f5ef0 2023-05-24T03:29:40.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.596+0000 7efcad7b5700 1 -- 172.21.15.146:0/947883855 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efca80cea70 con 0x7efca81f5ef0 2023-05-24T03:29:40.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.596+0000 7efcad7b5700 1 -- 172.21.15.146:0/947883855 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efca80ccff0 con 0x7efca81f5ef0 2023-05-24T03:29:40.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.597+0000 7efcad7b5700 1 -- 172.21.15.146:0/947883855 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efca804e810 con 0x7efca81f5ef0 2023-05-24T03:29:40.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.598+0000 7efc8f7fe700 1 -- 172.21.15.146:0/947883855 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efca0004030 con 0x7efca81f5ef0 2023-05-24T03:29:40.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.598+0000 7efc8f7fe700 1 --2- 172.21.15.146:0/947883855 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7efc9406ace0 0x7efc9406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:40.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.598+0000 7efc8f7fe700 1 -- 172.21.15.146:0/947883855 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7efca008a450 con 0x7efca81f5ef0 2023-05-24T03:29:40.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.598+0000 7efca6ffd700 1 --2- 172.21.15.146:0/947883855 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7efc9406ace0 0x7efc9406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:40.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.598+0000 7efca6ffd700 1 --2- 172.21.15.146:0/947883855 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7efc9406ace0 0x7efc9406d190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7efc9c007fd0 tx=0x7efc9c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:40.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.602+0000 7efc8f7fe700 1 -- 172.21.15.146:0/947883855 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7efca0055a00 con 0x7efca81f5ef0 2023-05-24T03:29:40.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.790+0000 7efcad7b5700 1 -- 172.21.15.146:0/947883855 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efca80b4d50 con 0x7efca81f5ef0 2023-05-24T03:29:40.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.791+0000 7efc8f7fe700 1 -- 172.21.15.146:0/947883855 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+14672 (secure 0 0 0) 0x7efca0059020 con 0x7efca81f5ef0 2023-05-24T03:29:40.796 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:29:40.796 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":20,"fsid":"11ca0adb-7672-4713-bde7-451e8b743ae9","created":"2023-05-24T03:29:19.113659+0000","modified":"2023-05-24T03:29:40.038595+0000","last_up_change":"2023-05-24T03:29:30.962339+0000","last_in_change":"2023-05-24T03:29:21.706540+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-24T03:29:32.749984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-24T03:29:37.719623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f24b319b-fcc8-4385-b0cb-78138fc31417","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6801","nonce":3353593100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6803","nonce":3353593100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6807","nonce":3353593100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6805","nonce":3353593100}]},"public_addr":"172.21.15.146:6801/3353593100","cluster_addr":"172.21.15.146:6803/3353593100","heartbeat_back_addr":"172.21.15.146:6807/3353593100","heartbeat_front_addr":"172.21.15.146:6805/3353593100","state":["exists","up"]},{"osd":1,"uuid":"c9639ea9-8f9b-498e-92c8-aa976edbf1da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6821","nonce":2537488734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6825","nonce":2537488734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6831","nonce":2537488734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6827","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6829","nonce":2537488734}]},"public_addr":"172.21.15.146:6821/2537488734","cluster_addr":"172.21.15.146:6825/2537488734","heartbeat_back_addr":"172.21.15.146:6831/2537488734","heartbeat_front_addr":"172.21.15.146:6829/2537488734","state":["exists","up"]},{"osd":2,"uuid":"7a6cfc6d-b0ca-4cb6-a66d-4001ec184657","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6809","nonce":1800242932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6811","nonce":1800242932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6815","nonce":1800242932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6813","nonce":1800242932}]},"public_addr":"172.21.15.146:6809/1800242932","cluster_addr":"172.21.15.146:6811/1800242932","heartbeat_back_addr":"172.21.15.146:6815/1800242932","heartbeat_front_addr":"172.21.15.146:6813/1800242932","state":["exists","up"]},{"osd":3,"uuid":"401509f7-cecd-44a2-b0ae-22c81a5d93c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6817","nonce":1749783580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6820","nonce":1749783580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6828","nonce":1749783580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6824","nonce":1749783580}]},"public_addr":"172.21.15.146:6817/1749783580","cluster_addr":"172.21.15.146:6820/1749783580","heartbeat_back_addr":"172.21.15.146:6828/1749783580","heartbeat_front_addr":"172.21.15.146:6824/1749783580","state":["exists","up"]},{"osd":4,"uuid":"9d07f440-d125-4f99-a825-411fab894d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6811","nonce":163453435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6814","nonce":163453435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6819","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6821","nonce":163453435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6818","nonce":163453435}]},"public_addr":"172.21.15.151:6811/163453435","cluster_addr":"172.21.15.151:6814/163453435","heartbeat_back_addr":"172.21.15.151:6821/163453435","heartbeat_front_addr":"172.21.15.151:6818/163453435","state":["exists","up"]},{"osd":5,"uuid":"9b2266e2-9e52-4f0e-96da-e703a6c23a6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6801","nonce":3283474903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6803","nonce":3283474903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6807","nonce":3283474903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6805","nonce":3283474903}]},"public_addr":"172.21.15.151:6801/3283474903","cluster_addr":"172.21.15.151:6803/3283474903","heartbeat_back_addr":"172.21.15.151:6807/3283474903","heartbeat_front_addr":"172.21.15.151:6805/3283474903","state":["exists","up"]},{"osd":6,"uuid":"5daedf77-0a83-49e7-b497-d9ed10436972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6825","nonce":3889424178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6827","nonce":3889424178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6831","nonce":3889424178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6829","nonce":3889424178}]},"public_addr":"172.21.15.151:6825/3889424178","cluster_addr":"172.21.15.151:6827/3889424178","heartbeat_back_addr":"172.21.15.151:6831/3889424178","heartbeat_front_addr":"172.21.15.151:6829/3889424178","state":["exists","up"]},{"osd":7,"uuid":"86ae4f7e-c01f-4c3d-a0dd-98160c209309","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6810","nonce":563291208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6815","nonce":563291208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6823","nonce":563291208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6820","nonce":563291208}]},"public_addr":"172.21.15.151:6810/563291208","cluster_addr":"172.21.15.151:6815/563291208","heartbeat_back_addr":"172.21.15.151:6823/563291208","heartbeat_front_addr":"172.21.15.151:6820/563291208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.872472+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.937126+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.877234+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.884793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.881632+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.938293+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.857661+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.945883+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-24T03:29:40.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.793+0000 7efcad7b5700 1 -- 172.21.15.146:0/947883855 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7efc9406ace0 msgr2=0x7efc9406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:40.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.793+0000 7efcad7b5700 1 --2- 172.21.15.146:0/947883855 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7efc9406ace0 0x7efc9406d190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7efc9c007fd0 tx=0x7efc9c009040 comp rx=0 tx=0).stop 2023-05-24T03:29:40.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.793+0000 7efcad7b5700 1 -- 172.21.15.146:0/947883855 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efca81f5ef0 msgr2=0x7efca814f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:40.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.793+0000 7efcad7b5700 1 --2- 172.21.15.146:0/947883855 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efca81f5ef0 0x7efca814f2a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efca0002230 tx=0x7efca0004b40 comp rx=0 tx=0).stop 2023-05-24T03:29:40.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.793+0000 7efcad7b5700 1 -- 172.21.15.146:0/947883855 shutdown_connections 2023-05-24T03:29:40.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.793+0000 7efcad7b5700 1 --2- 172.21.15.146:0/947883855 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7efc9406ace0 0x7efc9406d190 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:40.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.793+0000 7efcad7b5700 1 --2- 172.21.15.146:0/947883855 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efca81f5ef0 0x7efca814f2a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:40.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.793+0000 7efcad7b5700 1 --2- 172.21.15.146:0/947883855 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efca80708b0 0x7efca80c8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:40.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.793+0000 7efcad7b5700 1 --2- 172.21.15.146:0/947883855 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efca8070c80 0x7efca81f2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:40.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.793+0000 7efcad7b5700 1 -- 172.21.15.146:0/947883855 >> 172.21.15.146:0/947883855 conn(0x7efca806b0b0 msgr2=0x7efca80ae730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:40.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.793+0000 7efcad7b5700 1 -- 172.21.15.146:0/947883855 shutdown_connections 2023-05-24T03:29:40.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.793+0000 7efcad7b5700 1 -- 172.21.15.146:0/947883855 wait complete. 2023-05-24T03:29:40.810 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-24T03:29:32.749984+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-24T03:29:37.719623+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-24T03:29:40.811 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-24T03:29:40.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.929+0000 7f201e647700 1 Processor -- start 2023-05-24T03:29:40.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.929+0000 7f201e647700 1 -- start start 2023-05-24T03:29:40.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.929+0000 7f201e647700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f20180b1920 0x7f20180b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:40.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.929+0000 7f201e647700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f20180c3960 0x7f20180c3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:40.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.929+0000 7f201e647700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20180c4320 con 0x7f20180cc0b0 2023-05-24T03:29:40.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.929+0000 7f201e647700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f201806d7a0 con 0x7f20180c3960 2023-05-24T03:29:40.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.929+0000 7f201e647700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f201806d190 con 0x7f20180b1920 2023-05-24T03:29:40.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.930+0000 7f201cbe4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f20180c3960 0x7f20180c3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:40.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.930+0000 7f20177fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f20180cc0b0 0x7f201806dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45002/0 (socket says 172.21.15.146:45002) 2023-05-24T03:29:40.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.930+0000 7f20177fe700 1 -- 172.21.15.146:0/4284312406 learned_addr learned my addr 172.21.15.146:0/4284312406 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:29:40.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.930+0000 7f2017fff700 1 --2- 172.21.15.146:0/4284312406 >> v2:172.21.15.151:3300/0 conn(0x7f20180b1920 0x7f20180b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:40.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.930+0000 7f2016ffd700 1 -- 172.21.15.146:0/4284312406 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3042833716 0 0) 0x7f200c001110 con 0x7f20180cc0b0 2023-05-24T03:29:40.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.930+0000 7f2016ffd700 1 -- 172.21.15.146:0/4284312406 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20000035b0 con 0x7f20180cc0b0 2023-05-24T03:29:40.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.930+0000 7f201cbe4700 1 -- 172.21.15.146:0/4284312406 >> v2:172.21.15.151:3300/0 conn(0x7f20180b1920 msgr2=0x7f20180b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:40.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.930+0000 7f201cbe4700 1 --2- 172.21.15.146:0/4284312406 >> v2:172.21.15.151:3300/0 conn(0x7f20180b1920 0x7f20180b1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:40.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.930+0000 7f201cbe4700 1 -- 172.21.15.146:0/4284312406 >> v1:172.21.15.146:6789/0 conn(0x7f20180cc0b0 legacy=0x7f201806dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:40.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.930+0000 7f201cbe4700 1 -- 172.21.15.146:0/4284312406 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20180b2230 con 0x7f20180c3960 2023-05-24T03:29:40.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.930+0000 7f201cbe4700 1 --2- 172.21.15.146:0/4284312406 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20180c3960 0x7f20180c3de0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f20180cfe00 tx=0x7f201000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aee2eea4adbfcf9 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:40.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.930+0000 7f2016ffd700 1 -- 172.21.15.146:0/4284312406 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201000e070 con 0x7f20180c3960 2023-05-24T03:29:40.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.930+0000 7f2016ffd700 1 -- 172.21.15.146:0/4284312406 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f201000bb20 con 0x7f20180c3960 2023-05-24T03:29:40.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.930+0000 7f2016ffd700 1 -- 172.21.15.146:0/4284312406 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2010012430 con 0x7f20180c3960 2023-05-24T03:29:40.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.931+0000 7f201e647700 1 -- 172.21.15.146:0/4284312406 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20180c3960 msgr2=0x7f20180c3de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:40.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.931+0000 7f201e647700 1 --2- 172.21.15.146:0/4284312406 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20180c3960 0x7f20180c3de0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f20180cfe00 tx=0x7f201000b330 comp rx=0 tx=0).stop 2023-05-24T03:29:40.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.931+0000 7f201e647700 1 -- 172.21.15.146:0/4284312406 shutdown_connections 2023-05-24T03:29:40.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.931+0000 7f201e647700 1 --2- 172.21.15.146:0/4284312406 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20180c3960 0x7f20180c3de0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:40.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.931+0000 7f201e647700 1 --2- 172.21.15.146:0/4284312406 >> v2:172.21.15.151:3300/0 conn(0x7f20180b1920 0x7f20180b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:40.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.931+0000 7f201e647700 1 -- 172.21.15.146:0/4284312406 >> 172.21.15.146:0/4284312406 conn(0x7f20180cfea0 msgr2=0x7f20180d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:40.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.931+0000 7f201e647700 1 -- 172.21.15.146:0/4284312406 shutdown_connections 2023-05-24T03:29:40.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.931+0000 7f201e647700 1 -- 172.21.15.146:0/4284312406 wait complete. 2023-05-24T03:29:40.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.932+0000 7f201e647700 1 Processor -- start 2023-05-24T03:29:40.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.932+0000 7f201e647700 1 -- start start 2023-05-24T03:29:40.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.933+0000 7f201e647700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20180b1920 0x7f20180c99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:40.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.933+0000 7f201e647700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20180c3960 0x7f20180c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:40.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.933+0000 7f201e647700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20180cc0b0 0x7f20181551f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:40.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.933+0000 7f201e647700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20181f3bf0 con 0x7f20180b1920 2023-05-24T03:29:40.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.933+0000 7f201e647700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20181f4730 con 0x7f20180cc0b0 2023-05-24T03:29:40.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.933+0000 7f201e647700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20181f0680 con 0x7f20180c3960 2023-05-24T03:29:40.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.933+0000 7f2017fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20180b1920 0x7f20180c99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:40.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.933+0000 7f2017fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20180b1920 0x7f20180c99c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38554/0 (socket says 172.21.15.146:38554) 2023-05-24T03:29:40.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.933+0000 7f2017fff700 1 -- 172.21.15.146:0/1305991040 learned_addr learned my addr 172.21.15.146:0/1305991040 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:40.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.933+0000 7f2017fff700 1 -- 172.21.15.146:0/1305991040 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20180c3960 msgr2=0x7f20180c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:40.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.933+0000 7f2017fff700 1 --2- 172.21.15.146:0/1305991040 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20180c3960 0x7f20180c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:40.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.933+0000 7f2017fff700 1 -- 172.21.15.146:0/1305991040 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20180cc0b0 msgr2=0x7f20181551f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:40.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.933+0000 7f2017fff700 1 --2- 172.21.15.146:0/1305991040 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20180cc0b0 0x7f20181551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:40.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.933+0000 7f2017fff700 1 -- 172.21.15.146:0/1305991040 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2010009a70 con 0x7f20180b1920 2023-05-24T03:29:40.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.933+0000 7f2017fff700 1 --2- 172.21.15.146:0/1305991040 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20180b1920 0x7f20180c99c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f200800e870 tx=0x7f200800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:40.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.933+0000 7f2014ff9700 1 -- 172.21.15.146:0/1305991040 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200800ee70 con 0x7f20180b1920 2023-05-24T03:29:40.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.934+0000 7f2014ff9700 1 -- 172.21.15.146:0/1305991040 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f200800c850 con 0x7f20180b1920 2023-05-24T03:29:40.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.934+0000 7f2014ff9700 1 -- 172.21.15.146:0/1305991040 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200800cbc0 con 0x7f20180b1920 2023-05-24T03:29:40.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.934+0000 7f201e647700 1 -- 172.21.15.146:0/1305991040 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f201806d430 con 0x7f20180b1920 2023-05-24T03:29:40.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.934+0000 7f201e647700 1 -- 172.21.15.146:0/1305991040 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2018071de0 con 0x7f20180b1920 2023-05-24T03:29:40.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.934+0000 7f201e647700 1 -- 172.21.15.146:0/1305991040 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f201806e340 con 0x7f20180b1920 2023-05-24T03:29:40.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.935+0000 7f2014ff9700 1 -- 172.21.15.146:0/1305991040 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f200800cd20 con 0x7f20180b1920 2023-05-24T03:29:40.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.935+0000 7f2014ff9700 1 --2- 172.21.15.146:0/1305991040 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f200406ace0 0x7f200406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:40.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.935+0000 7f2014ff9700 1 -- 172.21.15.146:0/1305991040 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f20080890f0 con 0x7f20180b1920 2023-05-24T03:29:40.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.935+0000 7f20177fe700 1 --2- 172.21.15.146:0/1305991040 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f200406ace0 0x7f200406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:40.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.936+0000 7f20177fe700 1 --2- 172.21.15.146:0/1305991040 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f200406ace0 0x7f200406d190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f200c000f60 tx=0x7f200c001190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:40.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:40.939+0000 7f2014ff9700 1 -- 172.21.15.146:0/1305991040 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f2008054580 con 0x7f20180b1920 2023-05-24T03:29:41.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.130+0000 7f201e647700 1 -- 172.21.15.146:0/1305991040 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2018068d00 con 0x7f20180b1920 2023-05-24T03:29:41.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.130+0000 7f2014ff9700 1 -- 172.21.15.146:0/1305991040 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2008057ba0 con 0x7f20180b1920 2023-05-24T03:29:41.135 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2023-05-24T03:29:41.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.132+0000 7f201e647700 1 -- 172.21.15.146:0/1305991040 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f200406ace0 msgr2=0x7f200406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:41.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.132+0000 7f201e647700 1 --2- 172.21.15.146:0/1305991040 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f200406ace0 0x7f200406d190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f200c000f60 tx=0x7f200c001190 comp rx=0 tx=0).stop 2023-05-24T03:29:41.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.132+0000 7f201e647700 1 -- 172.21.15.146:0/1305991040 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20180b1920 msgr2=0x7f20180c99c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:41.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.132+0000 7f201e647700 1 --2- 172.21.15.146:0/1305991040 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20180b1920 0x7f20180c99c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f200800e870 tx=0x7f200800ec30 comp rx=0 tx=0).stop 2023-05-24T03:29:41.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.132+0000 7f201e647700 1 -- 172.21.15.146:0/1305991040 shutdown_connections 2023-05-24T03:29:41.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.132+0000 7f201e647700 1 --2- 172.21.15.146:0/1305991040 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f200406ace0 0x7f200406d190 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:41.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.132+0000 7f201e647700 1 --2- 172.21.15.146:0/1305991040 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20180cc0b0 0x7f20181551f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:41.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.132+0000 7f201e647700 1 --2- 172.21.15.146:0/1305991040 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20180b1920 0x7f20180c99c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:41.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.132+0000 7f201e647700 1 --2- 172.21.15.146:0/1305991040 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20180c3960 0x7f20180c87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:41.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.132+0000 7f201e647700 1 -- 172.21.15.146:0/1305991040 >> 172.21.15.146:0/1305991040 conn(0x7f20180cfea0 msgr2=0x7f201806d930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:41.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.132+0000 7f201e647700 1 -- 172.21.15.146:0/1305991040 shutdown_connections 2023-05-24T03:29:41.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.132+0000 7f201e647700 1 -- 172.21.15.146:0/1305991040 wait complete. 2023-05-24T03:29:41.148 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-24T03:29:41.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.268+0000 7f93d0c3c700 1 Processor -- start 2023-05-24T03:29:41.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.268+0000 7f93d0c3c700 1 -- start start 2023-05-24T03:29:41.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.269+0000 7f93d0c3c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f93cc06a460 0x7f93cc0cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:41.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.269+0000 7f93d0c3c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f93cc0aefd0 0x7f93cc160d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:41.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.269+0000 7f93d0c3c700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93cc0cfd00 con 0x7f93cc15cd90 2023-05-24T03:29:41.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.269+0000 7f93d0c3c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93cc072350 con 0x7f93cc0aefd0 2023-05-24T03:29:41.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.269+0000 7f93d0c3c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93cc0cf460 con 0x7f93cc06a460 2023-05-24T03:29:41.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.269+0000 7f93cad9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f93cc0aefd0 0x7f93cc160d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:41.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.269+0000 7f93cad9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f93cc0aefd0 0x7f93cc160d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38564/0 (socket says 172.21.15.146:38564) 2023-05-24T03:29:41.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.269+0000 7f93cad9d700 1 -- 172.21.15.146:0/1187659111 learned_addr learned my addr 172.21.15.146:0/1187659111 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:41.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.269+0000 7f93ca59c700 1 --2- 172.21.15.146:0/1187659111 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f93cc06a460 0x7f93cc0cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:41.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.269+0000 7f93cad9d700 1 -- 172.21.15.146:0/1187659111 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f93cc06a460 msgr2=0x7f93cc0cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:41.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.269+0000 7f93cad9d700 1 --2- 172.21.15.146:0/1187659111 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f93cc06a460 0x7f93cc0cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:41.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.269+0000 7f93cad9d700 1 -- 172.21.15.146:0/1187659111 >> v1:172.21.15.151:6789/0 conn(0x7f93cc15cd90 legacy=0x7f93cc06a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:41.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.269+0000 7f93cad9d700 1 -- 172.21.15.146:0/1187659111 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93cc0cf740 con 0x7f93cc0aefd0 2023-05-24T03:29:41.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.269+0000 7f93cad9d700 1 --2- 172.21.15.146:0/1187659111 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93cc0aefd0 0x7f93cc160d20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f93c4009e50 tx=0x7f93c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=480344b67d1c4f2 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:41.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.269+0000 7f93c959a700 1 -- 172.21.15.146:0/1187659111 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c400e070 con 0x7f93cc0aefd0 2023-05-24T03:29:41.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.269+0000 7f93c959a700 1 -- 172.21.15.146:0/1187659111 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c400b9c0 con 0x7f93cc0aefd0 2023-05-24T03:29:41.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.269+0000 7f93c959a700 1 -- 172.21.15.146:0/1187659111 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c400bd70 con 0x7f93cc0aefd0 2023-05-24T03:29:41.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.270+0000 7f93d0c3c700 1 -- 172.21.15.146:0/1187659111 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93cc0aefd0 msgr2=0x7f93cc160d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:41.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.270+0000 7f93d0c3c700 1 --2- 172.21.15.146:0/1187659111 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93cc0aefd0 0x7f93cc160d20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f93c4009e50 tx=0x7f93c400b330 comp rx=0 tx=0).stop 2023-05-24T03:29:41.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.270+0000 7f93d0c3c700 1 -- 172.21.15.146:0/1187659111 shutdown_connections 2023-05-24T03:29:41.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.270+0000 7f93d0c3c700 1 --2- 172.21.15.146:0/1187659111 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93cc0aefd0 0x7f93cc160d20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:41.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.270+0000 7f93d0c3c700 1 --2- 172.21.15.146:0/1187659111 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f93cc06a460 0x7f93cc0cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:41.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.270+0000 7f93d0c3c700 1 -- 172.21.15.146:0/1187659111 >> 172.21.15.146:0/1187659111 conn(0x7f93cc0cfea0 msgr2=0x7f93cc0d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:41.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.270+0000 7f93d0c3c700 1 -- 172.21.15.146:0/1187659111 shutdown_connections 2023-05-24T03:29:41.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.270+0000 7f93d0c3c700 1 -- 172.21.15.146:0/1187659111 wait complete. 2023-05-24T03:29:41.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.271+0000 7f93d0c3c700 1 Processor -- start 2023-05-24T03:29:41.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.271+0000 7f93d0c3c700 1 -- start start 2023-05-24T03:29:41.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.272+0000 7f93d0c3c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93cc06a460 0x7f93cc0c5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:41.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.272+0000 7f93d0c3c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f93cc0aefd0 0x7f93cc15f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:41.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.272+0000 7f93d0c3c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93cc15cd90 0x7f93cc0ae030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:41.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.272+0000 7f93d0c3c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93cc15d850 con 0x7f93cc15cd90 2023-05-24T03:29:41.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.272+0000 7f93d0c3c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93cc0c5b90 con 0x7f93cc06a460 2023-05-24T03:29:41.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.272+0000 7f93d0c3c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93cc0c5e60 con 0x7f93cc0aefd0 2023-05-24T03:29:41.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.272+0000 7f93cad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93cc15cd90 0x7f93cc0ae030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:41.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.272+0000 7f93cad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93cc15cd90 0x7f93cc0ae030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38570/0 (socket says 172.21.15.146:38570) 2023-05-24T03:29:41.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.272+0000 7f93cad9d700 1 -- 172.21.15.146:0/3584082589 learned_addr learned my addr 172.21.15.146:0/3584082589 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:41.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.272+0000 7f93c9d9b700 1 --2- 172.21.15.146:0/3584082589 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f93cc0aefd0 0x7f93cc15f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:41.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.272+0000 7f93ca59c700 1 --2- 172.21.15.146:0/3584082589 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93cc06a460 0x7f93cc0c5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:41.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.272+0000 7f93cad9d700 1 -- 172.21.15.146:0/3584082589 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f93cc0aefd0 msgr2=0x7f93cc15f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:41.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.272+0000 7f93cad9d700 1 --2- 172.21.15.146:0/3584082589 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f93cc0aefd0 0x7f93cc15f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:41.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.272+0000 7f93cad9d700 1 -- 172.21.15.146:0/3584082589 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93cc06a460 msgr2=0x7f93cc0c5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:41.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.272+0000 7f93cad9d700 1 --2- 172.21.15.146:0/3584082589 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93cc06a460 0x7f93cc0c5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:41.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.272+0000 7f93cad9d700 1 -- 172.21.15.146:0/3584082589 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c4009b30 con 0x7f93cc15cd90 2023-05-24T03:29:41.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.272+0000 7f93ca59c700 1 --2- 172.21.15.146:0/3584082589 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93cc06a460 0x7f93cc0c5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:29:41.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.272+0000 7f93c9d9b700 1 --2- 172.21.15.146:0/3584082589 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f93cc0aefd0 0x7f93cc15f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:29:41.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.273+0000 7f93cad9d700 1 --2- 172.21.15.146:0/3584082589 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93cc15cd90 0x7f93cc0ae030 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f93cc0b2a90 tx=0x7f93c4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:41.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.273+0000 7f93baffd700 1 -- 172.21.15.146:0/3584082589 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c4004960 con 0x7f93cc15cd90 2023-05-24T03:29:41.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.273+0000 7f93baffd700 1 -- 172.21.15.146:0/3584082589 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c40099b0 con 0x7f93cc15cd90 2023-05-24T03:29:41.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.273+0000 7f93d0c3c700 1 -- 172.21.15.146:0/3584082589 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93cc160800 con 0x7f93cc15cd90 2023-05-24T03:29:41.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.273+0000 7f93baffd700 1 -- 172.21.15.146:0/3584082589 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c401b670 con 0x7f93cc15cd90 2023-05-24T03:29:41.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.273+0000 7f93d0c3c700 1 -- 172.21.15.146:0/3584082589 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93cc0cfa20 con 0x7f93cc15cd90 2023-05-24T03:29:41.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.274+0000 7f93d0c3c700 1 -- 172.21.15.146:0/3584082589 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93cc0af620 con 0x7f93cc15cd90 2023-05-24T03:29:41.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.274+0000 7f93baffd700 1 -- 172.21.15.146:0/3584082589 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f93c401b7d0 con 0x7f93cc15cd90 2023-05-24T03:29:41.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.274+0000 7f93baffd700 1 --2- 172.21.15.146:0/3584082589 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f93ac06ace0 0x7f93ac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:41.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.275+0000 7f93baffd700 1 -- 172.21.15.146:0/3584082589 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f93c408aa40 con 0x7f93cc15cd90 2023-05-24T03:29:41.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.275+0000 7f93ca59c700 1 --2- 172.21.15.146:0/3584082589 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f93ac06ace0 0x7f93ac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:41.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.275+0000 7f93ca59c700 1 --2- 172.21.15.146:0/3584082589 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f93ac06ace0 0x7f93ac06d190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f93bc007a50 tx=0x7f93bc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:41.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.279+0000 7f93baffd700 1 -- 172.21.15.146:0/3584082589 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f93c408ce60 con 0x7f93cc15cd90 2023-05-24T03:29:41.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.466+0000 7f93d0c3c700 1 -- 172.21.15.146:0/3584082589 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f93cc068d00 con 0x7f93cc15cd90 2023-05-24T03:29:41.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.467+0000 7f93baffd700 1 -- 172.21.15.146:0/3584082589 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f93c4055ed0 con 0x7f93cc15cd90 2023-05-24T03:29:41.472 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2023-05-24T03:29:41.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.469+0000 7f93d0c3c700 1 -- 172.21.15.146:0/3584082589 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f93ac06ace0 msgr2=0x7f93ac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:41.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.469+0000 7f93d0c3c700 1 --2- 172.21.15.146:0/3584082589 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f93ac06ace0 0x7f93ac06d190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f93bc007a50 tx=0x7f93bc008040 comp rx=0 tx=0).stop 2023-05-24T03:29:41.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.469+0000 7f93d0c3c700 1 -- 172.21.15.146:0/3584082589 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93cc15cd90 msgr2=0x7f93cc0ae030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:41.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.469+0000 7f93d0c3c700 1 --2- 172.21.15.146:0/3584082589 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93cc15cd90 0x7f93cc0ae030 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f93cc0b2a90 tx=0x7f93c4004ad0 comp rx=0 tx=0).stop 2023-05-24T03:29:41.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.469+0000 7f93d0c3c700 1 -- 172.21.15.146:0/3584082589 shutdown_connections 2023-05-24T03:29:41.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.469+0000 7f93d0c3c700 1 --2- 172.21.15.146:0/3584082589 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f93ac06ace0 0x7f93ac06d190 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:41.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.469+0000 7f93d0c3c700 1 --2- 172.21.15.146:0/3584082589 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93cc15cd90 0x7f93cc0ae030 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:41.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.469+0000 7f93d0c3c700 1 --2- 172.21.15.146:0/3584082589 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93cc06a460 0x7f93cc0c5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:41.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.469+0000 7f93d0c3c700 1 --2- 172.21.15.146:0/3584082589 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f93cc0aefd0 0x7f93cc15f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:41.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.469+0000 7f93d0c3c700 1 -- 172.21.15.146:0/3584082589 >> 172.21.15.146:0/3584082589 conn(0x7f93cc0cfea0 msgr2=0x7f93cc06a830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:41.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.469+0000 7f93d0c3c700 1 -- 172.21.15.146:0/3584082589 shutdown_connections 2023-05-24T03:29:41.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.469+0000 7f93d0c3c700 1 -- 172.21.15.146:0/3584082589 wait complete. 2023-05-24T03:29:41.485 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-05-24T03:29:41.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.601+0000 7f1bcf2da700 1 Processor -- start 2023-05-24T03:29:41.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.601+0000 7f1bcf2da700 1 -- start start 2023-05-24T03:29:41.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.602+0000 7f1bcf2da700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1bc80ce150 0x7f1bc80b2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:41.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.602+0000 7f1bcf2da700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1bc80d0840 0x7f1bc80d0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:41.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.602+0000 7f1bcf2da700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bc80cd110 con 0x7f1bc815cf60 2023-05-24T03:29:41.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.602+0000 7f1bcf2da700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bc80b3240 con 0x7f1bc80ce150 2023-05-24T03:29:41.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.602+0000 7f1bcf2da700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc806d620 con 0x7f1bc80d0840 2023-05-24T03:29:41.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.602+0000 7f1bcd076700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f1bc815cf60 0x7f1bc80cda40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45026/0 (socket says 172.21.15.146:45026) 2023-05-24T03:29:41.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.602+0000 7f1bcd076700 1 -- 172.21.15.146:0/2629069771 learned_addr learned my addr 172.21.15.146:0/2629069771 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:29:41.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.602+0000 7f1bcd877700 1 --2- 172.21.15.146:0/2629069771 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1bc80d0840 0x7f1bc80d0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:41.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.602+0000 7f1bcc875700 1 --2- 172.21.15.146:0/2629069771 >> v2:172.21.15.151:3300/0 conn(0x7f1bc80ce150 0x7f1bc80b2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:41.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.602+0000 7f1bbffff700 1 -- 172.21.15.146:0/2629069771 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 212417571 0 0) 0x7f1bc80cd110 con 0x7f1bc815cf60 2023-05-24T03:29:41.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.602+0000 7f1bbffff700 1 -- 172.21.15.146:0/2629069771 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bb40035b0 con 0x7f1bc815cf60 2023-05-24T03:29:41.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.602+0000 7f1bbffff700 1 -- 172.21.15.146:0/2629069771 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1976465658 0 0) 0x7f1bb40035b0 con 0x7f1bc815cf60 2023-05-24T03:29:41.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.602+0000 7f1bbffff700 1 -- 172.21.15.146:0/2629069771 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1bc80d0840 msgr2=0x7f1bc80d0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:41.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.602+0000 7f1bbffff700 1 --2- 172.21.15.146:0/2629069771 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1bc80d0840 0x7f1bc80d0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:41.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.602+0000 7f1bbffff700 1 -- 172.21.15.146:0/2629069771 >> v2:172.21.15.151:3300/0 conn(0x7f1bc80ce150 msgr2=0x7f1bc80b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:41.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.602+0000 7f1bbffff700 1 --2- 172.21.15.146:0/2629069771 >> v2:172.21.15.151:3300/0 conn(0x7f1bc80ce150 0x7f1bc80b2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:41.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.602+0000 7f1bbffff700 1 -- 172.21.15.146:0/2629069771 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc815d330 con 0x7f1bc815cf60 2023-05-24T03:29:41.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.602+0000 7f1bbffff700 1 -- 172.21.15.146:0/2629069771 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1301887351 0 0) 0x7f1bc4001670 con 0x7f1bc815cf60 2023-05-24T03:29:41.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.602+0000 7f1bbffff700 1 -- 172.21.15.146:0/2629069771 >> v1:172.21.15.146:6789/0 conn(0x7f1bc815cf60 legacy=0x7f1bc80cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:41.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.602+0000 7f1bbffff700 1 --2- 172.21.15.146:0/2629069771 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1bc80d0840 0x7f1bb4003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:41.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.602+0000 7f1bbffff700 1 --2- 172.21.15.146:0/2629069771 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bb4003f80 0x7f1bb4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:41.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.602+0000 7f1bbffff700 1 --2- 172.21.15.146:0/2629069771 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bb4004d90 0x7f1bb4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:41.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.603+0000 7f1bbffff700 1 -- 172.21.15.146:0/2629069771 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc806d620 con 0x7f1bb4003f80 2023-05-24T03:29:41.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.603+0000 7f1bbffff700 1 -- 172.21.15.146:0/2629069771 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb400ba10 con 0x7f1bb4004d90 2023-05-24T03:29:41.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.603+0000 7f1bbffff700 1 -- 172.21.15.146:0/2629069771 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb400bb50 con 0x7f1bc80d0840 2023-05-24T03:29:41.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.603+0000 7f1bcc875700 1 --2- 172.21.15.146:0/2629069771 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bb4003f80 0x7f1bb4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:41.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.603+0000 7f1bcd076700 1 --2- 172.21.15.146:0/2629069771 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1bc80d0840 0x7f1bb4003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:41.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.603+0000 7f1bcd877700 1 --2- 172.21.15.146:0/2629069771 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bb4004d90 0x7f1bb4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:41.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.603+0000 7f1bcc875700 1 -- 172.21.15.146:0/2629069771 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1bc80d0840 msgr2=0x7f1bb4003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:41.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.603+0000 7f1bcc875700 1 --2- 172.21.15.146:0/2629069771 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1bc80d0840 0x7f1bb4003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:41.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.603+0000 7f1bcc875700 1 -- 172.21.15.146:0/2629069771 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bb4004d90 msgr2=0x7f1bb4005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:41.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.603+0000 7f1bcc875700 1 --2- 172.21.15.146:0/2629069771 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bb4004d90 0x7f1bb4005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:41.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.603+0000 7f1bcc875700 1 -- 172.21.15.146:0/2629069771 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bb40035b0 con 0x7f1bb4003f80 2023-05-24T03:29:41.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.603+0000 7f1bcc875700 1 --2- 172.21.15.146:0/2629069771 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bb4003f80 0x7f1bb4004850 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1bc80ce670 tx=0x7f1bb4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=780bc64539dea3f9 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:41.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.603+0000 7f1bbffff700 1 -- 172.21.15.146:0/2629069771 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb800e6c0 con 0x7f1bb4003f80 2023-05-24T03:29:41.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.603+0000 7f1bbffff700 1 -- 172.21.15.146:0/2629069771 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb800e820 con 0x7f1bb4003f80 2023-05-24T03:29:41.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.603+0000 7f1bbffff700 1 -- 172.21.15.146:0/2629069771 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb800eb90 con 0x7f1bb4003f80 2023-05-24T03:29:41.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.604+0000 7f1bcf2da700 1 -- 172.21.15.146:0/2629069771 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bb4003f80 msgr2=0x7f1bb4004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:41.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.604+0000 7f1bcf2da700 1 --2- 172.21.15.146:0/2629069771 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bb4003f80 0x7f1bb4004850 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1bc80ce670 tx=0x7f1bb4005880 comp rx=0 tx=0).stop 2023-05-24T03:29:41.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.604+0000 7f1bcd877700 1 -- 172.21.15.146:0/2629069771 reap_dead start 2023-05-24T03:29:41.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.604+0000 7f1bcf2da700 1 -- 172.21.15.146:0/2629069771 shutdown_connections 2023-05-24T03:29:41.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.604+0000 7f1bcf2da700 1 -- 172.21.15.146:0/2629069771 >> 172.21.15.146:0/2629069771 conn(0x7f1bc806e2a0 msgr2=0x7f1bc806e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:41.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.604+0000 7f1bcf2da700 1 -- 172.21.15.146:0/2629069771 shutdown_connections 2023-05-24T03:29:41.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.604+0000 7f1bcf2da700 1 -- 172.21.15.146:0/2629069771 wait complete. 2023-05-24T03:29:41.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.605+0000 7f1bcf2da700 1 Processor -- start 2023-05-24T03:29:41.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.605+0000 7f1bcf2da700 1 -- start start 2023-05-24T03:29:41.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.606+0000 7f1bcf2da700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bb4003f80 0x7f1bc81f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:41.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.606+0000 7f1bcf2da700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bc81603c0 0x7f1bc80c9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:41.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.606+0000 7f1bcf2da700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1bc80cbc50 0x7f1bc80cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:41.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.606+0000 7f1bcf2da700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc80cc610 con 0x7f1bc81603c0 2023-05-24T03:29:41.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.606+0000 7f1bcf2da700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc81f3370 con 0x7f1bb4003f80 2023-05-24T03:29:41.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.606+0000 7f1bcf2da700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc81f27f0 con 0x7f1bc80cbc50 2023-05-24T03:29:41.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.606+0000 7f1bcc875700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bc81603c0 0x7f1bc80c9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:41.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.606+0000 7f1bcc875700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bc81603c0 0x7f1bc80c9630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38588/0 (socket says 172.21.15.146:38588) 2023-05-24T03:29:41.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.606+0000 7f1bcc875700 1 -- 172.21.15.146:0/1742044574 learned_addr learned my addr 172.21.15.146:0/1742044574 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:41.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.607+0000 7f1bcd877700 1 --2- 172.21.15.146:0/1742044574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1bc80cbc50 0x7f1bc80cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:41.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.607+0000 7f1bcd076700 1 --2- 172.21.15.146:0/1742044574 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bb4003f80 0x7f1bc81f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:41.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.607+0000 7f1bcc875700 1 -- 172.21.15.146:0/1742044574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1bc80cbc50 msgr2=0x7f1bc80cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:41.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.607+0000 7f1bcc875700 1 --2- 172.21.15.146:0/1742044574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1bc80cbc50 0x7f1bc80cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:41.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.607+0000 7f1bcc875700 1 -- 172.21.15.146:0/1742044574 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bb4003f80 msgr2=0x7f1bc81f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:41.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.607+0000 7f1bcc875700 1 --2- 172.21.15.146:0/1742044574 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bb4003f80 0x7f1bc81f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:41.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.607+0000 7f1bcc875700 1 -- 172.21.15.146:0/1742044574 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc806c120 con 0x7f1bc81603c0 2023-05-24T03:29:41.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.607+0000 7f1bcc875700 1 --2- 172.21.15.146:0/1742044574 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bc81603c0 0x7f1bc80c9630 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8000c00 tx=0x7f1bb80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:41.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.607+0000 7f1bbdffb700 1 -- 172.21.15.146:0/1742044574 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb800e6c0 con 0x7f1bc81603c0 2023-05-24T03:29:41.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.607+0000 7f1bbdffb700 1 -- 172.21.15.146:0/1742044574 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb8003ab0 con 0x7f1bc81603c0 2023-05-24T03:29:41.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.607+0000 7f1bcf2da700 1 -- 172.21.15.146:0/1742044574 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bc806d340 con 0x7f1bc81603c0 2023-05-24T03:29:41.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.607+0000 7f1bbdffb700 1 -- 172.21.15.146:0/1742044574 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb8006e60 con 0x7f1bc81603c0 2023-05-24T03:29:41.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.607+0000 7f1bcf2da700 1 -- 172.21.15.146:0/1742044574 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bc806c400 con 0x7f1bc81603c0 2023-05-24T03:29:41.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.608+0000 7f1bcf2da700 1 -- 172.21.15.146:0/1742044574 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bc80ca180 con 0x7f1bc81603c0 2023-05-24T03:29:41.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.608+0000 7f1bbdffb700 1 -- 172.21.15.146:0/1742044574 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1bb8013470 con 0x7f1bc81603c0 2023-05-24T03:29:41.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.609+0000 7f1bbdffb700 1 --2- 172.21.15.146:0/1742044574 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f1bac06ace0 0x7f1bac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:41.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.609+0000 7f1bbdffb700 1 -- 172.21.15.146:0/1742044574 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1bb808abb0 con 0x7f1bc81603c0 2023-05-24T03:29:41.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.609+0000 7f1bcd076700 1 --2- 172.21.15.146:0/1742044574 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f1bac06ace0 0x7f1bac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:41.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.609+0000 7f1bcd076700 1 --2- 172.21.15.146:0/1742044574 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f1bac06ace0 0x7f1bac06d190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4000c00 tx=0x7f1bc4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:41.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.613+0000 7f1bbdffb700 1 -- 172.21.15.146:0/1742044574 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f1bb8056040 con 0x7f1bc81603c0 2023-05-24T03:29:41.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.804+0000 7f1bcf2da700 1 -- 172.21.15.146:0/1742044574 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f1bc80b2b30 con 0x7f1bc81603c0 2023-05-24T03:29:41.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.805+0000 7f1bbdffb700 1 -- 172.21.15.146:0/1742044574 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v20) v1 ==== 84+0+126 (secure 0 0 0) 0x7f1bb8003e60 con 0x7f1bc81603c0 2023-05-24T03:29:41.810 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:29:41.810 INFO:teuthology.orchestra.run.smithi146.stdout:[ 2023-05-24T03:29:41.810 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-05-24T03:29:41.811 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 1, 2023-05-24T03:29:41.811 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": ".mgr" 2023-05-24T03:29:41.811 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-05-24T03:29:41.811 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-05-24T03:29:41.811 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 2, 2023-05-24T03:29:41.811 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": "rbd" 2023-05-24T03:29:41.811 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-05-24T03:29:41.812 INFO:teuthology.orchestra.run.smithi146.stdout:] 2023-05-24T03:29:41.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.807+0000 7f1bcf2da700 1 -- 172.21.15.146:0/1742044574 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f1bac06ace0 msgr2=0x7f1bac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:41.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.807+0000 7f1bcf2da700 1 --2- 172.21.15.146:0/1742044574 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f1bac06ace0 0x7f1bac06d190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4000c00 tx=0x7f1bc4009040 comp rx=0 tx=0).stop 2023-05-24T03:29:41.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.807+0000 7f1bcf2da700 1 -- 172.21.15.146:0/1742044574 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bc81603c0 msgr2=0x7f1bc80c9630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:41.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.807+0000 7f1bcf2da700 1 --2- 172.21.15.146:0/1742044574 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bc81603c0 0x7f1bc80c9630 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8000c00 tx=0x7f1bb80047c0 comp rx=0 tx=0).stop 2023-05-24T03:29:41.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.807+0000 7f1bcf2da700 1 -- 172.21.15.146:0/1742044574 shutdown_connections 2023-05-24T03:29:41.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.807+0000 7f1bcf2da700 1 --2- 172.21.15.146:0/1742044574 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f1bac06ace0 0x7f1bac06d190 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:41.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.807+0000 7f1bcf2da700 1 --2- 172.21.15.146:0/1742044574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1bc80cbc50 0x7f1bc80cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:41.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.807+0000 7f1bcf2da700 1 --2- 172.21.15.146:0/1742044574 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bb4003f80 0x7f1bc81f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:41.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.807+0000 7f1bcf2da700 1 --2- 172.21.15.146:0/1742044574 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bc81603c0 0x7f1bc80c9630 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:41.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.807+0000 7f1bcf2da700 1 -- 172.21.15.146:0/1742044574 >> 172.21.15.146:0/1742044574 conn(0x7f1bc806e2a0 msgr2=0x7f1bc815c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:41.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.807+0000 7f1bcf2da700 1 -- 172.21.15.146:0/1742044574 shutdown_connections 2023-05-24T03:29:41.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.807+0000 7f1bcf2da700 1 -- 172.21.15.146:0/1742044574 wait complete. 2023-05-24T03:29:41.823 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-05-24T03:29:41.823 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-05-24T03:29:41.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.945+0000 7fd1f4558700 1 Processor -- start 2023-05-24T03:29:41.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.945+0000 7fd1f4558700 1 -- start start 2023-05-24T03:29:41.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.946+0000 7fd1f4558700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd1ec0cdf10 0x7fd1ec159c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:41.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.946+0000 7fd1f4558700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd1ec15dcf0 0x7fd1ec0ce2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:41.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.946+0000 7fd1f4558700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1ec0ce820 con 0x7fd1ec070f50 2023-05-24T03:29:41.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.946+0000 7fd1f4558700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1ec15a1c0 con 0x7fd1ec15dcf0 2023-05-24T03:29:41.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.946+0000 7fd1f4558700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1ec15a3c0 con 0x7fd1ec0cdf10 2023-05-24T03:29:41.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.946+0000 7fd1f1af3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd1ec15dcf0 0x7fd1ec0ce2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:41.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.946+0000 7fd1f2af5700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd1ec070f50 0x7fd1ec06d6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45050/0 (socket says 172.21.15.146:45050) 2023-05-24T03:29:41.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.946+0000 7fd1f2af5700 1 -- 172.21.15.146:0/103549661 learned_addr learned my addr 172.21.15.146:0/103549661 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:29:41.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.946+0000 7fd1f1af3700 1 --2- 172.21.15.146:0/103549661 >> v2:172.21.15.146:3300/0 conn(0x7fd1ec15dcf0 0x7fd1ec0ce2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38594/0 (socket says 172.21.15.146:38594) 2023-05-24T03:29:41.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.946+0000 7fd1f22f4700 1 --2- 172.21.15.146:0/103549661 >> v2:172.21.15.151:3300/0 conn(0x7fd1ec0cdf10 0x7fd1ec159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:41.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.946+0000 7fd1f1af3700 1 -- 172.21.15.146:0/103549661 >> v2:172.21.15.151:3300/0 conn(0x7fd1ec0cdf10 msgr2=0x7fd1ec159c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:41.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.946+0000 7fd1f1af3700 1 --2- 172.21.15.146:0/103549661 >> v2:172.21.15.151:3300/0 conn(0x7fd1ec0cdf10 0x7fd1ec159c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:41.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.946+0000 7fd1f1af3700 1 -- 172.21.15.146:0/103549661 >> v1:172.21.15.146:6789/0 conn(0x7fd1ec070f50 legacy=0x7fd1ec06d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:41.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.946+0000 7fd1f1af3700 1 -- 172.21.15.146:0/103549661 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ec15a6a0 con 0x7fd1ec15dcf0 2023-05-24T03:29:41.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.946+0000 7fd1f12f2700 1 -- 172.21.15.146:0/103549661 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2710300441 0 0) 0x7fd1ec0ce820 con 0x7fd1ec070f50 2023-05-24T03:29:41.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.946+0000 7fd1f1af3700 1 --2- 172.21.15.146:0/103549661 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1ec15dcf0 0x7fd1ec0ce2e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec067440 tx=0x7fd1dc009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=537b775ecfc77ab1 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:41.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.946+0000 7fd1f12f2700 1 -- 172.21.15.146:0/103549661 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc011830 con 0x7fd1ec15dcf0 2023-05-24T03:29:41.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.946+0000 7fd1f12f2700 1 -- 172.21.15.146:0/103549661 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1dc011990 con 0x7fd1ec15dcf0 2023-05-24T03:29:41.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.946+0000 7fd1f12f2700 1 -- 172.21.15.146:0/103549661 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc011d20 con 0x7fd1ec15dcf0 2023-05-24T03:29:41.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.947+0000 7fd1f4558700 1 -- 172.21.15.146:0/103549661 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1ec15dcf0 msgr2=0x7fd1ec0ce2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:41.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.947+0000 7fd1f4558700 1 --2- 172.21.15.146:0/103549661 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1ec15dcf0 0x7fd1ec0ce2e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec067440 tx=0x7fd1dc009b20 comp rx=0 tx=0).stop 2023-05-24T03:29:41.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.947+0000 7fd1f4558700 1 -- 172.21.15.146:0/103549661 shutdown_connections 2023-05-24T03:29:41.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.947+0000 7fd1f4558700 1 --2- 172.21.15.146:0/103549661 >> v2:172.21.15.151:3300/0 conn(0x7fd1ec0cdf10 0x7fd1ec159c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:41.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.947+0000 7fd1f4558700 1 --2- 172.21.15.146:0/103549661 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1ec15dcf0 0x7fd1ec0ce2e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:41.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.947+0000 7fd1f4558700 1 -- 172.21.15.146:0/103549661 >> 172.21.15.146:0/103549661 conn(0x7fd1ec0cfea0 msgr2=0x7fd1ec0d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:41.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.947+0000 7fd1f4558700 1 -- 172.21.15.146:0/103549661 shutdown_connections 2023-05-24T03:29:41.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.947+0000 7fd1f4558700 1 -- 172.21.15.146:0/103549661 wait complete. 2023-05-24T03:29:41.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.948+0000 7fd1f4558700 1 Processor -- start 2023-05-24T03:29:41.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.948+0000 7fd1f4558700 1 -- start start 2023-05-24T03:29:41.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.949+0000 7fd1f4558700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1ec070f50 0x7fd1ec0b46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:41.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.949+0000 7fd1f4558700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1ec0cdf10 0x7fd1ec0b0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:41.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.949+0000 7fd1f4558700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1ec15dcf0 0x7fd1ec1532e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:41.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.949+0000 7fd1f4558700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ec0b58e0 con 0x7fd1ec15dcf0 2023-05-24T03:29:41.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.949+0000 7fd1f4558700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ec0b4cd0 con 0x7fd1ec070f50 2023-05-24T03:29:41.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.949+0000 7fd1f4558700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ec0b4fb0 con 0x7fd1ec0cdf10 2023-05-24T03:29:41.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.949+0000 7fd1f2af5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1ec15dcf0 0x7fd1ec1532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:41.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.949+0000 7fd1f2af5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1ec15dcf0 0x7fd1ec1532e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38604/0 (socket says 172.21.15.146:38604) 2023-05-24T03:29:41.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.949+0000 7fd1f2af5700 1 -- 172.21.15.146:0/629576505 learned_addr learned my addr 172.21.15.146:0/629576505 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:41.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.949+0000 7fd1f22f4700 1 --2- 172.21.15.146:0/629576505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1ec070f50 0x7fd1ec0b46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:41.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.949+0000 7fd1f1af3700 1 --2- 172.21.15.146:0/629576505 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1ec0cdf10 0x7fd1ec0b0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:41.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.949+0000 7fd1f2af5700 1 -- 172.21.15.146:0/629576505 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1ec0cdf10 msgr2=0x7fd1ec0b0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:41.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.949+0000 7fd1f2af5700 1 --2- 172.21.15.146:0/629576505 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1ec0cdf10 0x7fd1ec0b0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:41.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.949+0000 7fd1f2af5700 1 -- 172.21.15.146:0/629576505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1ec070f50 msgr2=0x7fd1ec0b46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:41.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.949+0000 7fd1f2af5700 1 --2- 172.21.15.146:0/629576505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1ec070f50 0x7fd1ec0b46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:41.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.949+0000 7fd1f2af5700 1 -- 172.21.15.146:0/629576505 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1dc0094a0 con 0x7fd1ec15dcf0 2023-05-24T03:29:41.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.950+0000 7fd1f2af5700 1 --2- 172.21.15.146:0/629576505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1ec15dcf0 0x7fd1ec1532e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd1e400cba0 tx=0x7fd1e400ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:41.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.950+0000 7fd1e2ffd700 1 -- 172.21.15.146:0/629576505 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e400aad0 con 0x7fd1ec15dcf0 2023-05-24T03:29:41.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.950+0000 7fd1e2ffd700 1 -- 172.21.15.146:0/629576505 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e400ac50 con 0x7fd1ec15dcf0 2023-05-24T03:29:41.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.950+0000 7fd1f4558700 1 -- 172.21.15.146:0/629576505 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1ec15ac60 con 0x7fd1ec15dcf0 2023-05-24T03:29:41.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.950+0000 7fd1e2ffd700 1 -- 172.21.15.146:0/629576505 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e40070d0 con 0x7fd1ec15dcf0 2023-05-24T03:29:41.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.950+0000 7fd1f4558700 1 -- 172.21.15.146:0/629576505 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1ec15a980 con 0x7fd1ec15dcf0 2023-05-24T03:29:41.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.951+0000 7fd1f4558700 1 -- 172.21.15.146:0/629576505 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1ec06d190 con 0x7fd1ec15dcf0 2023-05-24T03:29:41.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.951+0000 7fd1e2ffd700 1 -- 172.21.15.146:0/629576505 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd1e4007230 con 0x7fd1ec15dcf0 2023-05-24T03:29:41.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.951+0000 7fd1e2ffd700 1 --2- 172.21.15.146:0/629576505 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fd1d006ace0 0x7fd1d006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:41.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.951+0000 7fd1e2ffd700 1 -- 172.21.15.146:0/629576505 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd1e4088e80 con 0x7fd1ec15dcf0 2023-05-24T03:29:41.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.951+0000 7fd1f22f4700 1 --2- 172.21.15.146:0/629576505 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fd1d006ace0 0x7fd1d006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:41.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.952+0000 7fd1f22f4700 1 --2- 172.21.15.146:0/629576505 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fd1d006ace0 0x7fd1d006d190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec0aef00 tx=0x7fd1e8009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:41.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:41.956+0000 7fd1e2ffd700 1 -- 172.21.15.146:0/629576505 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fd1e4054310 con 0x7fd1ec15dcf0 2023-05-24T03:29:42.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:42.146+0000 7fd1f4558700 1 -- 172.21.15.146:0/629576505 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd1ec04e810 con 0x7fd1ec15dcf0 2023-05-24T03:29:42.893 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T03:29:42.895 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T03:29:43.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.064+0000 7fd1e2ffd700 1 -- 172.21.15.146:0/629576505 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v21) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd1e4018020 con 0x7fd1ec15dcf0 2023-05-24T03:29:43.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.069+0000 7fd1f4558700 1 -- 172.21.15.146:0/629576505 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fd1d006ace0 msgr2=0x7fd1d006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:43.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.069+0000 7fd1f4558700 1 --2- 172.21.15.146:0/629576505 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fd1d006ace0 0x7fd1d006d190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec0aef00 tx=0x7fd1e8009210 comp rx=0 tx=0).stop 2023-05-24T03:29:43.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.069+0000 7fd1f4558700 1 -- 172.21.15.146:0/629576505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1ec15dcf0 msgr2=0x7fd1ec1532e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:43.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.069+0000 7fd1f4558700 1 --2- 172.21.15.146:0/629576505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1ec15dcf0 0x7fd1ec1532e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd1e400cba0 tx=0x7fd1e400ceb0 comp rx=0 tx=0).stop 2023-05-24T03:29:43.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.069+0000 7fd1f4558700 1 -- 172.21.15.146:0/629576505 shutdown_connections 2023-05-24T03:29:43.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.069+0000 7fd1f4558700 1 --2- 172.21.15.146:0/629576505 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fd1d006ace0 0x7fd1d006d190 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:43.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.069+0000 7fd1f4558700 1 --2- 172.21.15.146:0/629576505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1ec15dcf0 0x7fd1ec1532e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:43.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.069+0000 7fd1f4558700 1 --2- 172.21.15.146:0/629576505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1ec070f50 0x7fd1ec0b46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:43.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.069+0000 7fd1f4558700 1 --2- 172.21.15.146:0/629576505 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1ec0cdf10 0x7fd1ec0b0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:43.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.069+0000 7fd1f4558700 1 -- 172.21.15.146:0/629576505 >> 172.21.15.146:0/629576505 conn(0x7fd1ec0cfea0 msgr2=0x7fd1ec0d0270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:43.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.069+0000 7fd1f4558700 1 -- 172.21.15.146:0/629576505 shutdown_connections 2023-05-24T03:29:43.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.069+0000 7fd1f4558700 1 -- 172.21.15.146:0/629576505 wait complete. 2023-05-24T03:29:43.076 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' created 2023-05-24T03:29:43.088 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-05-24T03:29:43.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.215+0000 7f59d408c700 1 Processor -- start 2023-05-24T03:29:43.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.215+0000 7f59d408c700 1 -- start start 2023-05-24T03:29:43.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.216+0000 7f59d408c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f59cc0b2d00 0x7f59cc0ce110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:43.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.216+0000 7f59d408c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59cc0cd950 con 0x7f59cc15af00 2023-05-24T03:29:43.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.216+0000 7f59d408c700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59cc0b36b0 con 0x7f59cc0d0110 2023-05-24T03:29:43.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.216+0000 7f59d408c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59cc0b3990 con 0x7f59cc0b2d00 2023-05-24T03:29:43.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.216+0000 7f59d1627700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f59cc0b2d00 0x7f59cc0ce110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:43.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.216+0000 7f59d1e28700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f59cc15af00 0x7f59cc15e8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45060/0 (socket says 172.21.15.146:45060) 2023-05-24T03:29:43.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.216+0000 7f59d1e28700 1 -- 172.21.15.146:0/4058247889 learned_addr learned my addr 172.21.15.146:0/4058247889 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:29:43.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.216+0000 7f59d1627700 1 -- 172.21.15.146:0/4058247889 >> v1:172.21.15.151:6789/0 conn(0x7f59cc0d0110 legacy=0x7f59cc0d0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:43.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.216+0000 7f59d1627700 1 -- 172.21.15.146:0/4058247889 >> v1:172.21.15.146:6789/0 conn(0x7f59cc15af00 legacy=0x7f59cc15e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:43.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.216+0000 7f59d1627700 1 -- 172.21.15.146:0/4058247889 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59cc15f6b0 con 0x7f59cc0b2d00 2023-05-24T03:29:43.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.216+0000 7f59d0e26700 1 -- 172.21.15.146:0/4058247889 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3799371528 0 0) 0x7f59cc0cd950 con 0x7f59cc15af00 2023-05-24T03:29:43.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.217+0000 7f59d1627700 1 --2- 172.21.15.146:0/4058247889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59cc0b2d00 0x7f59cc0ce110 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f59c8009840 tx=0x7f59c8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93272954137a50c4 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:43.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.217+0000 7f59d0e26700 1 -- 172.21.15.146:0/4058247889 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c8004230 con 0x7f59cc0b2d00 2023-05-24T03:29:43.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.217+0000 7f59d0e26700 1 -- 172.21.15.146:0/4058247889 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c8004390 con 0x7f59cc0b2d00 2023-05-24T03:29:43.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.217+0000 7f59d0e26700 1 -- 172.21.15.146:0/4058247889 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c80036a0 con 0x7f59cc0b2d00 2023-05-24T03:29:43.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.217+0000 7f59d408c700 1 -- 172.21.15.146:0/4058247889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59cc0b2d00 msgr2=0x7f59cc0ce110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:43.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.217+0000 7f59d408c700 1 --2- 172.21.15.146:0/4058247889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59cc0b2d00 0x7f59cc0ce110 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f59c8009840 tx=0x7f59c8009b50 comp rx=0 tx=0).stop 2023-05-24T03:29:43.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.217+0000 7f59d408c700 1 -- 172.21.15.146:0/4058247889 shutdown_connections 2023-05-24T03:29:43.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.217+0000 7f59d408c700 1 --2- 172.21.15.146:0/4058247889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59cc0b2d00 0x7f59cc0ce110 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:43.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.217+0000 7f59d408c700 1 -- 172.21.15.146:0/4058247889 >> 172.21.15.146:0/4058247889 conn(0x7f59cc06e2a0 msgr2=0x7f59cc06e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:43.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.217+0000 7f59d408c700 1 -- 172.21.15.146:0/4058247889 shutdown_connections 2023-05-24T03:29:43.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.217+0000 7f59d408c700 1 -- 172.21.15.146:0/4058247889 wait complete. 2023-05-24T03:29:43.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.218+0000 7f59d408c700 1 Processor -- start 2023-05-24T03:29:43.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.219+0000 7f59d408c700 1 -- start start 2023-05-24T03:29:43.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.219+0000 7f59d408c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f59cc0b2d00 0x7f59cc157ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:43.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.219+0000 7f59d408c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59cc0d0110 0x7f59cc15dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:43.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.219+0000 7f59d408c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59cc15af00 0x7f59cc1f21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:43.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.219+0000 7f59d408c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59cc1f3200 con 0x7f59cc15af00 2023-05-24T03:29:43.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.219+0000 7f59d408c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59cc158410 con 0x7f59cc0d0110 2023-05-24T03:29:43.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.219+0000 7f59d408c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59cc15d120 con 0x7f59cc0b2d00 2023-05-24T03:29:43.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.219+0000 7f59d2629700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59cc15af00 0x7f59cc1f21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:43.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.219+0000 7f59d2629700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59cc15af00 0x7f59cc1f21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38618/0 (socket says 172.21.15.146:38618) 2023-05-24T03:29:43.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.219+0000 7f59d2629700 1 -- 172.21.15.146:0/1343193654 learned_addr learned my addr 172.21.15.146:0/1343193654 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:43.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.220+0000 7f59d1627700 1 --2- 172.21.15.146:0/1343193654 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59cc0d0110 0x7f59cc15dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:43.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.220+0000 7f59d2629700 1 -- 172.21.15.146:0/1343193654 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f59cc0b2d00 msgr2=0x7f59cc157ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:43.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.220+0000 7f59d1e28700 1 --2- 172.21.15.146:0/1343193654 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f59cc0b2d00 0x7f59cc157ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:43.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.220+0000 7f59d2629700 1 --2- 172.21.15.146:0/1343193654 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f59cc0b2d00 0x7f59cc157ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:43.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.220+0000 7f59d2629700 1 -- 172.21.15.146:0/1343193654 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59cc0d0110 msgr2=0x7f59cc15dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:43.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.220+0000 7f59d2629700 1 --2- 172.21.15.146:0/1343193654 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59cc0d0110 0x7f59cc15dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:43.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.220+0000 7f59d2629700 1 -- 172.21.15.146:0/1343193654 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c80094a0 con 0x7f59cc15af00 2023-05-24T03:29:43.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.220+0000 7f59d1627700 1 --2- 172.21.15.146:0/1343193654 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59cc0d0110 0x7f59cc15dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:29:43.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.220+0000 7f59d2629700 1 --2- 172.21.15.146:0/1343193654 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59cc15af00 0x7f59cc1f21f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f59c400cc10 tx=0x7f59c400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:43.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.220+0000 7f59c27fc700 1 -- 172.21.15.146:0/1343193654 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c400abb0 con 0x7f59cc15af00 2023-05-24T03:29:43.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.220+0000 7f59c27fc700 1 -- 172.21.15.146:0/1343193654 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c400ad10 con 0x7f59cc15af00 2023-05-24T03:29:43.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.220+0000 7f59d408c700 1 -- 172.21.15.146:0/1343193654 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59cc0cb970 con 0x7f59cc15af00 2023-05-24T03:29:43.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.220+0000 7f59c27fc700 1 -- 172.21.15.146:0/1343193654 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c4012660 con 0x7f59cc15af00 2023-05-24T03:29:43.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.220+0000 7f59d408c700 1 -- 172.21.15.146:0/1343193654 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59cc0cdbf0 con 0x7f59cc15af00 2023-05-24T03:29:43.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.221+0000 7f59d408c700 1 -- 172.21.15.146:0/1343193654 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59cc15efb0 con 0x7f59cc15af00 2023-05-24T03:29:43.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.222+0000 7f59c27fc700 1 -- 172.21.15.146:0/1343193654 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f59c40127c0 con 0x7f59cc15af00 2023-05-24T03:29:43.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.222+0000 7f59c27fc700 1 --2- 172.21.15.146:0/1343193654 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f59b006ace0 0x7f59b006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:43.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.222+0000 7f59c27fc700 1 -- 172.21.15.146:0/1343193654 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f59c4089a20 con 0x7f59cc15af00 2023-05-24T03:29:43.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.222+0000 7f59d1e28700 1 --2- 172.21.15.146:0/1343193654 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f59b006ace0 0x7f59b006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:43.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.222+0000 7f59d1e28700 1 --2- 172.21.15.146:0/1343193654 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f59b006ace0 0x7f59b006d190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f59bc000f60 tx=0x7f59bc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:43.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.226+0000 7f59c27fc700 1 -- 172.21.15.146:0/1343193654 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f59c4054cb0 con 0x7f59cc15af00 2023-05-24T03:29:43.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:43.412+0000 7f59d408c700 1 -- 172.21.15.146:0/1343193654 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f59cc068d50 con 0x7f59cc15af00 2023-05-24T03:29:44.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.063+0000 7f59c27fc700 1 -- 172.21.15.146:0/1343193654 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v22) v1 ==== 171+0+0 (secure 0 0 0) 0x7f59c4016020 con 0x7f59cc15af00 2023-05-24T03:29:44.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.067+0000 7f59d408c700 1 -- 172.21.15.146:0/1343193654 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f59b006ace0 msgr2=0x7f59b006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:44.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.067+0000 7f59d408c700 1 --2- 172.21.15.146:0/1343193654 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f59b006ace0 0x7f59b006d190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f59bc000f60 tx=0x7f59bc009040 comp rx=0 tx=0).stop 2023-05-24T03:29:44.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.067+0000 7f59d408c700 1 -- 172.21.15.146:0/1343193654 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59cc15af00 msgr2=0x7f59cc1f21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:44.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.067+0000 7f59d408c700 1 --2- 172.21.15.146:0/1343193654 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59cc15af00 0x7f59cc1f21f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f59c400cc10 tx=0x7f59c400a060 comp rx=0 tx=0).stop 2023-05-24T03:29:44.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.067+0000 7f59d408c700 1 -- 172.21.15.146:0/1343193654 shutdown_connections 2023-05-24T03:29:44.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.067+0000 7f59d408c700 1 --2- 172.21.15.146:0/1343193654 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f59b006ace0 0x7f59b006d190 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:44.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.067+0000 7f59d408c700 1 --2- 172.21.15.146:0/1343193654 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59cc15af00 0x7f59cc1f21f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:44.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.067+0000 7f59d408c700 1 --2- 172.21.15.146:0/1343193654 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f59cc0b2d00 0x7f59cc157ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:44.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.067+0000 7f59d408c700 1 --2- 172.21.15.146:0/1343193654 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59cc0d0110 0x7f59cc15dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:44.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.067+0000 7f59d408c700 1 -- 172.21.15.146:0/1343193654 >> 172.21.15.146:0/1343193654 conn(0x7f59cc06e2a0 msgr2=0x7f59cc0cce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:44.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.069+0000 7f59d408c700 1 -- 172.21.15.146:0/1343193654 shutdown_connections 2023-05-24T03:29:44.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.070+0000 7f59d408c700 1 -- 172.21.15.146:0/1343193654 wait complete. 2023-05-24T03:29:44.079 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' created 2023-05-24T03:29:44.100 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-05-24T03:29:44.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.224+0000 7f8a0920b700 1 Processor -- start 2023-05-24T03:29:44.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.224+0000 7f8a0920b700 1 -- start start 2023-05-24T03:29:44.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.225+0000 7f8a0920b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8a0415cd90 0x7f8a040cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:44.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.225+0000 7f8a0920b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8a040aefd0 0x7f8a04160d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:44.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.225+0000 7f8a0920b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a040cfd00 con 0x7f8a0406a460 2023-05-24T03:29:44.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.225+0000 7f8a0920b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a04072350 con 0x7f8a040aefd0 2023-05-24T03:29:44.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.225+0000 7f8a0920b700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a040cf460 con 0x7f8a0415cd90 2023-05-24T03:29:44.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.225+0000 7f8a0359e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8a040aefd0 0x7f8a04160d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:44.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.225+0000 7f8a0359e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8a040aefd0 0x7f8a04160d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38624/0 (socket says 172.21.15.146:38624) 2023-05-24T03:29:44.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.225+0000 7f8a02d9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8a0406a460 0x7f8a0406a830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45074/0 (socket says 172.21.15.146:45074) 2023-05-24T03:29:44.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.225+0000 7f8a0359e700 1 -- 172.21.15.146:0/3263245294 learned_addr learned my addr 172.21.15.146:0/3263245294 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:44.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.225+0000 7f8a0259c700 1 --2- 172.21.15.146:0/3263245294 >> v2:172.21.15.151:3300/0 conn(0x7f8a0415cd90 0x7f8a040cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:44.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.225+0000 7f8a0359e700 1 -- 172.21.15.146:0/3263245294 >> v2:172.21.15.151:3300/0 conn(0x7f8a0415cd90 msgr2=0x7f8a040cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:44.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.225+0000 7f8a0359e700 1 --2- 172.21.15.146:0/3263245294 >> v2:172.21.15.151:3300/0 conn(0x7f8a0415cd90 0x7f8a040cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:44.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.225+0000 7f8a0359e700 1 -- 172.21.15.146:0/3263245294 >> v1:172.21.15.146:6789/0 conn(0x7f8a0406a460 legacy=0x7f8a0406a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:44.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.225+0000 7f8a0359e700 1 -- 172.21.15.146:0/3263245294 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a040cf740 con 0x7f8a040aefd0 2023-05-24T03:29:44.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.225+0000 7f8a01d9b700 1 -- 172.21.15.146:0/3263245294 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4001952547 0 0) 0x7f89f4001110 con 0x7f8a0406a460 2023-05-24T03:29:44.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.225+0000 7f8a0359e700 1 --2- 172.21.15.146:0/3263245294 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a040aefd0 0x7f8a04160d20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8a04074870 tx=0x7f89fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b68897c12926aadc server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:44.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.225+0000 7f8a01d9b700 1 -- 172.21.15.146:0/3263245294 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89fc00e070 con 0x7f8a040aefd0 2023-05-24T03:29:44.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.225+0000 7f8a01d9b700 1 -- 172.21.15.146:0/3263245294 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89fc00b9c0 con 0x7f8a040aefd0 2023-05-24T03:29:44.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.225+0000 7f8a01d9b700 1 -- 172.21.15.146:0/3263245294 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89fc00bd70 con 0x7f8a040aefd0 2023-05-24T03:29:44.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.226+0000 7f8a0920b700 1 -- 172.21.15.146:0/3263245294 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a040aefd0 msgr2=0x7f8a04160d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:44.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.226+0000 7f8a0920b700 1 --2- 172.21.15.146:0/3263245294 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a040aefd0 0x7f8a04160d20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8a04074870 tx=0x7f89fc00b330 comp rx=0 tx=0).stop 2023-05-24T03:29:44.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.226+0000 7f8a0920b700 1 -- 172.21.15.146:0/3263245294 shutdown_connections 2023-05-24T03:29:44.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.226+0000 7f8a0920b700 1 --2- 172.21.15.146:0/3263245294 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a040aefd0 0x7f8a04160d20 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:44.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.226+0000 7f8a0920b700 1 --2- 172.21.15.146:0/3263245294 >> v2:172.21.15.151:3300/0 conn(0x7f8a0415cd90 0x7f8a040cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:44.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.226+0000 7f8a0920b700 1 -- 172.21.15.146:0/3263245294 >> 172.21.15.146:0/3263245294 conn(0x7f8a040cfea0 msgr2=0x7f8a040d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:44.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.226+0000 7f8a0920b700 1 -- 172.21.15.146:0/3263245294 shutdown_connections 2023-05-24T03:29:44.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.226+0000 7f8a0920b700 1 -- 172.21.15.146:0/3263245294 wait complete. 2023-05-24T03:29:44.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.228+0000 7f8a0920b700 1 Processor -- start 2023-05-24T03:29:44.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.228+0000 7f8a0920b700 1 -- start start 2023-05-24T03:29:44.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.229+0000 7f8a0920b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a0406a460 0x7f8a0415fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:44.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.229+0000 7f8a0920b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a040aefd0 0x7f8a04159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:44.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.229+0000 7f8a0920b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a0415cd90 0x7f8a0415bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:44.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.229+0000 7f8a0920b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a040b04f0 con 0x7f8a0406a460 2023-05-24T03:29:44.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.229+0000 7f8a0920b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a040af900 con 0x7f8a040aefd0 2023-05-24T03:29:44.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.229+0000 7f8a0920b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0415a300 con 0x7f8a0415cd90 2023-05-24T03:29:44.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.229+0000 7f8a02d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a0406a460 0x7f8a0415fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:44.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.229+0000 7f8a02d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a0406a460 0x7f8a0415fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38628/0 (socket says 172.21.15.146:38628) 2023-05-24T03:29:44.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.229+0000 7f8a02d9d700 1 -- 172.21.15.146:0/2712455008 learned_addr learned my addr 172.21.15.146:0/2712455008 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:44.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.229+0000 7f8a0259c700 1 --2- 172.21.15.146:0/2712455008 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a040aefd0 0x7f8a04159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:44.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.229+0000 7f8a0359e700 1 --2- 172.21.15.146:0/2712455008 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a0415cd90 0x7f8a0415bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:44.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.229+0000 7f8a02d9d700 1 -- 172.21.15.146:0/2712455008 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a0415cd90 msgr2=0x7f8a0415bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:44.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.229+0000 7f8a02d9d700 1 --2- 172.21.15.146:0/2712455008 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a0415cd90 0x7f8a0415bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:44.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.229+0000 7f8a02d9d700 1 -- 172.21.15.146:0/2712455008 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a040aefd0 msgr2=0x7f8a04159440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:44.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.229+0000 7f8a02d9d700 1 --2- 172.21.15.146:0/2712455008 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a040aefd0 0x7f8a04159440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:44.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.229+0000 7f8a02d9d700 1 -- 172.21.15.146:0/2712455008 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89fc009b30 con 0x7f8a0406a460 2023-05-24T03:29:44.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.229+0000 7f8a0259c700 1 --2- 172.21.15.146:0/2712455008 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a040aefd0 0x7f8a04159440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:29:44.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.229+0000 7f8a0359e700 1 --2- 172.21.15.146:0/2712455008 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a0415cd90 0x7f8a0415bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:29:44.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.229+0000 7f8a02d9d700 1 --2- 172.21.15.146:0/2712455008 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a0406a460 0x7f8a0415fec0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f89f400c760 tx=0x7f89f400cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:44.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.229+0000 7f89eb7fe700 1 -- 172.21.15.146:0/2712455008 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f4004c80 con 0x7f8a0406a460 2023-05-24T03:29:44.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.229+0000 7f89eb7fe700 1 -- 172.21.15.146:0/2712455008 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f4004e00 con 0x7f8a0406a460 2023-05-24T03:29:44.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.229+0000 7f8a0920b700 1 -- 172.21.15.146:0/2712455008 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a04160800 con 0x7f8a0406a460 2023-05-24T03:29:44.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.229+0000 7f89eb7fe700 1 -- 172.21.15.146:0/2712455008 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f4007310 con 0x7f8a0406a460 2023-05-24T03:29:44.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.229+0000 7f8a0920b700 1 -- 172.21.15.146:0/2712455008 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a040cfa20 con 0x7f8a0406a460 2023-05-24T03:29:44.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.230+0000 7f8a0920b700 1 -- 172.21.15.146:0/2712455008 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a040af620 con 0x7f8a0406a460 2023-05-24T03:29:44.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.231+0000 7f89eb7fe700 1 -- 172.21.15.146:0/2712455008 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f89f4007470 con 0x7f8a0406a460 2023-05-24T03:29:44.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.231+0000 7f89eb7fe700 1 --2- 172.21.15.146:0/2712455008 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f89f006ad10 0x7f89f006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:44.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.231+0000 7f8a0259c700 1 --2- 172.21.15.146:0/2712455008 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f89f006ad10 0x7f89f006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:44.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.232+0000 7f89eb7fe700 1 -- 172.21.15.146:0/2712455008 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f89f4088fe0 con 0x7f8a0406a460 2023-05-24T03:29:44.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.232+0000 7f8a0259c700 1 --2- 172.21.15.146:0/2712455008 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f89f006ad10 0x7f89f006d1c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8a040b3570 tx=0x7f89f8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:44.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.236+0000 7f89eb7fe700 1 -- 172.21.15.146:0/2712455008 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f89f4054180 con 0x7f8a0406a460 2023-05-24T03:29:44.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.467+0000 7f8a0920b700 1 -- 172.21.15.146:0/2712455008 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f8a040cfd00 con 0x7f8a0406a460 2023-05-24T03:29:44.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.473+0000 7f89eb7fe700 1 -- 172.21.15.146:0/2712455008 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f8a040cfd00 con 0x7f8a0406a460 2023-05-24T03:29:44.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.478+0000 7f8a0920b700 1 -- 172.21.15.146:0/2712455008 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f89f006ad10 msgr2=0x7f89f006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:44.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.478+0000 7f8a0920b700 1 --2- 172.21.15.146:0/2712455008 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f89f006ad10 0x7f89f006d1c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8a040b3570 tx=0x7f89f8008040 comp rx=0 tx=0).stop 2023-05-24T03:29:44.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.478+0000 7f8a0920b700 1 -- 172.21.15.146:0/2712455008 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a0406a460 msgr2=0x7f8a0415fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:44.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.478+0000 7f8a0920b700 1 --2- 172.21.15.146:0/2712455008 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a0406a460 0x7f8a0415fec0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f89f400c760 tx=0x7f89f400cb20 comp rx=0 tx=0).stop 2023-05-24T03:29:44.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.478+0000 7f8a0920b700 1 -- 172.21.15.146:0/2712455008 shutdown_connections 2023-05-24T03:29:44.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.478+0000 7f8a0920b700 1 --2- 172.21.15.146:0/2712455008 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f89f006ad10 0x7f89f006d1c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:44.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.478+0000 7f8a0920b700 1 --2- 172.21.15.146:0/2712455008 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a0415cd90 0x7f8a0415bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:44.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.478+0000 7f8a0920b700 1 --2- 172.21.15.146:0/2712455008 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a0406a460 0x7f8a0415fec0 secure :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f89f400c760 tx=0x7f89f400cb20 comp rx=0 tx=0).stop 2023-05-24T03:29:44.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.478+0000 7f8a0920b700 1 --2- 172.21.15.146:0/2712455008 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a040aefd0 0x7f8a04159440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:44.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.478+0000 7f8a0920b700 1 -- 172.21.15.146:0/2712455008 >> 172.21.15.146:0/2712455008 conn(0x7f8a040cfea0 msgr2=0x7f8a040711c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:44.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.479+0000 7f8a0920b700 1 -- 172.21.15.146:0/2712455008 shutdown_connections 2023-05-24T03:29:44.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.480+0000 7f8a0920b700 1 -- 172.21.15.146:0/2712455008 wait complete. 2023-05-24T03:29:44.487 INFO:teuthology.orchestra.run.smithi146.stderr:new fs with metadata pool 3 and data pool 4 2023-05-24T03:29:44.506 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-05-24T03:29:44.506 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-05-24T03:29:44.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.629+0000 7f4fe663e700 1 Processor -- start 2023-05-24T03:29:44.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.629+0000 7f4fe663e700 1 -- start start 2023-05-24T03:29:44.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.630+0000 7f4fe663e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4fe00cbc90 0x7f4fe006a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:44.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.630+0000 7f4fe663e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fe00b27e0 con 0x7f4fe00cc1d0 2023-05-24T03:29:44.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.630+0000 7f4fe663e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fe00b2220 con 0x7f4fe00cb8c0 2023-05-24T03:29:44.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.630+0000 7f4fe663e700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fe00b2030 con 0x7f4fe00cbc90 2023-05-24T03:29:44.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.630+0000 7f4fdf7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f4fe00cc1d0 0x7f4fe00b1920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45100/0 (socket says 172.21.15.146:45100) 2023-05-24T03:29:44.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.630+0000 7f4fdf7fe700 1 -- 172.21.15.146:0/3848148754 learned_addr learned my addr 172.21.15.146:0/3848148754 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:29:44.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.630+0000 7f4fe4bdb700 1 --2- 172.21.15.146:0/3848148754 >> v2:172.21.15.151:3300/0 conn(0x7f4fe00cbc90 0x7f4fe006a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:44.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.630+0000 7f4fdeffd700 1 -- 172.21.15.146:0/3848148754 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2682433057 0 0) 0x7f4fe00b27e0 con 0x7f4fe00cc1d0 2023-05-24T03:29:44.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.630+0000 7f4fdeffd700 1 -- 172.21.15.146:0/3848148754 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fc80035b0 con 0x7f4fe00cc1d0 2023-05-24T03:29:44.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.630+0000 7f4fdeffd700 1 -- 172.21.15.146:0/3848148754 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1410668668 0 0) 0x7f4fc80035b0 con 0x7f4fe00cc1d0 2023-05-24T03:29:44.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.630+0000 7f4fdeffd700 1 -- 172.21.15.146:0/3848148754 >> v2:172.21.15.151:3300/0 conn(0x7f4fe00cbc90 msgr2=0x7f4fe006a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:44.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.630+0000 7f4fdeffd700 1 --2- 172.21.15.146:0/3848148754 >> v2:172.21.15.151:3300/0 conn(0x7f4fe00cbc90 0x7f4fe006a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:44.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.630+0000 7f4fdeffd700 1 -- 172.21.15.146:0/3848148754 >> v1:172.21.15.151:6789/0 conn(0x7f4fe00cb8c0 legacy=0x7f4fe0161030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:44.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.630+0000 7f4fdeffd700 1 -- 172.21.15.146:0/3848148754 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fe00b2500 con 0x7f4fe00cc1d0 2023-05-24T03:29:44.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.631+0000 7f4fdeffd700 1 -- 172.21.15.146:0/3848148754 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1301887351 0 0) 0x7f4fd0001670 con 0x7f4fe00cc1d0 2023-05-24T03:29:44.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.631+0000 7f4fdeffd700 1 -- 172.21.15.146:0/3848148754 >> v1:172.21.15.146:6789/0 conn(0x7f4fe00cc1d0 legacy=0x7f4fe00b1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:44.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.631+0000 7f4fdeffd700 1 --2- 172.21.15.146:0/3848148754 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4fc8003a00 0x7f4fc8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:44.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.631+0000 7f4fdeffd700 1 --2- 172.21.15.146:0/3848148754 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fc8004850 0x7f4fc8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:44.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.631+0000 7f4fdeffd700 1 --2- 172.21.15.146:0/3848148754 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fc8005200 0x7f4fc800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:44.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.631+0000 7f4fdeffd700 1 -- 172.21.15.146:0/3848148754 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc800c050 con 0x7f4fc8005200 2023-05-24T03:29:44.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.631+0000 7f4fdeffd700 1 -- 172.21.15.146:0/3848148754 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc800c1c0 con 0x7f4fc8004850 2023-05-24T03:29:44.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.631+0000 7f4fdeffd700 1 -- 172.21.15.146:0/3848148754 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc800c380 con 0x7f4fc8003a00 2023-05-24T03:29:44.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.631+0000 7f4fe4bdb700 1 --2- 172.21.15.146:0/3848148754 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fc8005200 0x7f4fc800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:44.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.631+0000 7f4fdf7fe700 1 --2- 172.21.15.146:0/3848148754 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fc8004850 0x7f4fc8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:44.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.631+0000 7f4fdffff700 1 --2- 172.21.15.146:0/3848148754 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4fc8003a00 0x7f4fc8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:44.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.631+0000 7f4fe4bdb700 1 -- 172.21.15.146:0/3848148754 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4fc8003a00 msgr2=0x7f4fc8003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:44.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.631+0000 7f4fe4bdb700 1 --2- 172.21.15.146:0/3848148754 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4fc8003a00 0x7f4fc8003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:44.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.631+0000 7f4fe4bdb700 1 -- 172.21.15.146:0/3848148754 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fc8004850 msgr2=0x7f4fc8004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:44.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.631+0000 7f4fe4bdb700 1 --2- 172.21.15.146:0/3848148754 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fc8004850 0x7f4fc8004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:44.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.631+0000 7f4fe4bdb700 1 -- 172.21.15.146:0/3848148754 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc80035b0 con 0x7f4fc8005200 2023-05-24T03:29:44.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.631+0000 7f4fe4bdb700 1 -- 172.21.15.146:0/3848148754 reap_dead start 2023-05-24T03:29:44.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.631+0000 7f4fe4bdb700 1 --2- 172.21.15.146:0/3848148754 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fc8005200 0x7f4fc800ba10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4fd8009fc0 tx=0x7f4fc8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e351d023132bce6d server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:44.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.631+0000 7f4fdeffd700 1 -- 172.21.15.146:0/3848148754 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd8003a20 con 0x7f4fc8005200 2023-05-24T03:29:44.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.631+0000 7f4fdeffd700 1 -- 172.21.15.146:0/3848148754 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fd800f040 con 0x7f4fc8005200 2023-05-24T03:29:44.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.631+0000 7f4fdeffd700 1 -- 172.21.15.146:0/3848148754 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd8003de0 con 0x7f4fc8005200 2023-05-24T03:29:44.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.632+0000 7f4fe663e700 1 -- 172.21.15.146:0/3848148754 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fc8005200 msgr2=0x7f4fc800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:44.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.632+0000 7f4fe663e700 1 --2- 172.21.15.146:0/3848148754 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fc8005200 0x7f4fc800ba10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4fd8009fc0 tx=0x7f4fc8005880 comp rx=0 tx=0).stop 2023-05-24T03:29:44.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.632+0000 7f4fe663e700 1 -- 172.21.15.146:0/3848148754 shutdown_connections 2023-05-24T03:29:44.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.632+0000 7f4fe663e700 1 --2- 172.21.15.146:0/3848148754 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fc8005200 0x7f4fc800ba10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:44.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.632+0000 7f4fe663e700 1 -- 172.21.15.146:0/3848148754 >> 172.21.15.146:0/3848148754 conn(0x7f4fe00cfea0 msgr2=0x7f4fe00d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:44.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.632+0000 7f4fe663e700 1 -- 172.21.15.146:0/3848148754 shutdown_connections 2023-05-24T03:29:44.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.632+0000 7f4fe663e700 1 -- 172.21.15.146:0/3848148754 wait complete. 2023-05-24T03:29:44.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.633+0000 7f4fe663e700 1 Processor -- start 2023-05-24T03:29:44.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.633+0000 7f4fe663e700 1 -- start start 2023-05-24T03:29:44.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.634+0000 7f4fe663e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fc8005200 0x7f4fe015f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:44.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.634+0000 7f4fe663e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fe00b4db0 0x7f4fe0155680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:44.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.634+0000 7f4fe663e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4fe00b2e20 0x7f4fe00b32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:44.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.634+0000 7f4fe663e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe00b3800 con 0x7f4fe00b4db0 2023-05-24T03:29:44.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.634+0000 7f4fe663e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe015ff30 con 0x7f4fc8005200 2023-05-24T03:29:44.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.634+0000 7f4fe663e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe00b5290 con 0x7f4fe00b2e20 2023-05-24T03:29:44.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.634+0000 7f4fdf7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fe00b4db0 0x7f4fe0155680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:44.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.634+0000 7f4fdf7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fe00b4db0 0x7f4fe0155680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38660/0 (socket says 172.21.15.146:38660) 2023-05-24T03:29:44.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.634+0000 7f4fdf7fe700 1 -- 172.21.15.146:0/1833456453 learned_addr learned my addr 172.21.15.146:0/1833456453 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:44.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.634+0000 7f4fdffff700 1 --2- 172.21.15.146:0/1833456453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fc8005200 0x7f4fe015f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:44.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.634+0000 7f4fe4bdb700 1 --2- 172.21.15.146:0/1833456453 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4fe00b2e20 0x7f4fe00b32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:44.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.634+0000 7f4fdf7fe700 1 -- 172.21.15.146:0/1833456453 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4fe00b2e20 msgr2=0x7f4fe00b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:44.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.634+0000 7f4fdf7fe700 1 --2- 172.21.15.146:0/1833456453 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4fe00b2e20 0x7f4fe00b32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:44.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.634+0000 7f4fdf7fe700 1 -- 172.21.15.146:0/1833456453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fc8005200 msgr2=0x7f4fe015f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:44.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.634+0000 7f4fdf7fe700 1 --2- 172.21.15.146:0/1833456453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fc8005200 0x7f4fe015f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:44.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.634+0000 7f4fdf7fe700 1 -- 172.21.15.146:0/1833456453 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fe0160b10 con 0x7f4fe00b4db0 2023-05-24T03:29:44.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.634+0000 7f4fdffff700 1 --2- 172.21.15.146:0/1833456453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fc8005200 0x7f4fe015f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:29:44.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.634+0000 7f4fe4bdb700 1 --2- 172.21.15.146:0/1833456453 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4fe00b2e20 0x7f4fe00b32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:29:44.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.634+0000 7f4fdf7fe700 1 --2- 172.21.15.146:0/1833456453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fe00b4db0 0x7f4fe0155680 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0006620 tx=0x7f4fd0013840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:44.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.635+0000 7f4fdcff9700 1 -- 172.21.15.146:0/1833456453 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd0023430 con 0x7f4fe00b4db0 2023-05-24T03:29:44.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.635+0000 7f4fdcff9700 1 -- 172.21.15.146:0/1833456453 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fd0023590 con 0x7f4fe00b4db0 2023-05-24T03:29:44.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.635+0000 7f4fe663e700 1 -- 172.21.15.146:0/1833456453 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fe0160830 con 0x7f4fe00b4db0 2023-05-24T03:29:44.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.635+0000 7f4fdcff9700 1 -- 172.21.15.146:0/1833456453 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd0023940 con 0x7f4fe00b4db0 2023-05-24T03:29:44.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.635+0000 7f4fe663e700 1 -- 172.21.15.146:0/1833456453 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fe00b1920 con 0x7f4fe00b4db0 2023-05-24T03:29:44.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.636+0000 7f4fe663e700 1 -- 172.21.15.146:0/1833456453 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fe004e810 con 0x7f4fe00b4db0 2023-05-24T03:29:44.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.636+0000 7f4fdcff9700 1 -- 172.21.15.146:0/1833456453 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4fd001f020 con 0x7f4fe00b4db0 2023-05-24T03:29:44.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.636+0000 7f4fdcff9700 1 --2- 172.21.15.146:0/1833456453 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f4fcc06ace0 0x7f4fcc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:44.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.637+0000 7f4fdcff9700 1 -- 172.21.15.146:0/1833456453 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4fd0011040 con 0x7f4fe00b4db0 2023-05-24T03:29:44.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.637+0000 7f4fdffff700 1 --2- 172.21.15.146:0/1833456453 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f4fcc06ace0 0x7f4fcc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:44.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.637+0000 7f4fdffff700 1 --2- 172.21.15.146:0/1833456453 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f4fcc06ace0 0x7f4fcc06d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4000c00 tx=0x7f4fd4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:44.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.641+0000 7f4fdcff9700 1 -- 172.21.15.146:0/1833456453 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f4fd005da50 con 0x7f4fe00b4db0 2023-05-24T03:29:44.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:44.842+0000 7f4fe663e700 1 -- 172.21.15.146:0/1833456453 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f4fe00cdd90 con 0x7f4fe00b4db0 2023-05-24T03:29:45.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.477+0000 7f4fdcff9700 1 -- 172.21.15.146:0/1833456453 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v24) v1 ==== 157+0+0 (secure 0 0 0) 0x7f4fd0028020 con 0x7f4fe00b4db0 2023-05-24T03:29:45.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.481+0000 7f4fe663e700 1 -- 172.21.15.146:0/1833456453 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f4fcc06ace0 msgr2=0x7f4fcc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:45.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.481+0000 7f4fe663e700 1 --2- 172.21.15.146:0/1833456453 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f4fcc06ace0 0x7f4fcc06d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4000c00 tx=0x7f4fd4009040 comp rx=0 tx=0).stop 2023-05-24T03:29:45.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.481+0000 7f4fe663e700 1 -- 172.21.15.146:0/1833456453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fe00b4db0 msgr2=0x7f4fe0155680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:45.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.481+0000 7f4fe663e700 1 --2- 172.21.15.146:0/1833456453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fe00b4db0 0x7f4fe0155680 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0006620 tx=0x7f4fd0013840 comp rx=0 tx=0).stop 2023-05-24T03:29:45.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.481+0000 7f4fe663e700 1 -- 172.21.15.146:0/1833456453 shutdown_connections 2023-05-24T03:29:45.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.481+0000 7f4fe663e700 1 --2- 172.21.15.146:0/1833456453 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f4fcc06ace0 0x7f4fcc06d190 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:45.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.481+0000 7f4fe663e700 1 --2- 172.21.15.146:0/1833456453 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4fe00b2e20 0x7f4fe00b32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:45.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.481+0000 7f4fe663e700 1 --2- 172.21.15.146:0/1833456453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fc8005200 0x7f4fe015f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:45.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.481+0000 7f4fe663e700 1 --2- 172.21.15.146:0/1833456453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fe00b4db0 0x7f4fe0155680 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:45.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.481+0000 7f4fe663e700 1 -- 172.21.15.146:0/1833456453 >> 172.21.15.146:0/1833456453 conn(0x7f4fe00cfea0 msgr2=0x7f4fe006de20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:45.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.481+0000 7f4fe663e700 1 -- 172.21.15.146:0/1833456453 shutdown_connections 2023-05-24T03:29:45.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.481+0000 7f4fe663e700 1 -- 172.21.15.146:0/1833456453 wait complete. 2023-05-24T03:29:45.500 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-05-24T03:29:45.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.631+0000 7f739ecb1700 1 Processor -- start 2023-05-24T03:29:45.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.631+0000 7f739ecb1700 1 -- start start 2023-05-24T03:29:45.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.632+0000 7f739ecb1700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7398070fe0 0x7f73980b21c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:45.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.632+0000 7f739ecb1700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7398159cd0 0x7f739815a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:45.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.632+0000 7f739ecb1700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f739815ad80 con 0x7f73980cdfd0 2023-05-24T03:29:45.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.632+0000 7f739ecb1700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f739815a7c0 con 0x7f7398159cd0 2023-05-24T03:29:45.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.632+0000 7f739ecb1700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f739815aaa0 con 0x7f7398070fe0 2023-05-24T03:29:45.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.632+0000 7f7397fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7398070fe0 0x7f73980b21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:45.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.633+0000 7f739d24e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7398159cd0 0x7f739815a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:45.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.633+0000 7f7397fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7398070fe0 0x7f73980b21c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:51532/0 (socket says 172.21.15.146:51532) 2023-05-24T03:29:45.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.633+0000 7f7397fff700 1 -- 172.21.15.146:0/309422356 learned_addr learned my addr 172.21.15.146:0/309422356 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:45.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.633+0000 7f739ca4d700 1 --1- 172.21.15.146:0/309422356 >> v1:172.21.15.151:6789/0 conn(0x7f73980cdfd0 0x7f73980ce3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:44152/0 (socket says 172.21.15.146:44152) 2023-05-24T03:29:45.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.633+0000 7f7397fff700 1 -- 172.21.15.146:0/309422356 >> v2:172.21.15.151:3300/0 conn(0x7f7398159cd0 msgr2=0x7f739815a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:45.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.633+0000 7f7397fff700 1 --2- 172.21.15.146:0/309422356 >> v2:172.21.15.151:3300/0 conn(0x7f7398159cd0 0x7f739815a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:45.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.633+0000 7f7397fff700 1 -- 172.21.15.146:0/309422356 >> v1:172.21.15.151:6789/0 conn(0x7f73980cdfd0 legacy=0x7f73980ce3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:45.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.633+0000 7f7397fff700 1 -- 172.21.15.146:0/309422356 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73980b19c0 con 0x7f7398070fe0 2023-05-24T03:29:45.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.633+0000 7f7397fff700 1 --2- 172.21.15.146:0/309422356 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7398070fe0 0x7f73980b21c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f73800098f0 tx=0x7f7380009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d61b2773c917f4e server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:45.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.633+0000 7f73977fe700 1 -- 172.21.15.146:0/309422356 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7380011830 con 0x7f7398070fe0 2023-05-24T03:29:45.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.633+0000 7f73977fe700 1 -- 172.21.15.146:0/309422356 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7380011990 con 0x7f7398070fe0 2023-05-24T03:29:45.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.633+0000 7f73977fe700 1 -- 172.21.15.146:0/309422356 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7380011d20 con 0x7f7398070fe0 2023-05-24T03:29:45.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.634+0000 7f739ecb1700 1 -- 172.21.15.146:0/309422356 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7398070fe0 msgr2=0x7f73980b21c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:45.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.634+0000 7f739ecb1700 1 --2- 172.21.15.146:0/309422356 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7398070fe0 0x7f73980b21c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f73800098f0 tx=0x7f7380009c00 comp rx=0 tx=0).stop 2023-05-24T03:29:45.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.634+0000 7f739ecb1700 1 -- 172.21.15.146:0/309422356 shutdown_connections 2023-05-24T03:29:45.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.634+0000 7f739ecb1700 1 --2- 172.21.15.146:0/309422356 >> v2:172.21.15.151:3300/0 conn(0x7f7398159cd0 0x7f739815a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:45.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.634+0000 7f739ecb1700 1 --2- 172.21.15.146:0/309422356 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7398070fe0 0x7f73980b21c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:45.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.634+0000 7f739ecb1700 1 -- 172.21.15.146:0/309422356 >> 172.21.15.146:0/309422356 conn(0x7f73980cfea0 msgr2=0x7f73980d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:45.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.634+0000 7f739ecb1700 1 -- 172.21.15.146:0/309422356 shutdown_connections 2023-05-24T03:29:45.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.634+0000 7f739ecb1700 1 -- 172.21.15.146:0/309422356 wait complete. 2023-05-24T03:29:45.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.635+0000 7f739ecb1700 1 Processor -- start 2023-05-24T03:29:45.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.635+0000 7f739ecb1700 1 -- start start 2023-05-24T03:29:45.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.636+0000 7f739ecb1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7398070fe0 0x7f739815b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:45.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.636+0000 7f739ecb1700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f73980cdfd0 0x7f739815cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:45.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.636+0000 7f739ecb1700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7398159cd0 0x7f739815d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:45.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.636+0000 7f739ecb1700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73980b3130 con 0x7f7398070fe0 2023-05-24T03:29:45.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.636+0000 7f739ecb1700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73980c8ee0 con 0x7f73980cdfd0 2023-05-24T03:29:45.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.636+0000 7f739ecb1700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73980c91c0 con 0x7f7398159cd0 2023-05-24T03:29:45.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.636+0000 7f739ca4d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7398070fe0 0x7f739815b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:45.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.636+0000 7f739ca4d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7398070fe0 0x7f739815b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38672/0 (socket says 172.21.15.146:38672) 2023-05-24T03:29:45.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.636+0000 7f739ca4d700 1 -- 172.21.15.146:0/427947053 learned_addr learned my addr 172.21.15.146:0/427947053 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:45.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.636+0000 7f7397fff700 1 --2- 172.21.15.146:0/427947053 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f73980cdfd0 0x7f739815cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:45.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.636+0000 7f739d24e700 1 --2- 172.21.15.146:0/427947053 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7398159cd0 0x7f739815d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:45.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.636+0000 7f739ca4d700 1 -- 172.21.15.146:0/427947053 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7398159cd0 msgr2=0x7f739815d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:45.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.636+0000 7f739ca4d700 1 --2- 172.21.15.146:0/427947053 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7398159cd0 0x7f739815d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:45.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.636+0000 7f739ca4d700 1 -- 172.21.15.146:0/427947053 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f73980cdfd0 msgr2=0x7f739815cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:45.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.636+0000 7f739ca4d700 1 --2- 172.21.15.146:0/427947053 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f73980cdfd0 0x7f739815cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:45.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.636+0000 7f739ca4d700 1 -- 172.21.15.146:0/427947053 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7380009550 con 0x7f7398070fe0 2023-05-24T03:29:45.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.636+0000 7f7397fff700 1 --2- 172.21.15.146:0/427947053 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f73980cdfd0 0x7f739815cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:29:45.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.636+0000 7f739ca4d700 1 --2- 172.21.15.146:0/427947053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7398070fe0 0x7f739815b1d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f739000cc50 tx=0x7f739000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:45.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.637+0000 7f73957fa700 1 -- 172.21.15.146:0/427947053 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739000ade0 con 0x7f7398070fe0 2023-05-24T03:29:45.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.637+0000 7f73957fa700 1 -- 172.21.15.146:0/427947053 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f739000ce50 con 0x7f7398070fe0 2023-05-24T03:29:45.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.637+0000 7f739ecb1700 1 -- 172.21.15.146:0/427947053 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73980b2700 con 0x7f7398070fe0 2023-05-24T03:29:45.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.637+0000 7f73957fa700 1 -- 172.21.15.146:0/427947053 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7390007270 con 0x7f7398070fe0 2023-05-24T03:29:45.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.637+0000 7f739ecb1700 1 -- 172.21.15.146:0/427947053 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73980b1ca0 con 0x7f7398070fe0 2023-05-24T03:29:45.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.638+0000 7f739ecb1700 1 -- 172.21.15.146:0/427947053 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73980b2890 con 0x7f7398070fe0 2023-05-24T03:29:45.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.638+0000 7f73957fa700 1 -- 172.21.15.146:0/427947053 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f73900073d0 con 0x7f7398070fe0 2023-05-24T03:29:45.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.638+0000 7f73957fa700 1 --2- 172.21.15.146:0/427947053 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f737806ace0 0x7f737806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:45.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.638+0000 7f73957fa700 1 -- 172.21.15.146:0/427947053 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6288+0+0 (secure 0 0 0) 0x7f7390089330 con 0x7f7398070fe0 2023-05-24T03:29:45.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.639+0000 7f7397fff700 1 --2- 172.21.15.146:0/427947053 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f737806ace0 0x7f737806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:45.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.639+0000 7f7397fff700 1 --2- 172.21.15.146:0/427947053 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f737806ace0 0x7f737806d190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f73980c6e50 tx=0x7f7380008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:45.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.643+0000 7f73957fa700 1 -- 172.21.15.146:0/427947053 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f73900543b0 con 0x7f7398070fe0 2023-05-24T03:29:45.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:45.832+0000 7f739ecb1700 1 -- 172.21.15.146:0/427947053 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f73980c98a0 con 0x7f7398070fe0 2023-05-24T03:29:47.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.492+0000 7f73957fa700 1 -- 172.21.15.146:0/427947053 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v26) v1 ==== 228+0+0 (secure 0 0 0) 0x7f7390017100 con 0x7f7398070fe0 2023-05-24T03:29:47.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.502+0000 7f739ecb1700 1 -- 172.21.15.146:0/427947053 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f737806ace0 msgr2=0x7f737806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:47.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.502+0000 7f739ecb1700 1 --2- 172.21.15.146:0/427947053 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f737806ace0 0x7f737806d190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f73980c6e50 tx=0x7f7380008030 comp rx=0 tx=0).stop 2023-05-24T03:29:47.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.502+0000 7f739ecb1700 1 -- 172.21.15.146:0/427947053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7398070fe0 msgr2=0x7f739815b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:47.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.502+0000 7f739ecb1700 1 --2- 172.21.15.146:0/427947053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7398070fe0 0x7f739815b1d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f739000cc50 tx=0x7f739000a340 comp rx=0 tx=0).stop 2023-05-24T03:29:47.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.502+0000 7f739ecb1700 1 -- 172.21.15.146:0/427947053 shutdown_connections 2023-05-24T03:29:47.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.502+0000 7f739ecb1700 1 --2- 172.21.15.146:0/427947053 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f737806ace0 0x7f737806d190 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:47.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.502+0000 7f739ecb1700 1 --2- 172.21.15.146:0/427947053 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7398159cd0 0x7f739815d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:47.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.502+0000 7f739ecb1700 1 --2- 172.21.15.146:0/427947053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7398070fe0 0x7f739815b1d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:47.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.502+0000 7f739ecb1700 1 --2- 172.21.15.146:0/427947053 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f73980cdfd0 0x7f739815cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:47.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.502+0000 7f739ecb1700 1 -- 172.21.15.146:0/427947053 >> 172.21.15.146:0/427947053 conn(0x7f73980cfea0 msgr2=0x7f739806d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:47.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.502+0000 7f739ecb1700 1 -- 172.21.15.146:0/427947053 shutdown_connections 2023-05-24T03:29:47.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.502+0000 7f739ecb1700 1 -- 172.21.15.146:0/427947053 wait complete. 2023-05-24T03:29:47.510 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data_ec' created 2023-05-24T03:29:47.521 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-05-24T03:29:47.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.647+0000 7f56a6712700 1 Processor -- start 2023-05-24T03:29:47.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.648+0000 7f56a6712700 1 -- start start 2023-05-24T03:29:47.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.648+0000 7f56a6712700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56a00b0520 0x7f56a00b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:47.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.648+0000 7f56a6712700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56a00b1860 con 0x7f56a00ca3d0 2023-05-24T03:29:47.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.648+0000 7f56a6712700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56a00b1000 con 0x7f56a00aed70 2023-05-24T03:29:47.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.648+0000 7f56a6712700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a00b12a0 con 0x7f56a00b0520 2023-05-24T03:29:47.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.648+0000 7f56a4caf700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f56a00ca3d0 0x7f56a00ca820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45136/0 (socket says 172.21.15.146:45136) 2023-05-24T03:29:47.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.648+0000 7f56a4caf700 1 -- 172.21.15.146:0/1638774863 learned_addr learned my addr 172.21.15.146:0/1638774863 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:29:47.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.649+0000 7f569ffff700 1 --2- 172.21.15.146:0/1638774863 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56a00b0520 0x7f56a00b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:47.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.649+0000 7f569effd700 1 -- 172.21.15.146:0/1638774863 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3163767222 0 0) 0x7f56a00b1860 con 0x7f56a00ca3d0 2023-05-24T03:29:47.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.649+0000 7f569effd700 1 -- 172.21.15.146:0/1638774863 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56880035b0 con 0x7f56a00ca3d0 2023-05-24T03:29:47.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.649+0000 7f569effd700 1 -- 172.21.15.146:0/1638774863 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1499970229 0 0) 0x7f56a00b1000 con 0x7f56a00aed70 2023-05-24T03:29:47.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.649+0000 7f569effd700 1 -- 172.21.15.146:0/1638774863 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56a00b1860 con 0x7f56a00aed70 2023-05-24T03:29:47.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.649+0000 7f569effd700 1 -- 172.21.15.146:0/1638774863 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 115374642 0 0) 0x7f56880035b0 con 0x7f56a00ca3d0 2023-05-24T03:29:47.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.649+0000 7f569effd700 1 -- 172.21.15.146:0/1638774863 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56a00b0520 msgr2=0x7f56a00b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:47.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.649+0000 7f569effd700 1 --2- 172.21.15.146:0/1638774863 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56a00b0520 0x7f56a00b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:47.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.649+0000 7f569effd700 1 -- 172.21.15.146:0/1638774863 >> v1:172.21.15.151:6789/0 conn(0x7f56a00aed70 legacy=0x7f56a00b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:47.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.649+0000 7f569effd700 1 -- 172.21.15.146:0/1638774863 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a00b1580 con 0x7f56a00ca3d0 2023-05-24T03:29:47.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.649+0000 7f569effd700 1 -- 172.21.15.146:0/1638774863 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1301887351 0 0) 0x7f56980019f0 con 0x7f56a00ca3d0 2023-05-24T03:29:47.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.649+0000 7f569effd700 1 -- 172.21.15.146:0/1638774863 >> v1:172.21.15.146:6789/0 conn(0x7f56a00ca3d0 legacy=0x7f56a00ca820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:47.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.649+0000 7f569effd700 1 --2- 172.21.15.146:0/1638774863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5688003bc0 0x7f5688003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:47.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.649+0000 7f569effd700 1 --2- 172.21.15.146:0/1638774863 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5688004850 0x7f5688004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:47.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.649+0000 7f569effd700 1 --2- 172.21.15.146:0/1638774863 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56a00b0520 0x7f5688005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:47.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.649+0000 7f569effd700 1 -- 172.21.15.146:0/1638774863 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a00b12a0 con 0x7f5688003bc0 2023-05-24T03:29:47.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.649+0000 7f569effd700 1 -- 172.21.15.146:0/1638774863 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f568800bac0 con 0x7f5688004850 2023-05-24T03:29:47.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.649+0000 7f569effd700 1 -- 172.21.15.146:0/1638774863 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f568800bc30 con 0x7f56a00b0520 2023-05-24T03:29:47.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.649+0000 7f569ffff700 1 --2- 172.21.15.146:0/1638774863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5688003bc0 0x7f5688003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:47.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.649+0000 7f56a4caf700 1 --2- 172.21.15.146:0/1638774863 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56a00b0520 0x7f5688005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:47.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.649+0000 7f569f7fe700 1 --2- 172.21.15.146:0/1638774863 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5688004850 0x7f5688004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:47.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.649+0000 7f569ffff700 1 -- 172.21.15.146:0/1638774863 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56a00b0520 msgr2=0x7f5688005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:47.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.649+0000 7f569ffff700 1 --2- 172.21.15.146:0/1638774863 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56a00b0520 0x7f5688005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:47.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.649+0000 7f569ffff700 1 -- 172.21.15.146:0/1638774863 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5688004850 msgr2=0x7f5688004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:47.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.649+0000 7f569ffff700 1 --2- 172.21.15.146:0/1638774863 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5688004850 0x7f5688004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:47.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.650+0000 7f569ffff700 1 -- 172.21.15.146:0/1638774863 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56880035b0 con 0x7f5688003bc0 2023-05-24T03:29:47.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.650+0000 7f569ffff700 1 --2- 172.21.15.146:0/1638774863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5688003bc0 0x7f5688003fb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5694009b60 tx=0x7f5688005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d244a5e2e8be84ca server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:47.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.650+0000 7f569effd700 1 -- 172.21.15.146:0/1638774863 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569400e6c0 con 0x7f5688003bc0 2023-05-24T03:29:47.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.650+0000 7f569effd700 1 -- 172.21.15.146:0/1638774863 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569400e820 con 0x7f5688003bc0 2023-05-24T03:29:47.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.650+0000 7f569effd700 1 -- 172.21.15.146:0/1638774863 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569400eb90 con 0x7f5688003bc0 2023-05-24T03:29:47.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.650+0000 7f56a6712700 1 -- 172.21.15.146:0/1638774863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5688003bc0 msgr2=0x7f5688003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:47.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.650+0000 7f56a6712700 1 --2- 172.21.15.146:0/1638774863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5688003bc0 0x7f5688003fb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5694009b60 tx=0x7f5688005880 comp rx=0 tx=0).stop 2023-05-24T03:29:47.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.650+0000 7f56a4caf700 1 -- 172.21.15.146:0/1638774863 reap_dead start 2023-05-24T03:29:47.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.650+0000 7f56a6712700 1 -- 172.21.15.146:0/1638774863 shutdown_connections 2023-05-24T03:29:47.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.650+0000 7f56a6712700 1 -- 172.21.15.146:0/1638774863 >> 172.21.15.146:0/1638774863 conn(0x7f56a00cf6c0 msgr2=0x7f56a00cfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:47.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.650+0000 7f56a6712700 1 -- 172.21.15.146:0/1638774863 shutdown_connections 2023-05-24T03:29:47.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.650+0000 7f56a6712700 1 -- 172.21.15.146:0/1638774863 wait complete. 2023-05-24T03:29:47.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.652+0000 7f56a6712700 1 Processor -- start 2023-05-24T03:29:47.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.652+0000 7f56a6712700 1 -- start start 2023-05-24T03:29:47.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.653+0000 7f56a6712700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5688003bc0 0x7f56a01541f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:47.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.653+0000 7f56a6712700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56a00c3c00 0x7f56a00c4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:47.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.653+0000 7f56a6712700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56a00b2e20 0x7f56a00b32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:47.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.653+0000 7f56a6712700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a00c52d0 con 0x7f56a00c3c00 2023-05-24T03:29:47.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.653+0000 7f56a6712700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a00c46c0 con 0x7f56a00b2e20 2023-05-24T03:29:47.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.653+0000 7f56a6712700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a00c49a0 con 0x7f5688003bc0 2023-05-24T03:29:47.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.653+0000 7f569f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56a00c3c00 0x7f56a00c4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:47.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.653+0000 7f569f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56a00c3c00 0x7f56a00c4070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38694/0 (socket says 172.21.15.146:38694) 2023-05-24T03:29:47.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.653+0000 7f569f7fe700 1 -- 172.21.15.146:0/3305765998 learned_addr learned my addr 172.21.15.146:0/3305765998 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:47.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.653+0000 7f569ffff700 1 --2- 172.21.15.146:0/3305765998 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5688003bc0 0x7f56a01541f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:47.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.653+0000 7f56a4caf700 1 --2- 172.21.15.146:0/3305765998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56a00b2e20 0x7f56a00b32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:47.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.653+0000 7f569f7fe700 1 -- 172.21.15.146:0/3305765998 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5688003bc0 msgr2=0x7f56a01541f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:47.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.653+0000 7f569f7fe700 1 --2- 172.21.15.146:0/3305765998 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5688003bc0 0x7f56a01541f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:47.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.653+0000 7f569f7fe700 1 -- 172.21.15.146:0/3305765998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56a00b2e20 msgr2=0x7f56a00b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:47.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.653+0000 7f569f7fe700 1 --2- 172.21.15.146:0/3305765998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56a00b2e20 0x7f56a00b32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:47.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.653+0000 7f569f7fe700 1 -- 172.21.15.146:0/3305765998 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a00af1c0 con 0x7f56a00c3c00 2023-05-24T03:29:47.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.653+0000 7f56a4caf700 1 --2- 172.21.15.146:0/3305765998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56a00b2e20 0x7f56a00b32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:29:47.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.654+0000 7f569f7fe700 1 --2- 172.21.15.146:0/3305765998 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56a00c3c00 0x7f56a00c4070 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f569000f780 tx=0x7f569000fb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:47.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.654+0000 7f569cff9700 1 -- 172.21.15.146:0/3305765998 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5690005320 con 0x7f56a00c3c00 2023-05-24T03:29:47.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.654+0000 7f569cff9700 1 -- 172.21.15.146:0/3305765998 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5690005480 con 0x7f56a00c3c00 2023-05-24T03:29:47.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.654+0000 7f56a6712700 1 -- 172.21.15.146:0/3305765998 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56a00c9eb0 con 0x7f56a00c3c00 2023-05-24T03:29:47.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.654+0000 7f569cff9700 1 -- 172.21.15.146:0/3305765998 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5690006aa0 con 0x7f56a00c3c00 2023-05-24T03:29:47.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.654+0000 7f56a6712700 1 -- 172.21.15.146:0/3305765998 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56a0159e00 con 0x7f56a00c3c00 2023-05-24T03:29:47.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.655+0000 7f56a6712700 1 -- 172.21.15.146:0/3305765998 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56a004e810 con 0x7f56a00c3c00 2023-05-24T03:29:47.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.655+0000 7f569cff9700 1 -- 172.21.15.146:0/3305765998 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5690006c00 con 0x7f56a00c3c00 2023-05-24T03:29:47.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.655+0000 7f569cff9700 1 --2- 172.21.15.146:0/3305765998 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f568c06ace0 0x7f568c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:47.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.656+0000 7f569cff9700 1 -- 172.21.15.146:0/3305765998 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6781+0+0 (secure 0 0 0) 0x7f5690088d40 con 0x7f56a00c3c00 2023-05-24T03:29:47.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.656+0000 7f569ffff700 1 --2- 172.21.15.146:0/3305765998 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f568c06ace0 0x7f568c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:47.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.656+0000 7f569ffff700 1 --2- 172.21.15.146:0/3305765998 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f568c06ace0 0x7f568c06d190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f56940090b0 tx=0x7f5694008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:47.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.660+0000 7f569cff9700 1 -- 172.21.15.146:0/3305765998 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f5690053b30 con 0x7f56a00c3c00 2023-05-24T03:29:47.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:47.847+0000 7f56a6712700 1 -- 172.21.15.146:0/3305765998 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f56a00c5410 con 0x7f56a00c3c00 2023-05-24T03:29:48.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.500+0000 7f569cff9700 1 -- 172.21.15.146:0/3305765998 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v27) v1 ==== 169+0+0 (secure 0 0 0) 0x7f56a00c5410 con 0x7f56a00c3c00 2023-05-24T03:29:48.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.508+0000 7f56a6712700 1 -- 172.21.15.146:0/3305765998 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f568c06ace0 msgr2=0x7f568c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:48.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.508+0000 7f56a6712700 1 --2- 172.21.15.146:0/3305765998 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f568c06ace0 0x7f568c06d190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f56940090b0 tx=0x7f5694008030 comp rx=0 tx=0).stop 2023-05-24T03:29:48.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.508+0000 7f56a6712700 1 -- 172.21.15.146:0/3305765998 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56a00c3c00 msgr2=0x7f56a00c4070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:48.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.508+0000 7f56a6712700 1 --2- 172.21.15.146:0/3305765998 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56a00c3c00 0x7f56a00c4070 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f569000f780 tx=0x7f569000fb40 comp rx=0 tx=0).stop 2023-05-24T03:29:48.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.508+0000 7f56a6712700 1 -- 172.21.15.146:0/3305765998 shutdown_connections 2023-05-24T03:29:48.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.508+0000 7f56a6712700 1 --2- 172.21.15.146:0/3305765998 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f568c06ace0 0x7f568c06d190 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:48.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.508+0000 7f56a6712700 1 --2- 172.21.15.146:0/3305765998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56a00b2e20 0x7f56a00b32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:48.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.508+0000 7f56a6712700 1 --2- 172.21.15.146:0/3305765998 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5688003bc0 0x7f56a01541f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:48.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.508+0000 7f56a6712700 1 --2- 172.21.15.146:0/3305765998 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56a00c3c00 0x7f56a00c4070 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:48.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.508+0000 7f56a6712700 1 -- 172.21.15.146:0/3305765998 >> 172.21.15.146:0/3305765998 conn(0x7f56a00cf6c0 msgr2=0x7f56a01579d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:48.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.508+0000 7f56a6712700 1 -- 172.21.15.146:0/3305765998 shutdown_connections 2023-05-24T03:29:48.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.508+0000 7f56a6712700 1 -- 172.21.15.146:0/3305765998 wait complete. 2023-05-24T03:29:48.519 INFO:teuthology.orchestra.run.smithi146.stderr:set pool 5 allow_ec_overwrites to true 2023-05-24T03:29:48.545 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-05-24T03:29:48.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.666+0000 7f870a824700 1 Processor -- start 2023-05-24T03:29:48.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.666+0000 7f870a824700 1 -- start start 2023-05-24T03:29:48.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.667+0000 7f870a824700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f870406a460 0x7f87040cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:48.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.667+0000 7f870a824700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f870415cd90 0x7f870406a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:48.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.667+0000 7f870a824700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87040cfd00 con 0x7f87040aefd0 2023-05-24T03:29:48.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.667+0000 7f870a824700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8704072350 con 0x7f870406a460 2023-05-24T03:29:48.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.667+0000 7f870a824700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f870406ad70 con 0x7f870415cd90 2023-05-24T03:29:48.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.667+0000 7f8703fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f870406a460 0x7f87040cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:48.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.667+0000 7f8708dc1700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f87040aefd0 0x7f8704160d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45154/0 (socket says 172.21.15.146:45154) 2023-05-24T03:29:48.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.667+0000 7f8708dc1700 1 -- 172.21.15.146:0/3518801708 learned_addr learned my addr 172.21.15.146:0/3518801708 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:29:48.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.667+0000 7f87037fe700 1 --2- 172.21.15.146:0/3518801708 >> v2:172.21.15.151:3300/0 conn(0x7f870415cd90 0x7f870406a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:48.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.667+0000 7f8703fff700 1 -- 172.21.15.146:0/3518801708 >> v2:172.21.15.151:3300/0 conn(0x7f870415cd90 msgr2=0x7f870406a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:48.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.667+0000 7f8703fff700 1 --2- 172.21.15.146:0/3518801708 >> v2:172.21.15.151:3300/0 conn(0x7f870415cd90 0x7f870406a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:48.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.667+0000 7f8703fff700 1 -- 172.21.15.146:0/3518801708 >> v1:172.21.15.146:6789/0 conn(0x7f87040aefd0 legacy=0x7f8704160d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:48.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.667+0000 7f8703fff700 1 -- 172.21.15.146:0/3518801708 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87040cf460 con 0x7f870406a460 2023-05-24T03:29:48.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.667+0000 7f8702ffd700 1 -- 172.21.15.146:0/3518801708 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 345324930 0 0) 0x7f86fc001490 con 0x7f87040aefd0 2023-05-24T03:29:48.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.668+0000 7f8703fff700 1 --2- 172.21.15.146:0/3518801708 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f870406a460 0x7f87040cede0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8704074870 tx=0x7f86f8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29cddb10ec9bb418 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:48.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.668+0000 7f8702ffd700 1 -- 172.21.15.146:0/3518801708 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f8011830 con 0x7f870406a460 2023-05-24T03:29:48.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.668+0000 7f8702ffd700 1 -- 172.21.15.146:0/3518801708 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f8011990 con 0x7f870406a460 2023-05-24T03:29:48.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.668+0000 7f8702ffd700 1 -- 172.21.15.146:0/3518801708 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f8011d20 con 0x7f870406a460 2023-05-24T03:29:48.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.668+0000 7f870a824700 1 -- 172.21.15.146:0/3518801708 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f870406a460 msgr2=0x7f87040cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:48.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.668+0000 7f870a824700 1 --2- 172.21.15.146:0/3518801708 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f870406a460 0x7f87040cede0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8704074870 tx=0x7f86f8009b20 comp rx=0 tx=0).stop 2023-05-24T03:29:48.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.668+0000 7f870a824700 1 -- 172.21.15.146:0/3518801708 shutdown_connections 2023-05-24T03:29:48.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.668+0000 7f870a824700 1 --2- 172.21.15.146:0/3518801708 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f870406a460 0x7f87040cede0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:48.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.668+0000 7f870a824700 1 --2- 172.21.15.146:0/3518801708 >> v2:172.21.15.151:3300/0 conn(0x7f870415cd90 0x7f870406a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:48.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.668+0000 7f870a824700 1 -- 172.21.15.146:0/3518801708 >> 172.21.15.146:0/3518801708 conn(0x7f87040cfea0 msgr2=0x7f87040d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:48.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.668+0000 7f870a824700 1 -- 172.21.15.146:0/3518801708 shutdown_connections 2023-05-24T03:29:48.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.668+0000 7f870a824700 1 -- 172.21.15.146:0/3518801708 wait complete. 2023-05-24T03:29:48.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.670+0000 7f870a824700 1 Processor -- start 2023-05-24T03:29:48.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.670+0000 7f870a824700 1 -- start start 2023-05-24T03:29:48.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.670+0000 7f870a824700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f870406a460 0x7f87040b2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:48.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.670+0000 7f870a824700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87040aefd0 0x7f8704150cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:48.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.670+0000 7f870a824700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f870415cd90 0x7f87040af620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:48.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.670+0000 7f870a824700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87040b1cc0 con 0x7f87040aefd0 2023-05-24T03:29:48.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.670+0000 7f870a824700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87040b0dd0 con 0x7f870415cd90 2023-05-24T03:29:48.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.670+0000 7f870a824700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87040b10b0 con 0x7f870406a460 2023-05-24T03:29:48.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.671+0000 7f87037fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87040aefd0 0x7f8704150cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:48.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.671+0000 7f87037fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87040aefd0 0x7f8704150cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38704/0 (socket says 172.21.15.146:38704) 2023-05-24T03:29:48.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.671+0000 7f87037fe700 1 -- 172.21.15.146:0/2773157181 learned_addr learned my addr 172.21.15.146:0/2773157181 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:48.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.671+0000 7f8708dc1700 1 --2- 172.21.15.146:0/2773157181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f870415cd90 0x7f87040af620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:48.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.671+0000 7f87037fe700 1 -- 172.21.15.146:0/2773157181 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f870406a460 msgr2=0x7f87040b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:48.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.671+0000 7f87037fe700 1 --2- 172.21.15.146:0/2773157181 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f870406a460 0x7f87040b2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:48.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.671+0000 7f87037fe700 1 -- 172.21.15.146:0/2773157181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f870415cd90 msgr2=0x7f87040af620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:48.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.671+0000 7f87037fe700 1 --2- 172.21.15.146:0/2773157181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f870415cd90 0x7f87040af620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:48.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.671+0000 7f87037fe700 1 -- 172.21.15.146:0/2773157181 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f80094a0 con 0x7f87040aefd0 2023-05-24T03:29:48.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.671+0000 7f87037fe700 1 --2- 172.21.15.146:0/2773157181 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87040aefd0 0x7f8704150cb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f86f400d800 tx=0x7f86f400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:48.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.671+0000 7f8700ff9700 1 -- 172.21.15.146:0/2773157181 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f40125f0 con 0x7f87040aefd0 2023-05-24T03:29:48.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.671+0000 7f8700ff9700 1 -- 172.21.15.146:0/2773157181 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f4012750 con 0x7f87040aefd0 2023-05-24T03:29:48.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.671+0000 7f8700ff9700 1 -- 172.21.15.146:0/2773157181 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f4012b00 con 0x7f87040aefd0 2023-05-24T03:29:48.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.671+0000 7f870a824700 1 -- 172.21.15.146:0/2773157181 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87040cfa20 con 0x7f87040aefd0 2023-05-24T03:29:48.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.671+0000 7f870a824700 1 -- 172.21.15.146:0/2773157181 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87040cf740 con 0x7f87040aefd0 2023-05-24T03:29:48.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.672+0000 7f870a824700 1 -- 172.21.15.146:0/2773157181 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8704160800 con 0x7f87040aefd0 2023-05-24T03:29:48.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.672+0000 7f8700ff9700 1 -- 172.21.15.146:0/2773157181 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f86f4012c60 con 0x7f87040aefd0 2023-05-24T03:29:48.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.673+0000 7f8700ff9700 1 --2- 172.21.15.146:0/2773157181 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f86f006ace0 0x7f86f006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:48.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.673+0000 7f8703fff700 1 --2- 172.21.15.146:0/2773157181 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f86f006ace0 0x7f86f006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:48.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.673+0000 7f8700ff9700 1 -- 172.21.15.146:0/2773157181 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6781+0+0 (secure 0 0 0) 0x7f86f4089b50 con 0x7f87040aefd0 2023-05-24T03:29:48.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.673+0000 7f8703fff700 1 --2- 172.21.15.146:0/2773157181 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f86f006ace0 0x7f86f006d190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f86f80090b0 tx=0x7f86f8010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:48.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.677+0000 7f8700ff9700 1 -- 172.21.15.146:0/2773157181 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f86f4054930 con 0x7f87040aefd0 2023-05-24T03:29:48.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.910+0000 7f870a824700 1 -- 172.21.15.146:0/2773157181 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f8704068d00 con 0x7f87040aefd0 2023-05-24T03:29:48.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.919+0000 7f8700ff9700 1 -- 172.21.15.146:0/2773157181 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f86f4057f50 con 0x7f87040aefd0 2023-05-24T03:29:48.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.922+0000 7f870a824700 1 -- 172.21.15.146:0/2773157181 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f86f006ace0 msgr2=0x7f86f006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:48.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.922+0000 7f870a824700 1 --2- 172.21.15.146:0/2773157181 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f86f006ace0 0x7f86f006d190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f86f80090b0 tx=0x7f86f8010000 comp rx=0 tx=0).stop 2023-05-24T03:29:48.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.922+0000 7f870a824700 1 -- 172.21.15.146:0/2773157181 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87040aefd0 msgr2=0x7f8704150cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:48.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.922+0000 7f870a824700 1 --2- 172.21.15.146:0/2773157181 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87040aefd0 0x7f8704150cb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f86f400d800 tx=0x7f86f400dbc0 comp rx=0 tx=0).stop 2023-05-24T03:29:48.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.922+0000 7f870a824700 1 -- 172.21.15.146:0/2773157181 shutdown_connections 2023-05-24T03:29:48.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.922+0000 7f870a824700 1 --2- 172.21.15.146:0/2773157181 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f86f006ace0 0x7f86f006d190 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:48.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.922+0000 7f870a824700 1 --2- 172.21.15.146:0/2773157181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f870415cd90 0x7f87040af620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:48.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.922+0000 7f870a824700 1 --2- 172.21.15.146:0/2773157181 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f870406a460 0x7f87040b2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:48.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.922+0000 7f870a824700 1 --2- 172.21.15.146:0/2773157181 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87040aefd0 0x7f8704150cb0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:48.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.922+0000 7f870a824700 1 -- 172.21.15.146:0/2773157181 >> 172.21.15.146:0/2773157181 conn(0x7f87040cfea0 msgr2=0x7f870415c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:48.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.922+0000 7f870a824700 1 -- 172.21.15.146:0/2773157181 shutdown_connections 2023-05-24T03:29:48.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:48.922+0000 7f870a824700 1 -- 172.21.15.146:0/2773157181 wait complete. 2023-05-24T03:29:48.928 INFO:teuthology.orchestra.run.smithi146.stderr:added data pool 5 to fsmap 2023-05-24T03:29:48.938 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-24T03:29:49.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.054+0000 7f5c7e3ee700 1 Processor -- start 2023-05-24T03:29:49.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.054+0000 7f5c7e3ee700 1 -- start start 2023-05-24T03:29:49.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.055+0000 7f5c7e3ee700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5c78159c80 0x7f5c7815dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:49.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.055+0000 7f5c7e3ee700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c78070f50 0x7f5c7806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:49.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.055+0000 7f5c7e3ee700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c7815e230 con 0x7f5c780cdf10 2023-05-24T03:29:49.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.055+0000 7f5c7e3ee700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c7815a120 con 0x7f5c78159c80 2023-05-24T03:29:49.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.055+0000 7f5c7e3ee700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7815a3c0 con 0x7f5c78070f50 2023-05-24T03:29:49.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.055+0000 7f5c77fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f5c780cdf10 0x7f5c780ce2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45164/0 (socket says 172.21.15.146:45164) 2023-05-24T03:29:49.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.055+0000 7f5c77fff700 1 -- 172.21.15.146:0/2086452418 learned_addr learned my addr 172.21.15.146:0/2086452418 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:29:49.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.055+0000 7f5c7c98b700 1 --2- 172.21.15.146:0/2086452418 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c78070f50 0x7f5c7806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:49.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.055+0000 7f5c777fe700 1 --2- 172.21.15.146:0/2086452418 >> v2:172.21.15.151:3300/0 conn(0x7f5c78159c80 0x7f5c7815dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:49.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.055+0000 7f5c76ffd700 1 -- 172.21.15.146:0/2086452418 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2967891273 0 0) 0x7f5c68001110 con 0x7f5c780cdf10 2023-05-24T03:29:49.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.055+0000 7f5c76ffd700 1 -- 172.21.15.146:0/2086452418 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c600057c0 con 0x7f5c780cdf10 2023-05-24T03:29:49.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.055+0000 7f5c76ffd700 1 -- 172.21.15.146:0/2086452418 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3138109857 0 0) 0x7f5c600057c0 con 0x7f5c780cdf10 2023-05-24T03:29:49.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.055+0000 7f5c76ffd700 1 -- 172.21.15.146:0/2086452418 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c78070f50 msgr2=0x7f5c7806d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:49.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.055+0000 7f5c76ffd700 1 --2- 172.21.15.146:0/2086452418 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c78070f50 0x7f5c7806d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:49.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.055+0000 7f5c76ffd700 1 -- 172.21.15.146:0/2086452418 >> v2:172.21.15.151:3300/0 conn(0x7f5c78159c80 msgr2=0x7f5c7815dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:49.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.055+0000 7f5c76ffd700 1 --2- 172.21.15.146:0/2086452418 >> v2:172.21.15.151:3300/0 conn(0x7f5c78159c80 0x7f5c7815dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:49.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.055+0000 7f5c76ffd700 1 -- 172.21.15.146:0/2086452418 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c7815a6a0 con 0x7f5c780cdf10 2023-05-24T03:29:49.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.055+0000 7f5c76ffd700 1 -- 172.21.15.146:0/2086452418 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1301887351 0 0) 0x7f5c68001800 con 0x7f5c780cdf10 2023-05-24T03:29:49.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.055+0000 7f5c76ffd700 1 -- 172.21.15.146:0/2086452418 >> v1:172.21.15.146:6789/0 conn(0x7f5c780cdf10 legacy=0x7f5c780ce2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:49.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.056+0000 7f5c76ffd700 1 --2- 172.21.15.146:0/2086452418 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c60005c10 0x7f5c60006020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:49.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.056+0000 7f5c76ffd700 1 --2- 172.21.15.146:0/2086452418 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c78070f50 0x7f5c60006a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:49.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.056+0000 7f5c76ffd700 1 --2- 172.21.15.146:0/2086452418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c60006fa0 0x7f5c60007410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:49.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.056+0000 7f5c76ffd700 1 -- 172.21.15.146:0/2086452418 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7815a120 con 0x7f5c60006fa0 2023-05-24T03:29:49.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.056+0000 7f5c76ffd700 1 -- 172.21.15.146:0/2086452418 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7815a3c0 con 0x7f5c60005c10 2023-05-24T03:29:49.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.056+0000 7f5c76ffd700 1 -- 172.21.15.146:0/2086452418 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6000dc20 con 0x7f5c78070f50 2023-05-24T03:29:49.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.056+0000 7f5c7c98b700 1 --2- 172.21.15.146:0/2086452418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c60006fa0 0x7f5c60007410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:49.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.056+0000 7f5c777fe700 1 --2- 172.21.15.146:0/2086452418 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c78070f50 0x7f5c60006a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:49.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.056+0000 7f5c77fff700 1 --2- 172.21.15.146:0/2086452418 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c60005c10 0x7f5c60006020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:49.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.056+0000 7f5c7c98b700 1 -- 172.21.15.146:0/2086452418 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c78070f50 msgr2=0x7f5c60006a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:49.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.056+0000 7f5c7c98b700 1 --2- 172.21.15.146:0/2086452418 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c78070f50 0x7f5c60006a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:49.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.056+0000 7f5c7c98b700 1 -- 172.21.15.146:0/2086452418 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c60005c10 msgr2=0x7f5c60006020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:49.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.056+0000 7f5c7c98b700 1 --2- 172.21.15.146:0/2086452418 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c60005c10 0x7f5c60006020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:49.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.056+0000 7f5c7c98b700 1 -- 172.21.15.146:0/2086452418 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c600057c0 con 0x7f5c60006fa0 2023-05-24T03:29:49.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.056+0000 7f5c7c98b700 1 --2- 172.21.15.146:0/2086452418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c60006fa0 0x7f5c60007410 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5c70009fc0 tx=0x7f5c60007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0e73172f124e6e4 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:49.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.056+0000 7f5c76ffd700 1 -- 172.21.15.146:0/2086452418 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c7000ebd0 con 0x7f5c60006fa0 2023-05-24T03:29:49.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.056+0000 7f5c76ffd700 1 -- 172.21.15.146:0/2086452418 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c7000f040 con 0x7f5c60006fa0 2023-05-24T03:29:49.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.056+0000 7f5c76ffd700 1 -- 172.21.15.146:0/2086452418 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c70014480 con 0x7f5c60006fa0 2023-05-24T03:29:49.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.057+0000 7f5c7e3ee700 1 -- 172.21.15.146:0/2086452418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c60006fa0 msgr2=0x7f5c60007410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:49.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.057+0000 7f5c7e3ee700 1 --2- 172.21.15.146:0/2086452418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c60006fa0 0x7f5c60007410 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5c70009fc0 tx=0x7f5c60007a90 comp rx=0 tx=0).stop 2023-05-24T03:29:49.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.057+0000 7f5c7c98b700 1 -- 172.21.15.146:0/2086452418 reap_dead start 2023-05-24T03:29:49.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.057+0000 7f5c7e3ee700 1 -- 172.21.15.146:0/2086452418 shutdown_connections 2023-05-24T03:29:49.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.057+0000 7f5c7e3ee700 1 -- 172.21.15.146:0/2086452418 >> 172.21.15.146:0/2086452418 conn(0x7f5c780cfea0 msgr2=0x7f5c780d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:49.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.057+0000 7f5c7e3ee700 1 -- 172.21.15.146:0/2086452418 shutdown_connections 2023-05-24T03:29:49.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.057+0000 7f5c7e3ee700 1 -- 172.21.15.146:0/2086452418 wait complete. 2023-05-24T03:29:49.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.058+0000 7f5c7e3ee700 1 Processor -- start 2023-05-24T03:29:49.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.058+0000 7f5c7e3ee700 1 -- start start 2023-05-24T03:29:49.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.059+0000 7f5c7e3ee700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c780b1ad0 0x7f5c780b2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:49.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.059+0000 7f5c7e3ee700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c780b3210 0x7f5c780b05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:49.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.059+0000 7f5c7e3ee700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c780b0b00 0x7f5c78158830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:49.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.059+0000 7f5c7e3ee700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c780b1ea0 con 0x7f5c780b0b00 2023-05-24T03:29:49.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.059+0000 7f5c7e3ee700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c780b0f80 con 0x7f5c780b3210 2023-05-24T03:29:49.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.059+0000 7f5c7e3ee700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7814dc50 con 0x7f5c780b1ad0 2023-05-24T03:29:49.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.059+0000 7f5c7c98b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c780b0b00 0x7f5c78158830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:49.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.059+0000 7f5c7c98b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c780b0b00 0x7f5c78158830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38728/0 (socket says 172.21.15.146:38728) 2023-05-24T03:29:49.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.059+0000 7f5c7c98b700 1 -- 172.21.15.146:0/554606750 learned_addr learned my addr 172.21.15.146:0/554606750 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:49.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.059+0000 7f5c77fff700 1 --2- 172.21.15.146:0/554606750 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c780b1ad0 0x7f5c780b2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:49.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.059+0000 7f5c777fe700 1 --2- 172.21.15.146:0/554606750 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c780b3210 0x7f5c780b05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:49.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.059+0000 7f5c7c98b700 1 -- 172.21.15.146:0/554606750 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c780b1ad0 msgr2=0x7f5c780b2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:49.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.059+0000 7f5c7c98b700 1 --2- 172.21.15.146:0/554606750 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c780b1ad0 0x7f5c780b2cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:49.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.059+0000 7f5c7c98b700 1 -- 172.21.15.146:0/554606750 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c780b3210 msgr2=0x7f5c780b05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:49.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.059+0000 7f5c7c98b700 1 --2- 172.21.15.146:0/554606750 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c780b3210 0x7f5c780b05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:49.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.059+0000 7f5c7c98b700 1 -- 172.21.15.146:0/554606750 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c7815ac60 con 0x7f5c780b0b00 2023-05-24T03:29:49.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.059+0000 7f5c77fff700 1 --2- 172.21.15.146:0/554606750 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c780b1ad0 0x7f5c780b2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:29:49.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.059+0000 7f5c777fe700 1 --2- 172.21.15.146:0/554606750 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c780b3210 0x7f5c780b05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:29:49.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.059+0000 7f5c7c98b700 1 --2- 172.21.15.146:0/554606750 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c780b0b00 0x7f5c78158830 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5c70009f60 tx=0x7f5c70009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:49.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.060+0000 7f5c74ff9700 1 -- 172.21.15.146:0/554606750 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c70007000 con 0x7f5c780b0b00 2023-05-24T03:29:49.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.060+0000 7f5c74ff9700 1 -- 172.21.15.146:0/554606750 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c70003e70 con 0x7f5c780b0b00 2023-05-24T03:29:49.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.060+0000 7f5c74ff9700 1 -- 172.21.15.146:0/554606750 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c70014ab0 con 0x7f5c780b0b00 2023-05-24T03:29:49.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.060+0000 7f5c7e3ee700 1 -- 172.21.15.146:0/554606750 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c7815a980 con 0x7f5c780b0b00 2023-05-24T03:29:49.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.060+0000 7f5c7e3ee700 1 -- 172.21.15.146:0/554606750 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c7806d190 con 0x7f5c780b0b00 2023-05-24T03:29:49.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.061+0000 7f5c7e3ee700 1 -- 172.21.15.146:0/554606750 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c7804e810 con 0x7f5c780b0b00 2023-05-24T03:29:49.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.061+0000 7f5c74ff9700 1 -- 172.21.15.146:0/554606750 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5c70023020 con 0x7f5c780b0b00 2023-05-24T03:29:49.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.061+0000 7f5c74ff9700 1 --2- 172.21.15.146:0/554606750 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f5c6406ad10 0x7f5c6406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:49.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.061+0000 7f5c74ff9700 1 -- 172.21.15.146:0/554606750 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5c7008aa30 con 0x7f5c780b0b00 2023-05-24T03:29:49.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.062+0000 7f5c77fff700 1 --2- 172.21.15.146:0/554606750 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f5c6406ad10 0x7f5c6406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:49.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.062+0000 7f5c77fff700 1 --2- 172.21.15.146:0/554606750 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f5c6406ad10 0x7f5c6406d1c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5c680012b0 tx=0x7f5c68009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:49.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.066+0000 7f5c74ff9700 1 -- 172.21.15.146:0/554606750 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f5c70055880 con 0x7f5c780b0b00 2023-05-24T03:29:49.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.298+0000 7f5c7e3ee700 1 -- 172.21.15.146:0/554606750 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5c780d0c60 con 0x7f5c780b0b00 2023-05-24T03:29:49.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.298+0000 7f5c74ff9700 1 -- 172.21.15.146:0/554606750 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4883 (secure 0 0 0) 0x7f5c70058ea0 con 0x7f5c780b0b00 2023-05-24T03:29:49.304 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:29:49.304 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1500590330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1500590330},{"type":"v1","addr":"172.21.15.151:6835","nonce":1500590330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/3574684057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3574684057},{"type":"v1","addr":"172.21.15.146:6837","nonce":3574684057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/3420469594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3420469594},{"type":"v1","addr":"172.21.15.151:6833","nonce":3420469594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-24T03:29:44.469134+0000","modified":"2023-05-24T03:29:48.912851+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6836/4012487240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":4012487240},{"type":"v1","addr":"172.21.15.146:6836","nonce":4012487240}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-05-24T03:29:49.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.300+0000 7f5c7e3ee700 1 -- 172.21.15.146:0/554606750 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f5c6406ad10 msgr2=0x7f5c6406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:49.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.300+0000 7f5c7e3ee700 1 --2- 172.21.15.146:0/554606750 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f5c6406ad10 0x7f5c6406d1c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5c680012b0 tx=0x7f5c68009040 comp rx=0 tx=0).stop 2023-05-24T03:29:49.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.300+0000 7f5c7e3ee700 1 -- 172.21.15.146:0/554606750 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c780b0b00 msgr2=0x7f5c78158830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:49.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.300+0000 7f5c7e3ee700 1 --2- 172.21.15.146:0/554606750 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c780b0b00 0x7f5c78158830 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5c70009f60 tx=0x7f5c70009750 comp rx=0 tx=0).stop 2023-05-24T03:29:49.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.300+0000 7f5c7e3ee700 1 -- 172.21.15.146:0/554606750 shutdown_connections 2023-05-24T03:29:49.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.300+0000 7f5c7e3ee700 1 --2- 172.21.15.146:0/554606750 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f5c6406ad10 0x7f5c6406d1c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:49.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.300+0000 7f5c7e3ee700 1 --2- 172.21.15.146:0/554606750 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c780b0b00 0x7f5c78158830 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:49.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.300+0000 7f5c7e3ee700 1 --2- 172.21.15.146:0/554606750 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c780b1ad0 0x7f5c780b2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:49.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.300+0000 7f5c7e3ee700 1 --2- 172.21.15.146:0/554606750 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c780b3210 0x7f5c780b05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:49.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.300+0000 7f5c7e3ee700 1 -- 172.21.15.146:0/554606750 >> 172.21.15.146:0/554606750 conn(0x7f5c780cfea0 msgr2=0x7f5c78157160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:49.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.300+0000 7f5c7e3ee700 1 -- 172.21.15.146:0/554606750 shutdown_connections 2023-05-24T03:29:49.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.300+0000 7f5c7e3ee700 1 -- 172.21.15.146:0/554606750 wait complete. 2023-05-24T03:29:49.309 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 7 2023-05-24T03:29:49.317 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-24T03:29:49.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.433+0000 7feccc435700 1 Processor -- start 2023-05-24T03:29:49.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.433+0000 7feccc435700 1 -- start start 2023-05-24T03:29:49.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.434+0000 7feccc435700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fecc415a9c0 0x7fecc40b52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:49.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.434+0000 7feccc435700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fecc40cc500 0x7fecc4071720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:49.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.434+0000 7feccc435700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecc40cb740 con 0x7fecc40b5820 2023-05-24T03:29:49.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.434+0000 7feccc435700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecc40cba20 con 0x7fecc40cc500 2023-05-24T03:29:49.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.434+0000 7feccc435700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecc40cbd00 con 0x7fecc415a9c0 2023-05-24T03:29:49.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.434+0000 7fecc99d0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fecc40cc500 0x7fecc4071720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:49.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.434+0000 7fecc99d0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fecc40cc500 0x7fecc4071720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38736/0 (socket says 172.21.15.146:38736) 2023-05-24T03:29:49.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.434+0000 7fecc99d0700 1 -- 172.21.15.146:0/3819388318 learned_addr learned my addr 172.21.15.146:0/3819388318 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:49.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.434+0000 7fecca1d1700 1 --2- 172.21.15.146:0/3819388318 >> v2:172.21.15.151:3300/0 conn(0x7fecc415a9c0 0x7fecc40b52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:49.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.434+0000 7fecc99d0700 1 -- 172.21.15.146:0/3819388318 >> v2:172.21.15.151:3300/0 conn(0x7fecc415a9c0 msgr2=0x7fecc40b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:49.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.434+0000 7fecc99d0700 1 --2- 172.21.15.146:0/3819388318 >> v2:172.21.15.151:3300/0 conn(0x7fecc415a9c0 0x7fecc40b52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:49.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.434+0000 7fecc99d0700 1 -- 172.21.15.146:0/3819388318 >> v1:172.21.15.151:6789/0 conn(0x7fecc40b5820 legacy=0x7fecc40b1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:49.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.434+0000 7fecc99d0700 1 -- 172.21.15.146:0/3819388318 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc40cbfe0 con 0x7fecc40cc500 2023-05-24T03:29:49.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.434+0000 7fecc99d0700 1 --2- 172.21.15.146:0/3819388318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecc40cc500 0x7fecc4071720 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fecc40cfe00 tx=0x7fecb4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74646f4689fafd83 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:49.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.434+0000 7fecc91cf700 1 -- 172.21.15.146:0/3819388318 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb4011830 con 0x7fecc40cc500 2023-05-24T03:29:49.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.435+0000 7fecc91cf700 1 -- 172.21.15.146:0/3819388318 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecb4011990 con 0x7fecc40cc500 2023-05-24T03:29:49.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.435+0000 7fecc91cf700 1 -- 172.21.15.146:0/3819388318 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb4011d20 con 0x7fecc40cc500 2023-05-24T03:29:49.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.435+0000 7feccc435700 1 -- 172.21.15.146:0/3819388318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecc40cc500 msgr2=0x7fecc4071720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:49.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.435+0000 7feccc435700 1 --2- 172.21.15.146:0/3819388318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecc40cc500 0x7fecc4071720 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fecc40cfe00 tx=0x7fecb4009bd0 comp rx=0 tx=0).stop 2023-05-24T03:29:49.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.435+0000 7feccc435700 1 -- 172.21.15.146:0/3819388318 shutdown_connections 2023-05-24T03:29:49.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.435+0000 7feccc435700 1 --2- 172.21.15.146:0/3819388318 >> v2:172.21.15.151:3300/0 conn(0x7fecc415a9c0 0x7fecc40b52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:49.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.435+0000 7feccc435700 1 --2- 172.21.15.146:0/3819388318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecc40cc500 0x7fecc4071720 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:49.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.435+0000 7feccc435700 1 -- 172.21.15.146:0/3819388318 >> 172.21.15.146:0/3819388318 conn(0x7fecc40cfea0 msgr2=0x7fecc40d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:49.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.435+0000 7feccc435700 1 -- 172.21.15.146:0/3819388318 shutdown_connections 2023-05-24T03:29:49.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.435+0000 7feccc435700 1 -- 172.21.15.146:0/3819388318 wait complete. 2023-05-24T03:29:49.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.436+0000 7feccc435700 1 Processor -- start 2023-05-24T03:29:49.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.436+0000 7feccc435700 1 -- start start 2023-05-24T03:29:49.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.437+0000 7feccc435700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fecc40b5820 0x7fecc41f2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:49.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.437+0000 7feccc435700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecc40cc500 0x7fecc415cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:49.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.437+0000 7feccc435700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fecc415a9c0 0x7fecc415d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:49.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.437+0000 7feccc435700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc40b0060 con 0x7fecc40cc500 2023-05-24T03:29:49.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.437+0000 7feccc435700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc415d5a0 con 0x7fecc415a9c0 2023-05-24T03:29:49.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.437+0000 7feccc435700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecc41f3140 con 0x7fecc40b5820 2023-05-24T03:29:49.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.437+0000 7fecc99d0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecc40cc500 0x7fecc415cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:49.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.437+0000 7fecc99d0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecc40cc500 0x7fecc415cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38738/0 (socket says 172.21.15.146:38738) 2023-05-24T03:29:49.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.437+0000 7fecc99d0700 1 -- 172.21.15.146:0/3265572880 learned_addr learned my addr 172.21.15.146:0/3265572880 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:49.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.437+0000 7fecca9d2700 1 --2- 172.21.15.146:0/3265572880 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fecc415a9c0 0x7fecc415d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:49.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.437+0000 7fecc99d0700 1 -- 172.21.15.146:0/3265572880 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fecc40b5820 msgr2=0x7fecc41f2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:49.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.437+0000 7fecc99d0700 1 --2- 172.21.15.146:0/3265572880 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fecc40b5820 0x7fecc41f2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:49.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.437+0000 7fecc99d0700 1 -- 172.21.15.146:0/3265572880 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fecc415a9c0 msgr2=0x7fecc415d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:49.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.437+0000 7fecc99d0700 1 --2- 172.21.15.146:0/3265572880 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fecc415a9c0 0x7fecc415d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:49.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.437+0000 7fecc99d0700 1 -- 172.21.15.146:0/3265572880 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb4009550 con 0x7fecc40cc500 2023-05-24T03:29:49.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.438+0000 7fecc99d0700 1 --2- 172.21.15.146:0/3265572880 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecc40cc500 0x7fecc415cb20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fecb4009c10 tx=0x7fecb4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:49.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.438+0000 7fecbaffd700 1 -- 172.21.15.146:0/3265572880 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb40036a0 con 0x7fecc40cc500 2023-05-24T03:29:49.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.438+0000 7fecbaffd700 1 -- 172.21.15.146:0/3265572880 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecb401f070 con 0x7fecc40cc500 2023-05-24T03:29:49.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.438+0000 7feccc435700 1 -- 172.21.15.146:0/3265572880 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecc40b5da0 con 0x7fecc40cc500 2023-05-24T03:29:49.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.438+0000 7fecbaffd700 1 -- 172.21.15.146:0/3265572880 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb4003a40 con 0x7fecc40cc500 2023-05-24T03:29:49.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.438+0000 7feccc435700 1 -- 172.21.15.146:0/3265572880 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecc415ad90 con 0x7fecc40cc500 2023-05-24T03:29:49.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.439+0000 7feccc435700 1 -- 172.21.15.146:0/3265572880 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecc40b01a0 con 0x7fecc40cc500 2023-05-24T03:29:49.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.439+0000 7fecbaffd700 1 -- 172.21.15.146:0/3265572880 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fecb4003ba0 con 0x7fecc40cc500 2023-05-24T03:29:49.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.439+0000 7fecbaffd700 1 --2- 172.21.15.146:0/3265572880 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7feca806ace0 0x7feca806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:49.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.440+0000 7fecbaffd700 1 -- 172.21.15.146:0/3265572880 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fecb4021070 con 0x7fecc40cc500 2023-05-24T03:29:49.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.440+0000 7fecca1d1700 1 --2- 172.21.15.146:0/3265572880 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7feca806ace0 0x7feca806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:49.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.440+0000 7fecca1d1700 1 --2- 172.21.15.146:0/3265572880 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7feca806ace0 0x7feca806d190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fecc0006b20 tx=0x7fecc0006ab0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:49.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.444+0000 7fecbaffd700 1 -- 172.21.15.146:0/3265572880 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fecc40b01a0 con 0x7fecc40cc500 2023-05-24T03:29:49.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.632+0000 7feccc435700 1 -- 172.21.15.146:0/3265572880 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fecc40b01a0 con 0x7fecc40cc500 2023-05-24T03:29:49.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.633+0000 7fecbaffd700 1 -- 172.21.15.146:0/3265572880 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20156 (secure 0 0 0) 0x7fecc40b01a0 con 0x7fecc40cc500 2023-05-24T03:29:49.638 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:29:49.638 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":28,"fsid":"11ca0adb-7672-4713-bde7-451e8b743ae9","created":"2023-05-24T03:29:19.113659+0000","modified":"2023-05-24T03:29:48.912599+0000","last_up_change":"2023-05-24T03:29:30.962339+0000","last_in_change":"2023-05-24T03:29:21.706540+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-24T03:29:32.749984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-24T03:29:37.719623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-24T03:29:42.165379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-24T03:29:43.431615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-24T03:29:46.503075+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f24b319b-fcc8-4385-b0cb-78138fc31417","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6801","nonce":3353593100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6803","nonce":3353593100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6807","nonce":3353593100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6805","nonce":3353593100}]},"public_addr":"172.21.15.146:6801/3353593100","cluster_addr":"172.21.15.146:6803/3353593100","heartbeat_back_addr":"172.21.15.146:6807/3353593100","heartbeat_front_addr":"172.21.15.146:6805/3353593100","state":["exists","up"]},{"osd":1,"uuid":"c9639ea9-8f9b-498e-92c8-aa976edbf1da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6821","nonce":2537488734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6825","nonce":2537488734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6831","nonce":2537488734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6827","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6829","nonce":2537488734}]},"public_addr":"172.21.15.146:6821/2537488734","cluster_addr":"172.21.15.146:6825/2537488734","heartbeat_back_addr":"172.21.15.146:6831/2537488734","heartbeat_front_addr":"172.21.15.146:6829/2537488734","state":["exists","up"]},{"osd":2,"uuid":"7a6cfc6d-b0ca-4cb6-a66d-4001ec184657","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6809","nonce":1800242932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6811","nonce":1800242932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6815","nonce":1800242932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6813","nonce":1800242932}]},"public_addr":"172.21.15.146:6809/1800242932","cluster_addr":"172.21.15.146:6811/1800242932","heartbeat_back_addr":"172.21.15.146:6815/1800242932","heartbeat_front_addr":"172.21.15.146:6813/1800242932","state":["exists","up"]},{"osd":3,"uuid":"401509f7-cecd-44a2-b0ae-22c81a5d93c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6817","nonce":1749783580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6820","nonce":1749783580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6828","nonce":1749783580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6824","nonce":1749783580}]},"public_addr":"172.21.15.146:6817/1749783580","cluster_addr":"172.21.15.146:6820/1749783580","heartbeat_back_addr":"172.21.15.146:6828/1749783580","heartbeat_front_addr":"172.21.15.146:6824/1749783580","state":["exists","up"]},{"osd":4,"uuid":"9d07f440-d125-4f99-a825-411fab894d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6811","nonce":163453435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6814","nonce":163453435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6819","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6821","nonce":163453435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6818","nonce":163453435}]},"public_addr":"172.21.15.151:6811/163453435","cluster_addr":"172.21.15.151:6814/163453435","heartbeat_back_addr":"172.21.15.151:6821/163453435","heartbeat_front_addr":"172.21.15.151:6818/163453435","state":["exists","up"]},{"osd":5,"uuid":"9b2266e2-9e52-4f0e-96da-e703a6c23a6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6801","nonce":3283474903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6803","nonce":3283474903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6807","nonce":3283474903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6805","nonce":3283474903}]},"public_addr":"172.21.15.151:6801/3283474903","cluster_addr":"172.21.15.151:6803/3283474903","heartbeat_back_addr":"172.21.15.151:6807/3283474903","heartbeat_front_addr":"172.21.15.151:6805/3283474903","state":["exists","up"]},{"osd":6,"uuid":"5daedf77-0a83-49e7-b497-d9ed10436972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6825","nonce":3889424178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6827","nonce":3889424178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6831","nonce":3889424178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6829","nonce":3889424178}]},"public_addr":"172.21.15.151:6825/3889424178","cluster_addr":"172.21.15.151:6827/3889424178","heartbeat_back_addr":"172.21.15.151:6831/3889424178","heartbeat_front_addr":"172.21.15.151:6829/3889424178","state":["exists","up"]},{"osd":7,"uuid":"86ae4f7e-c01f-4c3d-a0dd-98160c209309","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6810","nonce":563291208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6815","nonce":563291208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6823","nonce":563291208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6820","nonce":563291208}]},"public_addr":"172.21.15.151:6810/563291208","cluster_addr":"172.21.15.151:6815/563291208","heartbeat_back_addr":"172.21.15.151:6823/563291208","heartbeat_front_addr":"172.21.15.151:6820/563291208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.872472+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.937126+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.877234+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.884793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.881632+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.938293+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.857661+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.945883+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-24T03:29:49.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.635+0000 7feccc435700 1 -- 172.21.15.146:0/3265572880 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7feca806ace0 msgr2=0x7feca806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:49.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.635+0000 7feccc435700 1 --2- 172.21.15.146:0/3265572880 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7feca806ace0 0x7feca806d190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fecc0006b20 tx=0x7fecc0006ab0 comp rx=0 tx=0).stop 2023-05-24T03:29:49.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.635+0000 7feccc435700 1 -- 172.21.15.146:0/3265572880 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecc40cc500 msgr2=0x7fecc415cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:49.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.635+0000 7feccc435700 1 --2- 172.21.15.146:0/3265572880 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecc40cc500 0x7fecc415cb20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fecb4009c10 tx=0x7fecb4004750 comp rx=0 tx=0).stop 2023-05-24T03:29:49.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.635+0000 7feccc435700 1 -- 172.21.15.146:0/3265572880 shutdown_connections 2023-05-24T03:29:49.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.635+0000 7feccc435700 1 --2- 172.21.15.146:0/3265572880 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7feca806ace0 0x7feca806d190 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:49.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.635+0000 7feccc435700 1 --2- 172.21.15.146:0/3265572880 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fecc415a9c0 0x7fecc415d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:49.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.635+0000 7feccc435700 1 --2- 172.21.15.146:0/3265572880 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fecc40b5820 0x7fecc41f2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:49.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.635+0000 7feccc435700 1 --2- 172.21.15.146:0/3265572880 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecc40cc500 0x7fecc415cb20 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:49.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.635+0000 7feccc435700 1 -- 172.21.15.146:0/3265572880 >> 172.21.15.146:0/3265572880 conn(0x7fecc40cfea0 msgr2=0x7fecc406a460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:49.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.635+0000 7feccc435700 1 -- 172.21.15.146:0/3265572880 shutdown_connections 2023-05-24T03:29:49.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.635+0000 7feccc435700 1 -- 172.21.15.146:0/3265572880 wait complete. 2023-05-24T03:29:49.652 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-24T03:29:49.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.768+0000 7f3e92845700 1 Processor -- start 2023-05-24T03:29:49.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.768+0000 7f3e92845700 1 -- start start 2023-05-24T03:29:49.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.769+0000 7f3e92845700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3e8c0cb8c0 0x7f3e8c161030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:49.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.769+0000 7f3e92845700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e8c0cc1d0 0x7f3e8c0b1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:49.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.769+0000 7f3e92845700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3e8c0cbc90 0x7f3e8c06a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:49.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.769+0000 7f3e92845700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e8c0b27e0 con 0x7f3e8c0cb8c0 2023-05-24T03:29:49.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.769+0000 7f3e92845700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e8c0b2220 con 0x7f3e8c0cbc90 2023-05-24T03:29:49.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.769+0000 7f3e92845700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8c0b2500 con 0x7f3e8c0cc1d0 2023-05-24T03:29:49.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.769+0000 7f3e8bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3e8c0cb8c0 0x7f3e8c161030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:49.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.769+0000 7f3e8bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3e8c0cb8c0 0x7f3e8c161030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38746/0 (socket says 172.21.15.146:38746) 2023-05-24T03:29:49.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.769+0000 7f3e8bfff700 1 -- 172.21.15.146:0/2492036492 learned_addr learned my addr 172.21.15.146:0/2492036492 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:49.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.769+0000 7f3e8b7fe700 1 --2- 172.21.15.146:0/2492036492 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e8c0cc1d0 0x7f3e8c0b1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:49.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.769+0000 7f3e90de2700 1 --2- 172.21.15.146:0/2492036492 >> v2:172.21.15.151:3300/0 conn(0x7f3e8c0cbc90 0x7f3e8c06a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:49.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.769+0000 7f3e8bfff700 1 -- 172.21.15.146:0/2492036492 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e8c0cc1d0 msgr2=0x7f3e8c0b1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:49.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.769+0000 7f3e8bfff700 1 --2- 172.21.15.146:0/2492036492 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e8c0cc1d0 0x7f3e8c0b1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:49.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.769+0000 7f3e8bfff700 1 -- 172.21.15.146:0/2492036492 >> v2:172.21.15.151:3300/0 conn(0x7f3e8c0cbc90 msgr2=0x7f3e8c06a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:49.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.769+0000 7f3e8bfff700 1 --2- 172.21.15.146:0/2492036492 >> v2:172.21.15.151:3300/0 conn(0x7f3e8c0cbc90 0x7f3e8c06a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:49.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.769+0000 7f3e8bfff700 1 -- 172.21.15.146:0/2492036492 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e8c160830 con 0x7f3e8c0cb8c0 2023-05-24T03:29:49.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.770+0000 7f3e8bfff700 1 --2- 172.21.15.146:0/2492036492 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e8c0cb8c0 0x7f3e8c161030 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c06b540 tx=0x7f3e80009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95da94792b2b7ce1 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:49.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.770+0000 7f3e8affd700 1 -- 172.21.15.146:0/2492036492 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8000b870 con 0x7f3e8c0cb8c0 2023-05-24T03:29:49.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.770+0000 7f3e8affd700 1 -- 172.21.15.146:0/2492036492 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e8000b9d0 con 0x7f3e8c0cb8c0 2023-05-24T03:29:49.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.770+0000 7f3e8affd700 1 -- 172.21.15.146:0/2492036492 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8000bd60 con 0x7f3e8c0cb8c0 2023-05-24T03:29:49.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.770+0000 7f3e92845700 1 -- 172.21.15.146:0/2492036492 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e8c0cb8c0 msgr2=0x7f3e8c161030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:49.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.770+0000 7f3e92845700 1 --2- 172.21.15.146:0/2492036492 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e8c0cb8c0 0x7f3e8c161030 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c06b540 tx=0x7f3e80009bd0 comp rx=0 tx=0).stop 2023-05-24T03:29:49.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.770+0000 7f3e92845700 1 -- 172.21.15.146:0/2492036492 shutdown_connections 2023-05-24T03:29:49.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.770+0000 7f3e92845700 1 --2- 172.21.15.146:0/2492036492 >> v2:172.21.15.151:3300/0 conn(0x7f3e8c0cbc90 0x7f3e8c06a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:49.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.770+0000 7f3e92845700 1 --2- 172.21.15.146:0/2492036492 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e8c0cb8c0 0x7f3e8c161030 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:49.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.770+0000 7f3e92845700 1 --2- 172.21.15.146:0/2492036492 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e8c0cc1d0 0x7f3e8c0b1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:49.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.770+0000 7f3e92845700 1 -- 172.21.15.146:0/2492036492 >> 172.21.15.146:0/2492036492 conn(0x7f3e8c0cfea0 msgr2=0x7f3e8c0d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:49.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.770+0000 7f3e92845700 1 -- 172.21.15.146:0/2492036492 shutdown_connections 2023-05-24T03:29:49.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.770+0000 7f3e92845700 1 -- 172.21.15.146:0/2492036492 wait complete. 2023-05-24T03:29:49.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.772+0000 7f3e92845700 1 Processor -- start 2023-05-24T03:29:49.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.772+0000 7f3e92845700 1 -- start start 2023-05-24T03:29:49.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.772+0000 7f3e92845700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e8c0cb8c0 0x7f3e8c0c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:49.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.772+0000 7f3e92845700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e8c0cbc90 0x7f3e8c1493d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:49.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.773+0000 7f3e92845700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e8c0cc1d0 0x7f3e8c0c9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:49.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.773+0000 7f3e92845700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8c0c9f60 con 0x7f3e8c0cb8c0 2023-05-24T03:29:49.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.773+0000 7f3e92845700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8c0ca240 con 0x7f3e8c0cc1d0 2023-05-24T03:29:49.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.773+0000 7f3e92845700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8c0ca520 con 0x7f3e8c0cbc90 2023-05-24T03:29:49.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.773+0000 7f3e8bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e8c0cb8c0 0x7f3e8c0c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:49.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.773+0000 7f3e8bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e8c0cb8c0 0x7f3e8c0c6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38754/0 (socket says 172.21.15.146:38754) 2023-05-24T03:29:49.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.773+0000 7f3e8bfff700 1 -- 172.21.15.146:0/2464842646 learned_addr learned my addr 172.21.15.146:0/2464842646 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:49.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.773+0000 7f3e90de2700 1 --2- 172.21.15.146:0/2464842646 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e8c0cc1d0 0x7f3e8c0c9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:49.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.773+0000 7f3e8b7fe700 1 --2- 172.21.15.146:0/2464842646 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e8c0cbc90 0x7f3e8c1493d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:49.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.773+0000 7f3e8bfff700 1 -- 172.21.15.146:0/2464842646 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e8c0cbc90 msgr2=0x7f3e8c1493d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:49.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.773+0000 7f3e8bfff700 1 --2- 172.21.15.146:0/2464842646 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e8c0cbc90 0x7f3e8c1493d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:49.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.773+0000 7f3e8bfff700 1 -- 172.21.15.146:0/2464842646 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e8c0cc1d0 msgr2=0x7f3e8c0c9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:49.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.773+0000 7f3e8bfff700 1 --2- 172.21.15.146:0/2464842646 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e8c0cc1d0 0x7f3e8c0c9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:49.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.773+0000 7f3e8bfff700 1 -- 172.21.15.146:0/2464842646 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e80009550 con 0x7f3e8c0cb8c0 2023-05-24T03:29:49.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.773+0000 7f3e8b7fe700 1 --2- 172.21.15.146:0/2464842646 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e8c0cbc90 0x7f3e8c1493d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:29:49.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.773+0000 7f3e8bfff700 1 --2- 172.21.15.146:0/2464842646 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e8c0cb8c0 0x7f3e8c0c6ee0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3e80000c00 tx=0x7f3e80004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:49.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.773+0000 7f3e88ff9700 1 -- 172.21.15.146:0/2464842646 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e80004540 con 0x7f3e8c0cb8c0 2023-05-24T03:29:49.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.773+0000 7f3e88ff9700 1 -- 172.21.15.146:0/2464842646 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e800036a0 con 0x7f3e8c0cb8c0 2023-05-24T03:29:49.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.773+0000 7f3e92845700 1 -- 172.21.15.146:0/2464842646 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e8c161570 con 0x7f3e8c0cb8c0 2023-05-24T03:29:49.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.773+0000 7f3e88ff9700 1 -- 172.21.15.146:0/2464842646 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e80003a50 con 0x7f3e8c0cb8c0 2023-05-24T03:29:49.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.773+0000 7f3e92845700 1 -- 172.21.15.146:0/2464842646 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e8c160b10 con 0x7f3e8c0cb8c0 2023-05-24T03:29:49.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.774+0000 7f3e92845700 1 -- 172.21.15.146:0/2464842646 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e8c0b1e60 con 0x7f3e8c0cb8c0 2023-05-24T03:29:49.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.774+0000 7f3e88ff9700 1 -- 172.21.15.146:0/2464842646 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3e80021070 con 0x7f3e8c0cb8c0 2023-05-24T03:29:49.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.775+0000 7f3e88ff9700 1 --2- 172.21.15.146:0/2464842646 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f3e7806ace0 0x7f3e7806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:49.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.775+0000 7f3e88ff9700 1 -- 172.21.15.146:0/2464842646 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3e8008ae00 con 0x7f3e8c0cb8c0 2023-05-24T03:29:49.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.775+0000 7f3e8b7fe700 1 --2- 172.21.15.146:0/2464842646 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f3e7806ace0 0x7f3e7806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:49.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.775+0000 7f3e8b7fe700 1 --2- 172.21.15.146:0/2464842646 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f3e7806ace0 0x7f3e7806d190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c0c7420 tx=0x7f3e7c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:49.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.779+0000 7f3e88ff9700 1 -- 172.21.15.146:0/2464842646 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3e80055c50 con 0x7f3e8c0cb8c0 2023-05-24T03:29:49.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.970+0000 7f3e92845700 1 -- 172.21.15.146:0/2464842646 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3e8c04e810 con 0x7f3e8c0cb8c0 2023-05-24T03:29:49.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.971+0000 7f3e88ff9700 1 -- 172.21.15.146:0/2464842646 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20156 (secure 0 0 0) 0x7f3e80015090 con 0x7f3e8c0cb8c0 2023-05-24T03:29:49.977 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:29:49.978 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":28,"fsid":"11ca0adb-7672-4713-bde7-451e8b743ae9","created":"2023-05-24T03:29:19.113659+0000","modified":"2023-05-24T03:29:48.912599+0000","last_up_change":"2023-05-24T03:29:30.962339+0000","last_in_change":"2023-05-24T03:29:21.706540+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-24T03:29:32.749984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-24T03:29:37.719623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-24T03:29:42.165379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-24T03:29:43.431615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-24T03:29:46.503075+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f24b319b-fcc8-4385-b0cb-78138fc31417","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6801","nonce":3353593100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6803","nonce":3353593100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6807","nonce":3353593100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6805","nonce":3353593100}]},"public_addr":"172.21.15.146:6801/3353593100","cluster_addr":"172.21.15.146:6803/3353593100","heartbeat_back_addr":"172.21.15.146:6807/3353593100","heartbeat_front_addr":"172.21.15.146:6805/3353593100","state":["exists","up"]},{"osd":1,"uuid":"c9639ea9-8f9b-498e-92c8-aa976edbf1da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6821","nonce":2537488734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6825","nonce":2537488734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6831","nonce":2537488734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6827","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6829","nonce":2537488734}]},"public_addr":"172.21.15.146:6821/2537488734","cluster_addr":"172.21.15.146:6825/2537488734","heartbeat_back_addr":"172.21.15.146:6831/2537488734","heartbeat_front_addr":"172.21.15.146:6829/2537488734","state":["exists","up"]},{"osd":2,"uuid":"7a6cfc6d-b0ca-4cb6-a66d-4001ec184657","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6809","nonce":1800242932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6811","nonce":1800242932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6815","nonce":1800242932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6813","nonce":1800242932}]},"public_addr":"172.21.15.146:6809/1800242932","cluster_addr":"172.21.15.146:6811/1800242932","heartbeat_back_addr":"172.21.15.146:6815/1800242932","heartbeat_front_addr":"172.21.15.146:6813/1800242932","state":["exists","up"]},{"osd":3,"uuid":"401509f7-cecd-44a2-b0ae-22c81a5d93c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6817","nonce":1749783580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6820","nonce":1749783580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6828","nonce":1749783580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6824","nonce":1749783580}]},"public_addr":"172.21.15.146:6817/1749783580","cluster_addr":"172.21.15.146:6820/1749783580","heartbeat_back_addr":"172.21.15.146:6828/1749783580","heartbeat_front_addr":"172.21.15.146:6824/1749783580","state":["exists","up"]},{"osd":4,"uuid":"9d07f440-d125-4f99-a825-411fab894d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6811","nonce":163453435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6814","nonce":163453435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6819","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6821","nonce":163453435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6818","nonce":163453435}]},"public_addr":"172.21.15.151:6811/163453435","cluster_addr":"172.21.15.151:6814/163453435","heartbeat_back_addr":"172.21.15.151:6821/163453435","heartbeat_front_addr":"172.21.15.151:6818/163453435","state":["exists","up"]},{"osd":5,"uuid":"9b2266e2-9e52-4f0e-96da-e703a6c23a6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6801","nonce":3283474903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6803","nonce":3283474903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6807","nonce":3283474903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6805","nonce":3283474903}]},"public_addr":"172.21.15.151:6801/3283474903","cluster_addr":"172.21.15.151:6803/3283474903","heartbeat_back_addr":"172.21.15.151:6807/3283474903","heartbeat_front_addr":"172.21.15.151:6805/3283474903","state":["exists","up"]},{"osd":6,"uuid":"5daedf77-0a83-49e7-b497-d9ed10436972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6825","nonce":3889424178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6827","nonce":3889424178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6831","nonce":3889424178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6829","nonce":3889424178}]},"public_addr":"172.21.15.151:6825/3889424178","cluster_addr":"172.21.15.151:6827/3889424178","heartbeat_back_addr":"172.21.15.151:6831/3889424178","heartbeat_front_addr":"172.21.15.151:6829/3889424178","state":["exists","up"]},{"osd":7,"uuid":"86ae4f7e-c01f-4c3d-a0dd-98160c209309","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6810","nonce":563291208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6815","nonce":563291208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6823","nonce":563291208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6820","nonce":563291208}]},"public_addr":"172.21.15.151:6810/563291208","cluster_addr":"172.21.15.151:6815/563291208","heartbeat_back_addr":"172.21.15.151:6823/563291208","heartbeat_front_addr":"172.21.15.151:6820/563291208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.872472+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.937126+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.877234+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.884793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.881632+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.938293+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.857661+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.945883+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-24T03:29:49.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.973+0000 7f3e92845700 1 -- 172.21.15.146:0/2464842646 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f3e7806ace0 msgr2=0x7f3e7806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:49.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.973+0000 7f3e92845700 1 --2- 172.21.15.146:0/2464842646 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f3e7806ace0 0x7f3e7806d190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c0c7420 tx=0x7f3e7c008040 comp rx=0 tx=0).stop 2023-05-24T03:29:49.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.973+0000 7f3e92845700 1 -- 172.21.15.146:0/2464842646 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e8c0cb8c0 msgr2=0x7f3e8c0c6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:49.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.973+0000 7f3e92845700 1 --2- 172.21.15.146:0/2464842646 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e8c0cb8c0 0x7f3e8c0c6ee0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3e80000c00 tx=0x7f3e80004750 comp rx=0 tx=0).stop 2023-05-24T03:29:49.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.973+0000 7f3e92845700 1 -- 172.21.15.146:0/2464842646 shutdown_connections 2023-05-24T03:29:49.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.973+0000 7f3e92845700 1 --2- 172.21.15.146:0/2464842646 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f3e7806ace0 0x7f3e7806d190 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:49.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.973+0000 7f3e92845700 1 --2- 172.21.15.146:0/2464842646 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e8c0cc1d0 0x7f3e8c0c9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:49.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.973+0000 7f3e92845700 1 --2- 172.21.15.146:0/2464842646 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e8c0cb8c0 0x7f3e8c0c6ee0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:49.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.973+0000 7f3e92845700 1 --2- 172.21.15.146:0/2464842646 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e8c0cbc90 0x7f3e8c1493d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:49.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.973+0000 7f3e92845700 1 -- 172.21.15.146:0/2464842646 >> 172.21.15.146:0/2464842646 conn(0x7f3e8c0cfea0 msgr2=0x7f3e8c06de60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:49.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.973+0000 7f3e92845700 1 -- 172.21.15.146:0/2464842646 shutdown_connections 2023-05-24T03:29:49.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:49.973+0000 7f3e92845700 1 -- 172.21.15.146:0/2464842646 wait complete. 2023-05-24T03:29:50.005 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-24T03:29:50.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.121+0000 7f054e6b6700 1 Processor -- start 2023-05-24T03:29:50.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.121+0000 7f054e6b6700 1 -- start start 2023-05-24T03:29:50.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.122+0000 7f054e6b6700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f05480cb8c0 0x7f0548161030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:50.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.122+0000 7f054e6b6700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f05480cc1d0 0x7f05480b1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:50.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.122+0000 7f054e6b6700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05480b27e0 con 0x7f05480cbc90 2023-05-24T03:29:50.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.122+0000 7f054e6b6700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05480b2220 con 0x7f05480cb8c0 2023-05-24T03:29:50.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.122+0000 7f054e6b6700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05480b2500 con 0x7f05480cc1d0 2023-05-24T03:29:50.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.122+0000 7f054cc53700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f05480cbc90 0x7f054806a460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45216/0 (socket says 172.21.15.146:45216) 2023-05-24T03:29:50.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.122+0000 7f054cc53700 1 -- 172.21.15.146:0/2069360854 learned_addr learned my addr 172.21.15.146:0/2069360854 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:29:50.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.122+0000 7f05477fe700 1 --2- 172.21.15.146:0/2069360854 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f05480cc1d0 0x7f05480b1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:50.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.122+0000 7f0546ffd700 1 -- 172.21.15.146:0/2069360854 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 69625208 0 0) 0x7f05480b27e0 con 0x7f05480cbc90 2023-05-24T03:29:50.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.122+0000 7f0547fff700 1 --2- 172.21.15.146:0/2069360854 >> v2:172.21.15.151:3300/0 conn(0x7f05480cb8c0 0x7f0548161030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:50.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.122+0000 7f0546ffd700 1 -- 172.21.15.146:0/2069360854 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05300035b0 con 0x7f05480cbc90 2023-05-24T03:29:50.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.123+0000 7f0546ffd700 1 -- 172.21.15.146:0/2069360854 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2828195986 0 0) 0x7f05300035b0 con 0x7f05480cbc90 2023-05-24T03:29:50.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.123+0000 7f0546ffd700 1 -- 172.21.15.146:0/2069360854 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f05480cc1d0 msgr2=0x7f05480b1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:50.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.123+0000 7f0546ffd700 1 --2- 172.21.15.146:0/2069360854 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f05480cc1d0 0x7f05480b1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:50.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.123+0000 7f0546ffd700 1 -- 172.21.15.146:0/2069360854 >> v2:172.21.15.151:3300/0 conn(0x7f05480cb8c0 msgr2=0x7f0548161030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:50.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.123+0000 7f0546ffd700 1 --2- 172.21.15.146:0/2069360854 >> v2:172.21.15.151:3300/0 conn(0x7f05480cb8c0 0x7f0548161030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:50.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.123+0000 7f0546ffd700 1 -- 172.21.15.146:0/2069360854 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0548160830 con 0x7f05480cbc90 2023-05-24T03:29:50.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.123+0000 7f0546ffd700 1 -- 172.21.15.146:0/2069360854 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1301887351 0 0) 0x7f05400019f0 con 0x7f05480cbc90 2023-05-24T03:29:50.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.123+0000 7f0546ffd700 1 -- 172.21.15.146:0/2069360854 >> v1:172.21.15.146:6789/0 conn(0x7f05480cbc90 legacy=0x7f054806a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:50.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.123+0000 7f0546ffd700 1 --2- 172.21.15.146:0/2069360854 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f05480cc1d0 0x7f0530003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:50.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.123+0000 7f0546ffd700 1 --2- 172.21.15.146:0/2069360854 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0530004030 0x7f0530004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:50.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.123+0000 7f0546ffd700 1 --2- 172.21.15.146:0/2069360854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0530004d90 0x7f0530005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:50.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.123+0000 7f0546ffd700 1 -- 172.21.15.146:0/2069360854 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05480b2220 con 0x7f0530004d90 2023-05-24T03:29:50.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.123+0000 7f0546ffd700 1 -- 172.21.15.146:0/2069360854 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05480b2500 con 0x7f0530004030 2023-05-24T03:29:50.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.123+0000 7f0546ffd700 1 -- 172.21.15.146:0/2069360854 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f053000bb10 con 0x7f05480cc1d0 2023-05-24T03:29:50.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.123+0000 7f054cc53700 1 --2- 172.21.15.146:0/2069360854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0530004d90 0x7f0530005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:50.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.123+0000 7f0547fff700 1 --2- 172.21.15.146:0/2069360854 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f05480cc1d0 0x7f0530003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:50.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.123+0000 7f05477fe700 1 --2- 172.21.15.146:0/2069360854 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0530004030 0x7f0530004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:50.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.123+0000 7f054cc53700 1 -- 172.21.15.146:0/2069360854 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f05480cc1d0 msgr2=0x7f0530003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:50.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.123+0000 7f054cc53700 1 --2- 172.21.15.146:0/2069360854 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f05480cc1d0 0x7f0530003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:50.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.123+0000 7f054cc53700 1 -- 172.21.15.146:0/2069360854 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0530004030 msgr2=0x7f0530004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:50.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.123+0000 7f054cc53700 1 --2- 172.21.15.146:0/2069360854 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0530004030 0x7f0530004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:50.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.123+0000 7f054cc53700 1 -- 172.21.15.146:0/2069360854 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05300035b0 con 0x7f0530004d90 2023-05-24T03:29:50.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.123+0000 7f054cc53700 1 --2- 172.21.15.146:0/2069360854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0530004d90 0x7f0530005200 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f05480cc110 tx=0x7f0530005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6c1b11a51a037c1 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:50.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.123+0000 7f0546ffd700 1 -- 172.21.15.146:0/2069360854 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0540012600 con 0x7f0530004d90 2023-05-24T03:29:50.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.123+0000 7f0546ffd700 1 -- 172.21.15.146:0/2069360854 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0540012760 con 0x7f0530004d90 2023-05-24T03:29:50.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.123+0000 7f0546ffd700 1 -- 172.21.15.146:0/2069360854 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0540012ad0 con 0x7f0530004d90 2023-05-24T03:29:50.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.124+0000 7f054e6b6700 1 -- 172.21.15.146:0/2069360854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0530004d90 msgr2=0x7f0530005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:50.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.124+0000 7f054e6b6700 1 --2- 172.21.15.146:0/2069360854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0530004d90 0x7f0530005200 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f05480cc110 tx=0x7f0530005880 comp rx=0 tx=0).stop 2023-05-24T03:29:50.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.124+0000 7f054cc53700 1 -- 172.21.15.146:0/2069360854 reap_dead start 2023-05-24T03:29:50.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.124+0000 7f054e6b6700 1 -- 172.21.15.146:0/2069360854 shutdown_connections 2023-05-24T03:29:50.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.124+0000 7f054e6b6700 1 -- 172.21.15.146:0/2069360854 >> 172.21.15.146:0/2069360854 conn(0x7f05480cfea0 msgr2=0x7f05480d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:50.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.124+0000 7f054e6b6700 1 -- 172.21.15.146:0/2069360854 shutdown_connections 2023-05-24T03:29:50.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.124+0000 7f054e6b6700 1 -- 172.21.15.146:0/2069360854 wait complete. 2023-05-24T03:29:50.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.125+0000 7f054e6b6700 1 Processor -- start 2023-05-24T03:29:50.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.125+0000 7f054e6b6700 1 -- start start 2023-05-24T03:29:50.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.126+0000 7f054e6b6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0548151220 0x7f05481f2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:50.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.126+0000 7f054e6b6700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f05480b54c0 0x7f05481f5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:50.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.126+0000 7f054e6b6700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f054815dc10 0x7f054815e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:50.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.126+0000 7f054e6b6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05481550f0 con 0x7f0548151220 2023-05-24T03:29:50.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.126+0000 7f054e6b6700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f054815e5c0 con 0x7f054815dc10 2023-05-24T03:29:50.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.126+0000 7f054e6b6700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05481f28c0 con 0x7f05480b54c0 2023-05-24T03:29:50.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.126+0000 7f0547fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0548151220 0x7f05481f2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:50.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.126+0000 7f0547fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0548151220 0x7f05481f2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38774/0 (socket says 172.21.15.146:38774) 2023-05-24T03:29:50.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.126+0000 7f0547fff700 1 -- 172.21.15.146:0/2723880925 learned_addr learned my addr 172.21.15.146:0/2723880925 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:50.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.126+0000 7f0547fff700 1 -- 172.21.15.146:0/2723880925 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f05480b54c0 msgr2=0x7f05481f5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:50.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.126+0000 7f0547fff700 1 --2- 172.21.15.146:0/2723880925 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f05480b54c0 0x7f05481f5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:50.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.126+0000 7f0547fff700 1 -- 172.21.15.146:0/2723880925 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f054815dc10 msgr2=0x7f054815e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:50.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.126+0000 7f0547fff700 1 --2- 172.21.15.146:0/2723880925 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f054815dc10 0x7f054815e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:50.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.126+0000 7f0547fff700 1 -- 172.21.15.146:0/2723880925 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0548161570 con 0x7f0548151220 2023-05-24T03:29:50.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.127+0000 7f0547fff700 1 --2- 172.21.15.146:0/2723880925 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0548151220 0x7f05481f2070 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f053c011930 tx=0x7f053c011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:50.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.127+0000 7f0544ff9700 1 -- 172.21.15.146:0/2723880925 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053c00c070 con 0x7f0548151220 2023-05-24T03:29:50.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.127+0000 7f0544ff9700 1 -- 172.21.15.146:0/2723880925 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f053c00f7f0 con 0x7f0548151220 2023-05-24T03:29:50.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.127+0000 7f054e6b6700 1 -- 172.21.15.146:0/2723880925 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0548160b10 con 0x7f0548151220 2023-05-24T03:29:50.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.127+0000 7f0544ff9700 1 -- 172.21.15.146:0/2723880925 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053c00fb80 con 0x7f0548151220 2023-05-24T03:29:50.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.127+0000 7f054e6b6700 1 -- 172.21.15.146:0/2723880925 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f054806ab70 con 0x7f0548151220 2023-05-24T03:29:50.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.128+0000 7f054e6b6700 1 -- 172.21.15.146:0/2723880925 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f054804e810 con 0x7f0548151220 2023-05-24T03:29:50.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.128+0000 7f0544ff9700 1 -- 172.21.15.146:0/2723880925 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f053c00fce0 con 0x7f0548151220 2023-05-24T03:29:50.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.128+0000 7f0544ff9700 1 --2- 172.21.15.146:0/2723880925 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f053406ad10 0x7f053406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:50.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.129+0000 7f0544ff9700 1 -- 172.21.15.146:0/2723880925 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f053c089a50 con 0x7f0548151220 2023-05-24T03:29:50.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.129+0000 7f05477fe700 1 --2- 172.21.15.146:0/2723880925 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f053406ad10 0x7f053406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:50.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.129+0000 7f05477fe700 1 --2- 172.21.15.146:0/2723880925 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f053406ad10 0x7f053406d1c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f05480b4140 tx=0x7f05380094c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:50.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.133+0000 7f0544ff9700 1 -- 172.21.15.146:0/2723880925 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f053c054780 con 0x7f0548151220 2023-05-24T03:29:50.165 INFO:tasks.ceph.mds.c.smithi146.stderr:2023-05-24T03:29:50.161+0000 7f41627d2700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-24T03:29:50.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.359+0000 7f054e6b6700 1 -- 172.21.15.146:0/2723880925 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f05480b5e20 con 0x7f0548151220 2023-05-24T03:29:50.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.360+0000 7f0544ff9700 1 -- 172.21.15.146:0/2723880925 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4883 (secure 0 0 0) 0x7f053c023020 con 0x7f0548151220 2023-05-24T03:29:50.365 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:29:50.365 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1500590330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1500590330},{"type":"v1","addr":"172.21.15.151:6835","nonce":1500590330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/3574684057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3574684057},{"type":"v1","addr":"172.21.15.146:6837","nonce":3574684057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/3420469594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3420469594},{"type":"v1","addr":"172.21.15.151:6833","nonce":3420469594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-24T03:29:44.469134+0000","modified":"2023-05-24T03:29:48.912851+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6836/4012487240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":4012487240},{"type":"v1","addr":"172.21.15.146:6836","nonce":4012487240}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-05-24T03:29:50.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.362+0000 7f054e6b6700 1 -- 172.21.15.146:0/2723880925 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f053406ad10 msgr2=0x7f053406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:50.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.362+0000 7f054e6b6700 1 --2- 172.21.15.146:0/2723880925 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f053406ad10 0x7f053406d1c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f05480b4140 tx=0x7f05380094c0 comp rx=0 tx=0).stop 2023-05-24T03:29:50.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.362+0000 7f054e6b6700 1 -- 172.21.15.146:0/2723880925 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0548151220 msgr2=0x7f05481f2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:50.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.362+0000 7f054e6b6700 1 --2- 172.21.15.146:0/2723880925 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0548151220 0x7f05481f2070 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f053c011930 tx=0x7f053c011cf0 comp rx=0 tx=0).stop 2023-05-24T03:29:50.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.362+0000 7f054e6b6700 1 -- 172.21.15.146:0/2723880925 shutdown_connections 2023-05-24T03:29:50.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.362+0000 7f054e6b6700 1 --2- 172.21.15.146:0/2723880925 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f053406ad10 0x7f053406d1c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:50.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.362+0000 7f054e6b6700 1 --2- 172.21.15.146:0/2723880925 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f054815dc10 0x7f054815e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:50.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.362+0000 7f054e6b6700 1 --2- 172.21.15.146:0/2723880925 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0548151220 0x7f05481f2070 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:50.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.362+0000 7f054e6b6700 1 --2- 172.21.15.146:0/2723880925 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f05480b54c0 0x7f05481f5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:50.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.362+0000 7f054e6b6700 1 -- 172.21.15.146:0/2723880925 >> 172.21.15.146:0/2723880925 conn(0x7f05480cfea0 msgr2=0x7f05480ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:50.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.362+0000 7f054e6b6700 1 -- 172.21.15.146:0/2723880925 shutdown_connections 2023-05-24T03:29:50.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.362+0000 7f054e6b6700 1 -- 172.21.15.146:0/2723880925 wait complete. 2023-05-24T03:29:50.369 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 7 2023-05-24T03:29:50.378 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-24T03:29:50.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.494+0000 7f1e9eeda700 1 Processor -- start 2023-05-24T03:29:50.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.494+0000 7f1e9eeda700 1 -- start start 2023-05-24T03:29:50.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.495+0000 7f1e9eeda700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1e9815a9c0 0x7f1e980b52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:50.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.495+0000 7f1e9eeda700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1e980cc500 0x7f1e98071720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:50.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.495+0000 7f1e9eeda700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1e980b5820 0x7f1e98071c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:50.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.495+0000 7f1e9eeda700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e980cb740 con 0x7f1e980b5820 2023-05-24T03:29:50.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.495+0000 7f1e9eeda700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e980cba20 con 0x7f1e9815a9c0 2023-05-24T03:29:50.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.495+0000 7f1e9eeda700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e980cbd00 con 0x7f1e980cc500 2023-05-24T03:29:50.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.495+0000 7f1e9d477700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1e980b5820 0x7f1e98071c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:50.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.495+0000 7f1e9d477700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1e980b5820 0x7f1e98071c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38784/0 (socket says 172.21.15.146:38784) 2023-05-24T03:29:50.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.495+0000 7f1e9d477700 1 -- 172.21.15.146:0/2645333278 learned_addr learned my addr 172.21.15.146:0/2645333278 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:50.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.495+0000 7f1e97fff700 1 --2- 172.21.15.146:0/2645333278 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1e980cc500 0x7f1e98071720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:50.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.495+0000 7f1e9cc76700 1 --2- 172.21.15.146:0/2645333278 >> v2:172.21.15.151:3300/0 conn(0x7f1e9815a9c0 0x7f1e980b52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:50.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.495+0000 7f1e9d477700 1 -- 172.21.15.146:0/2645333278 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1e980cc500 msgr2=0x7f1e98071720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:50.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.495+0000 7f1e9d477700 1 --2- 172.21.15.146:0/2645333278 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1e980cc500 0x7f1e98071720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:50.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.495+0000 7f1e9d477700 1 -- 172.21.15.146:0/2645333278 >> v2:172.21.15.151:3300/0 conn(0x7f1e9815a9c0 msgr2=0x7f1e980b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:50.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.495+0000 7f1e9d477700 1 --2- 172.21.15.146:0/2645333278 >> v2:172.21.15.151:3300/0 conn(0x7f1e9815a9c0 0x7f1e980b52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:50.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.495+0000 7f1e9d477700 1 -- 172.21.15.146:0/2645333278 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e980cbfe0 con 0x7f1e980b5820 2023-05-24T03:29:50.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.495+0000 7f1e9cc76700 1 --2- 172.21.15.146:0/2645333278 >> v2:172.21.15.151:3300/0 conn(0x7f1e9815a9c0 0x7f1e980b52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:29:50.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.495+0000 7f1e9d477700 1 --2- 172.21.15.146:0/2645333278 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e980b5820 0x7f1e98071c60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1e980cfe00 tx=0x7f1e9000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0dae1e840e25b5f server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:50.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.496+0000 7f1e977fe700 1 -- 172.21.15.146:0/2645333278 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9000e070 con 0x7f1e980b5820 2023-05-24T03:29:50.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.496+0000 7f1e977fe700 1 -- 172.21.15.146:0/2645333278 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e9000b910 con 0x7f1e980b5820 2023-05-24T03:29:50.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.496+0000 7f1e977fe700 1 -- 172.21.15.146:0/2645333278 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9000bcc0 con 0x7f1e980b5820 2023-05-24T03:29:50.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.496+0000 7f1e9eeda700 1 -- 172.21.15.146:0/2645333278 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e980b5820 msgr2=0x7f1e98071c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:50.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.496+0000 7f1e9eeda700 1 --2- 172.21.15.146:0/2645333278 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e980b5820 0x7f1e98071c60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1e980cfe00 tx=0x7f1e9000b330 comp rx=0 tx=0).stop 2023-05-24T03:29:50.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.496+0000 7f1e9eeda700 1 -- 172.21.15.146:0/2645333278 shutdown_connections 2023-05-24T03:29:50.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.496+0000 7f1e9eeda700 1 --2- 172.21.15.146:0/2645333278 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e980b5820 0x7f1e98071c60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:50.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.496+0000 7f1e9eeda700 1 --2- 172.21.15.146:0/2645333278 >> v2:172.21.15.151:3300/0 conn(0x7f1e9815a9c0 0x7f1e980b52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:50.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.496+0000 7f1e9eeda700 1 --2- 172.21.15.146:0/2645333278 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1e980cc500 0x7f1e98071720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:50.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.496+0000 7f1e9eeda700 1 -- 172.21.15.146:0/2645333278 >> 172.21.15.146:0/2645333278 conn(0x7f1e980cfea0 msgr2=0x7f1e980d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:50.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.496+0000 7f1e9eeda700 1 -- 172.21.15.146:0/2645333278 shutdown_connections 2023-05-24T03:29:50.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.496+0000 7f1e9eeda700 1 -- 172.21.15.146:0/2645333278 wait complete. 2023-05-24T03:29:50.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.497+0000 7f1e9eeda700 1 Processor -- start 2023-05-24T03:29:50.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.497+0000 7f1e9eeda700 1 -- start start 2023-05-24T03:29:50.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.498+0000 7f1e9eeda700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e980b5820 0x7f1e98153fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:50.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.498+0000 7f1e9eeda700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1e980cc500 0x7f1e980b1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:50.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.498+0000 7f1e9eeda700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1e9815a9c0 0x7f1e981573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:50.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.498+0000 7f1e9eeda700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e98154500 con 0x7f1e980b5820 2023-05-24T03:29:50.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.498+0000 7f1e9eeda700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e980cd9e0 con 0x7f1e980cc500 2023-05-24T03:29:50.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.498+0000 7f1e9eeda700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e980ad480 con 0x7f1e9815a9c0 2023-05-24T03:29:50.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.498+0000 7f1e9cc76700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e980b5820 0x7f1e98153fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:50.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.498+0000 7f1e9cc76700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e980b5820 0x7f1e98153fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38786/0 (socket says 172.21.15.146:38786) 2023-05-24T03:29:50.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.498+0000 7f1e9cc76700 1 -- 172.21.15.146:0/3226279732 learned_addr learned my addr 172.21.15.146:0/3226279732 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:50.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.498+0000 7f1e9d477700 1 --2- 172.21.15.146:0/3226279732 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1e9815a9c0 0x7f1e981573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:50.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.499+0000 7f1e9cc76700 1 -- 172.21.15.146:0/3226279732 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1e9815a9c0 msgr2=0x7f1e981573f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:50.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.499+0000 7f1e97fff700 1 --2- 172.21.15.146:0/3226279732 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1e980cc500 0x7f1e980b1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:50.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.499+0000 7f1e9cc76700 1 --2- 172.21.15.146:0/3226279732 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1e9815a9c0 0x7f1e981573f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:50.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.499+0000 7f1e9cc76700 1 -- 172.21.15.146:0/3226279732 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1e980cc500 msgr2=0x7f1e980b1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:50.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.499+0000 7f1e9cc76700 1 --2- 172.21.15.146:0/3226279732 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1e980cc500 0x7f1e980b1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:50.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.499+0000 7f1e9cc76700 1 -- 172.21.15.146:0/3226279732 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e90009b30 con 0x7f1e980b5820 2023-05-24T03:29:50.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.499+0000 7f1e97fff700 1 --2- 172.21.15.146:0/3226279732 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1e980cc500 0x7f1e980b1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:29:50.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.499+0000 7f1e9d477700 1 --2- 172.21.15.146:0/3226279732 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1e9815a9c0 0x7f1e981573f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:29:50.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.499+0000 7f1e9cc76700 1 --2- 172.21.15.146:0/3226279732 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e980b5820 0x7f1e98153fc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c00e760 tx=0x7f1e8c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:50.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.499+0000 7f1e957fa700 1 -- 172.21.15.146:0/3226279732 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c013610 con 0x7f1e980b5820 2023-05-24T03:29:50.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.499+0000 7f1e957fa700 1 -- 172.21.15.146:0/3226279732 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e8c013770 con 0x7f1e980b5820 2023-05-24T03:29:50.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.499+0000 7f1e9eeda700 1 -- 172.21.15.146:0/3226279732 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e980b5da0 con 0x7f1e980b5820 2023-05-24T03:29:50.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.499+0000 7f1e957fa700 1 -- 172.21.15.146:0/3226279732 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c013b20 con 0x7f1e980b5820 2023-05-24T03:29:50.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.499+0000 7f1e9eeda700 1 -- 172.21.15.146:0/3226279732 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e9815ad90 con 0x7f1e980b5820 2023-05-24T03:29:50.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.500+0000 7f1e9eeda700 1 -- 172.21.15.146:0/3226279732 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e9806b2a0 con 0x7f1e980b5820 2023-05-24T03:29:50.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.500+0000 7f1e957fa700 1 -- 172.21.15.146:0/3226279732 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1e8c013c80 con 0x7f1e980b5820 2023-05-24T03:29:50.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.501+0000 7f1e957fa700 1 --2- 172.21.15.146:0/3226279732 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f1e7c06ace0 0x7f1e7c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:50.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.501+0000 7f1e957fa700 1 -- 172.21.15.146:0/3226279732 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1e8c089330 con 0x7f1e980b5820 2023-05-24T03:29:50.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.501+0000 7f1e97fff700 1 --2- 172.21.15.146:0/3226279732 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f1e7c06ace0 0x7f1e7c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:50.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.501+0000 7f1e97fff700 1 --2- 172.21.15.146:0/3226279732 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f1e7c06ace0 0x7f1e7c06d190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1e980b4d30 tx=0x7f1e84008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:50.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.507+0000 7f1e957fa700 1 -- 172.21.15.146:0/3226279732 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f1e8c057b80 con 0x7f1e980b5820 2023-05-24T03:29:50.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.694+0000 7f1e9eeda700 1 -- 172.21.15.146:0/3226279732 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e980b2870 con 0x7f1e980b5820 2023-05-24T03:29:50.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.695+0000 7f1e957fa700 1 -- 172.21.15.146:0/3226279732 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20156 (secure 0 0 0) 0x7f1e8c057710 con 0x7f1e980b5820 2023-05-24T03:29:50.700 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:29:50.701 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":28,"fsid":"11ca0adb-7672-4713-bde7-451e8b743ae9","created":"2023-05-24T03:29:19.113659+0000","modified":"2023-05-24T03:29:48.912599+0000","last_up_change":"2023-05-24T03:29:30.962339+0000","last_in_change":"2023-05-24T03:29:21.706540+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-24T03:29:32.749984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-24T03:29:37.719623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-24T03:29:42.165379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-24T03:29:43.431615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-24T03:29:46.503075+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f24b319b-fcc8-4385-b0cb-78138fc31417","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6801","nonce":3353593100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6803","nonce":3353593100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6807","nonce":3353593100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6805","nonce":3353593100}]},"public_addr":"172.21.15.146:6801/3353593100","cluster_addr":"172.21.15.146:6803/3353593100","heartbeat_back_addr":"172.21.15.146:6807/3353593100","heartbeat_front_addr":"172.21.15.146:6805/3353593100","state":["exists","up"]},{"osd":1,"uuid":"c9639ea9-8f9b-498e-92c8-aa976edbf1da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6821","nonce":2537488734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6825","nonce":2537488734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6831","nonce":2537488734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6827","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6829","nonce":2537488734}]},"public_addr":"172.21.15.146:6821/2537488734","cluster_addr":"172.21.15.146:6825/2537488734","heartbeat_back_addr":"172.21.15.146:6831/2537488734","heartbeat_front_addr":"172.21.15.146:6829/2537488734","state":["exists","up"]},{"osd":2,"uuid":"7a6cfc6d-b0ca-4cb6-a66d-4001ec184657","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6809","nonce":1800242932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6811","nonce":1800242932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6815","nonce":1800242932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6813","nonce":1800242932}]},"public_addr":"172.21.15.146:6809/1800242932","cluster_addr":"172.21.15.146:6811/1800242932","heartbeat_back_addr":"172.21.15.146:6815/1800242932","heartbeat_front_addr":"172.21.15.146:6813/1800242932","state":["exists","up"]},{"osd":3,"uuid":"401509f7-cecd-44a2-b0ae-22c81a5d93c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6817","nonce":1749783580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6820","nonce":1749783580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6828","nonce":1749783580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6824","nonce":1749783580}]},"public_addr":"172.21.15.146:6817/1749783580","cluster_addr":"172.21.15.146:6820/1749783580","heartbeat_back_addr":"172.21.15.146:6828/1749783580","heartbeat_front_addr":"172.21.15.146:6824/1749783580","state":["exists","up"]},{"osd":4,"uuid":"9d07f440-d125-4f99-a825-411fab894d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6811","nonce":163453435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6814","nonce":163453435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6819","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6821","nonce":163453435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6818","nonce":163453435}]},"public_addr":"172.21.15.151:6811/163453435","cluster_addr":"172.21.15.151:6814/163453435","heartbeat_back_addr":"172.21.15.151:6821/163453435","heartbeat_front_addr":"172.21.15.151:6818/163453435","state":["exists","up"]},{"osd":5,"uuid":"9b2266e2-9e52-4f0e-96da-e703a6c23a6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6801","nonce":3283474903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6803","nonce":3283474903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6807","nonce":3283474903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6805","nonce":3283474903}]},"public_addr":"172.21.15.151:6801/3283474903","cluster_addr":"172.21.15.151:6803/3283474903","heartbeat_back_addr":"172.21.15.151:6807/3283474903","heartbeat_front_addr":"172.21.15.151:6805/3283474903","state":["exists","up"]},{"osd":6,"uuid":"5daedf77-0a83-49e7-b497-d9ed10436972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6825","nonce":3889424178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6827","nonce":3889424178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6831","nonce":3889424178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6829","nonce":3889424178}]},"public_addr":"172.21.15.151:6825/3889424178","cluster_addr":"172.21.15.151:6827/3889424178","heartbeat_back_addr":"172.21.15.151:6831/3889424178","heartbeat_front_addr":"172.21.15.151:6829/3889424178","state":["exists","up"]},{"osd":7,"uuid":"86ae4f7e-c01f-4c3d-a0dd-98160c209309","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6810","nonce":563291208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6815","nonce":563291208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6823","nonce":563291208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6820","nonce":563291208}]},"public_addr":"172.21.15.151:6810/563291208","cluster_addr":"172.21.15.151:6815/563291208","heartbeat_back_addr":"172.21.15.151:6823/563291208","heartbeat_front_addr":"172.21.15.151:6820/563291208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.872472+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.937126+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.877234+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.884793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.881632+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.938293+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.857661+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.945883+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-24T03:29:50.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.697+0000 7f1e9eeda700 1 -- 172.21.15.146:0/3226279732 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f1e7c06ace0 msgr2=0x7f1e7c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:50.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.697+0000 7f1e9eeda700 1 --2- 172.21.15.146:0/3226279732 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f1e7c06ace0 0x7f1e7c06d190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1e980b4d30 tx=0x7f1e84008040 comp rx=0 tx=0).stop 2023-05-24T03:29:50.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.698+0000 7f1e9eeda700 1 -- 172.21.15.146:0/3226279732 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e980b5820 msgr2=0x7f1e98153fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:50.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.698+0000 7f1e9eeda700 1 --2- 172.21.15.146:0/3226279732 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e980b5820 0x7f1e98153fc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c00e760 tx=0x7f1e8c00eb20 comp rx=0 tx=0).stop 2023-05-24T03:29:50.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.698+0000 7f1e9eeda700 1 -- 172.21.15.146:0/3226279732 shutdown_connections 2023-05-24T03:29:50.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.698+0000 7f1e9eeda700 1 --2- 172.21.15.146:0/3226279732 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f1e7c06ace0 0x7f1e7c06d190 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:50.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.698+0000 7f1e9eeda700 1 --2- 172.21.15.146:0/3226279732 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1e9815a9c0 0x7f1e981573f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:50.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.698+0000 7f1e9eeda700 1 --2- 172.21.15.146:0/3226279732 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e980b5820 0x7f1e98153fc0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:50.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.698+0000 7f1e9eeda700 1 --2- 172.21.15.146:0/3226279732 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1e980cc500 0x7f1e980b1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:50.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.698+0000 7f1e9eeda700 1 -- 172.21.15.146:0/3226279732 >> 172.21.15.146:0/3226279732 conn(0x7f1e980cfea0 msgr2=0x7f1e981565e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:50.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.698+0000 7f1e9eeda700 1 -- 172.21.15.146:0/3226279732 shutdown_connections 2023-05-24T03:29:50.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:50.698+0000 7f1e9eeda700 1 -- 172.21.15.146:0/3226279732 wait complete. 2023-05-24T03:29:51.116 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-05-24T03:29:44.469134+0000', 'modified': '2023-05-24T03:29:48.912851+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4290}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4290': {'gid': 4290, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.146:6836/4012487240', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6835', 'nonce': 4012487240}, {'type': 'v1', 'addr': '172.21.15.146:6836', 'nonce': 4012487240}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-05-24T03:29:51.117 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-05-24T03:29:51.117 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-05-24T03:29:51.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.235+0000 7f6a20524700 1 Processor -- start 2023-05-24T03:29:51.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.235+0000 7f6a20524700 1 -- start start 2023-05-24T03:29:51.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.236+0000 7f6a20524700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a1815a9c0 0x7f6a180b52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:51.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.236+0000 7f6a20524700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6a180cc500 0x7f6a18071720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:51.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.236+0000 7f6a20524700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6a180b5820 0x7f6a18071c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:51.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.236+0000 7f6a20524700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a180cb740 con 0x7f6a180b5820 2023-05-24T03:29:51.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.236+0000 7f6a20524700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a180cba20 con 0x7f6a180cc500 2023-05-24T03:29:51.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.236+0000 7f6a20524700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a180cbd00 con 0x7f6a1815a9c0 2023-05-24T03:29:51.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.236+0000 7f6a1eac1700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6a180b5820 0x7f6a18071c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:51.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.236+0000 7f6a1eac1700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6a180b5820 0x7f6a18071c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38798/0 (socket says 172.21.15.146:38798) 2023-05-24T03:29:51.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.236+0000 7f6a1eac1700 1 -- 172.21.15.146:0/793006964 learned_addr learned my addr 172.21.15.146:0/793006964 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:51.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.236+0000 7f6a1e2c0700 1 --2- 172.21.15.146:0/793006964 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a1815a9c0 0x7f6a180b52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:51.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.236+0000 7f6a1dabf700 1 --2- 172.21.15.146:0/793006964 >> v2:172.21.15.151:3300/0 conn(0x7f6a180cc500 0x7f6a18071720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:51.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.237+0000 7f6a1eac1700 1 -- 172.21.15.146:0/793006964 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a1815a9c0 msgr2=0x7f6a180b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:51.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.237+0000 7f6a1eac1700 1 --2- 172.21.15.146:0/793006964 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a1815a9c0 0x7f6a180b52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:51.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.237+0000 7f6a1eac1700 1 -- 172.21.15.146:0/793006964 >> v2:172.21.15.151:3300/0 conn(0x7f6a180cc500 msgr2=0x7f6a18071720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:51.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.237+0000 7f6a1eac1700 1 --2- 172.21.15.146:0/793006964 >> v2:172.21.15.151:3300/0 conn(0x7f6a180cc500 0x7f6a18071720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:51.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.237+0000 7f6a1eac1700 1 -- 172.21.15.146:0/793006964 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a180cbfe0 con 0x7f6a180b5820 2023-05-24T03:29:51.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.237+0000 7f6a1eac1700 1 --2- 172.21.15.146:0/793006964 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a180b5820 0x7f6a18071c60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6a18070d40 tx=0x7f6a1000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db2a410979821a8b server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:51.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.237+0000 7f6a1d2be700 1 -- 172.21.15.146:0/793006964 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1000e070 con 0x7f6a180b5820 2023-05-24T03:29:51.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.237+0000 7f6a1d2be700 1 -- 172.21.15.146:0/793006964 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a1000b910 con 0x7f6a180b5820 2023-05-24T03:29:51.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.237+0000 7f6a1d2be700 1 -- 172.21.15.146:0/793006964 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1000bcc0 con 0x7f6a180b5820 2023-05-24T03:29:51.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.237+0000 7f6a20524700 1 -- 172.21.15.146:0/793006964 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a180b5820 msgr2=0x7f6a18071c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:51.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.237+0000 7f6a20524700 1 --2- 172.21.15.146:0/793006964 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a180b5820 0x7f6a18071c60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6a18070d40 tx=0x7f6a1000b330 comp rx=0 tx=0).stop 2023-05-24T03:29:51.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.237+0000 7f6a20524700 1 -- 172.21.15.146:0/793006964 shutdown_connections 2023-05-24T03:29:51.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.237+0000 7f6a20524700 1 --2- 172.21.15.146:0/793006964 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a180b5820 0x7f6a18071c60 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:51.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.237+0000 7f6a20524700 1 --2- 172.21.15.146:0/793006964 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a1815a9c0 0x7f6a180b52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:51.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.237+0000 7f6a20524700 1 --2- 172.21.15.146:0/793006964 >> v2:172.21.15.151:3300/0 conn(0x7f6a180cc500 0x7f6a18071720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:51.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.237+0000 7f6a20524700 1 -- 172.21.15.146:0/793006964 >> 172.21.15.146:0/793006964 conn(0x7f6a180cfea0 msgr2=0x7f6a180d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:51.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.238+0000 7f6a20524700 1 -- 172.21.15.146:0/793006964 shutdown_connections 2023-05-24T03:29:51.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.238+0000 7f6a20524700 1 -- 172.21.15.146:0/793006964 wait complete. 2023-05-24T03:29:51.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.239+0000 7f6a20524700 1 Processor -- start 2023-05-24T03:29:51.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.239+0000 7f6a20524700 1 -- start start 2023-05-24T03:29:51.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.239+0000 7f6a20524700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a180b5820 0x7f6a180c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:51.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.239+0000 7f6a20524700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a180cc500 0x7f6a1814beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:51.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.239+0000 7f6a20524700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a1815a9c0 0x7f6a180c9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:51.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.239+0000 7f6a20524700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a181f0a50 con 0x7f6a180cc500 2023-05-24T03:29:51.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.239+0000 7f6a20524700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a181efb60 con 0x7f6a1815a9c0 2023-05-24T03:29:51.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.239+0000 7f6a20524700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a181efdd0 con 0x7f6a180b5820 2023-05-24T03:29:51.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.240+0000 7f6a1dabf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a180cc500 0x7f6a1814beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:51.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.240+0000 7f6a1dabf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a180cc500 0x7f6a1814beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38802/0 (socket says 172.21.15.146:38802) 2023-05-24T03:29:51.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.240+0000 7f6a1dabf700 1 -- 172.21.15.146:0/2200987069 learned_addr learned my addr 172.21.15.146:0/2200987069 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:51.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.240+0000 7f6a1eac1700 1 --2- 172.21.15.146:0/2200987069 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a1815a9c0 0x7f6a180c9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:51.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.240+0000 7f6a1e2c0700 1 --2- 172.21.15.146:0/2200987069 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a180b5820 0x7f6a180c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:51.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.240+0000 7f6a1dabf700 1 -- 172.21.15.146:0/2200987069 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a180b5820 msgr2=0x7f6a180c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:51.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.240+0000 7f6a1dabf700 1 --2- 172.21.15.146:0/2200987069 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a180b5820 0x7f6a180c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:51.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.240+0000 7f6a1dabf700 1 -- 172.21.15.146:0/2200987069 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a1815a9c0 msgr2=0x7f6a180c9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:51.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.240+0000 7f6a1dabf700 1 --2- 172.21.15.146:0/2200987069 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a1815a9c0 0x7f6a180c9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:51.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.240+0000 7f6a1dabf700 1 -- 172.21.15.146:0/2200987069 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a10009b30 con 0x7f6a180cc500 2023-05-24T03:29:51.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.240+0000 7f6a1dabf700 1 --2- 172.21.15.146:0/2200987069 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a180cc500 0x7f6a1814beb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6a0800e9b0 tx=0x7f6a0800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:51.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.240+0000 7f6a0effd700 1 -- 172.21.15.146:0/2200987069 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a08009710 con 0x7f6a180cc500 2023-05-24T03:29:51.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.240+0000 7f6a0effd700 1 -- 172.21.15.146:0/2200987069 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a0800ee50 con 0x7f6a180cc500 2023-05-24T03:29:51.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.240+0000 7f6a20524700 1 -- 172.21.15.146:0/2200987069 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a180b5da0 con 0x7f6a180cc500 2023-05-24T03:29:51.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.240+0000 7f6a0effd700 1 -- 172.21.15.146:0/2200987069 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0800ca90 con 0x7f6a180cc500 2023-05-24T03:29:51.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.240+0000 7f6a20524700 1 -- 172.21.15.146:0/2200987069 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a1815ad90 con 0x7f6a180cc500 2023-05-24T03:29:51.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.242+0000 7f6a0effd700 1 -- 172.21.15.146:0/2200987069 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6a0800cbf0 con 0x7f6a180cc500 2023-05-24T03:29:51.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.242+0000 7f6a0effd700 1 --2- 172.21.15.146:0/2200987069 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f69fc06ace0 0x7f69fc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:51.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.242+0000 7f6a0effd700 1 -- 172.21.15.146:0/2200987069 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6a080896d0 con 0x7f6a180cc500 2023-05-24T03:29:51.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.242+0000 7f6a1e2c0700 1 --2- 172.21.15.146:0/2200987069 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f69fc06ace0 0x7f69fc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:51.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.242+0000 7f6a1e2c0700 1 --2- 172.21.15.146:0/2200987069 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f69fc06ace0 0x7f69fc06d190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6a14009ac0 tx=0x7f6a14009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:51.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.244+0000 7f6a2c6b0b80 1 Processor -- start 2023-05-24T03:29:51.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.244+0000 7f6a2c6b0b80 1 -- start start 2023-05-24T03:29:51.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.245+0000 7f6a2c6b0b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fc53ac060 0x559fc53ac790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:51.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.245+0000 7f6a2c6b0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559fc5383850 0x559fc5386270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:51.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.245+0000 7f6a2c6b0b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559fc53cbc90 0x559fc53b0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:51.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.245+0000 7f6a2c6b0b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fc528a010 con 0x559fc53ac060 2023-05-24T03:29:51.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.245+0000 7f6a2c6b0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fc52dc850 con 0x559fc5383850 2023-05-24T03:29:51.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.245+0000 7f6a2c6b0b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x559fc52d5ce0 con 0x559fc53cbc90 2023-05-24T03:29:51.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.245+0000 7f6a1e2c0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fc53ac060 0x559fc53ac790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:51.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.245+0000 7f6a1e2c0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fc53ac060 0x559fc53ac790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38808/0 (socket says 172.21.15.146:38808) 2023-05-24T03:29:51.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.245+0000 7f6a1e2c0700 1 -- 172.21.15.146:0/3071461315 learned_addr learned my addr 172.21.15.146:0/3071461315 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:51.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.245+0000 7f6a1dabf700 1 --2- 172.21.15.146:0/3071461315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559fc5383850 0x559fc5386270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:51.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.245+0000 7f6a1eac1700 1 --2- 172.21.15.146:0/3071461315 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559fc53cbc90 0x559fc53b0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:51.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.245+0000 7f6a1e2c0700 1 -- 172.21.15.146:0/3071461315 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559fc53cbc90 msgr2=0x559fc53b0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:51.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.245+0000 7f6a1e2c0700 1 --2- 172.21.15.146:0/3071461315 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559fc53cbc90 0x559fc53b0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:51.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.245+0000 7f6a1e2c0700 1 -- 172.21.15.146:0/3071461315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559fc5383850 msgr2=0x559fc5386270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:51.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.245+0000 7f6a1e2c0700 1 --2- 172.21.15.146:0/3071461315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559fc5383850 0x559fc5386270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:51.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.245+0000 7f6a1e2c0700 1 -- 172.21.15.146:0/3071461315 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559fc51575e0 con 0x559fc53ac060 2023-05-24T03:29:51.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.245+0000 7f6a1e2c0700 1 --2- 172.21.15.146:0/3071461315 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fc53ac060 0x559fc53ac790 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6a14004530 tx=0x7f6a14014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a4034179137c3ee server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:51.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.245+0000 7f69fbfff700 1 -- 172.21.15.146:0/3071461315 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1401c040 con 0x559fc53ac060 2023-05-24T03:29:51.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.245+0000 7f69fbfff700 1 -- 172.21.15.146:0/3071461315 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a14004560 con 0x559fc53ac060 2023-05-24T03:29:51.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.245+0000 7f69fbfff700 1 -- 172.21.15.146:0/3071461315 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a14009770 con 0x559fc53ac060 2023-05-24T03:29:51.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.246+0000 7f6a2c6b0b80 1 -- 172.21.15.146:0/3071461315 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fc53ac060 msgr2=0x559fc53ac790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:51.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.246+0000 7f6a2c6b0b80 1 --2- 172.21.15.146:0/3071461315 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fc53ac060 0x559fc53ac790 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6a14004530 tx=0x7f6a14014000 comp rx=0 tx=0).stop 2023-05-24T03:29:51.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.246+0000 7f6a2c6b0b80 1 -- 172.21.15.146:0/3071461315 shutdown_connections 2023-05-24T03:29:51.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.246+0000 7f6a2c6b0b80 1 --2- 172.21.15.146:0/3071461315 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559fc53cbc90 0x559fc53b0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:51.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.246+0000 7f6a2c6b0b80 1 --2- 172.21.15.146:0/3071461315 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fc53ac060 0x559fc53ac790 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:51.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.246+0000 7f6a2c6b0b80 1 --2- 172.21.15.146:0/3071461315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559fc5383850 0x559fc5386270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:51.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.246+0000 7f6a2c6b0b80 1 -- 172.21.15.146:0/3071461315 >> 172.21.15.146:0/3071461315 conn(0x559fc537aed0 msgr2=0x559fc53cb210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:51.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.246+0000 7f6a2c6b0b80 1 -- 172.21.15.146:0/3071461315 shutdown_connections 2023-05-24T03:29:51.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.246+0000 7f6a2c6b0b80 1 -- 172.21.15.146:0/3071461315 wait complete. 2023-05-24T03:29:51.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.247+0000 7f6a2c6b0b80 1 -- start start 2023-05-24T03:29:51.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.247+0000 7f6a2c6b0b80 1 Processor -- start 2023-05-24T03:29:51.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.248+0000 7f6a2c6b0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559fc5383850 0x559fc53b40b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:51.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.248+0000 7f6a2c6b0b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fc53ac060 0x559fc53865e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:51.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.248+0000 7f6a2c6b0b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559fc53cbc90 0x559fc53cc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:51.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.248+0000 7f6a2c6b0b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fc5277890 con 0x559fc53ac060 2023-05-24T03:29:51.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.248+0000 7f6a2c6b0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fc5277530 con 0x559fc5383850 2023-05-24T03:29:51.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.248+0000 7f6a2c6b0b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x559fc51598d0 con 0x559fc53cbc90 2023-05-24T03:29:51.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.248+0000 7f6a2c6b0b80 10 client.0 _ll_register_callbacks cb 0x559fc5295730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-24T03:29:51.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.248+0000 7f6a1dabf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fc53ac060 0x559fc53865e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:51.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.248+0000 7f6a1dabf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fc53ac060 0x559fc53865e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38816/0 (socket says 172.21.15.146:38816) 2023-05-24T03:29:51.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.248+0000 7f6a1dabf700 1 -- 172.21.15.146:0/1042201444 learned_addr learned my addr 172.21.15.146:0/1042201444 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:51.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.248+0000 7f6a1e2c0700 1 --2- 172.21.15.146:0/1042201444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559fc5383850 0x559fc53b40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:51.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.248+0000 7f6a1eac1700 1 --2- 172.21.15.146:0/1042201444 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559fc53cbc90 0x559fc53cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:51.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.248+0000 7f6a1dabf700 1 -- 172.21.15.146:0/1042201444 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559fc53cbc90 msgr2=0x559fc53cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:51.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.248+0000 7f6a1dabf700 1 --2- 172.21.15.146:0/1042201444 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559fc53cbc90 0x559fc53cc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:51.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.248+0000 7f6a1dabf700 1 -- 172.21.15.146:0/1042201444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559fc5383850 msgr2=0x559fc53b40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:51.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.248+0000 7f6a1dabf700 1 --2- 172.21.15.146:0/1042201444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559fc5383850 0x559fc53b40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:51.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.248+0000 7f6a1dabf700 1 -- 172.21.15.146:0/1042201444 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a140041b0 con 0x559fc53ac060 2023-05-24T03:29:51.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.248+0000 7f6a1dabf700 1 --2- 172.21.15.146:0/1042201444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fc53ac060 0x559fc53865e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6a0800c430 tx=0x7f6a0805c1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cce7934fbb794b5 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:51.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.248+0000 7f69f97fa700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-05-24T03:29:51.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.248+0000 7f69f97fa700 1 -- 172.21.15.146:0/1042201444 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a08056640 con 0x559fc53ac060 2023-05-24T03:29:51.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.248+0000 7f69f97fa700 1 -- 172.21.15.146:0/1042201444 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6a080600a0 con 0x559fc53ac060 2023-05-24T03:29:51.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.248+0000 7f6a2c6b0b80 1 -- 172.21.15.146:0/1042201444 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559fc5378690 con 0x559fc53ac060 2023-05-24T03:29:51.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.248+0000 7f69f97fa700 1 -- 172.21.15.146:0/1042201444 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a08060260 con 0x559fc53ac060 2023-05-24T03:29:51.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.248+0000 7f6a2c6b0b80 10 client.4458 fetch_fsmap learned FSMap version 7 2023-05-24T03:29:51.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.248+0000 7f6a2c6b0b80 1 -- 172.21.15.146:0/1042201444 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x559fc529c140 con 0x559fc53ac060 2023-05-24T03:29:51.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.249+0000 7f69f97fa700 1 -- 172.21.15.146:0/1042201444 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a08075030 con 0x559fc53ac060 2023-05-24T03:29:51.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.249+0000 7f69f97fa700 1 -- 172.21.15.146:0/1042201444 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f6a08087250 con 0x559fc53ac060 2023-05-24T03:29:51.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.249+0000 7f6a2c6b0b80 10 client.4458 fetch_fsmap finished waiting for FSMap version 7 2023-05-24T03:29:51.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.249+0000 7f6a2c6b0b80 10 client.4458 resolve_mds: resolved name 'c' to daemon mds.c 2023-05-24T03:29:51.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.249+0000 7f6a2c6b0b80 20 client.4458 populate_metadata read hostname 'smithi146' 2023-05-24T03:29:51.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.249+0000 7f6a2c6b0b80 1 --2- 172.21.15.146:0/1042201444 >> [v2:172.21.15.146:6835/4012487240,v1:172.21.15.146:6836/4012487240] conn(0x559fc53a7dc0 0x559fc53a8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:51.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.249+0000 7f6a2c6b0b80 4 client.4458 mds_command: new command op to 4290 tid=0[{"prefix": "get_command_descriptions"}] 2023-05-24T03:29:51.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.249+0000 7f6a2c6b0b80 1 -- 172.21.15.146:0/1042201444 --> [v2:172.21.15.146:6835/4012487240,v1:172.21.15.146:6836/4012487240] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559fc5298050 con 0x559fc53a7dc0 2023-05-24T03:29:51.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.249+0000 7f6a1e2c0700 1 --2- 172.21.15.146:0/1042201444 >> [v2:172.21.15.146:6835/4012487240,v1:172.21.15.146:6836/4012487240] conn(0x559fc53a7dc0 0x559fc53a8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:51.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.249+0000 7f69f97fa700 10 client.4458 ms_handle_connect on v2:172.21.15.146:6835/4012487240 2023-05-24T03:29:51.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.249+0000 7f6a1e2c0700 1 --2- 172.21.15.146:0/1042201444 >> [v2:172.21.15.146:6835/4012487240,v1:172.21.15.146:6836/4012487240] conn(0x559fc53a7dc0 0x559fc53a8190 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0dce6a949e67e2b server_cookie=713ffe107b839eae in_seq=0 out_seq=0 2023-05-24T03:29:51.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.250+0000 7f69f97fa700 1 -- 172.21.15.146:0/1042201444 <== mds.0 v2:172.21.15.146:6835/4012487240 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x559fc5298050 con 0x559fc53a7dc0 2023-05-24T03:29:51.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.250+0000 7f69f97fa700 10 client.4458 handle_command_reply: tid=0 2023-05-24T03:29:51.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.250+0000 7f6a2c6b0b80 1 client.4458 shutdown 2023-05-24T03:29:51.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.250+0000 7f6a2c6b0b80 1 -- 172.21.15.146:0/1042201444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fc53ac060 msgr2=0x559fc53865e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:51.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.250+0000 7f6a2c6b0b80 1 --2- 172.21.15.146:0/1042201444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fc53ac060 0x559fc53865e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6a0800c430 tx=0x7f6a0805c1a0 comp rx=0 tx=0).stop 2023-05-24T03:29:51.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.250+0000 7f6a2c6b0b80 1 -- 172.21.15.146:0/1042201444 shutdown_connections 2023-05-24T03:29:51.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.250+0000 7f6a2c6b0b80 1 --2- 172.21.15.146:0/1042201444 >> [v2:172.21.15.146:6835/4012487240,v1:172.21.15.146:6836/4012487240] conn(0x559fc53a7dc0 0x559fc53a8190 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:51.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.250+0000 7f6a2c6b0b80 1 --2- 172.21.15.146:0/1042201444 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559fc53cbc90 0x559fc53cc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:51.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.250+0000 7f6a2c6b0b80 1 --2- 172.21.15.146:0/1042201444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559fc5383850 0x559fc53b40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:51.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.250+0000 7f69f97fa700 0 client.4458 ms_handle_reset on v2:172.21.15.146:6835/4012487240 2023-05-24T03:29:51.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.250+0000 7f6a2c6b0b80 1 --2- 172.21.15.146:0/1042201444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fc53ac060 0x559fc53865e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:51.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.250+0000 7f6a2c6b0b80 1 -- 172.21.15.146:0/1042201444 >> 172.21.15.146:0/1042201444 conn(0x559fc537aed0 msgr2=0x559fc53815a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:51.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.250+0000 7f6a2c6b0b80 1 -- 172.21.15.146:0/1042201444 shutdown_connections 2023-05-24T03:29:51.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.250+0000 7f6a2c6b0b80 1 -- 172.21.15.146:0/1042201444 wait complete. 2023-05-24T03:29:51.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.250+0000 7f6a2c6b0b80 20 client.4458 trim_cache size 0 max 16384 2023-05-24T03:29:51.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.268+0000 7f6a2c6b0b80 1 Processor -- start 2023-05-24T03:29:51.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.268+0000 7f6a2c6b0b80 1 -- start start 2023-05-24T03:29:51.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.269+0000 7f6a2c6b0b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fc5383850 0x559fc53824c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:51.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.269+0000 7f6a2c6b0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559fc53ac060 0x559fc537c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:51.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.269+0000 7f6a2c6b0b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559fc53cbc90 0x559fc53cade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:51.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.269+0000 7f6a2c6b0b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fc53cf410 con 0x559fc5383850 2023-05-24T03:29:51.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.269+0000 7f6a2c6b0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fc53a8a30 con 0x559fc53ac060 2023-05-24T03:29:51.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.269+0000 7f6a2c6b0b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x559fc537fb70 con 0x559fc53cbc90 2023-05-24T03:29:51.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.269+0000 7f6a1e2c0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fc5383850 0x559fc53824c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:51.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.269+0000 7f6a1e2c0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fc5383850 0x559fc53824c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38822/0 (socket says 172.21.15.146:38822) 2023-05-24T03:29:51.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.269+0000 7f6a1e2c0700 1 -- 172.21.15.146:0/1329148315 learned_addr learned my addr 172.21.15.146:0/1329148315 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:51.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.269+0000 7f6a1dabf700 1 --2- 172.21.15.146:0/1329148315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559fc53ac060 0x559fc537c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:51.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.269+0000 7f6a1eac1700 1 --2- 172.21.15.146:0/1329148315 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559fc53cbc90 0x559fc53cade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:51.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.270+0000 7f6a1e2c0700 1 -- 172.21.15.146:0/1329148315 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559fc53cbc90 msgr2=0x559fc53cade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:51.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.270+0000 7f6a1e2c0700 1 --2- 172.21.15.146:0/1329148315 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559fc53cbc90 0x559fc53cade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:51.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.270+0000 7f6a1e2c0700 1 -- 172.21.15.146:0/1329148315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559fc53ac060 msgr2=0x559fc537c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:51.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.270+0000 7f6a1e2c0700 1 --2- 172.21.15.146:0/1329148315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559fc53ac060 0x559fc537c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:51.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.270+0000 7f6a1e2c0700 1 -- 172.21.15.146:0/1329148315 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559fc529be90 con 0x559fc5383850 2023-05-24T03:29:51.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.270+0000 7f6a1dabf700 1 --2- 172.21.15.146:0/1329148315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559fc53ac060 0x559fc537c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:29:51.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.270+0000 7f6a1e2c0700 1 --2- 172.21.15.146:0/1329148315 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fc5383850 0x559fc53824c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6a14004500 tx=0x7f6a14016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3530a61b4539967 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:51.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.270+0000 7f6a0cff9700 1 -- 172.21.15.146:0/1329148315 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a14006de0 con 0x559fc5383850 2023-05-24T03:29:51.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.270+0000 7f6a0cff9700 1 -- 172.21.15.146:0/1329148315 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a14033040 con 0x559fc5383850 2023-05-24T03:29:51.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.270+0000 7f6a0cff9700 1 -- 172.21.15.146:0/1329148315 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a14009750 con 0x559fc5383850 2023-05-24T03:29:51.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.270+0000 7f6a2c6b0b80 1 -- 172.21.15.146:0/1329148315 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fc5383850 msgr2=0x559fc53824c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:51.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.270+0000 7f6a2c6b0b80 1 --2- 172.21.15.146:0/1329148315 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fc5383850 0x559fc53824c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6a14004500 tx=0x7f6a14016000 comp rx=0 tx=0).stop 2023-05-24T03:29:51.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.270+0000 7f6a2c6b0b80 1 -- 172.21.15.146:0/1329148315 shutdown_connections 2023-05-24T03:29:51.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.270+0000 7f6a2c6b0b80 1 --2- 172.21.15.146:0/1329148315 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559fc53cbc90 0x559fc53cade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:51.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.270+0000 7f6a2c6b0b80 1 --2- 172.21.15.146:0/1329148315 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fc5383850 0x559fc53824c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:51.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.270+0000 7f6a2c6b0b80 1 --2- 172.21.15.146:0/1329148315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559fc53ac060 0x559fc537c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:51.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.270+0000 7f6a2c6b0b80 1 -- 172.21.15.146:0/1329148315 >> 172.21.15.146:0/1329148315 conn(0x559fc537aed0 msgr2=0x559fc53a7560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:51.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.270+0000 7f6a2c6b0b80 1 -- 172.21.15.146:0/1329148315 shutdown_connections 2023-05-24T03:29:51.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.270+0000 7f6a2c6b0b80 1 -- 172.21.15.146:0/1329148315 wait complete. 2023-05-24T03:29:51.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.271+0000 7f6a2c6b0b80 1 -- start start 2023-05-24T03:29:51.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.271+0000 7f6a2c6b0b80 1 Processor -- start 2023-05-24T03:29:51.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.272+0000 7f6a2c6b0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559fc5383850 0x559fc5431e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:51.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.272+0000 7f6a2c6b0b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fc53ac060 0x559fc53a44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:51.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.272+0000 7f6a2c6b0b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559fc53cbc90 0x559fc53a49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:51.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.273+0000 7f6a2c6b0b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fc5432b20 con 0x559fc53ac060 2023-05-24T03:29:51.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.273+0000 7f6a2c6b0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fc53cb340 con 0x559fc5383850 2023-05-24T03:29:51.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.273+0000 7f6a2c6b0b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x559fc53cb590 con 0x559fc53cbc90 2023-05-24T03:29:51.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.273+0000 7f6a2c6b0b80 10 client.0 _ll_register_callbacks cb 0x7f6a0800cea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-24T03:29:51.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.273+0000 7f6a1dabf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fc53ac060 0x559fc53a44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:51.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.273+0000 7f6a1dabf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fc53ac060 0x559fc53a44a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38830/0 (socket says 172.21.15.146:38830) 2023-05-24T03:29:51.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.273+0000 7f6a1dabf700 1 -- 172.21.15.146:0/3245541990 learned_addr learned my addr 172.21.15.146:0/3245541990 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:51.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.273+0000 7f6a1e2c0700 1 --2- 172.21.15.146:0/3245541990 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559fc5383850 0x559fc5431e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:51.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.273+0000 7f6a1eac1700 1 --2- 172.21.15.146:0/3245541990 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559fc53cbc90 0x559fc53a49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:51.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.273+0000 7f6a1dabf700 1 -- 172.21.15.146:0/3245541990 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559fc53cbc90 msgr2=0x559fc53a49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:51.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.273+0000 7f6a1dabf700 1 --2- 172.21.15.146:0/3245541990 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559fc53cbc90 0x559fc53a49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:51.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.273+0000 7f6a1dabf700 1 -- 172.21.15.146:0/3245541990 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559fc5383850 msgr2=0x559fc5431e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:51.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.273+0000 7f6a1dabf700 1 --2- 172.21.15.146:0/3245541990 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559fc5383850 0x559fc5431e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:51.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.273+0000 7f6a1dabf700 1 -- 172.21.15.146:0/3245541990 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559fc51575e0 con 0x559fc53ac060 2023-05-24T03:29:51.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.273+0000 7f6a1dabf700 1 --2- 172.21.15.146:0/3245541990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fc53ac060 0x559fc53a44a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6a080546e0 tx=0x7f6a0805b070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c3161592b17b16a server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:51.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.273+0000 7f69f97fa700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-05-24T03:29:51.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.273+0000 7f69f97fa700 1 -- 172.21.15.146:0/3245541990 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0806fdb0 con 0x559fc53ac060 2023-05-24T03:29:51.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.273+0000 7f69f97fa700 1 -- 172.21.15.146:0/3245541990 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6a08056640 con 0x559fc53ac060 2023-05-24T03:29:51.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.273+0000 7f6a2c6b0b80 1 -- 172.21.15.146:0/3245541990 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6a14004560 con 0x559fc53ac060 2023-05-24T03:29:51.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.273+0000 7f69f97fa700 1 -- 172.21.15.146:0/3245541990 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a08087580 con 0x559fc53ac060 2023-05-24T03:29:51.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.273+0000 7f6a2c6b0b80 10 client.4464 fetch_fsmap learned FSMap version 7 2023-05-24T03:29:51.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.273+0000 7f6a2c6b0b80 1 -- 172.21.15.146:0/3245541990 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x559fc50ecc10 con 0x559fc53ac060 2023-05-24T03:29:51.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.273+0000 7f69f97fa700 1 -- 172.21.15.146:0/3245541990 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a14004560 con 0x559fc53ac060 2023-05-24T03:29:51.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.274+0000 7f69f97fa700 1 -- 172.21.15.146:0/3245541990 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f6a08053fd0 con 0x559fc53ac060 2023-05-24T03:29:51.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.274+0000 7f6a2c6b0b80 10 client.4464 fetch_fsmap finished waiting for FSMap version 7 2023-05-24T03:29:51.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.274+0000 7f6a2c6b0b80 10 client.4464 resolve_mds: resolved name 'c' to daemon mds.c 2023-05-24T03:29:51.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.274+0000 7f6a2c6b0b80 20 client.4464 populate_metadata read hostname 'smithi146' 2023-05-24T03:29:51.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.274+0000 7f6a2c6b0b80 1 --2- 172.21.15.146:0/3245541990 >> [v2:172.21.15.146:6835/4012487240,v1:172.21.15.146:6836/4012487240] conn(0x559fc53ae4d0 0x559fc53ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:51.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.274+0000 7f6a2c6b0b80 4 client.4464 mds_command: new command op to 4290 tid=0[{"prefix": "status"}] 2023-05-24T03:29:51.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.274+0000 7f6a2c6b0b80 1 -- 172.21.15.146:0/3245541990 --> [v2:172.21.15.146:6835/4012487240,v1:172.21.15.146:6836/4012487240] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559fc52a4610 con 0x559fc53ae4d0 2023-05-24T03:29:51.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.274+0000 7f6a1e2c0700 1 --2- 172.21.15.146:0/3245541990 >> [v2:172.21.15.146:6835/4012487240,v1:172.21.15.146:6836/4012487240] conn(0x559fc53ae4d0 0x559fc53ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:51.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.274+0000 7f69f97fa700 10 client.4464 ms_handle_connect on v2:172.21.15.146:6835/4012487240 2023-05-24T03:29:51.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.274+0000 7f6a1e2c0700 1 --2- 172.21.15.146:0/3245541990 >> [v2:172.21.15.146:6835/4012487240,v1:172.21.15.146:6836/4012487240] conn(0x559fc53ae4d0 0x559fc53ae8a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f65727144e34983f server_cookie=7a9fd4cf3c1b7882 in_seq=0 out_seq=0 2023-05-24T03:29:51.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.274+0000 7f69f97fa700 1 -- 172.21.15.146:0/3245541990 <== mds.0 v2:172.21.15.146:6835/4012487240 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+317 (crc 0 0 0) 0x559fc52a4610 con 0x559fc53ae4d0 2023-05-24T03:29:51.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.274+0000 7f69f97fa700 10 client.4464 handle_command_reply: tid=0 2023-05-24T03:29:51.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.274+0000 7f6a2c6b0b80 1 client.4464 shutdown 2023-05-24T03:29:51.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.274+0000 7f6a2c6b0b80 1 -- 172.21.15.146:0/3245541990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fc53ac060 msgr2=0x559fc53a44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:51.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.274+0000 7f6a2c6b0b80 1 --2- 172.21.15.146:0/3245541990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fc53ac060 0x559fc53a44a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6a080546e0 tx=0x7f6a0805b070 comp rx=0 tx=0).stop 2023-05-24T03:29:51.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.274+0000 7f6a2c6b0b80 1 -- 172.21.15.146:0/3245541990 shutdown_connections 2023-05-24T03:29:51.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.274+0000 7f6a2c6b0b80 1 --2- 172.21.15.146:0/3245541990 >> [v2:172.21.15.146:6835/4012487240,v1:172.21.15.146:6836/4012487240] conn(0x559fc53ae4d0 0x559fc53ae8a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:51.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.274+0000 7f6a2c6b0b80 1 --2- 172.21.15.146:0/3245541990 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559fc53cbc90 0x559fc53a49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:51.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.274+0000 7f6a2c6b0b80 1 --2- 172.21.15.146:0/3245541990 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559fc5383850 0x559fc5431e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:51.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.274+0000 7f69f97fa700 0 client.4464 ms_handle_reset on v2:172.21.15.146:6835/4012487240 2023-05-24T03:29:51.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.274+0000 7f6a2c6b0b80 1 --2- 172.21.15.146:0/3245541990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fc53ac060 0x559fc53a44a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:51.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.274+0000 7f6a2c6b0b80 1 -- 172.21.15.146:0/3245541990 >> 172.21.15.146:0/3245541990 conn(0x559fc537aed0 msgr2=0x559fc53cde70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:51.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.275+0000 7f6a2c6b0b80 1 -- 172.21.15.146:0/3245541990 shutdown_connections 2023-05-24T03:29:51.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.275+0000 7f6a2c6b0b80 1 -- 172.21.15.146:0/3245541990 wait complete. 2023-05-24T03:29:51.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.275+0000 7f6a2c6b0b80 20 client.4464 trim_cache size 0 max 16384 2023-05-24T03:29:51.293 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-05-24T03:29:51.294 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "11ca0adb-7672-4713-bde7-451e8b743ae9", 2023-05-24T03:29:51.294 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2023-05-24T03:29:51.294 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 4290, 2023-05-24T03:29:51.294 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2023-05-24T03:29:51.294 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2023-05-24T03:29:51.294 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2023-05-24T03:29:51.295 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 6.804713939, 2023-05-24T03:29:51.295 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 7, 2023-05-24T03:29:51.295 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 28, 2023-05-24T03:29:51.295 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 27, 2023-05-24T03:29:51.295 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 12.123831273 2023-05-24T03:29:51.295 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-05-24T03:29:51.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.275+0000 7f6a20524700 1 -- 172.21.15.146:0/2200987069 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f69fc06ace0 msgr2=0x7f69fc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:51.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.275+0000 7f6a20524700 1 --2- 172.21.15.146:0/2200987069 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f69fc06ace0 0x7f69fc06d190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6a14009ac0 tx=0x7f6a14009210 comp rx=0 tx=0).stop 2023-05-24T03:29:51.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.275+0000 7f6a20524700 1 -- 172.21.15.146:0/2200987069 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a180cc500 msgr2=0x7f6a1814beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:51.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.275+0000 7f6a20524700 1 --2- 172.21.15.146:0/2200987069 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a180cc500 0x7f6a1814beb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6a0800e9b0 tx=0x7f6a0800ecc0 comp rx=0 tx=0).stop 2023-05-24T03:29:51.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.275+0000 7f6a20524700 1 -- 172.21.15.146:0/2200987069 shutdown_connections 2023-05-24T03:29:51.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.275+0000 7f6a20524700 1 --2- 172.21.15.146:0/2200987069 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f69fc06ace0 0x7f69fc06d190 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:51.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.275+0000 7f6a20524700 1 --2- 172.21.15.146:0/2200987069 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a1815a9c0 0x7f6a180c9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:51.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.275+0000 7f6a20524700 1 --2- 172.21.15.146:0/2200987069 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a180b5820 0x7f6a180c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:51.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.275+0000 7f6a20524700 1 --2- 172.21.15.146:0/2200987069 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a180cc500 0x7f6a1814beb0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:51.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.275+0000 7f6a20524700 1 -- 172.21.15.146:0/2200987069 >> 172.21.15.146:0/2200987069 conn(0x7f6a180cfea0 msgr2=0x7f6a18157310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:51.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.275+0000 7f6a20524700 1 -- 172.21.15.146:0/2200987069 shutdown_connections 2023-05-24T03:29:51.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.275+0000 7f6a20524700 1 -- 172.21.15.146:0/2200987069 wait complete. 2023-05-24T03:29:51.299 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-05-24T03:29:51.301 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-05-24T03:29:51.301 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-24T03:29:51.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.418+0000 7fd58caee700 1 Processor -- start 2023-05-24T03:29:51.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.418+0000 7fd58caee700 1 -- start start 2023-05-24T03:29:51.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.419+0000 7fd58caee700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd5880caeb0 0x7fd588164290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:51.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.419+0000 7fd58caee700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd58806a6f0 con 0x7fd588071bc0 2023-05-24T03:29:51.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.419+0000 7fd58caee700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd588070b20 con 0x7fd588159310 2023-05-24T03:29:51.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.419+0000 7fd58caee700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd588070e00 con 0x7fd5880caeb0 2023-05-24T03:29:51.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.419+0000 7fd585d9b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd588071bc0 0x7fd5880ca7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45288/0 (socket says 172.21.15.146:45288) 2023-05-24T03:29:51.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.419+0000 7fd585d9b700 1 -- 172.21.15.146:0/1731457847 learned_addr learned my addr 172.21.15.146:0/1731457847 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:29:51.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.419+0000 7fd586d9d700 1 --2- 172.21.15.146:0/1731457847 >> v2:172.21.15.151:3300/0 conn(0x7fd5880caeb0 0x7fd588164290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:51.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.419+0000 7fd58559a700 1 -- 172.21.15.146:0/1731457847 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3352489050 0 0) 0x7fd58806a6f0 con 0x7fd588071bc0 2023-05-24T03:29:51.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.419+0000 7fd58559a700 1 -- 172.21.15.146:0/1731457847 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5700046c0 con 0x7fd588071bc0 2023-05-24T03:29:51.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.419+0000 7fd58559a700 1 -- 172.21.15.146:0/1731457847 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2446269469 0 0) 0x7fd588070b20 con 0x7fd588159310 2023-05-24T03:29:51.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.419+0000 7fd58559a700 1 -- 172.21.15.146:0/1731457847 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd58806a6f0 con 0x7fd588159310 2023-05-24T03:29:51.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.419+0000 7fd586d9d700 1 -- 172.21.15.146:0/1731457847 >> v1:172.21.15.151:6789/0 conn(0x7fd588159310 legacy=0x7fd58806b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:51.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.419+0000 7fd58559a700 1 -- 172.21.15.146:0/1731457847 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3720292590 0 0) 0x7fd5700046c0 con 0x7fd588071bc0 2023-05-24T03:29:51.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.419+0000 7fd586d9d700 1 -- 172.21.15.146:0/1731457847 >> v1:172.21.15.146:6789/0 conn(0x7fd588071bc0 legacy=0x7fd5880ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:51.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.419+0000 7fd586d9d700 1 -- 172.21.15.146:0/1731457847 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5880710e0 con 0x7fd5880caeb0 2023-05-24T03:29:51.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.420+0000 7fd586d9d700 1 --2- 172.21.15.146:0/1731457847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5880caeb0 0x7fd588164290 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd580009d90 tx=0x7fd58000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82e189813e911415 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:51.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.420+0000 7fd58559a700 1 -- 172.21.15.146:0/1731457847 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58000e070 con 0x7fd5880caeb0 2023-05-24T03:29:51.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.420+0000 7fd58559a700 1 -- 172.21.15.146:0/1731457847 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd580003a20 con 0x7fd5880caeb0 2023-05-24T03:29:51.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.420+0000 7fd58559a700 1 -- 172.21.15.146:0/1731457847 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57c001670 con 0x7fd5880caeb0 2023-05-24T03:29:51.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.420+0000 7fd58caee700 1 -- 172.21.15.146:0/1731457847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5880caeb0 msgr2=0x7fd588164290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:51.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.420+0000 7fd58caee700 1 --2- 172.21.15.146:0/1731457847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5880caeb0 0x7fd588164290 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd580009d90 tx=0x7fd58000b330 comp rx=0 tx=0).stop 2023-05-24T03:29:51.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.420+0000 7fd58caee700 1 -- 172.21.15.146:0/1731457847 shutdown_connections 2023-05-24T03:29:51.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.420+0000 7fd58caee700 1 --2- 172.21.15.146:0/1731457847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5880caeb0 0x7fd588164290 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:51.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.420+0000 7fd58caee700 1 -- 172.21.15.146:0/1731457847 >> 172.21.15.146:0/1731457847 conn(0x7fd5880cf6c0 msgr2=0x7fd5880cfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:51.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.420+0000 7fd58caee700 1 -- 172.21.15.146:0/1731457847 shutdown_connections 2023-05-24T03:29:51.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.420+0000 7fd58caee700 1 -- 172.21.15.146:0/1731457847 wait complete. 2023-05-24T03:29:51.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.422+0000 7fd58caee700 1 Processor -- start 2023-05-24T03:29:51.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.422+0000 7fd58caee700 1 -- start start 2023-05-24T03:29:51.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.422+0000 7fd58caee700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd588071bc0 0x7fd5880c7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:51.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.422+0000 7fd58caee700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5880caeb0 0x7fd588153ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:51.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.423+0000 7fd58caee700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd588159310 0x7fd5880c93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:51.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.423+0000 7fd58caee700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5880c8310 con 0x7fd588159310 2023-05-24T03:29:51.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.423+0000 7fd58caee700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5880c85f0 con 0x7fd5880caeb0 2023-05-24T03:29:51.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.423+0000 7fd58caee700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5880c88d0 con 0x7fd588071bc0 2023-05-24T03:29:51.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.423+0000 7fd586d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd588159310 0x7fd5880c93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:51.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.423+0000 7fd586d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd588159310 0x7fd5880c93b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38846/0 (socket says 172.21.15.146:38846) 2023-05-24T03:29:51.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.423+0000 7fd586d9d700 1 -- 172.21.15.146:0/1752178333 learned_addr learned my addr 172.21.15.146:0/1752178333 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:51.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.423+0000 7fd58659c700 1 --2- 172.21.15.146:0/1752178333 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd588071bc0 0x7fd5880c7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:51.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.423+0000 7fd585d9b700 1 --2- 172.21.15.146:0/1752178333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5880caeb0 0x7fd588153ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:51.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.423+0000 7fd586d9d700 1 -- 172.21.15.146:0/1752178333 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd588071bc0 msgr2=0x7fd5880c7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:51.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.423+0000 7fd586d9d700 1 --2- 172.21.15.146:0/1752178333 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd588071bc0 0x7fd5880c7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:51.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.423+0000 7fd586d9d700 1 -- 172.21.15.146:0/1752178333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5880caeb0 msgr2=0x7fd588153ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:51.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.423+0000 7fd586d9d700 1 --2- 172.21.15.146:0/1752178333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5880caeb0 0x7fd588153ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:51.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.423+0000 7fd586d9d700 1 -- 172.21.15.146:0/1752178333 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd580009a70 con 0x7fd588159310 2023-05-24T03:29:51.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.423+0000 7fd58659c700 1 --2- 172.21.15.146:0/1752178333 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd588071bc0 0x7fd5880c7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:29:51.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.423+0000 7fd585d9b700 1 --2- 172.21.15.146:0/1752178333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5880caeb0 0x7fd588153ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:29:51.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.423+0000 7fd586d9d700 1 --2- 172.21.15.146:0/1752178333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd588159310 0x7fd5880c93b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd58000b370 tx=0x7fd580004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:51.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.423+0000 7fd576ffd700 1 -- 172.21.15.146:0/1752178333 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5800045c0 con 0x7fd588159310 2023-05-24T03:29:51.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.423+0000 7fd576ffd700 1 -- 172.21.15.146:0/1752178333 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd580004740 con 0x7fd588159310 2023-05-24T03:29:51.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.423+0000 7fd576ffd700 1 -- 172.21.15.146:0/1752178333 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58001d470 con 0x7fd588159310 2023-05-24T03:29:51.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.423+0000 7fd58caee700 1 -- 172.21.15.146:0/1752178333 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5880716a0 con 0x7fd588159310 2023-05-24T03:29:51.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.423+0000 7fd58caee700 1 -- 172.21.15.146:0/1752178333 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5880713c0 con 0x7fd588159310 2023-05-24T03:29:51.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.424+0000 7fd58caee700 1 -- 172.21.15.146:0/1752178333 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5880707b0 con 0x7fd588159310 2023-05-24T03:29:51.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.425+0000 7fd576ffd700 1 -- 172.21.15.146:0/1752178333 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd58001d5d0 con 0x7fd588159310 2023-05-24T03:29:51.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.425+0000 7fd576ffd700 1 --2- 172.21.15.146:0/1752178333 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fd56806ace0 0x7fd56806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:51.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.425+0000 7fd576ffd700 1 -- 172.21.15.146:0/1752178333 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd58008b300 con 0x7fd588159310 2023-05-24T03:29:51.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.425+0000 7fd58659c700 1 --2- 172.21.15.146:0/1752178333 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fd56806ace0 0x7fd56806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:51.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.425+0000 7fd58659c700 1 --2- 172.21.15.146:0/1752178333 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fd56806ace0 0x7fd56806d190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd578001220 tx=0x7fd578009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:51.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.429+0000 7fd576ffd700 1 -- 172.21.15.146:0/1752178333 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fd580056150 con 0x7fd588159310 2023-05-24T03:29:51.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.659+0000 7fd58caee700 1 -- 172.21.15.146:0/1752178333 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd58804e810 con 0x7fd588159310 2023-05-24T03:29:51.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.659+0000 7fd576ffd700 1 -- 172.21.15.146:0/1752178333 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7fd580059770 con 0x7fd588159310 2023-05-24T03:29:51.664 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-05-24T03:29:51.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.661+0000 7fd58caee700 1 -- 172.21.15.146:0/1752178333 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fd56806ace0 msgr2=0x7fd56806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:51.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.661+0000 7fd58caee700 1 --2- 172.21.15.146:0/1752178333 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fd56806ace0 0x7fd56806d190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd578001220 tx=0x7fd578009040 comp rx=0 tx=0).stop 2023-05-24T03:29:51.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.661+0000 7fd58caee700 1 -- 172.21.15.146:0/1752178333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd588159310 msgr2=0x7fd5880c93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:51.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.661+0000 7fd58caee700 1 --2- 172.21.15.146:0/1752178333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd588159310 0x7fd5880c93b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd58000b370 tx=0x7fd580004ad0 comp rx=0 tx=0).stop 2023-05-24T03:29:51.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.661+0000 7fd58caee700 1 -- 172.21.15.146:0/1752178333 shutdown_connections 2023-05-24T03:29:51.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.661+0000 7fd58caee700 1 --2- 172.21.15.146:0/1752178333 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fd56806ace0 0x7fd56806d190 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:51.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.661+0000 7fd58caee700 1 --2- 172.21.15.146:0/1752178333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd588159310 0x7fd5880c93b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:51.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.661+0000 7fd58caee700 1 --2- 172.21.15.146:0/1752178333 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd588071bc0 0x7fd5880c7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:51.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.661+0000 7fd58caee700 1 --2- 172.21.15.146:0/1752178333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5880caeb0 0x7fd588153ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:51.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.661+0000 7fd58caee700 1 -- 172.21.15.146:0/1752178333 >> 172.21.15.146:0/1752178333 conn(0x7fd5880cf6c0 msgr2=0x7fd5880afba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:51.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.661+0000 7fd58caee700 1 -- 172.21.15.146:0/1752178333 shutdown_connections 2023-05-24T03:29:51.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:51.662+0000 7fd58caee700 1 -- 172.21.15.146:0/1752178333 wait complete. 2023-05-24T03:29:51.678 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-05-24T03:29:51.678 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-24T03:29:51.679 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2023-05-24T03:29:51.679 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-05-24T03:29:51.679 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-05-24T03:29:51.679 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-05-24T03:29:51.680 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-24T03:29:51.680 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-24T03:29:51.680 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-05-24T03:29:51.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:29:51.681 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2023-05-24T03:29:51.698 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-24T03:29:51.698 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-24T03:29:51.698 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2023-05-24T03:29:51.698 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-05-24T03:29:51.698 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2023-05-24T03:29:51.698 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-05-24T03:29:51.699 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-24T03:29:51.699 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2023-05-24T03:29:51.699 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-24T03:29:51.699 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2023-05-24T03:29:51.699 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-24T03:29:51.699 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2023-05-24T03:29:51.699 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-24T03:29:51.700 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2023-05-24T03:29:51.700 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-05-24T03:29:51.700 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42290sec preferred_lft 42290sec 2023-05-24T03:29:51.700 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::1ab9:7f4d:347e:588/64 scope link noprefixroute 2023-05-24T03:29:51.700 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-05-24T03:29:51.702 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-05-24T03:29:51.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:29:51.703 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-05-24T03:29:51.703 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-05-24T03:29:51.703 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link add name ceph-brx type bridge 2023-05-24T03:29:51.704 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip addr flush dev ceph-brx 2023-05-24T03:29:51.704 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set ceph-brx up 2023-05-24T03:29:51.704 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-05-24T03:29:51.705 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-05-24T03:29:51.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:29:51.865 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-24T03:29:51.892 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-05-24T03:29:51.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:29:51.894 DEBUG:teuthology.orchestra.run.smithi146:> route 2023-05-24T03:29:51.967 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2023-05-24T03:29:51.968 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-24T03:29:51.968 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-05-24T03:29:51.968 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-05-24T03:29:51.968 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-24T03:29:51.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:29:51.969 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-05-24T03:29:51.969 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-05-24T03:29:51.969 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-05-24T03:29:51.970 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-05-24T03:29:51.970 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-05-24T03:29:51.970 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-05-24T03:29:52.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:29:52.224 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2023-05-24T03:29:52.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:29:52.241 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list-id 2023-05-24T03:29:52.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:29:52.298 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-05-24T03:29:52.298 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-05-24T03:29:52.298 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-05-24T03:29:52.299 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-05-24T03:29:52.299 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-05-24T03:29:52.391 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-05-24T03:29:52.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:29:52.392 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-05-24T03:29:52.393 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-05-24T03:29:52.393 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-05-24T03:29:52.393 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-05-24T03:29:52.394 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-05-24T03:29:52.394 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-05-24T03:29:52.394 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-05-24T03:29:52.394 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-05-24T03:29:52.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:29:52.576 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-05-24T03:29:52.577 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-05-24T03:29:52.577 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2023-05-24T03:29:52.577 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set dev brx.0 master ceph-brx 2023-05-24T03:29:52.577 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-05-24T03:29:52.679 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-05-24T03:29:52.680 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-24T03:29:52.680 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-05-24T03:29:52.700 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-05-24T03:29:52.700 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-24T03:29:52.701 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-05-24T03:29:52.757 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-05-24T03:29:52.824 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-24T03:29:52.824 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-24T03:29:52.890 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-24T03:29:52.891 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-24T03:29:52.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:29:52.892 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-05-24T03:29:52.947 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-05-24T03:29:52.948 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-05-24T03:29:52.989 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-05-24T03:29:53.014 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-24T03:29:53.015 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-24T03:29:53.081 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-24T03:29:53.082 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-24T03:29:53.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:29:53.083 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-05-24T03:29:53.087 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi146.stderr:2023-05-24T03:29:53.082+0000 7fb7cd8375c0 -1 init, newargv = 0x561805c30750 newargc=15 2023-05-24T03:29:53.087 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi146.stderr:ceph-fuse[106519]: starting ceph client 2023-05-24T03:29:53.093 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi146.stderr:ceph-fuse[106519]: starting fuse 2023-05-24T03:29:53.102 INFO:teuthology.orchestra.run.smithi146.stdout:46 2023-05-24T03:29:53.103 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-05-24T03:29:53.103 DEBUG:teuthology.orchestra.run.smithi146:> sudo stdin-killer -- python3 -c ' 2023-05-24T03:29:53.103 DEBUG:teuthology.orchestra.run.smithi146:> import glob 2023-05-24T03:29:53.104 DEBUG:teuthology.orchestra.run.smithi146:> import re 2023-05-24T03:29:53.104 DEBUG:teuthology.orchestra.run.smithi146:> import os 2023-05-24T03:29:53.104 DEBUG:teuthology.orchestra.run.smithi146:> import subprocess 2023-05-24T03:29:53.104 DEBUG:teuthology.orchestra.run.smithi146:> 2023-05-24T03:29:53.105 DEBUG:teuthology.orchestra.run.smithi146:> def _find_admin_socket(client_name): 2023-05-24T03:29:53.105 DEBUG:teuthology.orchestra.run.smithi146:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-05-24T03:29:53.105 DEBUG:teuthology.orchestra.run.smithi146:> files = glob.glob(asok_path) 2023-05-24T03:29:53.105 DEBUG:teuthology.orchestra.run.smithi146:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-05-24T03:29:53.106 DEBUG:teuthology.orchestra.run.smithi146:> 2023-05-24T03:29:53.106 DEBUG:teuthology.orchestra.run.smithi146:> # Given a non-glob path, it better be there 2023-05-24T03:29:53.106 DEBUG:teuthology.orchestra.run.smithi146:> if "*" not in asok_path: 2023-05-24T03:29:53.107 DEBUG:teuthology.orchestra.run.smithi146:> assert(len(files) == 1) 2023-05-24T03:29:53.107 DEBUG:teuthology.orchestra.run.smithi146:> return files[0] 2023-05-24T03:29:53.107 DEBUG:teuthology.orchestra.run.smithi146:> 2023-05-24T03:29:53.107 DEBUG:teuthology.orchestra.run.smithi146:> for f in files: 2023-05-24T03:29:53.108 DEBUG:teuthology.orchestra.run.smithi146:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-05-24T03:29:53.108 DEBUG:teuthology.orchestra.run.smithi146:> if os.path.exists("/proc/{0}".format(pid)): 2023-05-24T03:29:53.109 DEBUG:teuthology.orchestra.run.smithi146:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-05-24T03:29:53.109 DEBUG:teuthology.orchestra.run.smithi146:> contents = proc_f.read() 2023-05-24T03:29:53.109 DEBUG:teuthology.orchestra.run.smithi146:> if mountpoint in contents: 2023-05-24T03:29:53.110 DEBUG:teuthology.orchestra.run.smithi146:> return f 2023-05-24T03:29:53.110 DEBUG:teuthology.orchestra.run.smithi146:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-05-24T03:29:53.110 DEBUG:teuthology.orchestra.run.smithi146:> 2023-05-24T03:29:53.110 DEBUG:teuthology.orchestra.run.smithi146:> print(_find_admin_socket("client.admin")) 2023-05-24T03:29:53.111 DEBUG:teuthology.orchestra.run.smithi146:> ' 2023-05-24T03:29:53.225 INFO:teuthology.orchestra.run.smithi146.stdout:/var/run/ceph/ceph-client.admin.106519.asok 2023-05-24T03:29:53.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53 stdin-killer ERROR: exiting normally with 0 2023-05-24T03:29:53.235 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.106519.asok 2023-05-24T03:29:53.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:29:53.236 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.106519.asok status 2023-05-24T03:29:53.391 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-05-24T03:29:53.391 INFO:teuthology.orchestra.run.smithi146.stdout: "metadata": { 2023-05-24T03:29:53.392 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_sha1": "fa0e62c4a1d8e4a737d9cbe50224f70009b79b28", 2023-05-24T03:29:53.392 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_version": "ceph version 18.0.0-4167-gfa0e62c4 (fa0e62c4a1d8e4a737d9cbe50224f70009b79b28) reef (dev)", 2023-05-24T03:29:53.392 INFO:teuthology.orchestra.run.smithi146.stdout: "entity_id": "admin", 2023-05-24T03:29:53.392 INFO:teuthology.orchestra.run.smithi146.stdout: "hostname": "smithi146", 2023-05-24T03:29:53.392 INFO:teuthology.orchestra.run.smithi146.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-05-24T03:29:53.392 INFO:teuthology.orchestra.run.smithi146.stdout: "pid": "106519", 2023-05-24T03:29:53.392 INFO:teuthology.orchestra.run.smithi146.stdout: "root": "/" 2023-05-24T03:29:53.392 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-05-24T03:29:53.393 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_count": 0, 2023-05-24T03:29:53.393 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_pinned_count": 0, 2023-05-24T03:29:53.393 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 4473, 2023-05-24T03:29:53.393 INFO:teuthology.orchestra.run.smithi146.stdout: "inst": { 2023-05-24T03:29:53.393 INFO:teuthology.orchestra.run.smithi146.stdout: "name": { 2023-05-24T03:29:53.393 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "client", 2023-05-24T03:29:53.393 INFO:teuthology.orchestra.run.smithi146.stdout: "num": 4473 2023-05-24T03:29:53.394 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-05-24T03:29:53.394 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2023-05-24T03:29:53.394 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-05-24T03:29:53.394 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "192.168.0.1:0", 2023-05-24T03:29:53.394 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 3525333396 2023-05-24T03:29:53.394 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-05-24T03:29:53.394 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-05-24T03:29:53.394 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2023-05-24T03:29:53.395 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-05-24T03:29:53.395 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "192.168.0.1:0", 2023-05-24T03:29:53.395 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 3525333396 2023-05-24T03:29:53.395 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-05-24T03:29:53.395 INFO:teuthology.orchestra.run.smithi146.stdout: "inst_str": "client.4473 192.168.0.1:0/3525333396", 2023-05-24T03:29:53.395 INFO:teuthology.orchestra.run.smithi146.stdout: "addr_str": "192.168.0.1:0/3525333396", 2023-05-24T03:29:53.395 INFO:teuthology.orchestra.run.smithi146.stdout: "inode_count": 1, 2023-05-24T03:29:53.395 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_epoch": 7, 2023-05-24T03:29:53.396 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch": 28, 2023-05-24T03:29:53.396 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch_barrier": 0, 2023-05-24T03:29:53.396 INFO:teuthology.orchestra.run.smithi146.stdout: "blocklisted": false, 2023-05-24T03:29:53.396 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs" 2023-05-24T03:29:53.396 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-05-24T03:29:53.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:29:53.401 DEBUG:teuthology.orchestra.run.smithi146:> stat --file-system '--printf=%T 2023-05-24T03:29:53.402 DEBUG:teuthology.orchestra.run.smithi146:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-05-24T03:29:53.418 INFO:teuthology.orchestra.run.smithi146.stdout:fuseblk 2023-05-24T03:29:53.419 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-05-24T03:29:53.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:29:53.419 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-05-24T03:29:53.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:29:53.486 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-05-24T03:29:53.580 INFO:teuthology.orchestra.run.smithi146.stdout:# file: . 2023-05-24T03:29:53.580 INFO:teuthology.orchestra.run.smithi146.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-05-24T03:29:53.580 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:29:53.581 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-05-24T03:29:53.581 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-24T03:29:53.598 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-24T03:29:53.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.753+0000 7fe8ecab8700 1 Processor -- start 2023-05-24T03:29:53.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.753+0000 7fe8ecab8700 1 -- start start 2023-05-24T03:29:53.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.754+0000 7fe8ecab8700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe8e80cbc90 0x7fe8e806a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:53.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.754+0000 7fe8ecab8700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8e80b27e0 con 0x7fe8e80cb8c0 2023-05-24T03:29:53.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.754+0000 7fe8ecab8700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8e80b2220 con 0x7fe8e80cc1d0 2023-05-24T03:29:53.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.754+0000 7fe8ecab8700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8e80b2030 con 0x7fe8e80cbc90 2023-05-24T03:29:53.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.754+0000 7fe8e659c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe8e80cb8c0 0x7fe8e8161030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45330/0 (socket says 172.21.15.146:45330) 2023-05-24T03:29:53.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.754+0000 7fe8e659c700 1 -- 172.21.15.146:0/3565704726 learned_addr learned my addr 172.21.15.146:0/3565704726 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:29:53.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.754+0000 7fe8e6d9d700 1 --2- 172.21.15.146:0/3565704726 >> v2:172.21.15.151:3300/0 conn(0x7fe8e80cbc90 0x7fe8e806a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:53.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.754+0000 7fe8e559a700 1 -- 172.21.15.146:0/3565704726 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4283031762 0 0) 0x7fe8e80b27e0 con 0x7fe8e80cb8c0 2023-05-24T03:29:53.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.754+0000 7fe8e559a700 1 -- 172.21.15.146:0/3565704726 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8d00035b0 con 0x7fe8e80cb8c0 2023-05-24T03:29:53.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.755+0000 7fe8e559a700 1 -- 172.21.15.146:0/3565704726 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4041764730 0 0) 0x7fe8d00035b0 con 0x7fe8e80cb8c0 2023-05-24T03:29:53.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.755+0000 7fe8e559a700 1 -- 172.21.15.146:0/3565704726 >> v2:172.21.15.151:3300/0 conn(0x7fe8e80cbc90 msgr2=0x7fe8e806a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:53.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.755+0000 7fe8e559a700 1 --2- 172.21.15.146:0/3565704726 >> v2:172.21.15.151:3300/0 conn(0x7fe8e80cbc90 0x7fe8e806a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:53.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.755+0000 7fe8e559a700 1 -- 172.21.15.146:0/3565704726 >> v1:172.21.15.151:6789/0 conn(0x7fe8e80cc1d0 legacy=0x7fe8e80b1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:53.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.755+0000 7fe8e559a700 1 -- 172.21.15.146:0/3565704726 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e80b2500 con 0x7fe8e80cb8c0 2023-05-24T03:29:53.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.755+0000 7fe8e559a700 1 -- 172.21.15.146:0/3565704726 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1301887351 0 0) 0x7fe8dc001670 con 0x7fe8e80cb8c0 2023-05-24T03:29:53.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.755+0000 7fe8e559a700 1 -- 172.21.15.146:0/3565704726 >> v1:172.21.15.146:6789/0 conn(0x7fe8e80cb8c0 legacy=0x7fe8e8161030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:53.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.755+0000 7fe8e559a700 1 --2- 172.21.15.146:0/3565704726 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8d0003a00 0x7fe8d0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:53.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.755+0000 7fe8e559a700 1 --2- 172.21.15.146:0/3565704726 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8d0004850 0x7fe8d0004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:53.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.755+0000 7fe8e559a700 1 --2- 172.21.15.146:0/3565704726 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8d0005200 0x7fe8d000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:53.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.755+0000 7fe8e559a700 1 -- 172.21.15.146:0/3565704726 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d000c050 con 0x7fe8d0005200 2023-05-24T03:29:53.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.755+0000 7fe8e559a700 1 -- 172.21.15.146:0/3565704726 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d000c1c0 con 0x7fe8d0004850 2023-05-24T03:29:53.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.755+0000 7fe8e559a700 1 -- 172.21.15.146:0/3565704726 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d000c380 con 0x7fe8d0003a00 2023-05-24T03:29:53.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.755+0000 7fe8e6d9d700 1 --2- 172.21.15.146:0/3565704726 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8d0005200 0x7fe8d000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:53.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.755+0000 7fe8e659c700 1 --2- 172.21.15.146:0/3565704726 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8d0003a00 0x7fe8d0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:53.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.755+0000 7fe8e5d9b700 1 --2- 172.21.15.146:0/3565704726 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8d0004850 0x7fe8d0004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:53.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.755+0000 7fe8e6d9d700 1 -- 172.21.15.146:0/3565704726 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8d0003a00 msgr2=0x7fe8d0003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:53.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.755+0000 7fe8e6d9d700 1 --2- 172.21.15.146:0/3565704726 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8d0003a00 0x7fe8d0003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:53.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.755+0000 7fe8e6d9d700 1 -- 172.21.15.146:0/3565704726 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8d0004850 msgr2=0x7fe8d0004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:53.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.755+0000 7fe8e6d9d700 1 --2- 172.21.15.146:0/3565704726 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8d0004850 0x7fe8d0004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:53.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.755+0000 7fe8e6d9d700 1 -- 172.21.15.146:0/3565704726 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d00035b0 con 0x7fe8d0005200 2023-05-24T03:29:53.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.755+0000 7fe8e6d9d700 1 -- 172.21.15.146:0/3565704726 reap_dead start 2023-05-24T03:29:53.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.755+0000 7fe8e6d9d700 1 --2- 172.21.15.146:0/3565704726 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8d0005200 0x7fe8d000ba10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0009fc0 tx=0x7fe8d0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aee54d67e4f0940 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:53.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.755+0000 7fe8e559a700 1 -- 172.21.15.146:0/3565704726 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e0003a20 con 0x7fe8d0005200 2023-05-24T03:29:53.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.755+0000 7fe8e559a700 1 -- 172.21.15.146:0/3565704726 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e000f040 con 0x7fe8d0005200 2023-05-24T03:29:53.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.755+0000 7fe8e559a700 1 -- 172.21.15.146:0/3565704726 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e0003de0 con 0x7fe8d0005200 2023-05-24T03:29:53.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.756+0000 7fe8ecab8700 1 -- 172.21.15.146:0/3565704726 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8d0005200 msgr2=0x7fe8d000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:53.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.756+0000 7fe8ecab8700 1 --2- 172.21.15.146:0/3565704726 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8d0005200 0x7fe8d000ba10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0009fc0 tx=0x7fe8d0005880 comp rx=0 tx=0).stop 2023-05-24T03:29:53.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.756+0000 7fe8ecab8700 1 -- 172.21.15.146:0/3565704726 shutdown_connections 2023-05-24T03:29:53.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.756+0000 7fe8ecab8700 1 --2- 172.21.15.146:0/3565704726 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8d0005200 0x7fe8d000ba10 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:53.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.756+0000 7fe8ecab8700 1 -- 172.21.15.146:0/3565704726 >> 172.21.15.146:0/3565704726 conn(0x7fe8e80cfea0 msgr2=0x7fe8e80d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:53.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.756+0000 7fe8ecab8700 1 -- 172.21.15.146:0/3565704726 shutdown_connections 2023-05-24T03:29:53.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.756+0000 7fe8ecab8700 1 -- 172.21.15.146:0/3565704726 wait complete. 2023-05-24T03:29:53.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.757+0000 7fe8ecab8700 1 Processor -- start 2023-05-24T03:29:53.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.757+0000 7fe8ecab8700 1 -- start start 2023-05-24T03:29:53.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.758+0000 7fe8ecab8700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8d0005200 0x7fe8e81e5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:53.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.758+0000 7fe8ecab8700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8e8157d50 0x7fe8e8156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:53.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.758+0000 7fe8ecab8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8e8153f30 0x7fe8e80b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:53.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.758+0000 7fe8ecab8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e80b35a0 con 0x7fe8e8153f30 2023-05-24T03:29:53.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.758+0000 7fe8ecab8700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e8156ff0 con 0x7fe8e8157d50 2023-05-24T03:29:53.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.758+0000 7fe8ecab8700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e80b2cd0 con 0x7fe8d0005200 2023-05-24T03:29:53.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.758+0000 7fe8e6d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8e8153f30 0x7fe8e80b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:53.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.758+0000 7fe8e6d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8e8153f30 0x7fe8e80b4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38894/0 (socket says 172.21.15.146:38894) 2023-05-24T03:29:53.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.758+0000 7fe8e6d9d700 1 -- 172.21.15.146:0/940804402 learned_addr learned my addr 172.21.15.146:0/940804402 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:53.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.758+0000 7fe8e5d9b700 1 --2- 172.21.15.146:0/940804402 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8e8157d50 0x7fe8e8156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:53.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.758+0000 7fe8e659c700 1 --2- 172.21.15.146:0/940804402 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8d0005200 0x7fe8e81e5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:53.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.759+0000 7fe8e6d9d700 1 -- 172.21.15.146:0/940804402 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8d0005200 msgr2=0x7fe8e81e5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:53.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.759+0000 7fe8e6d9d700 1 --2- 172.21.15.146:0/940804402 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8d0005200 0x7fe8e81e5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:53.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.759+0000 7fe8e6d9d700 1 -- 172.21.15.146:0/940804402 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8e8157d50 msgr2=0x7fe8e8156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:53.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.759+0000 7fe8e6d9d700 1 --2- 172.21.15.146:0/940804402 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8e8157d50 0x7fe8e8156ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:53.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.759+0000 7fe8e6d9d700 1 -- 172.21.15.146:0/940804402 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e8160b10 con 0x7fe8e8153f30 2023-05-24T03:29:53.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.759+0000 7fe8e6d9d700 1 --2- 172.21.15.146:0/940804402 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8e8153f30 0x7fe8e80b4db0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe8e8066ba0 tx=0x7fe8e0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:53.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.759+0000 7fe8d6ffd700 1 -- 172.21.15.146:0/940804402 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e0003e10 con 0x7fe8e8153f30 2023-05-24T03:29:53.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.759+0000 7fe8d6ffd700 1 -- 172.21.15.146:0/940804402 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e0004230 con 0x7fe8e8153f30 2023-05-24T03:29:53.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.759+0000 7fe8ecab8700 1 -- 172.21.15.146:0/940804402 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8e8160830 con 0x7fe8e8153f30 2023-05-24T03:29:53.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.759+0000 7fe8d6ffd700 1 -- 172.21.15.146:0/940804402 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e00045e0 con 0x7fe8e8153f30 2023-05-24T03:29:53.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.759+0000 7fe8ecab8700 1 -- 172.21.15.146:0/940804402 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8e80b1920 con 0x7fe8e8153f30 2023-05-24T03:29:53.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.760+0000 7fe8ecab8700 1 -- 172.21.15.146:0/940804402 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8e804e810 con 0x7fe8e8153f30 2023-05-24T03:29:53.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.760+0000 7fe8d6ffd700 1 -- 172.21.15.146:0/940804402 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe8e0004740 con 0x7fe8e8153f30 2023-05-24T03:29:53.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.760+0000 7fe8d6ffd700 1 --2- 172.21.15.146:0/940804402 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fe8c806ace0 0x7fe8c806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:53.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.761+0000 7fe8d6ffd700 1 -- 172.21.15.146:0/940804402 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe8e008a900 con 0x7fe8e8153f30 2023-05-24T03:29:53.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.761+0000 7fe8e659c700 1 --2- 172.21.15.146:0/940804402 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fe8c806ace0 0x7fe8c806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:53.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.761+0000 7fe8e659c700 1 --2- 172.21.15.146:0/940804402 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fe8c806ace0 0x7fe8c806d190 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc000c00 tx=0x7fe8dc000ed0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:53.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.765+0000 7fe8d6ffd700 1 -- 172.21.15.146:0/940804402 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fe8e00557f0 con 0x7fe8e8153f30 2023-05-24T03:29:53.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.957+0000 7fe8ecab8700 1 -- 172.21.15.146:0/940804402 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe8e80b4b90 con 0x7fe8e8153f30 2023-05-24T03:29:53.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.958+0000 7fe8d6ffd700 1 -- 172.21.15.146:0/940804402 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20156 (secure 0 0 0) 0x7fe8e0058e10 con 0x7fe8e8153f30 2023-05-24T03:29:53.963 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:29:53.963 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":28,"fsid":"11ca0adb-7672-4713-bde7-451e8b743ae9","created":"2023-05-24T03:29:19.113659+0000","modified":"2023-05-24T03:29:48.912599+0000","last_up_change":"2023-05-24T03:29:30.962339+0000","last_in_change":"2023-05-24T03:29:21.706540+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-24T03:29:32.749984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-24T03:29:37.719623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-24T03:29:42.165379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-24T03:29:43.431615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-24T03:29:46.503075+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f24b319b-fcc8-4385-b0cb-78138fc31417","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6801","nonce":3353593100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6803","nonce":3353593100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6807","nonce":3353593100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6805","nonce":3353593100}]},"public_addr":"172.21.15.146:6801/3353593100","cluster_addr":"172.21.15.146:6803/3353593100","heartbeat_back_addr":"172.21.15.146:6807/3353593100","heartbeat_front_addr":"172.21.15.146:6805/3353593100","state":["exists","up"]},{"osd":1,"uuid":"c9639ea9-8f9b-498e-92c8-aa976edbf1da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6821","nonce":2537488734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6825","nonce":2537488734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6831","nonce":2537488734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6827","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6829","nonce":2537488734}]},"public_addr":"172.21.15.146:6821/2537488734","cluster_addr":"172.21.15.146:6825/2537488734","heartbeat_back_addr":"172.21.15.146:6831/2537488734","heartbeat_front_addr":"172.21.15.146:6829/2537488734","state":["exists","up"]},{"osd":2,"uuid":"7a6cfc6d-b0ca-4cb6-a66d-4001ec184657","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6809","nonce":1800242932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6811","nonce":1800242932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6815","nonce":1800242932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6813","nonce":1800242932}]},"public_addr":"172.21.15.146:6809/1800242932","cluster_addr":"172.21.15.146:6811/1800242932","heartbeat_back_addr":"172.21.15.146:6815/1800242932","heartbeat_front_addr":"172.21.15.146:6813/1800242932","state":["exists","up"]},{"osd":3,"uuid":"401509f7-cecd-44a2-b0ae-22c81a5d93c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6817","nonce":1749783580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6820","nonce":1749783580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6828","nonce":1749783580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6824","nonce":1749783580}]},"public_addr":"172.21.15.146:6817/1749783580","cluster_addr":"172.21.15.146:6820/1749783580","heartbeat_back_addr":"172.21.15.146:6828/1749783580","heartbeat_front_addr":"172.21.15.146:6824/1749783580","state":["exists","up"]},{"osd":4,"uuid":"9d07f440-d125-4f99-a825-411fab894d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6811","nonce":163453435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6814","nonce":163453435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6819","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6821","nonce":163453435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6818","nonce":163453435}]},"public_addr":"172.21.15.151:6811/163453435","cluster_addr":"172.21.15.151:6814/163453435","heartbeat_back_addr":"172.21.15.151:6821/163453435","heartbeat_front_addr":"172.21.15.151:6818/163453435","state":["exists","up"]},{"osd":5,"uuid":"9b2266e2-9e52-4f0e-96da-e703a6c23a6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6801","nonce":3283474903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6803","nonce":3283474903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6807","nonce":3283474903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6805","nonce":3283474903}]},"public_addr":"172.21.15.151:6801/3283474903","cluster_addr":"172.21.15.151:6803/3283474903","heartbeat_back_addr":"172.21.15.151:6807/3283474903","heartbeat_front_addr":"172.21.15.151:6805/3283474903","state":["exists","up"]},{"osd":6,"uuid":"5daedf77-0a83-49e7-b497-d9ed10436972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6825","nonce":3889424178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6827","nonce":3889424178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6831","nonce":3889424178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6829","nonce":3889424178}]},"public_addr":"172.21.15.151:6825/3889424178","cluster_addr":"172.21.15.151:6827/3889424178","heartbeat_back_addr":"172.21.15.151:6831/3889424178","heartbeat_front_addr":"172.21.15.151:6829/3889424178","state":["exists","up"]},{"osd":7,"uuid":"86ae4f7e-c01f-4c3d-a0dd-98160c209309","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6810","nonce":563291208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6815","nonce":563291208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6823","nonce":563291208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6820","nonce":563291208}]},"public_addr":"172.21.15.151:6810/563291208","cluster_addr":"172.21.15.151:6815/563291208","heartbeat_back_addr":"172.21.15.151:6823/563291208","heartbeat_front_addr":"172.21.15.151:6820/563291208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.872472+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.937126+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.877234+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.884793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.881632+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.938293+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.857661+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.945883+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-24T03:29:53.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.960+0000 7fe8ecab8700 1 -- 172.21.15.146:0/940804402 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fe8c806ace0 msgr2=0x7fe8c806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:53.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.960+0000 7fe8ecab8700 1 --2- 172.21.15.146:0/940804402 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fe8c806ace0 0x7fe8c806d190 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc000c00 tx=0x7fe8dc000ed0 comp rx=0 tx=0).stop 2023-05-24T03:29:53.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.960+0000 7fe8ecab8700 1 -- 172.21.15.146:0/940804402 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8e8153f30 msgr2=0x7fe8e80b4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:53.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.960+0000 7fe8ecab8700 1 --2- 172.21.15.146:0/940804402 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8e8153f30 0x7fe8e80b4db0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe8e8066ba0 tx=0x7fe8e0009750 comp rx=0 tx=0).stop 2023-05-24T03:29:53.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.960+0000 7fe8ecab8700 1 -- 172.21.15.146:0/940804402 shutdown_connections 2023-05-24T03:29:53.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.960+0000 7fe8ecab8700 1 --2- 172.21.15.146:0/940804402 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fe8c806ace0 0x7fe8c806d190 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:53.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.960+0000 7fe8ecab8700 1 --2- 172.21.15.146:0/940804402 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8e8153f30 0x7fe8e80b4db0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:53.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.960+0000 7fe8ecab8700 1 --2- 172.21.15.146:0/940804402 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8d0005200 0x7fe8e81e5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:53.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.960+0000 7fe8ecab8700 1 --2- 172.21.15.146:0/940804402 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8e8157d50 0x7fe8e8156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:53.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.960+0000 7fe8ecab8700 1 -- 172.21.15.146:0/940804402 >> 172.21.15.146:0/940804402 conn(0x7fe8e80cfea0 msgr2=0x7fe8e806d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:53.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.960+0000 7fe8ecab8700 1 -- 172.21.15.146:0/940804402 shutdown_connections 2023-05-24T03:29:53.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:53.960+0000 7fe8ecab8700 1 -- 172.21.15.146:0/940804402 wait complete. 2023-05-24T03:29:53.976 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-24T03:29:32.749984+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-24T03:29:37.719623+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-24T03:29:42.165379+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-24T03:29:43.431615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-24T03:29:46.503075+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-24T03:29:53.977 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-24T03:29:54.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.096+0000 7fa699d89700 1 Processor -- start 2023-05-24T03:29:54.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.096+0000 7fa699d89700 1 -- start start 2023-05-24T03:29:54.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.096+0000 7fa699d89700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa69415cd90 0x7fa6940cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:54.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.097+0000 7fa699d89700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6940cfd00 con 0x7fa6940aefd0 2023-05-24T03:29:54.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.097+0000 7fa699d89700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa694072350 con 0x7fa69406a460 2023-05-24T03:29:54.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.097+0000 7fa699d89700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6940cf460 con 0x7fa69415cd90 2023-05-24T03:29:54.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.097+0000 7fa693fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fa6940aefd0 0x7fa694160d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45354/0 (socket says 172.21.15.146:45354) 2023-05-24T03:29:54.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.097+0000 7fa693fff700 1 -- 172.21.15.146:0/2894473131 learned_addr learned my addr 172.21.15.146:0/2894473131 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:29:54.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.097+0000 7fa6927fc700 1 -- 172.21.15.146:0/2894473131 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 803344834 0 0) 0x7fa68c001490 con 0x7fa6940aefd0 2023-05-24T03:29:54.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.097+0000 7fa692ffd700 1 --2- 172.21.15.146:0/2894473131 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa69415cd90 0x7fa6940cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:54.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.097+0000 7fa6927fc700 1 -- 172.21.15.146:0/2894473131 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa67c0035b0 con 0x7fa6940aefd0 2023-05-24T03:29:54.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.097+0000 7fa6927fc700 1 -- 172.21.15.146:0/2894473131 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3142694579 0 0) 0x7fa67c0035b0 con 0x7fa6940aefd0 2023-05-24T03:29:54.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.097+0000 7fa6927fc700 1 -- 172.21.15.146:0/2894473131 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa69415cd90 msgr2=0x7fa6940cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:54.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.097+0000 7fa6927fc700 1 --2- 172.21.15.146:0/2894473131 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa69415cd90 0x7fa6940cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:54.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.097+0000 7fa6927fc700 1 -- 172.21.15.146:0/2894473131 >> v1:172.21.15.151:6789/0 conn(0x7fa69406a460 legacy=0x7fa69406a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:54.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.097+0000 7fa6927fc700 1 -- 172.21.15.146:0/2894473131 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6940cf740 con 0x7fa6940aefd0 2023-05-24T03:29:54.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.097+0000 7fa6927fc700 1 -- 172.21.15.146:0/2894473131 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1301887351 0 0) 0x7fa68c001b80 con 0x7fa6940aefd0 2023-05-24T03:29:54.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.097+0000 7fa6927fc700 1 -- 172.21.15.146:0/2894473131 >> v1:172.21.15.146:6789/0 conn(0x7fa6940aefd0 legacy=0x7fa694160d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:54.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.097+0000 7fa6927fc700 1 --2- 172.21.15.146:0/2894473131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa67c003a30 0x7fa67c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:54.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.097+0000 7fa6927fc700 1 --2- 172.21.15.146:0/2894473131 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa67c0043d0 0x7fa67c004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:54.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.097+0000 7fa6927fc700 1 --2- 172.21.15.146:0/2894473131 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa69415cd90 0x7fa67c0050f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:54.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.097+0000 7fa6927fc700 1 -- 172.21.15.146:0/2894473131 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6940cf460 con 0x7fa67c0043d0 2023-05-24T03:29:54.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.097+0000 7fa6927fc700 1 -- 172.21.15.146:0/2894473131 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67c00ba10 con 0x7fa67c003a30 2023-05-24T03:29:54.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.097+0000 7fa6927fc700 1 -- 172.21.15.146:0/2894473131 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa67c00bba0 con 0x7fa69415cd90 2023-05-24T03:29:54.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.097+0000 7fa692ffd700 1 --2- 172.21.15.146:0/2894473131 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa67c0043d0 0x7fa67c004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:54.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.097+0000 7fa6937fe700 1 --2- 172.21.15.146:0/2894473131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa67c003a30 0x7fa67c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:54.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.098+0000 7fa693fff700 1 --2- 172.21.15.146:0/2894473131 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa69415cd90 0x7fa67c0050f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:54.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.098+0000 7fa692ffd700 1 -- 172.21.15.146:0/2894473131 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa69415cd90 msgr2=0x7fa67c0050f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:54.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.098+0000 7fa692ffd700 1 --2- 172.21.15.146:0/2894473131 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa69415cd90 0x7fa67c0050f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:54.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.098+0000 7fa692ffd700 1 -- 172.21.15.146:0/2894473131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa67c003a30 msgr2=0x7fa67c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:54.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.098+0000 7fa692ffd700 1 --2- 172.21.15.146:0/2894473131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa67c003a30 0x7fa67c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:54.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.098+0000 7fa692ffd700 1 -- 172.21.15.146:0/2894473131 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa67c0035b0 con 0x7fa67c0043d0 2023-05-24T03:29:54.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.098+0000 7fa692ffd700 1 --2- 172.21.15.146:0/2894473131 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa67c0043d0 0x7fa67c004890 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa688009b60 tx=0x7fa67c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc6bde2e29e2d368 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:54.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.098+0000 7fa6927fc700 1 -- 172.21.15.146:0/2894473131 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68800e6c0 con 0x7fa67c0043d0 2023-05-24T03:29:54.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.098+0000 7fa6927fc700 1 -- 172.21.15.146:0/2894473131 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa68800e820 con 0x7fa67c0043d0 2023-05-24T03:29:54.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.098+0000 7fa6927fc700 1 -- 172.21.15.146:0/2894473131 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68800eb90 con 0x7fa67c0043d0 2023-05-24T03:29:54.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.098+0000 7fa699d89700 1 -- 172.21.15.146:0/2894473131 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa67c0043d0 msgr2=0x7fa67c004890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:54.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.098+0000 7fa699d89700 1 --2- 172.21.15.146:0/2894473131 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa67c0043d0 0x7fa67c004890 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa688009b60 tx=0x7fa67c005880 comp rx=0 tx=0).stop 2023-05-24T03:29:54.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.098+0000 7fa693fff700 1 -- 172.21.15.146:0/2894473131 reap_dead start 2023-05-24T03:29:54.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.099+0000 7fa699d89700 1 -- 172.21.15.146:0/2894473131 shutdown_connections 2023-05-24T03:29:54.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.099+0000 7fa699d89700 1 -- 172.21.15.146:0/2894473131 >> 172.21.15.146:0/2894473131 conn(0x7fa6940cfea0 msgr2=0x7fa6940d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:54.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.099+0000 7fa699d89700 1 -- 172.21.15.146:0/2894473131 shutdown_connections 2023-05-24T03:29:54.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.099+0000 7fa699d89700 1 -- 172.21.15.146:0/2894473131 wait complete. 2023-05-24T03:29:54.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.100+0000 7fa699d89700 1 Processor -- start 2023-05-24T03:29:54.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.100+0000 7fa699d89700 1 -- start start 2023-05-24T03:29:54.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.101+0000 7fa699d89700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa67c0043d0 0x7fa6940b23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:54.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.101+0000 7fa699d89700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa69415fa30 0x7fa694144a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:54.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.101+0000 7fa699d89700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa694144fd0 0x7fa6941f4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:54.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.101+0000 7fa699d89700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6940ae400 con 0x7fa69415fa30 2023-05-24T03:29:54.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.101+0000 7fa699d89700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6940ad360 con 0x7fa694144fd0 2023-05-24T03:29:54.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.101+0000 7fa699d89700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6940ad640 con 0x7fa67c0043d0 2023-05-24T03:29:54.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.101+0000 7fa692ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa69415fa30 0x7fa694144a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:54.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.101+0000 7fa692ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa69415fa30 0x7fa694144a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38912/0 (socket says 172.21.15.146:38912) 2023-05-24T03:29:54.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.101+0000 7fa692ffd700 1 -- 172.21.15.146:0/3006566844 learned_addr learned my addr 172.21.15.146:0/3006566844 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:54.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.102+0000 7fa693fff700 1 --2- 172.21.15.146:0/3006566844 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa694144fd0 0x7fa6941f4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:54.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.102+0000 7fa6937fe700 1 --2- 172.21.15.146:0/3006566844 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa67c0043d0 0x7fa6940b23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:54.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.102+0000 7fa692ffd700 1 -- 172.21.15.146:0/3006566844 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa67c0043d0 msgr2=0x7fa6940b23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:54.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.102+0000 7fa692ffd700 1 --2- 172.21.15.146:0/3006566844 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa67c0043d0 0x7fa6940b23e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:54.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.102+0000 7fa692ffd700 1 -- 172.21.15.146:0/3006566844 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa694144fd0 msgr2=0x7fa6941f4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:54.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.102+0000 7fa692ffd700 1 --2- 172.21.15.146:0/3006566844 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa694144fd0 0x7fa6941f4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:54.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.102+0000 7fa692ffd700 1 -- 172.21.15.146:0/3006566844 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa694160800 con 0x7fa69415fa30 2023-05-24T03:29:54.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.102+0000 7fa693fff700 1 --2- 172.21.15.146:0/3006566844 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa694144fd0 0x7fa6941f4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:29:54.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.102+0000 7fa692ffd700 1 --2- 172.21.15.146:0/3006566844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa69415fa30 0x7fa694144a90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa67c005800 tx=0x7fa6880047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:54.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.102+0000 7fa67bfff700 1 -- 172.21.15.146:0/3006566844 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68800e6c0 con 0x7fa69415fa30 2023-05-24T03:29:54.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.102+0000 7fa67bfff700 1 -- 172.21.15.146:0/3006566844 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa688003ab0 con 0x7fa69415fa30 2023-05-24T03:29:54.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.102+0000 7fa699d89700 1 -- 172.21.15.146:0/3006566844 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6940cfa20 con 0x7fa69415fa30 2023-05-24T03:29:54.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.102+0000 7fa67bfff700 1 -- 172.21.15.146:0/3006566844 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa688003e60 con 0x7fa69415fa30 2023-05-24T03:29:54.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.102+0000 7fa699d89700 1 -- 172.21.15.146:0/3006566844 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6940af620 con 0x7fa69415fa30 2023-05-24T03:29:54.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.103+0000 7fa699d89700 1 -- 172.21.15.146:0/3006566844 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa694068d00 con 0x7fa69415fa30 2023-05-24T03:29:54.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.103+0000 7fa67bfff700 1 -- 172.21.15.146:0/3006566844 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa688013470 con 0x7fa69415fa30 2023-05-24T03:29:54.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.104+0000 7fa67bfff700 1 --2- 172.21.15.146:0/3006566844 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fa68006ace0 0x7fa68006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:54.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.104+0000 7fa6937fe700 1 --2- 172.21.15.146:0/3006566844 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fa68006ace0 0x7fa68006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:54.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.104+0000 7fa67bfff700 1 -- 172.21.15.146:0/3006566844 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa68808b0d0 con 0x7fa69415fa30 2023-05-24T03:29:54.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.104+0000 7fa6937fe700 1 --2- 172.21.15.146:0/3006566844 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fa68006ace0 0x7fa68006d190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa6940aeea0 tx=0x7fa684009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:54.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.108+0000 7fa67bfff700 1 -- 172.21.15.146:0/3006566844 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fa688055f20 con 0x7fa69415fa30 2023-05-24T03:29:54.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.295+0000 7fa699d89700 1 -- 172.21.15.146:0/3006566844 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa6940d0a80 con 0x7fa69415fa30 2023-05-24T03:29:54.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.296+0000 7fa67bfff700 1 -- 172.21.15.146:0/3006566844 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa688059540 con 0x7fa69415fa30 2023-05-24T03:29:54.301 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2023-05-24T03:29:54.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.298+0000 7fa699d89700 1 -- 172.21.15.146:0/3006566844 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fa68006ace0 msgr2=0x7fa68006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:54.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.298+0000 7fa699d89700 1 --2- 172.21.15.146:0/3006566844 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fa68006ace0 0x7fa68006d190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa6940aeea0 tx=0x7fa684009040 comp rx=0 tx=0).stop 2023-05-24T03:29:54.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.298+0000 7fa699d89700 1 -- 172.21.15.146:0/3006566844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa69415fa30 msgr2=0x7fa694144a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:54.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.298+0000 7fa699d89700 1 --2- 172.21.15.146:0/3006566844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa69415fa30 0x7fa694144a90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa67c005800 tx=0x7fa6880047c0 comp rx=0 tx=0).stop 2023-05-24T03:29:54.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.298+0000 7fa699d89700 1 -- 172.21.15.146:0/3006566844 shutdown_connections 2023-05-24T03:29:54.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.298+0000 7fa699d89700 1 --2- 172.21.15.146:0/3006566844 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fa68006ace0 0x7fa68006d190 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:54.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.298+0000 7fa699d89700 1 --2- 172.21.15.146:0/3006566844 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa694144fd0 0x7fa6941f4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:54.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.298+0000 7fa699d89700 1 --2- 172.21.15.146:0/3006566844 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa67c0043d0 0x7fa6940b23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:54.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.298+0000 7fa699d89700 1 --2- 172.21.15.146:0/3006566844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa69415fa30 0x7fa694144a90 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:54.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.298+0000 7fa699d89700 1 -- 172.21.15.146:0/3006566844 >> 172.21.15.146:0/3006566844 conn(0x7fa6940cfea0 msgr2=0x7fa69415c160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:54.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.298+0000 7fa699d89700 1 -- 172.21.15.146:0/3006566844 shutdown_connections 2023-05-24T03:29:54.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.298+0000 7fa699d89700 1 -- 172.21.15.146:0/3006566844 wait complete. 2023-05-24T03:29:54.314 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-24T03:29:54.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.434+0000 7f00fce02700 1 Processor -- start 2023-05-24T03:29:54.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.434+0000 7f00fce02700 1 -- start start 2023-05-24T03:29:54.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.435+0000 7f00fce02700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f00f806a460 0x7f00f80cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:54.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.435+0000 7f00fce02700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f00f815cd90 0x7f00f806a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:54.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.435+0000 7f00fce02700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f00f80aefd0 0x7f00f8160d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:54.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.435+0000 7f00fce02700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00f80cfd00 con 0x7f00f806a460 2023-05-24T03:29:54.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.435+0000 7f00fce02700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00f8072350 con 0x7f00f80aefd0 2023-05-24T03:29:54.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.435+0000 7f00fce02700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f806ad70 con 0x7f00f815cd90 2023-05-24T03:29:54.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.435+0000 7f00f659c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f00f806a460 0x7f00f80cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:54.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.435+0000 7f00f659c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f00f806a460 0x7f00f80cede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38918/0 (socket says 172.21.15.146:38918) 2023-05-24T03:29:54.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.435+0000 7f00f659c700 1 -- 172.21.15.146:0/4246065053 learned_addr learned my addr 172.21.15.146:0/4246065053 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:54.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.435+0000 7f00f5d9b700 1 --2- 172.21.15.146:0/4246065053 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f00f815cd90 0x7f00f806a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:54.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.435+0000 7f00f6d9d700 1 --2- 172.21.15.146:0/4246065053 >> v2:172.21.15.151:3300/0 conn(0x7f00f80aefd0 0x7f00f8160d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:54.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.435+0000 7f00f659c700 1 -- 172.21.15.146:0/4246065053 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f00f815cd90 msgr2=0x7f00f806a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:54.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.435+0000 7f00f659c700 1 --2- 172.21.15.146:0/4246065053 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f00f815cd90 0x7f00f806a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:54.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.435+0000 7f00f659c700 1 -- 172.21.15.146:0/4246065053 >> v2:172.21.15.151:3300/0 conn(0x7f00f80aefd0 msgr2=0x7f00f8160d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:54.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.435+0000 7f00f659c700 1 --2- 172.21.15.146:0/4246065053 >> v2:172.21.15.151:3300/0 conn(0x7f00f80aefd0 0x7f00f8160d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:54.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.435+0000 7f00f659c700 1 -- 172.21.15.146:0/4246065053 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f80cf460 con 0x7f00f806a460 2023-05-24T03:29:54.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.435+0000 7f00f6d9d700 1 --2- 172.21.15.146:0/4246065053 >> v2:172.21.15.151:3300/0 conn(0x7f00f80aefd0 0x7f00f8160d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:29:54.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.435+0000 7f00f659c700 1 --2- 172.21.15.146:0/4246065053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00f806a460 0x7f00f80cede0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f00f806c4b0 tx=0x7f00e8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba560fa966e70fd2 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:54.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.436+0000 7f00f559a700 1 -- 172.21.15.146:0/4246065053 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e8011830 con 0x7f00f806a460 2023-05-24T03:29:54.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.436+0000 7f00f559a700 1 -- 172.21.15.146:0/4246065053 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e8011990 con 0x7f00f806a460 2023-05-24T03:29:54.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.436+0000 7f00f559a700 1 -- 172.21.15.146:0/4246065053 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e8011d20 con 0x7f00f806a460 2023-05-24T03:29:54.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.436+0000 7f00fce02700 1 -- 172.21.15.146:0/4246065053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00f806a460 msgr2=0x7f00f80cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:54.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.436+0000 7f00fce02700 1 --2- 172.21.15.146:0/4246065053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00f806a460 0x7f00f80cede0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f00f806c4b0 tx=0x7f00e8009bd0 comp rx=0 tx=0).stop 2023-05-24T03:29:54.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.436+0000 7f00fce02700 1 -- 172.21.15.146:0/4246065053 shutdown_connections 2023-05-24T03:29:54.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.436+0000 7f00fce02700 1 --2- 172.21.15.146:0/4246065053 >> v2:172.21.15.151:3300/0 conn(0x7f00f80aefd0 0x7f00f8160d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:54.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.436+0000 7f00fce02700 1 --2- 172.21.15.146:0/4246065053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00f806a460 0x7f00f80cede0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:54.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.436+0000 7f00fce02700 1 --2- 172.21.15.146:0/4246065053 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f00f815cd90 0x7f00f806a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:54.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.436+0000 7f00fce02700 1 -- 172.21.15.146:0/4246065053 >> 172.21.15.146:0/4246065053 conn(0x7f00f80cfea0 msgr2=0x7f00f80d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:54.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.436+0000 7f00fce02700 1 -- 172.21.15.146:0/4246065053 shutdown_connections 2023-05-24T03:29:54.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.436+0000 7f00fce02700 1 -- 172.21.15.146:0/4246065053 wait complete. 2023-05-24T03:29:54.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.438+0000 7f00fce02700 1 Processor -- start 2023-05-24T03:29:54.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.438+0000 7f00fce02700 1 -- start start 2023-05-24T03:29:54.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.439+0000 7f00fce02700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f00f806a460 0x7f00f80c45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:54.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.439+0000 7f00fce02700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00f80aefd0 0x7f00f80c3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:54.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.439+0000 7f00fce02700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00f815cd90 0x7f00f81f5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:54.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.439+0000 7f00fce02700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f814f420 con 0x7f00f815cd90 2023-05-24T03:29:54.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.439+0000 7f00fce02700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f814f700 con 0x7f00f80aefd0 2023-05-24T03:29:54.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.439+0000 7f00fce02700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f814f9e0 con 0x7f00f806a460 2023-05-24T03:29:54.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.439+0000 7f00f6d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00f815cd90 0x7f00f81f5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:54.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.439+0000 7f00f6d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00f815cd90 0x7f00f81f5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38926/0 (socket says 172.21.15.146:38926) 2023-05-24T03:29:54.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.439+0000 7f00f6d9d700 1 -- 172.21.15.146:0/833853437 learned_addr learned my addr 172.21.15.146:0/833853437 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:54.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.439+0000 7f00f659c700 1 --2- 172.21.15.146:0/833853437 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f00f806a460 0x7f00f80c45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:54.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.439+0000 7f00f5d9b700 1 --2- 172.21.15.146:0/833853437 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00f80aefd0 0x7f00f80c3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:54.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.439+0000 7f00f6d9d700 1 -- 172.21.15.146:0/833853437 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f00f806a460 msgr2=0x7f00f80c45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:54.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.439+0000 7f00f6d9d700 1 --2- 172.21.15.146:0/833853437 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f00f806a460 0x7f00f80c45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:54.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.439+0000 7f00f6d9d700 1 -- 172.21.15.146:0/833853437 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00f80aefd0 msgr2=0x7f00f80c3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:54.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.439+0000 7f00f6d9d700 1 --2- 172.21.15.146:0/833853437 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00f80aefd0 0x7f00f80c3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:54.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.439+0000 7f00f6d9d700 1 -- 172.21.15.146:0/833853437 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e8009550 con 0x7f00f815cd90 2023-05-24T03:29:54.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.439+0000 7f00f6d9d700 1 --2- 172.21.15.146:0/833853437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00f815cd90 0x7f00f81f5bf0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f00f0007df0 tx=0x7f00f000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:54.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.440+0000 7f00e6ffd700 1 -- 172.21.15.146:0/833853437 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f000ddd0 con 0x7f00f815cd90 2023-05-24T03:29:54.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.440+0000 7f00e6ffd700 1 -- 172.21.15.146:0/833853437 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f000f040 con 0x7f00f815cd90 2023-05-24T03:29:54.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.440+0000 7f00e6ffd700 1 -- 172.21.15.146:0/833853437 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f0003c60 con 0x7f00f815cd90 2023-05-24T03:29:54.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.440+0000 7f00fce02700 1 -- 172.21.15.146:0/833853437 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00f80cfa20 con 0x7f00f815cd90 2023-05-24T03:29:54.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.440+0000 7f00fce02700 1 -- 172.21.15.146:0/833853437 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00f80cf740 con 0x7f00f815cd90 2023-05-24T03:29:54.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.441+0000 7f00fce02700 1 -- 172.21.15.146:0/833853437 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00f8160800 con 0x7f00f815cd90 2023-05-24T03:29:54.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.441+0000 7f00e6ffd700 1 -- 172.21.15.146:0/833853437 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f00f0004030 con 0x7f00f815cd90 2023-05-24T03:29:54.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.441+0000 7f00e6ffd700 1 --2- 172.21.15.146:0/833853437 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f00d806ace0 0x7f00d806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:54.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.442+0000 7f00e6ffd700 1 -- 172.21.15.146:0/833853437 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f00f0089990 con 0x7f00f815cd90 2023-05-24T03:29:54.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.442+0000 7f00f659c700 1 --2- 172.21.15.146:0/833853437 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f00d806ace0 0x7f00d806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:54.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.442+0000 7f00f659c700 1 --2- 172.21.15.146:0/833853437 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f00d806ace0 0x7f00d806d190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f00e8014040 tx=0x7f00e8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:54.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.446+0000 7f00e6ffd700 1 -- 172.21.15.146:0/833853437 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f00f0054750 con 0x7f00f815cd90 2023-05-24T03:29:54.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.632+0000 7f00fce02700 1 -- 172.21.15.146:0/833853437 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f00f814ff00 con 0x7f00f815cd90 2023-05-24T03:29:54.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.632+0000 7f00e6ffd700 1 -- 172.21.15.146:0/833853437 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f00f814ff00 con 0x7f00f815cd90 2023-05-24T03:29:54.637 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2023-05-24T03:29:54.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.634+0000 7f00fce02700 1 -- 172.21.15.146:0/833853437 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f00d806ace0 msgr2=0x7f00d806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:54.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.634+0000 7f00fce02700 1 --2- 172.21.15.146:0/833853437 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f00d806ace0 0x7f00d806d190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f00e8014040 tx=0x7f00e8008030 comp rx=0 tx=0).stop 2023-05-24T03:29:54.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.634+0000 7f00fce02700 1 -- 172.21.15.146:0/833853437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00f815cd90 msgr2=0x7f00f81f5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:54.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.634+0000 7f00fce02700 1 --2- 172.21.15.146:0/833853437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00f815cd90 0x7f00f81f5bf0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f00f0007df0 tx=0x7f00f000d3b0 comp rx=0 tx=0).stop 2023-05-24T03:29:54.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.634+0000 7f00fce02700 1 -- 172.21.15.146:0/833853437 shutdown_connections 2023-05-24T03:29:54.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.634+0000 7f00fce02700 1 --2- 172.21.15.146:0/833853437 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f00d806ace0 0x7f00d806d190 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:54.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.634+0000 7f00fce02700 1 --2- 172.21.15.146:0/833853437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00f815cd90 0x7f00f81f5bf0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:54.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.634+0000 7f00fce02700 1 --2- 172.21.15.146:0/833853437 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f00f806a460 0x7f00f80c45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:54.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.634+0000 7f00fce02700 1 --2- 172.21.15.146:0/833853437 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00f80aefd0 0x7f00f80c3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:54.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.634+0000 7f00fce02700 1 -- 172.21.15.146:0/833853437 >> 172.21.15.146:0/833853437 conn(0x7f00f80cfea0 msgr2=0x7f00f815c160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:54.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.634+0000 7f00fce02700 1 -- 172.21.15.146:0/833853437 shutdown_connections 2023-05-24T03:29:54.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.634+0000 7f00fce02700 1 -- 172.21.15.146:0/833853437 wait complete. 2023-05-24T03:29:54.651 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-24T03:29:54.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.770+0000 7f6e23588700 1 Processor -- start 2023-05-24T03:29:54.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.771+0000 7f6e23588700 1 -- start start 2023-05-24T03:29:54.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.771+0000 7f6e23588700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e1c15cd90 0x7f6e1c0cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:54.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.771+0000 7f6e23588700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6e1c0aefd0 0x7f6e1c160d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:54.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.771+0000 7f6e23588700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e1c0cfd00 con 0x7f6e1c06a460 2023-05-24T03:29:54.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.771+0000 7f6e23588700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e1c072350 con 0x7f6e1c0aefd0 2023-05-24T03:29:54.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.771+0000 7f6e23588700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1c0cf460 con 0x7f6e1c15cd90 2023-05-24T03:29:54.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.771+0000 7f6e21b25700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6e1c0aefd0 0x7f6e1c160d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:54.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.772+0000 7f6e21b25700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6e1c0aefd0 0x7f6e1c160d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38934/0 (socket says 172.21.15.146:38934) 2023-05-24T03:29:54.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.772+0000 7f6e21b25700 1 -- 172.21.15.146:0/1845187389 learned_addr learned my addr 172.21.15.146:0/1845187389 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:54.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.772+0000 7f6e20b23700 1 --2- 172.21.15.146:0/1845187389 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e1c15cd90 0x7f6e1c0cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:54.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.772+0000 7f6e21b25700 1 -- 172.21.15.146:0/1845187389 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e1c15cd90 msgr2=0x7f6e1c0cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:54.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.772+0000 7f6e21b25700 1 --2- 172.21.15.146:0/1845187389 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e1c15cd90 0x7f6e1c0cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:54.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.772+0000 7f6e21b25700 1 -- 172.21.15.146:0/1845187389 >> v1:172.21.15.151:6789/0 conn(0x7f6e1c06a460 legacy=0x7f6e1c06a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:54.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.772+0000 7f6e21b25700 1 -- 172.21.15.146:0/1845187389 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e1c0cf740 con 0x7f6e1c0aefd0 2023-05-24T03:29:54.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.772+0000 7f6e21b25700 1 --2- 172.21.15.146:0/1845187389 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e1c0aefd0 0x7f6e1c160d20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6e14009e50 tx=0x7f6e1400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aad7b0f5c1ecd96 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:54.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.772+0000 7f6e0ffff700 1 -- 172.21.15.146:0/1845187389 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1400e070 con 0x7f6e1c0aefd0 2023-05-24T03:29:54.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.772+0000 7f6e0ffff700 1 -- 172.21.15.146:0/1845187389 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e1400b910 con 0x7f6e1c0aefd0 2023-05-24T03:29:54.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.772+0000 7f6e0ffff700 1 -- 172.21.15.146:0/1845187389 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1400bcc0 con 0x7f6e1c0aefd0 2023-05-24T03:29:54.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.773+0000 7f6e23588700 1 -- 172.21.15.146:0/1845187389 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e1c0aefd0 msgr2=0x7f6e1c160d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:54.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.773+0000 7f6e23588700 1 --2- 172.21.15.146:0/1845187389 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e1c0aefd0 0x7f6e1c160d20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6e14009e50 tx=0x7f6e1400b330 comp rx=0 tx=0).stop 2023-05-24T03:29:54.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.773+0000 7f6e23588700 1 -- 172.21.15.146:0/1845187389 shutdown_connections 2023-05-24T03:29:54.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.773+0000 7f6e23588700 1 --2- 172.21.15.146:0/1845187389 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e1c0aefd0 0x7f6e1c160d20 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:54.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.773+0000 7f6e23588700 1 --2- 172.21.15.146:0/1845187389 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e1c15cd90 0x7f6e1c0cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:54.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.773+0000 7f6e23588700 1 -- 172.21.15.146:0/1845187389 >> 172.21.15.146:0/1845187389 conn(0x7f6e1c0cfea0 msgr2=0x7f6e1c0d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:54.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.773+0000 7f6e23588700 1 -- 172.21.15.146:0/1845187389 shutdown_connections 2023-05-24T03:29:54.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.773+0000 7f6e23588700 1 -- 172.21.15.146:0/1845187389 wait complete. 2023-05-24T03:29:54.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.774+0000 7f6e23588700 1 Processor -- start 2023-05-24T03:29:54.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.774+0000 7f6e23588700 1 -- start start 2023-05-24T03:29:54.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.775+0000 7f6e23588700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e1c06a460 0x7f6e1c151450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:54.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.775+0000 7f6e23588700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e1c0aefd0 0x7f6e1c0b11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:54.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.775+0000 7f6e23588700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e1c15cd90 0x7f6e1c0ada00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:54.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.775+0000 7f6e23588700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1c151990 con 0x7f6e1c06a460 2023-05-24T03:29:54.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.775+0000 7f6e23588700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1c15d160 con 0x7f6e1c0aefd0 2023-05-24T03:29:54.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.775+0000 7f6e23588700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1c0b1c40 con 0x7f6e1c15cd90 2023-05-24T03:29:54.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.775+0000 7f6e21324700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e1c06a460 0x7f6e1c151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:54.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.775+0000 7f6e21324700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e1c06a460 0x7f6e1c151450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38936/0 (socket says 172.21.15.146:38936) 2023-05-24T03:29:54.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.775+0000 7f6e21324700 1 -- 172.21.15.146:0/2141218585 learned_addr learned my addr 172.21.15.146:0/2141218585 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:54.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.775+0000 7f6e21b25700 1 --2- 172.21.15.146:0/2141218585 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e1c15cd90 0x7f6e1c0ada00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:54.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.775+0000 7f6e20b23700 1 --2- 172.21.15.146:0/2141218585 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e1c0aefd0 0x7f6e1c0b11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:54.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.775+0000 7f6e21324700 1 -- 172.21.15.146:0/2141218585 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e1c15cd90 msgr2=0x7f6e1c0ada00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:54.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.775+0000 7f6e21324700 1 --2- 172.21.15.146:0/2141218585 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e1c15cd90 0x7f6e1c0ada00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:54.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.775+0000 7f6e21324700 1 -- 172.21.15.146:0/2141218585 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e1c0aefd0 msgr2=0x7f6e1c0b11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:54.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.775+0000 7f6e21324700 1 --2- 172.21.15.146:0/2141218585 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e1c0aefd0 0x7f6e1c0b11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:54.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.775+0000 7f6e21324700 1 -- 172.21.15.146:0/2141218585 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e14009b30 con 0x7f6e1c06a460 2023-05-24T03:29:54.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.775+0000 7f6e20b23700 1 --2- 172.21.15.146:0/2141218585 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e1c0aefd0 0x7f6e1c0b11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:29:54.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.775+0000 7f6e21324700 1 --2- 172.21.15.146:0/2141218585 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e1c06a460 0x7f6e1c151450 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6e1800c450 tx=0x7f6e1800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:54.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.775+0000 7f6e0dffb700 1 -- 172.21.15.146:0/2141218585 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e180052d0 con 0x7f6e1c06a460 2023-05-24T03:29:54.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.775+0000 7f6e0dffb700 1 -- 172.21.15.146:0/2141218585 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e18005430 con 0x7f6e1c06a460 2023-05-24T03:29:54.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.775+0000 7f6e23588700 1 -- 172.21.15.146:0/2141218585 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e1c160800 con 0x7f6e1c06a460 2023-05-24T03:29:54.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.775+0000 7f6e0dffb700 1 -- 172.21.15.146:0/2141218585 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e180038c0 con 0x7f6e1c06a460 2023-05-24T03:29:54.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.776+0000 7f6e23588700 1 -- 172.21.15.146:0/2141218585 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e1c0cfa20 con 0x7f6e1c06a460 2023-05-24T03:29:54.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.776+0000 7f6e23588700 1 -- 172.21.15.146:0/2141218585 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e1c0af620 con 0x7f6e1c06a460 2023-05-24T03:29:54.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.777+0000 7f6e0dffb700 1 -- 172.21.15.146:0/2141218585 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6e18003a20 con 0x7f6e1c06a460 2023-05-24T03:29:54.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.777+0000 7f6e0dffb700 1 --2- 172.21.15.146:0/2141218585 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f6e0006ace0 0x7f6e0006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:54.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.777+0000 7f6e0dffb700 1 -- 172.21.15.146:0/2141218585 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6e18088880 con 0x7f6e1c06a460 2023-05-24T03:29:54.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.777+0000 7f6e20b23700 1 --2- 172.21.15.146:0/2141218585 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f6e0006ace0 0x7f6e0006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:54.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.778+0000 7f6e20b23700 1 --2- 172.21.15.146:0/2141218585 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f6e0006ace0 0x7f6e0006d190 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c0667c0 tx=0x7f6e10008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:54.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.782+0000 7f6e0dffb700 1 -- 172.21.15.146:0/2141218585 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f6e180536d0 con 0x7f6e1c06a460 2023-05-24T03:29:54.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.971+0000 7f6e23588700 1 -- 172.21.15.146:0/2141218585 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6e1c0cfcd0 con 0x7f6e1c06a460 2023-05-24T03:29:54.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.971+0000 7f6e0dffb700 1 -- 172.21.15.146:0/2141218585 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6e18056cf0 con 0x7f6e1c06a460 2023-05-24T03:29:54.977 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2023-05-24T03:29:54.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.974+0000 7f6e23588700 1 -- 172.21.15.146:0/2141218585 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f6e0006ace0 msgr2=0x7f6e0006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:54.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.974+0000 7f6e23588700 1 --2- 172.21.15.146:0/2141218585 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f6e0006ace0 0x7f6e0006d190 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c0667c0 tx=0x7f6e10008040 comp rx=0 tx=0).stop 2023-05-24T03:29:54.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.974+0000 7f6e23588700 1 -- 172.21.15.146:0/2141218585 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e1c06a460 msgr2=0x7f6e1c151450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:54.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.974+0000 7f6e23588700 1 --2- 172.21.15.146:0/2141218585 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e1c06a460 0x7f6e1c151450 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6e1800c450 tx=0x7f6e1800c810 comp rx=0 tx=0).stop 2023-05-24T03:29:54.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.974+0000 7f6e23588700 1 -- 172.21.15.146:0/2141218585 shutdown_connections 2023-05-24T03:29:54.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.974+0000 7f6e23588700 1 --2- 172.21.15.146:0/2141218585 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f6e0006ace0 0x7f6e0006d190 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:54.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.974+0000 7f6e23588700 1 --2- 172.21.15.146:0/2141218585 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e1c15cd90 0x7f6e1c0ada00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:54.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.974+0000 7f6e23588700 1 --2- 172.21.15.146:0/2141218585 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e1c06a460 0x7f6e1c151450 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:54.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.974+0000 7f6e23588700 1 --2- 172.21.15.146:0/2141218585 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e1c0aefd0 0x7f6e1c0b11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:54.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.974+0000 7f6e23588700 1 -- 172.21.15.146:0/2141218585 >> 172.21.15.146:0/2141218585 conn(0x7f6e1c0cfea0 msgr2=0x7f6e1c0b2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:54.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.974+0000 7f6e23588700 1 -- 172.21.15.146:0/2141218585 shutdown_connections 2023-05-24T03:29:54.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:54.974+0000 7f6e23588700 1 -- 172.21.15.146:0/2141218585 wait complete. 2023-05-24T03:29:54.990 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-24T03:29:55.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.111+0000 7f4760b08700 1 Processor -- start 2023-05-24T03:29:55.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.111+0000 7f4760b08700 1 -- start start 2023-05-24T03:29:55.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.112+0000 7f4760b08700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f475c0cb9b0 0x7f475c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:55.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.112+0000 7f4760b08700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f475c159f60 con 0x7f475c159b90 2023-05-24T03:29:55.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.112+0000 7f4760b08700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f475c0b19d0 con 0x7f475c06b710 2023-05-24T03:29:55.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.112+0000 7f4760b08700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f475c071e00 con 0x7f475c0cb9b0 2023-05-24T03:29:55.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.112+0000 7f4759d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f475c0cb9b0 0x7f475c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:55.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.112+0000 7f475a59c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f475c159b90 0x7f475c0cb2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45396/0 (socket says 172.21.15.146:45396) 2023-05-24T03:29:55.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.112+0000 7f4759d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f475c0cb9b0 0x7f475c0718c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38946/0 (socket says 172.21.15.146:38946) 2023-05-24T03:29:55.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.112+0000 7f475a59c700 1 -- 172.21.15.146:0/1287388797 learned_addr learned my addr 172.21.15.146:0/1287388797 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:29:55.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.112+0000 7f4759d9b700 1 -- 172.21.15.146:0/1287388797 >> v1:172.21.15.151:6789/0 conn(0x7f475c06b710 legacy=0x7f475c0c9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:55.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.112+0000 7f4759d9b700 1 -- 172.21.15.146:0/1287388797 >> v1:172.21.15.146:6789/0 conn(0x7f475c159b90 legacy=0x7f475c0cb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:55.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.112+0000 7f4759d9b700 1 -- 172.21.15.146:0/1287388797 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f475c072010 con 0x7f475c0cb9b0 2023-05-24T03:29:55.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.112+0000 7f475959a700 1 -- 172.21.15.146:0/1287388797 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3271479656 0 0) 0x7f475c159f60 con 0x7f475c159b90 2023-05-24T03:29:55.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.112+0000 7f4759d9b700 1 --2- 172.21.15.146:0/1287388797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f475c0cb9b0 0x7f475c0718c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f474c009840 tx=0x7f474c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7000ea32d8552ca server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:55.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.113+0000 7f475959a700 1 -- 172.21.15.146:0/1287388797 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c011830 con 0x7f475c0cb9b0 2023-05-24T03:29:55.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.113+0000 7f475959a700 1 -- 172.21.15.146:0/1287388797 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f474c011990 con 0x7f475c0cb9b0 2023-05-24T03:29:55.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.113+0000 7f475959a700 1 -- 172.21.15.146:0/1287388797 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c011d20 con 0x7f475c0cb9b0 2023-05-24T03:29:55.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.113+0000 7f4760b08700 1 -- 172.21.15.146:0/1287388797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f475c0cb9b0 msgr2=0x7f475c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:55.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.113+0000 7f4760b08700 1 --2- 172.21.15.146:0/1287388797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f475c0cb9b0 0x7f475c0718c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f474c009840 tx=0x7f474c009b50 comp rx=0 tx=0).stop 2023-05-24T03:29:55.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.113+0000 7f4760b08700 1 -- 172.21.15.146:0/1287388797 shutdown_connections 2023-05-24T03:29:55.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.113+0000 7f4760b08700 1 --2- 172.21.15.146:0/1287388797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f475c0cb9b0 0x7f475c0718c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:55.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.113+0000 7f4760b08700 1 -- 172.21.15.146:0/1287388797 >> 172.21.15.146:0/1287388797 conn(0x7f475c0cf6c0 msgr2=0x7f475c0cfa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:55.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.113+0000 7f4760b08700 1 -- 172.21.15.146:0/1287388797 shutdown_connections 2023-05-24T03:29:55.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.113+0000 7f4760b08700 1 -- 172.21.15.146:0/1287388797 wait complete. 2023-05-24T03:29:55.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.115+0000 7f4760b08700 1 Processor -- start 2023-05-24T03:29:55.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.115+0000 7f4760b08700 1 -- start start 2023-05-24T03:29:55.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.116+0000 7f4760b08700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f475c06b710 0x7f475c158d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:55.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.116+0000 7f4760b08700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f475c0cb9b0 0x7f475c0a8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:55.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.116+0000 7f4760b08700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f475c159b90 0x7f475c1f3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:55.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.116+0000 7f4760b08700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475c1592c0 con 0x7f475c06b710 2023-05-24T03:29:55.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.116+0000 7f4760b08700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475c1e36d0 con 0x7f475c159b90 2023-05-24T03:29:55.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.116+0000 7f4760b08700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f475c1e39b0 con 0x7f475c0cb9b0 2023-05-24T03:29:55.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.116+0000 7f475a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f475c06b710 0x7f475c158d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:55.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.116+0000 7f475a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f475c06b710 0x7f475c158d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38950/0 (socket says 172.21.15.146:38950) 2023-05-24T03:29:55.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.116+0000 7f475a59c700 1 -- 172.21.15.146:0/3922699660 learned_addr learned my addr 172.21.15.146:0/3922699660 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:55.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.116+0000 7f4759d9b700 1 --2- 172.21.15.146:0/3922699660 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f475c0cb9b0 0x7f475c0a8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:55.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.116+0000 7f475ad9d700 1 --2- 172.21.15.146:0/3922699660 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f475c159b90 0x7f475c1f3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:55.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.116+0000 7f475a59c700 1 -- 172.21.15.146:0/3922699660 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f475c0cb9b0 msgr2=0x7f475c0a8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:55.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.116+0000 7f475a59c700 1 --2- 172.21.15.146:0/3922699660 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f475c0cb9b0 0x7f475c0a8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:55.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.116+0000 7f475a59c700 1 -- 172.21.15.146:0/3922699660 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f475c159b90 msgr2=0x7f475c1f3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:55.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.116+0000 7f475a59c700 1 --2- 172.21.15.146:0/3922699660 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f475c159b90 0x7f475c1f3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:55.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.116+0000 7f475a59c700 1 -- 172.21.15.146:0/3922699660 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f474c0094a0 con 0x7f475c06b710 2023-05-24T03:29:55.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.116+0000 7f4759d9b700 1 --2- 172.21.15.146:0/3922699660 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f475c0cb9b0 0x7f475c0a8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:29:55.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.116+0000 7f475a59c700 1 --2- 172.21.15.146:0/3922699660 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f475c06b710 0x7f475c158d80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f475000c520 tx=0x7f475000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:55.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.116+0000 7f474affd700 1 -- 172.21.15.146:0/3922699660 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4750004c80 con 0x7f475c06b710 2023-05-24T03:29:55.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.116+0000 7f474affd700 1 -- 172.21.15.146:0/3922699660 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4750004e20 con 0x7f475c06b710 2023-05-24T03:29:55.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.116+0000 7f4760b08700 1 -- 172.21.15.146:0/3922699660 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f475c0b1380 con 0x7f475c06b710 2023-05-24T03:29:55.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.116+0000 7f474affd700 1 -- 172.21.15.146:0/3922699660 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4750007310 con 0x7f475c06b710 2023-05-24T03:29:55.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.116+0000 7f4760b08700 1 -- 172.21.15.146:0/3922699660 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f475c0b10a0 con 0x7f475c06b710 2023-05-24T03:29:55.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.117+0000 7f4760b08700 1 -- 172.21.15.146:0/3922699660 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f475c0b1660 con 0x7f475c06b710 2023-05-24T03:29:55.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.118+0000 7f474affd700 1 -- 172.21.15.146:0/3922699660 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4750007470 con 0x7f475c06b710 2023-05-24T03:29:55.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.118+0000 7f474affd700 1 --2- 172.21.15.146:0/3922699660 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f473c06ace0 0x7f473c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:55.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.118+0000 7f474affd700 1 -- 172.21.15.146:0/3922699660 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4750089430 con 0x7f475c06b710 2023-05-24T03:29:55.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.118+0000 7f4759d9b700 1 --2- 172.21.15.146:0/3922699660 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f473c06ace0 0x7f473c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:55.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.119+0000 7f4759d9b700 1 --2- 172.21.15.146:0/3922699660 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f473c06ace0 0x7f473c06d190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f475c0cbda0 tx=0x7f474c01c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:55.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.122+0000 7f474affd700 1 -- 172.21.15.146:0/3922699660 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f4750054280 con 0x7f475c06b710 2023-05-24T03:29:55.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.311+0000 7f4760b08700 1 -- 172.21.15.146:0/3922699660 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f475c068d00 con 0x7f475c06b710 2023-05-24T03:29:55.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.312+0000 7f474affd700 1 -- 172.21.15.146:0/3922699660 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f47500578a0 con 0x7f475c06b710 2023-05-24T03:29:55.317 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2023-05-24T03:29:55.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.314+0000 7f4760b08700 1 -- 172.21.15.146:0/3922699660 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f473c06ace0 msgr2=0x7f473c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:55.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.314+0000 7f4760b08700 1 --2- 172.21.15.146:0/3922699660 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f473c06ace0 0x7f473c06d190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f475c0cbda0 tx=0x7f474c01c040 comp rx=0 tx=0).stop 2023-05-24T03:29:55.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.314+0000 7f4760b08700 1 -- 172.21.15.146:0/3922699660 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f475c06b710 msgr2=0x7f475c158d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:55.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.314+0000 7f4760b08700 1 --2- 172.21.15.146:0/3922699660 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f475c06b710 0x7f475c158d80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f475000c520 tx=0x7f475000c8e0 comp rx=0 tx=0).stop 2023-05-24T03:29:55.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.314+0000 7f4760b08700 1 -- 172.21.15.146:0/3922699660 shutdown_connections 2023-05-24T03:29:55.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.314+0000 7f4760b08700 1 --2- 172.21.15.146:0/3922699660 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f473c06ace0 0x7f473c06d190 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:55.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.314+0000 7f4760b08700 1 --2- 172.21.15.146:0/3922699660 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f475c159b90 0x7f475c1f3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:55.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.314+0000 7f4760b08700 1 --2- 172.21.15.146:0/3922699660 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f475c06b710 0x7f475c158d80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:55.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.314+0000 7f4760b08700 1 --2- 172.21.15.146:0/3922699660 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f475c0cb9b0 0x7f475c0a8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:55.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.314+0000 7f4760b08700 1 -- 172.21.15.146:0/3922699660 >> 172.21.15.146:0/3922699660 conn(0x7f475c0cf6c0 msgr2=0x7f475c0ae8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:55.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.314+0000 7f4760b08700 1 -- 172.21.15.146:0/3922699660 shutdown_connections 2023-05-24T03:29:55.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.314+0000 7f4760b08700 1 -- 172.21.15.146:0/3922699660 wait complete. 2023-05-24T03:29:55.330 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-24T03:29:55.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.448+0000 7ffbd0d81700 1 Processor -- start 2023-05-24T03:29:55.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.449+0000 7ffbd0d81700 1 -- start start 2023-05-24T03:29:55.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.450+0000 7ffbd0d81700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ffbcc06a460 0x7ffbcc0cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:55.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.450+0000 7ffbd0d81700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ffbcc15cd90 0x7ffbcc06a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:55.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.450+0000 7ffbd0d81700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffbcc0aefd0 0x7ffbcc160d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:55.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.450+0000 7ffbd0d81700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbcc0cfd00 con 0x7ffbcc06a460 2023-05-24T03:29:55.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.450+0000 7ffbd0d81700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbcc072350 con 0x7ffbcc15cd90 2023-05-24T03:29:55.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.450+0000 7ffbd0d81700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbcc06ad70 con 0x7ffbcc0aefd0 2023-05-24T03:29:55.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.450+0000 7ffbca59c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ffbcc06a460 0x7ffbcc0cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:55.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.450+0000 7ffbca59c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ffbcc06a460 0x7ffbcc0cede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38958/0 (socket says 172.21.15.146:38958) 2023-05-24T03:29:55.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.450+0000 7ffbca59c700 1 -- 172.21.15.146:0/3615146844 learned_addr learned my addr 172.21.15.146:0/3615146844 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:55.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.450+0000 7ffbcad9d700 1 --2- 172.21.15.146:0/3615146844 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffbcc0aefd0 0x7ffbcc160d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:55.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.450+0000 7ffbc9d9b700 1 --2- 172.21.15.146:0/3615146844 >> v2:172.21.15.151:3300/0 conn(0x7ffbcc15cd90 0x7ffbcc06a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:55.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.450+0000 7ffbca59c700 1 -- 172.21.15.146:0/3615146844 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffbcc0aefd0 msgr2=0x7ffbcc160d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:55.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.450+0000 7ffbca59c700 1 --2- 172.21.15.146:0/3615146844 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffbcc0aefd0 0x7ffbcc160d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:55.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.450+0000 7ffbca59c700 1 -- 172.21.15.146:0/3615146844 >> v2:172.21.15.151:3300/0 conn(0x7ffbcc15cd90 msgr2=0x7ffbcc06a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:55.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.450+0000 7ffbca59c700 1 --2- 172.21.15.146:0/3615146844 >> v2:172.21.15.151:3300/0 conn(0x7ffbcc15cd90 0x7ffbcc06a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:55.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.450+0000 7ffbca59c700 1 -- 172.21.15.146:0/3615146844 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbcc0cf460 con 0x7ffbcc06a460 2023-05-24T03:29:55.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.450+0000 7ffbca59c700 1 --2- 172.21.15.146:0/3615146844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffbcc06a460 0x7ffbcc0cede0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc074870 tx=0x7ffbbc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e5d50fbe76cba6b server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:55.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.450+0000 7ffbc959a700 1 -- 172.21.15.146:0/3615146844 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc011830 con 0x7ffbcc06a460 2023-05-24T03:29:55.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.451+0000 7ffbc959a700 1 -- 172.21.15.146:0/3615146844 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbbc011990 con 0x7ffbcc06a460 2023-05-24T03:29:55.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.451+0000 7ffbc959a700 1 -- 172.21.15.146:0/3615146844 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc011d20 con 0x7ffbcc06a460 2023-05-24T03:29:55.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.451+0000 7ffbd0d81700 1 -- 172.21.15.146:0/3615146844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffbcc06a460 msgr2=0x7ffbcc0cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:55.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.451+0000 7ffbd0d81700 1 --2- 172.21.15.146:0/3615146844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffbcc06a460 0x7ffbcc0cede0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc074870 tx=0x7ffbbc009bd0 comp rx=0 tx=0).stop 2023-05-24T03:29:55.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.451+0000 7ffbd0d81700 1 -- 172.21.15.146:0/3615146844 shutdown_connections 2023-05-24T03:29:55.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.451+0000 7ffbd0d81700 1 --2- 172.21.15.146:0/3615146844 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffbcc0aefd0 0x7ffbcc160d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:55.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.451+0000 7ffbd0d81700 1 --2- 172.21.15.146:0/3615146844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffbcc06a460 0x7ffbcc0cede0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:55.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.451+0000 7ffbd0d81700 1 --2- 172.21.15.146:0/3615146844 >> v2:172.21.15.151:3300/0 conn(0x7ffbcc15cd90 0x7ffbcc06a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:55.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.451+0000 7ffbd0d81700 1 -- 172.21.15.146:0/3615146844 >> 172.21.15.146:0/3615146844 conn(0x7ffbcc0cfea0 msgr2=0x7ffbcc0d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:55.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.451+0000 7ffbd0d81700 1 -- 172.21.15.146:0/3615146844 shutdown_connections 2023-05-24T03:29:55.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.451+0000 7ffbd0d81700 1 -- 172.21.15.146:0/3615146844 wait complete. 2023-05-24T03:29:55.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.453+0000 7ffbd0d81700 1 Processor -- start 2023-05-24T03:29:55.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.453+0000 7ffbd0d81700 1 -- start start 2023-05-24T03:29:55.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.454+0000 7ffbd0d81700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffbcc06a460 0x7ffbcc1e73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:55.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.454+0000 7ffbd0d81700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffbcc0aefd0 0x7ffbcc0aff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:55.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.454+0000 7ffbd0d81700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffbcc15cd90 0x7ffbcc15bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:55.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.454+0000 7ffbd0d81700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbcc0c5000 con 0x7ffbcc15cd90 2023-05-24T03:29:55.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.454+0000 7ffbd0d81700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbcc0b0830 con 0x7ffbcc0aefd0 2023-05-24T03:29:55.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.454+0000 7ffbd0d81700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbcc0b0b10 con 0x7ffbcc06a460 2023-05-24T03:29:55.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.454+0000 7ffbcad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffbcc15cd90 0x7ffbcc15bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:55.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.454+0000 7ffbcad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffbcc15cd90 0x7ffbcc15bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38966/0 (socket says 172.21.15.146:38966) 2023-05-24T03:29:55.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.454+0000 7ffbcad9d700 1 -- 172.21.15.146:0/1617683053 learned_addr learned my addr 172.21.15.146:0/1617683053 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:55.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.454+0000 7ffbca59c700 1 --2- 172.21.15.146:0/1617683053 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffbcc06a460 0x7ffbcc1e73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:55.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.454+0000 7ffbc9d9b700 1 --2- 172.21.15.146:0/1617683053 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffbcc0aefd0 0x7ffbcc0aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:55.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.454+0000 7ffbcad9d700 1 -- 172.21.15.146:0/1617683053 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffbcc06a460 msgr2=0x7ffbcc1e73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:55.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.454+0000 7ffbcad9d700 1 --2- 172.21.15.146:0/1617683053 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffbcc06a460 0x7ffbcc1e73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:55.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.454+0000 7ffbcad9d700 1 -- 172.21.15.146:0/1617683053 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffbcc0aefd0 msgr2=0x7ffbcc0aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:55.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.454+0000 7ffbcad9d700 1 --2- 172.21.15.146:0/1617683053 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffbcc0aefd0 0x7ffbcc0aff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:55.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.454+0000 7ffbcad9d700 1 -- 172.21.15.146:0/1617683053 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbbc009550 con 0x7ffbcc15cd90 2023-05-24T03:29:55.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.454+0000 7ffbcad9d700 1 --2- 172.21.15.146:0/1617683053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffbcc15cd90 0x7ffbcc15bf00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ffbc400efc0 tx=0x7ffbc400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:55.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.454+0000 7ffbbaffd700 1 -- 172.21.15.146:0/1617683053 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc4009ba0 con 0x7ffbcc15cd90 2023-05-24T03:29:55.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.455+0000 7ffbbaffd700 1 -- 172.21.15.146:0/1617683053 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc400f040 con 0x7ffbcc15cd90 2023-05-24T03:29:55.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.455+0000 7ffbd0d81700 1 -- 172.21.15.146:0/1617683053 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbcc0cfa20 con 0x7ffbcc15cd90 2023-05-24T03:29:55.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.455+0000 7ffbbaffd700 1 -- 172.21.15.146:0/1617683053 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc4014480 con 0x7ffbcc15cd90 2023-05-24T03:29:55.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.455+0000 7ffbd0d81700 1 -- 172.21.15.146:0/1617683053 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbcc0cf740 con 0x7ffbcc15cd90 2023-05-24T03:29:55.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.455+0000 7ffbd0d81700 1 -- 172.21.15.146:0/1617683053 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbcc160800 con 0x7ffbcc15cd90 2023-05-24T03:29:55.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.456+0000 7ffbbaffd700 1 -- 172.21.15.146:0/1617683053 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ffbc40145e0 con 0x7ffbcc15cd90 2023-05-24T03:29:55.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.456+0000 7ffbbaffd700 1 --2- 172.21.15.146:0/1617683053 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7ffbac06ace0 0x7ffbac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:55.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.456+0000 7ffbbaffd700 1 -- 172.21.15.146:0/1617683053 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ffbc408a030 con 0x7ffbcc15cd90 2023-05-24T03:29:55.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.456+0000 7ffbca59c700 1 --2- 172.21.15.146:0/1617683053 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7ffbac06ace0 0x7ffbac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:55.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.457+0000 7ffbca59c700 1 --2- 172.21.15.146:0/1617683053 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7ffbac06ace0 0x7ffbac06d190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc014040 tx=0x7ffbbc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:55.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.461+0000 7ffbbaffd700 1 -- 172.21.15.146:0/1617683053 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ffbc4054e80 con 0x7ffbcc15cd90 2023-05-24T03:29:55.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.647+0000 7ffbd0d81700 1 -- 172.21.15.146:0/1617683053 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ffbcc0c4d60 con 0x7ffbcc15cd90 2023-05-24T03:29:55.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.648+0000 7ffbbaffd700 1 -- 172.21.15.146:0/1617683053 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7ffbcc0c4d60 con 0x7ffbcc15cd90 2023-05-24T03:29:55.653 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2023-05-24T03:29:55.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.650+0000 7ffbd0d81700 1 -- 172.21.15.146:0/1617683053 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7ffbac06ace0 msgr2=0x7ffbac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:55.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.650+0000 7ffbd0d81700 1 --2- 172.21.15.146:0/1617683053 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7ffbac06ace0 0x7ffbac06d190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc014040 tx=0x7ffbbc008030 comp rx=0 tx=0).stop 2023-05-24T03:29:55.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.650+0000 7ffbd0d81700 1 -- 172.21.15.146:0/1617683053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffbcc15cd90 msgr2=0x7ffbcc15bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:55.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.650+0000 7ffbd0d81700 1 --2- 172.21.15.146:0/1617683053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffbcc15cd90 0x7ffbcc15bf00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ffbc400efc0 tx=0x7ffbc400c3a0 comp rx=0 tx=0).stop 2023-05-24T03:29:55.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.650+0000 7ffbd0d81700 1 -- 172.21.15.146:0/1617683053 shutdown_connections 2023-05-24T03:29:55.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.650+0000 7ffbd0d81700 1 --2- 172.21.15.146:0/1617683053 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7ffbac06ace0 0x7ffbac06d190 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:55.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.650+0000 7ffbd0d81700 1 --2- 172.21.15.146:0/1617683053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffbcc15cd90 0x7ffbcc15bf00 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:55.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.650+0000 7ffbd0d81700 1 --2- 172.21.15.146:0/1617683053 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffbcc06a460 0x7ffbcc1e73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:55.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.650+0000 7ffbd0d81700 1 --2- 172.21.15.146:0/1617683053 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffbcc0aefd0 0x7ffbcc0aff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:55.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.650+0000 7ffbd0d81700 1 -- 172.21.15.146:0/1617683053 >> 172.21.15.146:0/1617683053 conn(0x7ffbcc0cfea0 msgr2=0x7ffbcc06d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:55.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.650+0000 7ffbd0d81700 1 -- 172.21.15.146:0/1617683053 shutdown_connections 2023-05-24T03:29:55.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.650+0000 7ffbd0d81700 1 -- 172.21.15.146:0/1617683053 wait complete. 2023-05-24T03:29:55.666 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-24T03:29:55.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.784+0000 7f3d2b472700 1 Processor -- start 2023-05-24T03:29:55.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.784+0000 7f3d2b472700 1 -- start start 2023-05-24T03:29:55.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.785+0000 7f3d2b472700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3d240cb8c0 0x7f3d24161030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:55.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.785+0000 7f3d2b472700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3d240cc1d0 0x7f3d240b1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:55.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.785+0000 7f3d2b472700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d240b27e0 con 0x7f3d240cbc90 2023-05-24T03:29:55.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.785+0000 7f3d2b472700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d240b2220 con 0x7f3d240cc1d0 2023-05-24T03:29:55.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.785+0000 7f3d2b472700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d240b2500 con 0x7f3d240cb8c0 2023-05-24T03:29:55.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.785+0000 7f3d28a0d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3d240cc1d0 0x7f3d240b1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:55.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.785+0000 7f3d29a0f700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3d240cbc90 0x7f3d2406a460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45426/0 (socket says 172.21.15.146:45426) 2023-05-24T03:29:55.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.785+0000 7f3d28a0d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3d240cc1d0 0x7f3d240b1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38970/0 (socket says 172.21.15.146:38970) 2023-05-24T03:29:55.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.785+0000 7f3d29a0f700 1 -- 172.21.15.146:0/2592173766 learned_addr learned my addr 172.21.15.146:0/2592173766 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:29:55.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.785+0000 7f3d2920e700 1 --2- 172.21.15.146:0/2592173766 >> v2:172.21.15.151:3300/0 conn(0x7f3d240cb8c0 0x7f3d24161030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:55.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.785+0000 7f3d28a0d700 1 -- 172.21.15.146:0/2592173766 >> v2:172.21.15.151:3300/0 conn(0x7f3d240cb8c0 msgr2=0x7f3d24161030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:55.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.785+0000 7f3d28a0d700 1 --2- 172.21.15.146:0/2592173766 >> v2:172.21.15.151:3300/0 conn(0x7f3d240cb8c0 0x7f3d24161030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:55.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.785+0000 7f3d28a0d700 1 -- 172.21.15.146:0/2592173766 >> v1:172.21.15.146:6789/0 conn(0x7f3d240cbc90 legacy=0x7f3d2406a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:55.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.785+0000 7f3d28a0d700 1 -- 172.21.15.146:0/2592173766 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d24160830 con 0x7f3d240cc1d0 2023-05-24T03:29:55.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.785+0000 7f3d1bfff700 1 -- 172.21.15.146:0/2592173766 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1129138965 0 0) 0x7f3d240b27e0 con 0x7f3d240cbc90 2023-05-24T03:29:55.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.785+0000 7f3d28a0d700 1 --2- 172.21.15.146:0/2592173766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d240cc1d0 0x7f3d240b1920 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3d240d0b40 tx=0x7f3d14009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98be201df1670ae4 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:55.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.786+0000 7f3d1bfff700 1 -- 172.21.15.146:0/2592173766 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d14011830 con 0x7f3d240cc1d0 2023-05-24T03:29:55.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.786+0000 7f3d1bfff700 1 -- 172.21.15.146:0/2592173766 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d14011990 con 0x7f3d240cc1d0 2023-05-24T03:29:55.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.786+0000 7f3d1bfff700 1 -- 172.21.15.146:0/2592173766 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d14011d20 con 0x7f3d240cc1d0 2023-05-24T03:29:55.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.786+0000 7f3d2b472700 1 -- 172.21.15.146:0/2592173766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d240cc1d0 msgr2=0x7f3d240b1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:55.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.786+0000 7f3d2b472700 1 --2- 172.21.15.146:0/2592173766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d240cc1d0 0x7f3d240b1920 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3d240d0b40 tx=0x7f3d14009b20 comp rx=0 tx=0).stop 2023-05-24T03:29:55.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.786+0000 7f3d2b472700 1 -- 172.21.15.146:0/2592173766 shutdown_connections 2023-05-24T03:29:55.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.786+0000 7f3d2b472700 1 --2- 172.21.15.146:0/2592173766 >> v2:172.21.15.151:3300/0 conn(0x7f3d240cb8c0 0x7f3d24161030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:55.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.786+0000 7f3d2b472700 1 --2- 172.21.15.146:0/2592173766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d240cc1d0 0x7f3d240b1920 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:55.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.786+0000 7f3d2b472700 1 -- 172.21.15.146:0/2592173766 >> 172.21.15.146:0/2592173766 conn(0x7f3d240cfea0 msgr2=0x7f3d240d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:55.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.786+0000 7f3d2b472700 1 -- 172.21.15.146:0/2592173766 shutdown_connections 2023-05-24T03:29:55.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.786+0000 7f3d2b472700 1 -- 172.21.15.146:0/2592173766 wait complete. 2023-05-24T03:29:55.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.788+0000 7f3d2b472700 1 Processor -- start 2023-05-24T03:29:55.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.788+0000 7f3d2b472700 1 -- start start 2023-05-24T03:29:55.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.789+0000 7f3d2b472700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3d240cb8c0 0x7f3d24151f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:55.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.789+0000 7f3d2b472700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d240cbc90 0x7f3d240b52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:55.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.789+0000 7f3d2b472700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d240cc1d0 0x7f3d2415d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:55.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.789+0000 7f3d2b472700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d241562f0 con 0x7f3d240cc1d0 2023-05-24T03:29:55.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.789+0000 7f3d2b472700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d24155260 con 0x7f3d240cbc90 2023-05-24T03:29:55.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.789+0000 7f3d2b472700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d24154ca0 con 0x7f3d240cb8c0 2023-05-24T03:29:55.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.789+0000 7f3d29a0f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d240cc1d0 0x7f3d2415d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:55.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.789+0000 7f3d29a0f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d240cc1d0 0x7f3d2415d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38978/0 (socket says 172.21.15.146:38978) 2023-05-24T03:29:55.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.789+0000 7f3d29a0f700 1 -- 172.21.15.146:0/2909207730 learned_addr learned my addr 172.21.15.146:0/2909207730 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:55.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.789+0000 7f3d2920e700 1 --2- 172.21.15.146:0/2909207730 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3d240cb8c0 0x7f3d24151f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:55.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.789+0000 7f3d28a0d700 1 --2- 172.21.15.146:0/2909207730 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d240cbc90 0x7f3d240b52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:55.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.789+0000 7f3d29a0f700 1 -- 172.21.15.146:0/2909207730 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3d240cb8c0 msgr2=0x7f3d24151f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:55.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.789+0000 7f3d29a0f700 1 --2- 172.21.15.146:0/2909207730 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3d240cb8c0 0x7f3d24151f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:55.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.789+0000 7f3d29a0f700 1 -- 172.21.15.146:0/2909207730 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d240cbc90 msgr2=0x7f3d240b52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:55.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.789+0000 7f3d29a0f700 1 --2- 172.21.15.146:0/2909207730 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d240cbc90 0x7f3d240b52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:55.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.789+0000 7f3d29a0f700 1 -- 172.21.15.146:0/2909207730 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d140094a0 con 0x7f3d240cc1d0 2023-05-24T03:29:55.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.789+0000 7f3d28a0d700 1 --2- 172.21.15.146:0/2909207730 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d240cbc90 0x7f3d240b52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:29:55.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.789+0000 7f3d29a0f700 1 --2- 172.21.15.146:0/2909207730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d240cc1d0 0x7f3d2415d810 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c002230 tx=0x7f3d1c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:55.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.789+0000 7f3d19ffb700 1 -- 172.21.15.146:0/2909207730 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1c00ac20 con 0x7f3d240cc1d0 2023-05-24T03:29:55.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.789+0000 7f3d19ffb700 1 -- 172.21.15.146:0/2909207730 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d1c00ada0 con 0x7f3d240cc1d0 2023-05-24T03:29:55.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.790+0000 7f3d2b472700 1 -- 172.21.15.146:0/2909207730 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d24161570 con 0x7f3d240cc1d0 2023-05-24T03:29:55.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.790+0000 7f3d19ffb700 1 -- 172.21.15.146:0/2909207730 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1c007310 con 0x7f3d240cc1d0 2023-05-24T03:29:55.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.790+0000 7f3d2b472700 1 -- 172.21.15.146:0/2909207730 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d24160b10 con 0x7f3d240cc1d0 2023-05-24T03:29:55.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.791+0000 7f3d2b472700 1 -- 172.21.15.146:0/2909207730 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d240b1e60 con 0x7f3d240cc1d0 2023-05-24T03:29:55.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.791+0000 7f3d19ffb700 1 -- 172.21.15.146:0/2909207730 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3d1c007470 con 0x7f3d240cc1d0 2023-05-24T03:29:55.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.791+0000 7f3d19ffb700 1 --2- 172.21.15.146:0/2909207730 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f3d0806ad10 0x7f3d0806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:55.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.792+0000 7f3d19ffb700 1 -- 172.21.15.146:0/2909207730 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3d1c089620 con 0x7f3d240cc1d0 2023-05-24T03:29:55.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.792+0000 7f3d2920e700 1 --2- 172.21.15.146:0/2909207730 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f3d0806ad10 0x7f3d0806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:55.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.792+0000 7f3d2920e700 1 --2- 172.21.15.146:0/2909207730 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f3d0806ad10 0x7f3d0806d1c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3d20009930 tx=0x7f3d20008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:55.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.796+0000 7f3d19ffb700 1 -- 172.21.15.146:0/2909207730 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3d1c054470 con 0x7f3d240cc1d0 2023-05-24T03:29:56.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.999+0000 7f3d2b472700 1 -- 172.21.15.146:0/2909207730 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3d2404e810 con 0x7f3d240cc1d0 2023-05-24T03:29:56.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:55.999+0000 7f3d19ffb700 1 -- 172.21.15.146:0/2909207730 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3d1c057a90 con 0x7f3d240cc1d0 2023-05-24T03:29:56.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.001+0000 7f3d2b472700 1 -- 172.21.15.146:0/2909207730 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f3d0806ad10 msgr2=0x7f3d0806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:56.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.001+0000 7f3d2b472700 1 --2- 172.21.15.146:0/2909207730 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f3d0806ad10 0x7f3d0806d1c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3d20009930 tx=0x7f3d20008040 comp rx=0 tx=0).stop 2023-05-24T03:29:56.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.001+0000 7f3d2b472700 1 -- 172.21.15.146:0/2909207730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d240cc1d0 msgr2=0x7f3d2415d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:56.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.001+0000 7f3d2b472700 1 --2- 172.21.15.146:0/2909207730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d240cc1d0 0x7f3d2415d810 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c002230 tx=0x7f3d1c00a060 comp rx=0 tx=0).stop 2023-05-24T03:29:56.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.001+0000 7f3d2b472700 1 -- 172.21.15.146:0/2909207730 shutdown_connections 2023-05-24T03:29:56.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.001+0000 7f3d2b472700 1 --2- 172.21.15.146:0/2909207730 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f3d0806ad10 0x7f3d0806d1c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:56.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.001+0000 7f3d2b472700 1 --2- 172.21.15.146:0/2909207730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d240cc1d0 0x7f3d2415d810 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:56.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.001+0000 7f3d2b472700 1 --2- 172.21.15.146:0/2909207730 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3d240cb8c0 0x7f3d24151f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:56.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.001+0000 7f3d2b472700 1 --2- 172.21.15.146:0/2909207730 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d240cbc90 0x7f3d240b52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:56.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.001+0000 7f3d2b472700 1 -- 172.21.15.146:0/2909207730 >> 172.21.15.146:0/2909207730 conn(0x7f3d240cfea0 msgr2=0x7f3d2415c180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:56.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.001+0000 7f3d2b472700 1 -- 172.21.15.146:0/2909207730 shutdown_connections 2023-05-24T03:29:56.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.001+0000 7f3d2b472700 1 -- 172.21.15.146:0/2909207730 wait complete. 2023-05-24T03:29:56.009 INFO:teuthology.orchestra.run.smithi146.stderr:listed 0 entries 2023-05-24T03:29:56.019 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-05-24T03:29:56.019 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-24T03:29:56.036 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-24T03:29:56.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.192+0000 7f162ceb9700 1 Processor -- start 2023-05-24T03:29:56.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.192+0000 7f162ceb9700 1 -- start start 2023-05-24T03:29:56.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.193+0000 7f162ceb9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f162815acd0 0x7f16280ce100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:56.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.193+0000 7f162ceb9700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f16280d06d0 0x7f16280d0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:56.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.193+0000 7f162ceb9700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16280cd940 con 0x7f16280d1090 2023-05-24T03:29:56.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.193+0000 7f162ceb9700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16280d14f0 con 0x7f162815acd0 2023-05-24T03:29:56.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.193+0000 7f162ceb9700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16280b33d0 con 0x7f16280d06d0 2023-05-24T03:29:56.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.193+0000 7f162659c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f162815acd0 0x7f16280ce100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:56.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.193+0000 7f162659c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f162815acd0 0x7f16280ce100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38984/0 (socket says 172.21.15.146:38984) 2023-05-24T03:29:56.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.193+0000 7f162659c700 1 -- 172.21.15.146:0/208257629 learned_addr learned my addr 172.21.15.146:0/208257629 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:56.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.194+0000 7f1625d9b700 1 --2- 172.21.15.146:0/208257629 >> v2:172.21.15.151:3300/0 conn(0x7f16280d06d0 0x7f16280d0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:56.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.194+0000 7f162659c700 1 -- 172.21.15.146:0/208257629 >> v2:172.21.15.151:3300/0 conn(0x7f16280d06d0 msgr2=0x7f16280d0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:56.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.194+0000 7f162659c700 1 --2- 172.21.15.146:0/208257629 >> v2:172.21.15.151:3300/0 conn(0x7f16280d06d0 0x7f16280d0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:56.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.194+0000 7f162659c700 1 -- 172.21.15.146:0/208257629 >> v1:172.21.15.151:6789/0 conn(0x7f16280d1090 legacy=0x7f162815e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:56.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.194+0000 7f162659c700 1 -- 172.21.15.146:0/208257629 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16280b3690 con 0x7f162815acd0 2023-05-24T03:29:56.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.194+0000 7f162659c700 1 --2- 172.21.15.146:0/208257629 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f162815acd0 0x7f16280ce100 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f16280d2120 tx=0x7f161c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fbaea41d1e8e5df server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:56.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.194+0000 7f162559a700 1 -- 172.21.15.146:0/208257629 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161c004230 con 0x7f162815acd0 2023-05-24T03:29:56.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.194+0000 7f162559a700 1 -- 172.21.15.146:0/208257629 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161c004390 con 0x7f162815acd0 2023-05-24T03:29:56.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.194+0000 7f162559a700 1 -- 172.21.15.146:0/208257629 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161c0036a0 con 0x7f162815acd0 2023-05-24T03:29:56.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.195+0000 7f162ceb9700 1 -- 172.21.15.146:0/208257629 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f162815acd0 msgr2=0x7f16280ce100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:56.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.195+0000 7f162ceb9700 1 --2- 172.21.15.146:0/208257629 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f162815acd0 0x7f16280ce100 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f16280d2120 tx=0x7f161c009bd0 comp rx=0 tx=0).stop 2023-05-24T03:29:56.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.195+0000 7f162ceb9700 1 -- 172.21.15.146:0/208257629 shutdown_connections 2023-05-24T03:29:56.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.195+0000 7f162ceb9700 1 --2- 172.21.15.146:0/208257629 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f162815acd0 0x7f16280ce100 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:56.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.195+0000 7f162ceb9700 1 --2- 172.21.15.146:0/208257629 >> v2:172.21.15.151:3300/0 conn(0x7f16280d06d0 0x7f16280d0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:56.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.195+0000 7f162ceb9700 1 -- 172.21.15.146:0/208257629 >> 172.21.15.146:0/208257629 conn(0x7f162806e2a0 msgr2=0x7f162806e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:56.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.195+0000 7f162ceb9700 1 -- 172.21.15.146:0/208257629 shutdown_connections 2023-05-24T03:29:56.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.195+0000 7f162ceb9700 1 -- 172.21.15.146:0/208257629 wait complete. 2023-05-24T03:29:56.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.196+0000 7f162ceb9700 1 Processor -- start 2023-05-24T03:29:56.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.196+0000 7f162ceb9700 1 -- start start 2023-05-24T03:29:56.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.197+0000 7f162ceb9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16280d06d0 0x7f162814f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:56.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.197+0000 7f162ceb9700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16280d1090 0x7f162806e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:56.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.197+0000 7f162ceb9700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f162815acd0 0x7f162806ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:56.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.197+0000 7f162ceb9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16280c8480 con 0x7f16280d06d0 2023-05-24T03:29:56.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.197+0000 7f162ceb9700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16280c5740 con 0x7f16280d1090 2023-05-24T03:29:56.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.197+0000 7f162ceb9700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16280c5a20 con 0x7f162815acd0 2023-05-24T03:29:56.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.197+0000 7f162659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16280d06d0 0x7f162814f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:56.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.197+0000 7f162659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16280d06d0 0x7f162814f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38990/0 (socket says 172.21.15.146:38990) 2023-05-24T03:29:56.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.197+0000 7f162659c700 1 -- 172.21.15.146:0/79992713 learned_addr learned my addr 172.21.15.146:0/79992713 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:56.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.197+0000 7f1625d9b700 1 --2- 172.21.15.146:0/79992713 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16280d1090 0x7f162806e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:56.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.197+0000 7f1626d9d700 1 --2- 172.21.15.146:0/79992713 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f162815acd0 0x7f162806ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:56.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.197+0000 7f162659c700 1 -- 172.21.15.146:0/79992713 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f162815acd0 msgr2=0x7f162806ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:56.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.197+0000 7f162659c700 1 --2- 172.21.15.146:0/79992713 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f162815acd0 0x7f162806ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:56.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.197+0000 7f162659c700 1 -- 172.21.15.146:0/79992713 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16280d1090 msgr2=0x7f162806e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:56.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.197+0000 7f162659c700 1 --2- 172.21.15.146:0/79992713 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16280d1090 0x7f162806e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:56.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.197+0000 7f162659c700 1 -- 172.21.15.146:0/79992713 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f161c009550 con 0x7f16280d06d0 2023-05-24T03:29:56.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.197+0000 7f1625d9b700 1 --2- 172.21.15.146:0/79992713 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16280d1090 0x7f162806e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:29:56.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.197+0000 7f162659c700 1 --2- 172.21.15.146:0/79992713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16280d06d0 0x7f162814f570 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f16280d2180 tx=0x7f161c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:56.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.197+0000 7f1616ffd700 1 -- 172.21.15.146:0/79992713 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161c003d80 con 0x7f16280d06d0 2023-05-24T03:29:56.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.197+0000 7f1616ffd700 1 -- 172.21.15.146:0/79992713 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161c01f070 con 0x7f16280d06d0 2023-05-24T03:29:56.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.197+0000 7f162ceb9700 1 -- 172.21.15.146:0/79992713 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16280b3970 con 0x7f16280d06d0 2023-05-24T03:29:56.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.197+0000 7f1616ffd700 1 -- 172.21.15.146:0/79992713 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161c011870 con 0x7f16280d06d0 2023-05-24T03:29:56.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.198+0000 7f162ceb9700 1 -- 172.21.15.146:0/79992713 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16280cdbe0 con 0x7f16280d06d0 2023-05-24T03:29:56.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.199+0000 7f162ceb9700 1 -- 172.21.15.146:0/79992713 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16280d03b0 con 0x7f16280d06d0 2023-05-24T03:29:56.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.199+0000 7f1616ffd700 1 -- 172.21.15.146:0/79992713 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f161c021030 con 0x7f16280d06d0 2023-05-24T03:29:56.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.199+0000 7f1616ffd700 1 --2- 172.21.15.146:0/79992713 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f160806ace0 0x7f160806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:56.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.199+0000 7f1625d9b700 1 --2- 172.21.15.146:0/79992713 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f160806ace0 0x7f160806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:56.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.200+0000 7f1616ffd700 1 -- 172.21.15.146:0/79992713 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f161c08ada0 con 0x7f16280d06d0 2023-05-24T03:29:56.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.200+0000 7f1625d9b700 1 --2- 172.21.15.146:0/79992713 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f160806ace0 0x7f160806d190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f16280c9670 tx=0x7f1618008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:56.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.204+0000 7f1616ffd700 1 -- 172.21.15.146:0/79992713 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f161c055bf0 con 0x7f16280d06d0 2023-05-24T03:29:56.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.395+0000 7f162ceb9700 1 -- 172.21.15.146:0/79992713 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f162804e810 con 0x7f16280d06d0 2023-05-24T03:29:56.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.396+0000 7f1616ffd700 1 -- 172.21.15.146:0/79992713 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20156 (secure 0 0 0) 0x7f161c059210 con 0x7f16280d06d0 2023-05-24T03:29:56.401 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:29:56.401 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":28,"fsid":"11ca0adb-7672-4713-bde7-451e8b743ae9","created":"2023-05-24T03:29:19.113659+0000","modified":"2023-05-24T03:29:48.912599+0000","last_up_change":"2023-05-24T03:29:30.962339+0000","last_in_change":"2023-05-24T03:29:21.706540+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-24T03:29:32.749984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-24T03:29:37.719623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-24T03:29:42.165379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-24T03:29:43.431615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-24T03:29:46.503075+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f24b319b-fcc8-4385-b0cb-78138fc31417","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6801","nonce":3353593100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6803","nonce":3353593100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6807","nonce":3353593100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6805","nonce":3353593100}]},"public_addr":"172.21.15.146:6801/3353593100","cluster_addr":"172.21.15.146:6803/3353593100","heartbeat_back_addr":"172.21.15.146:6807/3353593100","heartbeat_front_addr":"172.21.15.146:6805/3353593100","state":["exists","up"]},{"osd":1,"uuid":"c9639ea9-8f9b-498e-92c8-aa976edbf1da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6821","nonce":2537488734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6825","nonce":2537488734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6831","nonce":2537488734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6827","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6829","nonce":2537488734}]},"public_addr":"172.21.15.146:6821/2537488734","cluster_addr":"172.21.15.146:6825/2537488734","heartbeat_back_addr":"172.21.15.146:6831/2537488734","heartbeat_front_addr":"172.21.15.146:6829/2537488734","state":["exists","up"]},{"osd":2,"uuid":"7a6cfc6d-b0ca-4cb6-a66d-4001ec184657","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6809","nonce":1800242932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6811","nonce":1800242932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6815","nonce":1800242932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6813","nonce":1800242932}]},"public_addr":"172.21.15.146:6809/1800242932","cluster_addr":"172.21.15.146:6811/1800242932","heartbeat_back_addr":"172.21.15.146:6815/1800242932","heartbeat_front_addr":"172.21.15.146:6813/1800242932","state":["exists","up"]},{"osd":3,"uuid":"401509f7-cecd-44a2-b0ae-22c81a5d93c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6817","nonce":1749783580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6820","nonce":1749783580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6828","nonce":1749783580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6824","nonce":1749783580}]},"public_addr":"172.21.15.146:6817/1749783580","cluster_addr":"172.21.15.146:6820/1749783580","heartbeat_back_addr":"172.21.15.146:6828/1749783580","heartbeat_front_addr":"172.21.15.146:6824/1749783580","state":["exists","up"]},{"osd":4,"uuid":"9d07f440-d125-4f99-a825-411fab894d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6811","nonce":163453435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6814","nonce":163453435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6819","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6821","nonce":163453435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6818","nonce":163453435}]},"public_addr":"172.21.15.151:6811/163453435","cluster_addr":"172.21.15.151:6814/163453435","heartbeat_back_addr":"172.21.15.151:6821/163453435","heartbeat_front_addr":"172.21.15.151:6818/163453435","state":["exists","up"]},{"osd":5,"uuid":"9b2266e2-9e52-4f0e-96da-e703a6c23a6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6801","nonce":3283474903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6803","nonce":3283474903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6807","nonce":3283474903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6805","nonce":3283474903}]},"public_addr":"172.21.15.151:6801/3283474903","cluster_addr":"172.21.15.151:6803/3283474903","heartbeat_back_addr":"172.21.15.151:6807/3283474903","heartbeat_front_addr":"172.21.15.151:6805/3283474903","state":["exists","up"]},{"osd":6,"uuid":"5daedf77-0a83-49e7-b497-d9ed10436972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6825","nonce":3889424178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6827","nonce":3889424178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6831","nonce":3889424178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6829","nonce":3889424178}]},"public_addr":"172.21.15.151:6825/3889424178","cluster_addr":"172.21.15.151:6827/3889424178","heartbeat_back_addr":"172.21.15.151:6831/3889424178","heartbeat_front_addr":"172.21.15.151:6829/3889424178","state":["exists","up"]},{"osd":7,"uuid":"86ae4f7e-c01f-4c3d-a0dd-98160c209309","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6810","nonce":563291208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6815","nonce":563291208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6823","nonce":563291208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6820","nonce":563291208}]},"public_addr":"172.21.15.151:6810/563291208","cluster_addr":"172.21.15.151:6815/563291208","heartbeat_back_addr":"172.21.15.151:6823/563291208","heartbeat_front_addr":"172.21.15.151:6820/563291208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.872472+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.937126+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.877234+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.884793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.881632+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.938293+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.857661+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.945883+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-24T03:29:56.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.398+0000 7f162ceb9700 1 -- 172.21.15.146:0/79992713 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f160806ace0 msgr2=0x7f160806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:56.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.398+0000 7f162ceb9700 1 --2- 172.21.15.146:0/79992713 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f160806ace0 0x7f160806d190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f16280c9670 tx=0x7f1618008040 comp rx=0 tx=0).stop 2023-05-24T03:29:56.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.398+0000 7f162ceb9700 1 -- 172.21.15.146:0/79992713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16280d06d0 msgr2=0x7f162814f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:56.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.398+0000 7f162ceb9700 1 --2- 172.21.15.146:0/79992713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16280d06d0 0x7f162814f570 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f16280d2180 tx=0x7f161c004750 comp rx=0 tx=0).stop 2023-05-24T03:29:56.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.398+0000 7f162ceb9700 1 -- 172.21.15.146:0/79992713 shutdown_connections 2023-05-24T03:29:56.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.398+0000 7f162ceb9700 1 --2- 172.21.15.146:0/79992713 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f160806ace0 0x7f160806d190 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:56.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.398+0000 7f162ceb9700 1 --2- 172.21.15.146:0/79992713 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f162815acd0 0x7f162806ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:56.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.398+0000 7f162ceb9700 1 --2- 172.21.15.146:0/79992713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16280d06d0 0x7f162814f570 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:56.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.398+0000 7f162ceb9700 1 --2- 172.21.15.146:0/79992713 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16280d1090 0x7f162806e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:56.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.398+0000 7f162ceb9700 1 -- 172.21.15.146:0/79992713 >> 172.21.15.146:0/79992713 conn(0x7f162806e2a0 msgr2=0x7f16280b3f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:56.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.398+0000 7f162ceb9700 1 -- 172.21.15.146:0/79992713 shutdown_connections 2023-05-24T03:29:56.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.398+0000 7f162ceb9700 1 -- 172.21.15.146:0/79992713 wait complete. 2023-05-24T03:29:56.415 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-24T03:29:32.749984+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-24T03:29:37.719623+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-24T03:29:42.165379+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-24T03:29:43.431615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-24T03:29:46.503075+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-24T03:29:56.416 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-24T03:29:56.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.541+0000 7fddeabad700 1 Processor -- start 2023-05-24T03:29:56.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.541+0000 7fddeabad700 1 -- start start 2023-05-24T03:29:56.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.542+0000 7fddeabad700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdde406a460 0x7fdde40cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:56.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.542+0000 7fddeabad700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fdde415cd90 0x7fdde406a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:56.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.542+0000 7fddeabad700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdde40cfd00 con 0x7fdde40aefd0 2023-05-24T03:29:56.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.542+0000 7fddeabad700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdde4072350 con 0x7fdde406a460 2023-05-24T03:29:56.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.542+0000 7fddeabad700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdde406ad70 con 0x7fdde415cd90 2023-05-24T03:29:56.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.542+0000 7fdde8949700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdde406a460 0x7fdde40cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:56.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.542+0000 7fdde8949700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdde406a460 0x7fdde40cede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39002/0 (socket says 172.21.15.146:39002) 2023-05-24T03:29:56.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.542+0000 7fdde914a700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fdde40aefd0 0x7fdde4160d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45456/0 (socket says 172.21.15.146:45456) 2023-05-24T03:29:56.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.542+0000 7fdde8949700 1 -- 172.21.15.146:0/3134182977 learned_addr learned my addr 172.21.15.146:0/3134182977 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:56.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.542+0000 7fdde3fff700 1 --2- 172.21.15.146:0/3134182977 >> v2:172.21.15.151:3300/0 conn(0x7fdde415cd90 0x7fdde406a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:56.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.542+0000 7fdde8949700 1 -- 172.21.15.146:0/3134182977 >> v2:172.21.15.151:3300/0 conn(0x7fdde415cd90 msgr2=0x7fdde406a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:56.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.542+0000 7fdde8949700 1 --2- 172.21.15.146:0/3134182977 >> v2:172.21.15.151:3300/0 conn(0x7fdde415cd90 0x7fdde406a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:56.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.542+0000 7fdde8949700 1 -- 172.21.15.146:0/3134182977 >> v1:172.21.15.146:6789/0 conn(0x7fdde40aefd0 legacy=0x7fdde4160d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:56.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.542+0000 7fdde37fe700 1 -- 172.21.15.146:0/3134182977 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3717656542 0 0) 0x7fdddc001490 con 0x7fdde40aefd0 2023-05-24T03:29:56.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.542+0000 7fdde8949700 1 -- 172.21.15.146:0/3134182977 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde40cf460 con 0x7fdde406a460 2023-05-24T03:29:56.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.542+0000 7fdde8949700 1 --2- 172.21.15.146:0/3134182977 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdde406a460 0x7fdde40cede0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdde4074870 tx=0x7fddd8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=691ead2d957e0bb9 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:56.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.542+0000 7fdde37fe700 1 -- 172.21.15.146:0/3134182977 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd8011830 con 0x7fdde406a460 2023-05-24T03:29:56.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.542+0000 7fdde37fe700 1 -- 172.21.15.146:0/3134182977 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd8011990 con 0x7fdde406a460 2023-05-24T03:29:56.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.542+0000 7fdde37fe700 1 -- 172.21.15.146:0/3134182977 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd8011d20 con 0x7fdde406a460 2023-05-24T03:29:56.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.543+0000 7fddeabad700 1 -- 172.21.15.146:0/3134182977 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdde406a460 msgr2=0x7fdde40cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:56.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.543+0000 7fddeabad700 1 --2- 172.21.15.146:0/3134182977 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdde406a460 0x7fdde40cede0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdde4074870 tx=0x7fddd8009bd0 comp rx=0 tx=0).stop 2023-05-24T03:29:56.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.543+0000 7fddeabad700 1 -- 172.21.15.146:0/3134182977 shutdown_connections 2023-05-24T03:29:56.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.543+0000 7fddeabad700 1 --2- 172.21.15.146:0/3134182977 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdde406a460 0x7fdde40cede0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:56.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.543+0000 7fddeabad700 1 --2- 172.21.15.146:0/3134182977 >> v2:172.21.15.151:3300/0 conn(0x7fdde415cd90 0x7fdde406a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:56.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.543+0000 7fddeabad700 1 -- 172.21.15.146:0/3134182977 >> 172.21.15.146:0/3134182977 conn(0x7fdde40cfea0 msgr2=0x7fdde40d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:56.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.543+0000 7fddeabad700 1 -- 172.21.15.146:0/3134182977 shutdown_connections 2023-05-24T03:29:56.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.543+0000 7fddeabad700 1 -- 172.21.15.146:0/3134182977 wait complete. 2023-05-24T03:29:56.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.544+0000 7fddeabad700 1 Processor -- start 2023-05-24T03:29:56.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.544+0000 7fddeabad700 1 -- start start 2023-05-24T03:29:56.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.545+0000 7fddeabad700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdde406a460 0x7fdde40b2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:56.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.545+0000 7fddeabad700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdde40aefd0 0x7fdde4150cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:56.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.545+0000 7fddeabad700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdde415cd90 0x7fdde40af620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:56.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.545+0000 7fddeabad700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde40b1cc0 con 0x7fdde406a460 2023-05-24T03:29:56.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.545+0000 7fddeabad700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde40b0dd0 con 0x7fdde415cd90 2023-05-24T03:29:56.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.545+0000 7fddeabad700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdde40b10b0 con 0x7fdde40aefd0 2023-05-24T03:29:56.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.545+0000 7fdde8949700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdde406a460 0x7fdde40b2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:56.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.545+0000 7fdde8949700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdde406a460 0x7fdde40b2150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39006/0 (socket says 172.21.15.146:39006) 2023-05-24T03:29:56.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.545+0000 7fdde8949700 1 -- 172.21.15.146:0/2286185888 learned_addr learned my addr 172.21.15.146:0/2286185888 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:56.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.545+0000 7fdde914a700 1 --2- 172.21.15.146:0/2286185888 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdde415cd90 0x7fdde40af620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:56.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.545+0000 7fdde3fff700 1 --2- 172.21.15.146:0/2286185888 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdde40aefd0 0x7fdde4150cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:56.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.545+0000 7fdde8949700 1 -- 172.21.15.146:0/2286185888 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdde40aefd0 msgr2=0x7fdde4150cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:56.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.545+0000 7fdde8949700 1 --2- 172.21.15.146:0/2286185888 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdde40aefd0 0x7fdde4150cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:56.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.545+0000 7fdde8949700 1 -- 172.21.15.146:0/2286185888 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdde415cd90 msgr2=0x7fdde40af620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:56.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.545+0000 7fdde8949700 1 --2- 172.21.15.146:0/2286185888 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdde415cd90 0x7fdde40af620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:56.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.546+0000 7fdde8949700 1 -- 172.21.15.146:0/2286185888 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd8009550 con 0x7fdde406a460 2023-05-24T03:29:56.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.546+0000 7fdde8949700 1 --2- 172.21.15.146:0/2286185888 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdde406a460 0x7fdde40b2150 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fddd8009fd0 tx=0x7fddd8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:56.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.546+0000 7fdde17fa700 1 -- 172.21.15.146:0/2286185888 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd80036a0 con 0x7fdde406a460 2023-05-24T03:29:56.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.546+0000 7fdde17fa700 1 -- 172.21.15.146:0/2286185888 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd801f070 con 0x7fdde406a460 2023-05-24T03:29:56.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.546+0000 7fdde17fa700 1 -- 172.21.15.146:0/2286185888 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd8003a20 con 0x7fdde406a460 2023-05-24T03:29:56.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.546+0000 7fddeabad700 1 -- 172.21.15.146:0/2286185888 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdde40cfa20 con 0x7fdde406a460 2023-05-24T03:29:56.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.546+0000 7fddeabad700 1 -- 172.21.15.146:0/2286185888 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdde40cf740 con 0x7fdde406a460 2023-05-24T03:29:56.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.547+0000 7fddeabad700 1 -- 172.21.15.146:0/2286185888 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdde4160800 con 0x7fdde406a460 2023-05-24T03:29:56.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.547+0000 7fdde17fa700 1 -- 172.21.15.146:0/2286185888 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fddd8003b80 con 0x7fdde406a460 2023-05-24T03:29:56.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.548+0000 7fdde17fa700 1 --2- 172.21.15.146:0/2286185888 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fddc806ace0 0x7fddc806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:56.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.548+0000 7fdde17fa700 1 -- 172.21.15.146:0/2286185888 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fddd8021070 con 0x7fdde406a460 2023-05-24T03:29:56.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.548+0000 7fdde3fff700 1 --2- 172.21.15.146:0/2286185888 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fddc806ace0 0x7fddc806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:56.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.548+0000 7fdde3fff700 1 --2- 172.21.15.146:0/2286185888 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fddc806ace0 0x7fddc806d190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdde40b3970 tx=0x7fddd0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:56.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.552+0000 7fdde17fa700 1 -- 172.21.15.146:0/2286185888 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fddd8055e20 con 0x7fdde406a460 2023-05-24T03:29:56.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.740+0000 7fddeabad700 1 -- 172.21.15.146:0/2286185888 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdde40b1fa0 con 0x7fdde406a460 2023-05-24T03:29:56.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.740+0000 7fdde17fa700 1 -- 172.21.15.146:0/2286185888 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fddd8015020 con 0x7fdde406a460 2023-05-24T03:29:56.745 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2023-05-24T03:29:56.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.742+0000 7fddeabad700 1 -- 172.21.15.146:0/2286185888 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fddc806ace0 msgr2=0x7fddc806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:56.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.742+0000 7fddeabad700 1 --2- 172.21.15.146:0/2286185888 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fddc806ace0 0x7fddc806d190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdde40b3970 tx=0x7fddd0008040 comp rx=0 tx=0).stop 2023-05-24T03:29:56.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.742+0000 7fddeabad700 1 -- 172.21.15.146:0/2286185888 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdde406a460 msgr2=0x7fdde40b2150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:56.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.742+0000 7fddeabad700 1 --2- 172.21.15.146:0/2286185888 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdde406a460 0x7fdde40b2150 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fddd8009fd0 tx=0x7fddd8004750 comp rx=0 tx=0).stop 2023-05-24T03:29:56.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.742+0000 7fddeabad700 1 -- 172.21.15.146:0/2286185888 shutdown_connections 2023-05-24T03:29:56.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.742+0000 7fddeabad700 1 --2- 172.21.15.146:0/2286185888 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fddc806ace0 0x7fddc806d190 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:56.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.742+0000 7fddeabad700 1 --2- 172.21.15.146:0/2286185888 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdde415cd90 0x7fdde40af620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:56.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.742+0000 7fddeabad700 1 --2- 172.21.15.146:0/2286185888 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdde406a460 0x7fdde40b2150 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:56.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.742+0000 7fddeabad700 1 --2- 172.21.15.146:0/2286185888 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdde40aefd0 0x7fdde4150cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:56.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.742+0000 7fddeabad700 1 -- 172.21.15.146:0/2286185888 >> 172.21.15.146:0/2286185888 conn(0x7fdde40cfea0 msgr2=0x7fdde415c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:56.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.742+0000 7fddeabad700 1 -- 172.21.15.146:0/2286185888 shutdown_connections 2023-05-24T03:29:56.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.742+0000 7fddeabad700 1 -- 172.21.15.146:0/2286185888 wait complete. 2023-05-24T03:29:56.759 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-24T03:29:56.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.879+0000 7f0380ab7700 1 Processor -- start 2023-05-24T03:29:56.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.879+0000 7f0380ab7700 1 -- start start 2023-05-24T03:29:56.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.880+0000 7f0380ab7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f037c0cdfd0 0x7f037c0ce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:56.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.880+0000 7f0380ab7700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f037c0b28d0 con 0x7f037c070fe0 2023-05-24T03:29:56.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.880+0000 7f0380ab7700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f037c15ad80 con 0x7f037c159cd0 2023-05-24T03:29:56.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.880+0000 7f0380ab7700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f037c15a7c0 con 0x7f037c0cdfd0 2023-05-24T03:29:56.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.880+0000 7f0379d9b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f037c070fe0 0x7f037c0b21c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45466/0 (socket says 172.21.15.146:45466) 2023-05-24T03:29:56.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.880+0000 7f0379d9b700 1 -- 172.21.15.146:0/3480578875 learned_addr learned my addr 172.21.15.146:0/3480578875 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:29:56.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.880+0000 7f037a59c700 1 --2- 172.21.15.146:0/3480578875 >> v2:172.21.15.146:3300/0 conn(0x7f037c0cdfd0 0x7f037c0ce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:56.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.880+0000 7f037959a700 1 -- 172.21.15.146:0/3480578875 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3715952912 0 0) 0x7f037c0b28d0 con 0x7f037c070fe0 2023-05-24T03:29:56.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.880+0000 7f037959a700 1 -- 172.21.15.146:0/3480578875 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03640035b0 con 0x7f037c070fe0 2023-05-24T03:29:56.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.881+0000 7f037a59c700 1 -- 172.21.15.146:0/3480578875 >> v1:172.21.15.151:6789/0 conn(0x7f037c159cd0 legacy=0x7f037c06d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:56.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.881+0000 7f037a59c700 1 -- 172.21.15.146:0/3480578875 >> v1:172.21.15.146:6789/0 conn(0x7f037c070fe0 legacy=0x7f037c0b21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:56.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.881+0000 7f037959a700 1 -- 172.21.15.146:0/3480578875 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3333104040 0 0) 0x7f037c15ad80 con 0x7f037c159cd0 2023-05-24T03:29:56.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.881+0000 7f037a59c700 1 -- 172.21.15.146:0/3480578875 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f037c15aaa0 con 0x7f037c0cdfd0 2023-05-24T03:29:56.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.881+0000 7f037a59c700 1 --2- 172.21.15.146:0/3480578875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f037c0cdfd0 0x7f037c0ce3a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0370009840 tx=0x7f0370009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeac89e9c8766299 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:56.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.881+0000 7f037959a700 1 -- 172.21.15.146:0/3480578875 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036c001670 con 0x7f037c0cdfd0 2023-05-24T03:29:56.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.881+0000 7f037959a700 1 -- 172.21.15.146:0/3480578875 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0370004030 con 0x7f037c0cdfd0 2023-05-24T03:29:56.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.881+0000 7f037959a700 1 -- 172.21.15.146:0/3480578875 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03700043c0 con 0x7f037c0cdfd0 2023-05-24T03:29:56.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.881+0000 7f0380ab7700 1 -- 172.21.15.146:0/3480578875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f037c0cdfd0 msgr2=0x7f037c0ce3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:56.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.881+0000 7f0380ab7700 1 --2- 172.21.15.146:0/3480578875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f037c0cdfd0 0x7f037c0ce3a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0370009840 tx=0x7f0370009b50 comp rx=0 tx=0).stop 2023-05-24T03:29:56.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.882+0000 7f0380ab7700 1 -- 172.21.15.146:0/3480578875 shutdown_connections 2023-05-24T03:29:56.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.882+0000 7f0380ab7700 1 --2- 172.21.15.146:0/3480578875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f037c0cdfd0 0x7f037c0ce3a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:56.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.882+0000 7f0380ab7700 1 -- 172.21.15.146:0/3480578875 >> 172.21.15.146:0/3480578875 conn(0x7f037c0cfea0 msgr2=0x7f037c0d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:56.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.882+0000 7f0380ab7700 1 -- 172.21.15.146:0/3480578875 shutdown_connections 2023-05-24T03:29:56.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.882+0000 7f0380ab7700 1 -- 172.21.15.146:0/3480578875 wait complete. 2023-05-24T03:29:56.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.883+0000 7f0380ab7700 1 Processor -- start 2023-05-24T03:29:56.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.883+0000 7f0380ab7700 1 -- start start 2023-05-24T03:29:56.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.884+0000 7f0380ab7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f037c070fe0 0x7f037c0c2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:56.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.884+0000 7f0380ab7700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f037c0cdfd0 0x7f037c0caf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:56.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.884+0000 7f0380ab7700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f037c159cd0 0x7f037c15afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:56.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.884+0000 7f0380ab7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037c0c8ba0 con 0x7f037c070fe0 2023-05-24T03:29:56.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.884+0000 7f0380ab7700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037c0c78f0 con 0x7f037c0cdfd0 2023-05-24T03:29:56.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.884+0000 7f0380ab7700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f037c0cc5d0 con 0x7f037c159cd0 2023-05-24T03:29:56.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.884+0000 7f037a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f037c070fe0 0x7f037c0c2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:56.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.884+0000 7f037a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f037c070fe0 0x7f037c0c2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39018/0 (socket says 172.21.15.146:39018) 2023-05-24T03:29:56.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.884+0000 7f037a59c700 1 -- 172.21.15.146:0/386366944 learned_addr learned my addr 172.21.15.146:0/386366944 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:56.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.884+0000 7f0379d9b700 1 --2- 172.21.15.146:0/386366944 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f037c0cdfd0 0x7f037c0caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:56.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.884+0000 7f037ad9d700 1 --2- 172.21.15.146:0/386366944 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f037c159cd0 0x7f037c15afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:56.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.884+0000 7f037a59c700 1 -- 172.21.15.146:0/386366944 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f037c159cd0 msgr2=0x7f037c15afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:56.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.884+0000 7f037a59c700 1 --2- 172.21.15.146:0/386366944 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f037c159cd0 0x7f037c15afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:56.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.884+0000 7f037a59c700 1 -- 172.21.15.146:0/386366944 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f037c0cdfd0 msgr2=0x7f037c0caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:56.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.884+0000 7f037a59c700 1 --2- 172.21.15.146:0/386366944 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f037c0cdfd0 0x7f037c0caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:56.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.884+0000 7f037a59c700 1 -- 172.21.15.146:0/386366944 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03700094a0 con 0x7f037c070fe0 2023-05-24T03:29:56.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.884+0000 7f037ad9d700 1 --2- 172.21.15.146:0/386366944 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f037c159cd0 0x7f037c15afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:29:56.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.884+0000 7f037a59c700 1 --2- 172.21.15.146:0/386366944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f037c070fe0 0x7f037c0c2b00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f037c06ce70 tx=0x7f0370004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:56.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.884+0000 7f036affd700 1 -- 172.21.15.146:0/386366944 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0370010790 con 0x7f037c070fe0 2023-05-24T03:29:56.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.884+0000 7f036affd700 1 -- 172.21.15.146:0/386366944 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03700108f0 con 0x7f037c070fe0 2023-05-24T03:29:56.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.884+0000 7f0380ab7700 1 -- 172.21.15.146:0/386366944 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f037c0b1ca0 con 0x7f037c070fe0 2023-05-24T03:29:56.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.884+0000 7f036affd700 1 -- 172.21.15.146:0/386366944 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0370010c80 con 0x7f037c070fe0 2023-05-24T03:29:56.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.884+0000 7f0380ab7700 1 -- 172.21.15.146:0/386366944 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f037c0b19c0 con 0x7f037c070fe0 2023-05-24T03:29:56.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.885+0000 7f0380ab7700 1 -- 172.21.15.146:0/386366944 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f037c0ce8e0 con 0x7f037c070fe0 2023-05-24T03:29:56.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.886+0000 7f036affd700 1 -- 172.21.15.146:0/386366944 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f037001c420 con 0x7f037c070fe0 2023-05-24T03:29:56.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.886+0000 7f036affd700 1 --2- 172.21.15.146:0/386366944 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f035c06ace0 0x7f035c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:56.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.886+0000 7f036affd700 1 -- 172.21.15.146:0/386366944 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f037008af80 con 0x7f037c070fe0 2023-05-24T03:29:56.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.886+0000 7f0379d9b700 1 --2- 172.21.15.146:0/386366944 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f035c06ace0 0x7f035c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:56.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.886+0000 7f0379d9b700 1 --2- 172.21.15.146:0/386366944 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f035c06ace0 0x7f035c06d190 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f036c001eb0 tx=0x7f036c0018c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:56.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:56.890+0000 7f036affd700 1 -- 172.21.15.146:0/386366944 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f0370055e60 con 0x7f037c070fe0 2023-05-24T03:29:57.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.079+0000 7f0380ab7700 1 -- 172.21.15.146:0/386366944 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f037c068d00 con 0x7f037c070fe0 2023-05-24T03:29:57.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.080+0000 7f036affd700 1 -- 172.21.15.146:0/386366944 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f03700200a0 con 0x7f037c070fe0 2023-05-24T03:29:57.085 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2023-05-24T03:29:57.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.081+0000 7f0380ab7700 1 -- 172.21.15.146:0/386366944 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f035c06ace0 msgr2=0x7f035c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:57.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.081+0000 7f0380ab7700 1 --2- 172.21.15.146:0/386366944 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f035c06ace0 0x7f035c06d190 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f036c001eb0 tx=0x7f036c0018c0 comp rx=0 tx=0).stop 2023-05-24T03:29:57.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.081+0000 7f0380ab7700 1 -- 172.21.15.146:0/386366944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f037c070fe0 msgr2=0x7f037c0c2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:57.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.081+0000 7f0380ab7700 1 --2- 172.21.15.146:0/386366944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f037c070fe0 0x7f037c0c2b00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f037c06ce70 tx=0x7f0370004750 comp rx=0 tx=0).stop 2023-05-24T03:29:57.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.081+0000 7f0380ab7700 1 -- 172.21.15.146:0/386366944 shutdown_connections 2023-05-24T03:29:57.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.081+0000 7f0380ab7700 1 --2- 172.21.15.146:0/386366944 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f035c06ace0 0x7f035c06d190 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:57.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.081+0000 7f0380ab7700 1 --2- 172.21.15.146:0/386366944 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f037c159cd0 0x7f037c15afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:57.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.081+0000 7f0380ab7700 1 --2- 172.21.15.146:0/386366944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f037c070fe0 0x7f037c0c2b00 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:57.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.081+0000 7f0380ab7700 1 --2- 172.21.15.146:0/386366944 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f037c0cdfd0 0x7f037c0caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:57.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.082+0000 7f0380ab7700 1 -- 172.21.15.146:0/386366944 >> 172.21.15.146:0/386366944 conn(0x7f037c0cfea0 msgr2=0x7f037c06da00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:57.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.082+0000 7f0380ab7700 1 -- 172.21.15.146:0/386366944 shutdown_connections 2023-05-24T03:29:57.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.082+0000 7f0380ab7700 1 -- 172.21.15.146:0/386366944 wait complete. 2023-05-24T03:29:57.098 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-24T03:29:57.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.217+0000 7f0dcd535700 1 Processor -- start 2023-05-24T03:29:57.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.217+0000 7f0dcd535700 1 -- start start 2023-05-24T03:29:57.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.218+0000 7f0dcd535700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0dc80b4c80 0x7f0dc80b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:57.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.218+0000 7f0dcd535700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0dc80d2d20 0x7f0dc80cd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:57.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.218+0000 7f0dcd535700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dc80b5850 con 0x7f0dc80cdd90 2023-05-24T03:29:57.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.218+0000 7f0dcd535700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dc806be90 con 0x7f0dc80b4c80 2023-05-24T03:29:57.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.218+0000 7f0dcd535700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc80d1ea0 con 0x7f0dc80d2d20 2023-05-24T03:29:57.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.218+0000 7f0dc77fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0dc80cdd90 0x7f0dc80cf410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45482/0 (socket says 172.21.15.146:45482) 2023-05-24T03:29:57.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.218+0000 7f0dc77fe700 1 -- 172.21.15.146:0/83889487 learned_addr learned my addr 172.21.15.146:0/83889487 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:29:57.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.218+0000 7f0dc67fc700 1 --2- 172.21.15.146:0/83889487 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0dc80d2d20 0x7f0dc80cd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:57.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.218+0000 7f0dc6ffd700 1 --2- 172.21.15.146:0/83889487 >> v2:172.21.15.151:3300/0 conn(0x7f0dc80b4c80 0x7f0dc80b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:57.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.218+0000 7f0dc5ffb700 1 -- 172.21.15.146:0/83889487 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3169818163 0 0) 0x7f0dc80b5850 con 0x7f0dc80cdd90 2023-05-24T03:29:57.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.218+0000 7f0dc5ffb700 1 -- 172.21.15.146:0/83889487 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0db00035b0 con 0x7f0dc80cdd90 2023-05-24T03:29:57.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.218+0000 7f0dc5ffb700 1 -- 172.21.15.146:0/83889487 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3729275712 0 0) 0x7f0db00035b0 con 0x7f0dc80cdd90 2023-05-24T03:29:57.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.218+0000 7f0dc5ffb700 1 -- 172.21.15.146:0/83889487 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0dc80d2d20 msgr2=0x7f0dc80cd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:57.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.218+0000 7f0dc5ffb700 1 --2- 172.21.15.146:0/83889487 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0dc80d2d20 0x7f0dc80cd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:57.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.218+0000 7f0dc5ffb700 1 -- 172.21.15.146:0/83889487 >> v2:172.21.15.151:3300/0 conn(0x7f0dc80b4c80 msgr2=0x7f0dc80b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:57.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.218+0000 7f0dc5ffb700 1 --2- 172.21.15.146:0/83889487 >> v2:172.21.15.151:3300/0 conn(0x7f0dc80b4c80 0x7f0dc80b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:57.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.218+0000 7f0dc5ffb700 1 -- 172.21.15.146:0/83889487 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc80b5af0 con 0x7f0dc80cdd90 2023-05-24T03:29:57.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.218+0000 7f0dc5ffb700 1 -- 172.21.15.146:0/83889487 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1301887351 0 0) 0x7f0dc00019f0 con 0x7f0dc80cdd90 2023-05-24T03:29:57.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.218+0000 7f0dc5ffb700 1 -- 172.21.15.146:0/83889487 >> v1:172.21.15.146:6789/0 conn(0x7f0dc80cdd90 legacy=0x7f0dc80cf410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:57.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.218+0000 7f0dc5ffb700 1 --2- 172.21.15.146:0/83889487 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0dc80d2d20 0x7f0db0003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:57.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.218+0000 7f0dc5ffb700 1 --2- 172.21.15.146:0/83889487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0db0003f80 0x7f0db0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:57.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.218+0000 7f0dc5ffb700 1 --2- 172.21.15.146:0/83889487 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0db0004d90 0x7f0db0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:57.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.218+0000 7f0dc5ffb700 1 -- 172.21.15.146:0/83889487 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc806be90 con 0x7f0db0003f80 2023-05-24T03:29:57.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.218+0000 7f0dc5ffb700 1 -- 172.21.15.146:0/83889487 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc80d1ea0 con 0x7f0db0004d90 2023-05-24T03:29:57.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.218+0000 7f0dc5ffb700 1 -- 172.21.15.146:0/83889487 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db000ba40 con 0x7f0dc80d2d20 2023-05-24T03:29:57.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.219+0000 7f0dc67fc700 1 --2- 172.21.15.146:0/83889487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0db0003f80 0x7f0db0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:57.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.219+0000 7f0dc6ffd700 1 --2- 172.21.15.146:0/83889487 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0dc80d2d20 0x7f0db0003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:57.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.219+0000 7f0dc77fe700 1 --2- 172.21.15.146:0/83889487 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0db0004d90 0x7f0db0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:57.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.219+0000 7f0dc67fc700 1 -- 172.21.15.146:0/83889487 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0dc80d2d20 msgr2=0x7f0db0003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:57.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.219+0000 7f0dc67fc700 1 --2- 172.21.15.146:0/83889487 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0dc80d2d20 0x7f0db0003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:57.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.219+0000 7f0dc67fc700 1 -- 172.21.15.146:0/83889487 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0db0004d90 msgr2=0x7f0db0005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:57.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.219+0000 7f0dc67fc700 1 --2- 172.21.15.146:0/83889487 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0db0004d90 0x7f0db0005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:57.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.219+0000 7f0dc67fc700 1 -- 172.21.15.146:0/83889487 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db00035b0 con 0x7f0db0003f80 2023-05-24T03:29:57.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.219+0000 7f0dc67fc700 1 --2- 172.21.15.146:0/83889487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0db0003f80 0x7f0db0004850 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc009b60 tx=0x7f0db0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af5a2897d2d844ff server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:57.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.219+0000 7f0dc5ffb700 1 -- 172.21.15.146:0/83889487 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc00e660 con 0x7f0db0003f80 2023-05-24T03:29:57.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.219+0000 7f0dc5ffb700 1 -- 172.21.15.146:0/83889487 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dbc00e7c0 con 0x7f0db0003f80 2023-05-24T03:29:57.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.219+0000 7f0dc5ffb700 1 -- 172.21.15.146:0/83889487 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc00eb30 con 0x7f0db0003f80 2023-05-24T03:29:57.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.220+0000 7f0dcd535700 1 -- 172.21.15.146:0/83889487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0db0003f80 msgr2=0x7f0db0004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:57.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.220+0000 7f0dcd535700 1 --2- 172.21.15.146:0/83889487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0db0003f80 0x7f0db0004850 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc009b60 tx=0x7f0db0005880 comp rx=0 tx=0).stop 2023-05-24T03:29:57.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.220+0000 7f0dc77fe700 1 -- 172.21.15.146:0/83889487 reap_dead start 2023-05-24T03:29:57.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.220+0000 7f0dcd535700 1 -- 172.21.15.146:0/83889487 shutdown_connections 2023-05-24T03:29:57.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.220+0000 7f0dcd535700 1 -- 172.21.15.146:0/83889487 >> 172.21.15.146:0/83889487 conn(0x7f0dc80743f0 msgr2=0x7f0dc806aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:57.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.220+0000 7f0dcd535700 1 -- 172.21.15.146:0/83889487 shutdown_connections 2023-05-24T03:29:57.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.220+0000 7f0dcd535700 1 -- 172.21.15.146:0/83889487 wait complete. 2023-05-24T03:29:57.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.221+0000 7f0dcd535700 1 Processor -- start 2023-05-24T03:29:57.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.221+0000 7f0dcd535700 1 -- start start 2023-05-24T03:29:57.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.222+0000 7f0dcd535700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0db0003f80 0x7f0dc815fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:57.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.222+0000 7f0dcd535700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0dc8154260 0x7f0dc80cace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:57.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.222+0000 7f0dcd535700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0dc80c7480 0x7f0dc80c78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:57.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.222+0000 7f0dcd535700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc80cc140 con 0x7f0dc8154260 2023-05-24T03:29:57.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.222+0000 7f0dcd535700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc80cb530 con 0x7f0dc80c7480 2023-05-24T03:29:57.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.222+0000 7f0dcd535700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc80cb810 con 0x7f0db0003f80 2023-05-24T03:29:57.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.222+0000 7f0dc67fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0dc8154260 0x7f0dc80cace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:57.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.222+0000 7f0dc67fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0dc8154260 0x7f0dc80cace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39040/0 (socket says 172.21.15.146:39040) 2023-05-24T03:29:57.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.222+0000 7f0dc67fc700 1 -- 172.21.15.146:0/686720437 learned_addr learned my addr 172.21.15.146:0/686720437 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:57.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.223+0000 7f0dc6ffd700 1 --2- 172.21.15.146:0/686720437 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0db0003f80 0x7f0dc815fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:57.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.223+0000 7f0dc77fe700 1 --2- 172.21.15.146:0/686720437 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0dc80c7480 0x7f0dc80c78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:57.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.223+0000 7f0dc67fc700 1 -- 172.21.15.146:0/686720437 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0db0003f80 msgr2=0x7f0dc815fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:57.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.223+0000 7f0dc67fc700 1 --2- 172.21.15.146:0/686720437 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0db0003f80 0x7f0dc815fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:57.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.223+0000 7f0dc67fc700 1 -- 172.21.15.146:0/686720437 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0dc80c7480 msgr2=0x7f0dc80c78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:57.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.223+0000 7f0dc67fc700 1 --2- 172.21.15.146:0/686720437 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0dc80c7480 0x7f0dc80c78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:57.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.223+0000 7f0dc67fc700 1 -- 172.21.15.146:0/686720437 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc806bbb0 con 0x7f0dc8154260 2023-05-24T03:29:57.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.223+0000 7f0dc77fe700 1 --2- 172.21.15.146:0/686720437 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0dc80c7480 0x7f0dc80c78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:29:57.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.223+0000 7f0dc67fc700 1 --2- 172.21.15.146:0/686720437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0dc8154260 0x7f0dc80cace0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0db0004770 tx=0x7f0dbc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:57.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.223+0000 7f0daf7fe700 1 -- 172.21.15.146:0/686720437 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc021070 con 0x7f0dc8154260 2023-05-24T03:29:57.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.223+0000 7f0daf7fe700 1 -- 172.21.15.146:0/686720437 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dbc0045d0 con 0x7f0dc8154260 2023-05-24T03:29:57.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.223+0000 7f0dcd535700 1 -- 172.21.15.146:0/686720437 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dc80b5590 con 0x7f0dc8154260 2023-05-24T03:29:57.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.223+0000 7f0daf7fe700 1 -- 172.21.15.146:0/686720437 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc00e660 con 0x7f0dc8154260 2023-05-24T03:29:57.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.223+0000 7f0dcd535700 1 -- 172.21.15.146:0/686720437 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dc80d1980 con 0x7f0dc8154260 2023-05-24T03:29:57.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.224+0000 7f0dcd535700 1 -- 172.21.15.146:0/686720437 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dc8072ae0 con 0x7f0dc8154260 2023-05-24T03:29:57.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.224+0000 7f0daf7fe700 1 -- 172.21.15.146:0/686720437 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0dbc025070 con 0x7f0dc8154260 2023-05-24T03:29:57.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.225+0000 7f0daf7fe700 1 --2- 172.21.15.146:0/686720437 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f0db406ace0 0x7f0db406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:57.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.225+0000 7f0daf7fe700 1 -- 172.21.15.146:0/686720437 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0dbc08a890 con 0x7f0dc8154260 2023-05-24T03:29:57.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.225+0000 7f0dc6ffd700 1 --2- 172.21.15.146:0/686720437 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f0db406ace0 0x7f0db406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:57.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.225+0000 7f0dc6ffd700 1 --2- 172.21.15.146:0/686720437 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f0db406ace0 0x7f0db406d190 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0db8009c20 tx=0x7f0db8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:57.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.229+0000 7f0daf7fe700 1 -- 172.21.15.146:0/686720437 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f0dbc055800 con 0x7f0dc8154260 2023-05-24T03:29:57.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.419+0000 7f0dcd535700 1 -- 172.21.15.146:0/686720437 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0dc8068d00 con 0x7f0dc8154260 2023-05-24T03:29:57.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.419+0000 7f0daf7fe700 1 -- 172.21.15.146:0/686720437 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0dbc058e20 con 0x7f0dc8154260 2023-05-24T03:29:57.424 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2023-05-24T03:29:57.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.421+0000 7f0dcd535700 1 -- 172.21.15.146:0/686720437 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f0db406ace0 msgr2=0x7f0db406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:57.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.421+0000 7f0dcd535700 1 --2- 172.21.15.146:0/686720437 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f0db406ace0 0x7f0db406d190 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0db8009c20 tx=0x7f0db8008040 comp rx=0 tx=0).stop 2023-05-24T03:29:57.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.421+0000 7f0dcd535700 1 -- 172.21.15.146:0/686720437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0dc8154260 msgr2=0x7f0dc80cace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:57.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.421+0000 7f0dcd535700 1 --2- 172.21.15.146:0/686720437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0dc8154260 0x7f0dc80cace0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0db0004770 tx=0x7f0dbc0047c0 comp rx=0 tx=0).stop 2023-05-24T03:29:57.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.421+0000 7f0dcd535700 1 -- 172.21.15.146:0/686720437 shutdown_connections 2023-05-24T03:29:57.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.421+0000 7f0dcd535700 1 --2- 172.21.15.146:0/686720437 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f0db406ace0 0x7f0db406d190 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:57.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.421+0000 7f0dcd535700 1 --2- 172.21.15.146:0/686720437 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0dc80c7480 0x7f0dc80c78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:57.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.421+0000 7f0dcd535700 1 --2- 172.21.15.146:0/686720437 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0db0003f80 0x7f0dc815fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:57.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.421+0000 7f0dcd535700 1 --2- 172.21.15.146:0/686720437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0dc8154260 0x7f0dc80cace0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:57.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.421+0000 7f0dcd535700 1 -- 172.21.15.146:0/686720437 >> 172.21.15.146:0/686720437 conn(0x7f0dc80743f0 msgr2=0x7f0dc80d2020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:57.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.421+0000 7f0dcd535700 1 -- 172.21.15.146:0/686720437 shutdown_connections 2023-05-24T03:29:57.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.421+0000 7f0dcd535700 1 -- 172.21.15.146:0/686720437 wait complete. 2023-05-24T03:29:57.438 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-24T03:29:57.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.556+0000 7ff29d655700 1 Processor -- start 2023-05-24T03:29:57.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.556+0000 7ff29d655700 1 -- start start 2023-05-24T03:29:57.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.557+0000 7ff29d655700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff2980cb490 0x7ff29806c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:57.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.557+0000 7ff29d655700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff298159210 0x7ff2981596b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:57.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.557+0000 7ff29d655700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2980cb900 con 0x7ff29806c370 2023-05-24T03:29:57.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.557+0000 7ff29d655700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2980cbb70 con 0x7ff298159210 2023-05-24T03:29:57.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.557+0000 7ff29d655700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2980c9890 con 0x7ff2980cb490 2023-05-24T03:29:57.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.557+0000 7ff2977fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff298159210 0x7ff2981596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:57.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.557+0000 7ff2977fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff298159210 0x7ff2981596b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39050/0 (socket says 172.21.15.146:39050) 2023-05-24T03:29:57.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.557+0000 7ff296ffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff29806c370 0x7ff29815d370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45498/0 (socket says 172.21.15.146:45498) 2023-05-24T03:29:57.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.557+0000 7ff2977fe700 1 -- 172.21.15.146:0/3936228589 learned_addr learned my addr 172.21.15.146:0/3936228589 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:57.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.557+0000 7ff2967fc700 1 --2- 172.21.15.146:0/3936228589 >> v2:172.21.15.151:3300/0 conn(0x7ff2980cb490 0x7ff29806c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:57.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.558+0000 7ff2977fe700 1 -- 172.21.15.146:0/3936228589 >> v2:172.21.15.151:3300/0 conn(0x7ff2980cb490 msgr2=0x7ff29806c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:57.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.558+0000 7ff2977fe700 1 --2- 172.21.15.146:0/3936228589 >> v2:172.21.15.151:3300/0 conn(0x7ff2980cb490 0x7ff29806c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:57.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.558+0000 7ff2977fe700 1 -- 172.21.15.146:0/3936228589 >> v1:172.21.15.146:6789/0 conn(0x7ff29806c370 legacy=0x7ff29815d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:57.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.558+0000 7ff2977fe700 1 -- 172.21.15.146:0/3936228589 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2980cce10 con 0x7ff298159210 2023-05-24T03:29:57.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.558+0000 7ff295ffb700 1 -- 172.21.15.146:0/3936228589 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1398543521 0 0) 0x7ff2980cb900 con 0x7ff29806c370 2023-05-24T03:29:57.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.558+0000 7ff2977fe700 1 --2- 172.21.15.146:0/3936228589 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff298159210 0x7ff2981596b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff2980ccd40 tx=0x7ff29000d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd7eaa1e17ad97e2 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:57.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.558+0000 7ff295ffb700 1 -- 172.21.15.146:0/3936228589 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff290010070 con 0x7ff298159210 2023-05-24T03:29:57.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.558+0000 7ff295ffb700 1 -- 172.21.15.146:0/3936228589 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff29000dd90 con 0x7ff298159210 2023-05-24T03:29:57.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.558+0000 7ff295ffb700 1 -- 172.21.15.146:0/3936228589 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29000b310 con 0x7ff298159210 2023-05-24T03:29:57.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.558+0000 7ff29d655700 1 -- 172.21.15.146:0/3936228589 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff298159210 msgr2=0x7ff2981596b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:57.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.558+0000 7ff29d655700 1 --2- 172.21.15.146:0/3936228589 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff298159210 0x7ff2981596b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff2980ccd40 tx=0x7ff29000d430 comp rx=0 tx=0).stop 2023-05-24T03:29:57.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.558+0000 7ff29d655700 1 -- 172.21.15.146:0/3936228589 shutdown_connections 2023-05-24T03:29:57.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.558+0000 7ff29d655700 1 --2- 172.21.15.146:0/3936228589 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff298159210 0x7ff2981596b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:57.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.558+0000 7ff29d655700 1 --2- 172.21.15.146:0/3936228589 >> v2:172.21.15.151:3300/0 conn(0x7ff2980cb490 0x7ff29806c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:57.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.558+0000 7ff29d655700 1 -- 172.21.15.146:0/3936228589 >> 172.21.15.146:0/3936228589 conn(0x7ff2980b0d90 msgr2=0x7ff2980b1160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:57.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.558+0000 7ff29d655700 1 -- 172.21.15.146:0/3936228589 shutdown_connections 2023-05-24T03:29:57.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.558+0000 7ff29d655700 1 -- 172.21.15.146:0/3936228589 wait complete. 2023-05-24T03:29:57.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.560+0000 7ff29d655700 1 Processor -- start 2023-05-24T03:29:57.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.560+0000 7ff29d655700 1 -- start start 2023-05-24T03:29:57.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.560+0000 7ff29d655700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff29806c370 0x7ff2980b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:57.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.560+0000 7ff29d655700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2980cb490 0x7ff298152780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:57.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.560+0000 7ff29d655700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff298159210 0x7ff2980c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:57.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.560+0000 7ff29d655700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2980c81c0 con 0x7ff2980cb490 2023-05-24T03:29:57.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.560+0000 7ff29d655700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2981ef4c0 con 0x7ff298159210 2023-05-24T03:29:57.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.561+0000 7ff29d655700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2981ef7a0 con 0x7ff29806c370 2023-05-24T03:29:57.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.561+0000 7ff2967fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2980cb490 0x7ff298152780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:57.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.561+0000 7ff2967fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2980cb490 0x7ff298152780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39054/0 (socket says 172.21.15.146:39054) 2023-05-24T03:29:57.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.561+0000 7ff2967fc700 1 -- 172.21.15.146:0/4059959987 learned_addr learned my addr 172.21.15.146:0/4059959987 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:57.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.561+0000 7ff296ffd700 1 --2- 172.21.15.146:0/4059959987 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff29806c370 0x7ff2980b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:57.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.561+0000 7ff2977fe700 1 --2- 172.21.15.146:0/4059959987 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff298159210 0x7ff2980c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:57.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.561+0000 7ff2967fc700 1 -- 172.21.15.146:0/4059959987 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff29806c370 msgr2=0x7ff2980b2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:57.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.561+0000 7ff2967fc700 1 --2- 172.21.15.146:0/4059959987 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff29806c370 0x7ff2980b2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:57.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.561+0000 7ff2967fc700 1 -- 172.21.15.146:0/4059959987 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff298159210 msgr2=0x7ff2980c8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:57.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.561+0000 7ff2967fc700 1 --2- 172.21.15.146:0/4059959987 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff298159210 0x7ff2980c8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:57.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.561+0000 7ff2967fc700 1 -- 172.21.15.146:0/4059959987 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff29000bd40 con 0x7ff2980cb490 2023-05-24T03:29:57.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.561+0000 7ff296ffd700 1 --2- 172.21.15.146:0/4059959987 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff29806c370 0x7ff2980b2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:29:57.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.561+0000 7ff2977fe700 1 --2- 172.21.15.146:0/4059959987 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff298159210 0x7ff2980c8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:29:57.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.561+0000 7ff2967fc700 1 --2- 172.21.15.146:0/4059959987 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2980cb490 0x7ff298152780 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff28800e7e0 tx=0x7ff28800eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:57.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.561+0000 7ff27f7fe700 1 -- 172.21.15.146:0/4059959987 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff288013610 con 0x7ff2980cb490 2023-05-24T03:29:57.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.561+0000 7ff27f7fe700 1 -- 172.21.15.146:0/4059959987 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff288013770 con 0x7ff2980cb490 2023-05-24T03:29:57.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.561+0000 7ff29d655700 1 -- 172.21.15.146:0/4059959987 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2980cebb0 con 0x7ff2980cb490 2023-05-24T03:29:57.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.561+0000 7ff27f7fe700 1 -- 172.21.15.146:0/4059959987 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff288013ae0 con 0x7ff2980cb490 2023-05-24T03:29:57.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.561+0000 7ff29d655700 1 -- 172.21.15.146:0/4059959987 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff29806cc80 con 0x7ff2980cb490 2023-05-24T03:29:57.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.562+0000 7ff29d655700 1 -- 172.21.15.146:0/4059959987 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2980cee90 con 0x7ff2980cb490 2023-05-24T03:29:57.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.563+0000 7ff27f7fe700 1 -- 172.21.15.146:0/4059959987 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff288013c40 con 0x7ff2980cb490 2023-05-24T03:29:57.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.563+0000 7ff27f7fe700 1 --2- 172.21.15.146:0/4059959987 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7ff28406ace0 0x7ff28406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:57.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.563+0000 7ff27f7fe700 1 -- 172.21.15.146:0/4059959987 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff2880893c0 con 0x7ff2980cb490 2023-05-24T03:29:57.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.563+0000 7ff296ffd700 1 --2- 172.21.15.146:0/4059959987 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7ff28406ace0 0x7ff28406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:57.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.563+0000 7ff296ffd700 1 --2- 172.21.15.146:0/4059959987 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7ff28406ace0 0x7ff28406d190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff28c000f60 tx=0x7ff28c007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:57.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.567+0000 7ff27f7fe700 1 -- 172.21.15.146:0/4059959987 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ff288054210 con 0x7ff2980cb490 2023-05-24T03:29:57.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.756+0000 7ff29d655700 1 -- 172.21.15.146:0/4059959987 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff298068d00 con 0x7ff2980cb490 2023-05-24T03:29:57.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.756+0000 7ff27f7fe700 1 -- 172.21.15.146:0/4059959987 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff288057830 con 0x7ff2980cb490 2023-05-24T03:29:57.761 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2023-05-24T03:29:57.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.758+0000 7ff29d655700 1 -- 172.21.15.146:0/4059959987 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7ff28406ace0 msgr2=0x7ff28406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:57.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.758+0000 7ff29d655700 1 --2- 172.21.15.146:0/4059959987 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7ff28406ace0 0x7ff28406d190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff28c000f60 tx=0x7ff28c007d30 comp rx=0 tx=0).stop 2023-05-24T03:29:57.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.758+0000 7ff29d655700 1 -- 172.21.15.146:0/4059959987 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2980cb490 msgr2=0x7ff298152780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:57.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.758+0000 7ff29d655700 1 --2- 172.21.15.146:0/4059959987 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2980cb490 0x7ff298152780 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff28800e7e0 tx=0x7ff28800eba0 comp rx=0 tx=0).stop 2023-05-24T03:29:57.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.758+0000 7ff29d655700 1 -- 172.21.15.146:0/4059959987 shutdown_connections 2023-05-24T03:29:57.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.758+0000 7ff29d655700 1 --2- 172.21.15.146:0/4059959987 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7ff28406ace0 0x7ff28406d190 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:57.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.758+0000 7ff29d655700 1 --2- 172.21.15.146:0/4059959987 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff298159210 0x7ff2980c8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:57.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.758+0000 7ff29d655700 1 --2- 172.21.15.146:0/4059959987 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff29806c370 0x7ff2980b2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:57.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.758+0000 7ff29d655700 1 --2- 172.21.15.146:0/4059959987 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2980cb490 0x7ff298152780 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:57.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.758+0000 7ff29d655700 1 -- 172.21.15.146:0/4059959987 >> 172.21.15.146:0/4059959987 conn(0x7ff2980b0d90 msgr2=0x7ff2980af9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:57.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.758+0000 7ff29d655700 1 -- 172.21.15.146:0/4059959987 shutdown_connections 2023-05-24T03:29:57.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.758+0000 7ff29d655700 1 -- 172.21.15.146:0/4059959987 wait complete. 2023-05-24T03:29:57.775 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-24T03:29:57.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.894+0000 7fecc1ea1700 1 Processor -- start 2023-05-24T03:29:57.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.894+0000 7fecc1ea1700 1 -- start start 2023-05-24T03:29:57.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.895+0000 7fecc1ea1700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fecbc15cd90 0x7fecbc0cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:57.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.895+0000 7fecc1ea1700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fecbc0aefd0 0x7fecbc160d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:57.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.895+0000 7fecc1ea1700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecbc0cfd00 con 0x7fecbc06a460 2023-05-24T03:29:57.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.895+0000 7fecc1ea1700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecbc072350 con 0x7fecbc15cd90 2023-05-24T03:29:57.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.895+0000 7fecc1ea1700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecbc0cf460 con 0x7fecbc0aefd0 2023-05-24T03:29:57.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.895+0000 7fecbaffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fecbc15cd90 0x7fecbc0cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:57.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.895+0000 7fecbb7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fecbc06a460 0x7fecbc06a830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45512/0 (socket says 172.21.15.146:45512) 2023-05-24T03:29:57.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.895+0000 7fecbb7fe700 1 -- 172.21.15.146:0/2939700358 learned_addr learned my addr 172.21.15.146:0/2939700358 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:29:57.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.895+0000 7fecbbfff700 1 --2- 172.21.15.146:0/2939700358 >> v2:172.21.15.151:3300/0 conn(0x7fecbc0aefd0 0x7fecbc160d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:57.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.896+0000 7fecbaffd700 1 -- 172.21.15.146:0/2939700358 >> v2:172.21.15.151:3300/0 conn(0x7fecbc0aefd0 msgr2=0x7fecbc160d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:57.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.896+0000 7fecbaffd700 1 --2- 172.21.15.146:0/2939700358 >> v2:172.21.15.151:3300/0 conn(0x7fecbc0aefd0 0x7fecbc160d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:57.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.896+0000 7fecbaffd700 1 -- 172.21.15.146:0/2939700358 >> v1:172.21.15.146:6789/0 conn(0x7fecbc06a460 legacy=0x7fecbc06a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:57.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.896+0000 7fecba7fc700 1 -- 172.21.15.146:0/2939700358 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3385769940 0 0) 0x7fecb0001110 con 0x7fecbc06a460 2023-05-24T03:29:57.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.896+0000 7fecbaffd700 1 -- 172.21.15.146:0/2939700358 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecbc0cf740 con 0x7fecbc15cd90 2023-05-24T03:29:57.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.896+0000 7fecbbfff700 1 --2- 172.21.15.146:0/2939700358 >> v2:172.21.15.151:3300/0 conn(0x7fecbc0aefd0 0x7fecbc160d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:29:57.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.896+0000 7fecbaffd700 1 --2- 172.21.15.146:0/2939700358 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecbc15cd90 0x7fecbc0cede0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fecbc06af40 tx=0x7fecac009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc57073019d905f7 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:57.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.896+0000 7fecba7fc700 1 -- 172.21.15.146:0/2939700358 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecac011830 con 0x7fecbc15cd90 2023-05-24T03:29:57.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.896+0000 7fecba7fc700 1 -- 172.21.15.146:0/2939700358 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecac011990 con 0x7fecbc15cd90 2023-05-24T03:29:57.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.896+0000 7fecba7fc700 1 -- 172.21.15.146:0/2939700358 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecac011d20 con 0x7fecbc15cd90 2023-05-24T03:29:57.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.896+0000 7fecc1ea1700 1 -- 172.21.15.146:0/2939700358 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecbc15cd90 msgr2=0x7fecbc0cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:57.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.896+0000 7fecc1ea1700 1 --2- 172.21.15.146:0/2939700358 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecbc15cd90 0x7fecbc0cede0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fecbc06af40 tx=0x7fecac009b20 comp rx=0 tx=0).stop 2023-05-24T03:29:57.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.897+0000 7fecc1ea1700 1 -- 172.21.15.146:0/2939700358 shutdown_connections 2023-05-24T03:29:57.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.897+0000 7fecc1ea1700 1 --2- 172.21.15.146:0/2939700358 >> v2:172.21.15.151:3300/0 conn(0x7fecbc0aefd0 0x7fecbc160d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:57.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.897+0000 7fecc1ea1700 1 --2- 172.21.15.146:0/2939700358 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecbc15cd90 0x7fecbc0cede0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:57.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.897+0000 7fecc1ea1700 1 -- 172.21.15.146:0/2939700358 >> 172.21.15.146:0/2939700358 conn(0x7fecbc0cfea0 msgr2=0x7fecbc0d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:57.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.897+0000 7fecc1ea1700 1 -- 172.21.15.146:0/2939700358 shutdown_connections 2023-05-24T03:29:57.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.897+0000 7fecc1ea1700 1 -- 172.21.15.146:0/2939700358 wait complete. 2023-05-24T03:29:57.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.898+0000 7fecc1ea1700 1 Processor -- start 2023-05-24T03:29:57.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.898+0000 7fecc1ea1700 1 -- start start 2023-05-24T03:29:57.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.899+0000 7fecc1ea1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecbc06a460 0x7fecbc152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:57.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.899+0000 7fecc1ea1700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fecbc0aefd0 0x7fecbc15d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:57.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.899+0000 7fecc1ea1700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fecbc15cd90 0x7fecbc15d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:57.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.899+0000 7fecc1ea1700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecbc153fc0 con 0x7fecbc06a460 2023-05-24T03:29:57.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.899+0000 7fecc1ea1700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecbc154210 con 0x7fecbc15cd90 2023-05-24T03:29:57.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.899+0000 7fecc1ea1700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecbc1544f0 con 0x7fecbc0aefd0 2023-05-24T03:29:57.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.899+0000 7fecbb7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecbc06a460 0x7fecbc152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:57.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.899+0000 7fecbb7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecbc06a460 0x7fecbc152e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39066/0 (socket says 172.21.15.146:39066) 2023-05-24T03:29:57.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.899+0000 7fecbb7fe700 1 -- 172.21.15.146:0/1256213538 learned_addr learned my addr 172.21.15.146:0/1256213538 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:57.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.899+0000 7fecbaffd700 1 --2- 172.21.15.146:0/1256213538 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fecbc0aefd0 0x7fecbc15d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:57.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.899+0000 7fecbbfff700 1 --2- 172.21.15.146:0/1256213538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fecbc15cd90 0x7fecbc15d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:57.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.899+0000 7fecbb7fe700 1 -- 172.21.15.146:0/1256213538 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fecbc0aefd0 msgr2=0x7fecbc15d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:57.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.899+0000 7fecbb7fe700 1 --2- 172.21.15.146:0/1256213538 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fecbc0aefd0 0x7fecbc15d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:57.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.899+0000 7fecbb7fe700 1 -- 172.21.15.146:0/1256213538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fecbc15cd90 msgr2=0x7fecbc15d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:57.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.899+0000 7fecbb7fe700 1 --2- 172.21.15.146:0/1256213538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fecbc15cd90 0x7fecbc15d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:57.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.899+0000 7fecbb7fe700 1 -- 172.21.15.146:0/1256213538 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecac0094a0 con 0x7fecbc06a460 2023-05-24T03:29:57.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.899+0000 7fecbb7fe700 1 --2- 172.21.15.146:0/1256213538 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecbc06a460 0x7fecbc152e00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fecb000c730 tx=0x7fecb000caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:57.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.899+0000 7feca3fff700 1 -- 172.21.15.146:0/1256213538 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb0004c80 con 0x7fecbc06a460 2023-05-24T03:29:57.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.899+0000 7feca3fff700 1 -- 172.21.15.146:0/1256213538 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecb0004e00 con 0x7fecbc06a460 2023-05-24T03:29:57.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.899+0000 7fecc1ea1700 1 -- 172.21.15.146:0/1256213538 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecbc160800 con 0x7fecbc06a460 2023-05-24T03:29:57.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.899+0000 7feca3fff700 1 -- 172.21.15.146:0/1256213538 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb0007310 con 0x7fecbc06a460 2023-05-24T03:29:57.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.899+0000 7fecc1ea1700 1 -- 172.21.15.146:0/1256213538 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecbc0cfa20 con 0x7fecbc06a460 2023-05-24T03:29:57.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.900+0000 7fecc1ea1700 1 -- 172.21.15.146:0/1256213538 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecbc0af620 con 0x7fecbc06a460 2023-05-24T03:29:57.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.901+0000 7feca3fff700 1 -- 172.21.15.146:0/1256213538 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fecb0007470 con 0x7fecbc06a460 2023-05-24T03:29:57.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.901+0000 7feca3fff700 1 --2- 172.21.15.146:0/1256213538 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7feca806ace0 0x7feca806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:57.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.901+0000 7fecbaffd700 1 --2- 172.21.15.146:0/1256213538 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7feca806ace0 0x7feca806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:57.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.901+0000 7feca3fff700 1 -- 172.21.15.146:0/1256213538 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fecb00893d0 con 0x7fecbc06a460 2023-05-24T03:29:57.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.902+0000 7fecbaffd700 1 --2- 172.21.15.146:0/1256213538 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7feca806ace0 0x7feca806d190 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fecac0090b0 tx=0x7fecac01c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:57.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:57.906+0000 7feca3fff700 1 -- 172.21.15.146:0/1256213538 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fecb0054180 con 0x7fecbc06a460 2023-05-24T03:29:58.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.092+0000 7fecc1ea1700 1 -- 172.21.15.146:0/1256213538 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fecbc0cfd00 con 0x7fecbc06a460 2023-05-24T03:29:58.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.093+0000 7feca3fff700 1 -- 172.21.15.146:0/1256213538 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fecbc0cfd00 con 0x7fecbc06a460 2023-05-24T03:29:58.098 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2023-05-24T03:29:58.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.095+0000 7fecc1ea1700 1 -- 172.21.15.146:0/1256213538 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7feca806ace0 msgr2=0x7feca806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:58.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.095+0000 7fecc1ea1700 1 --2- 172.21.15.146:0/1256213538 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7feca806ace0 0x7feca806d190 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fecac0090b0 tx=0x7fecac01c040 comp rx=0 tx=0).stop 2023-05-24T03:29:58.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.095+0000 7fecc1ea1700 1 -- 172.21.15.146:0/1256213538 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecbc06a460 msgr2=0x7fecbc152e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:58.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.095+0000 7fecc1ea1700 1 --2- 172.21.15.146:0/1256213538 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecbc06a460 0x7fecbc152e00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fecb000c730 tx=0x7fecb000caf0 comp rx=0 tx=0).stop 2023-05-24T03:29:58.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.095+0000 7fecc1ea1700 1 -- 172.21.15.146:0/1256213538 shutdown_connections 2023-05-24T03:29:58.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.095+0000 7fecc1ea1700 1 --2- 172.21.15.146:0/1256213538 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7feca806ace0 0x7feca806d190 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:58.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.095+0000 7fecc1ea1700 1 --2- 172.21.15.146:0/1256213538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fecbc15cd90 0x7fecbc15d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:58.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.095+0000 7fecc1ea1700 1 --2- 172.21.15.146:0/1256213538 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecbc06a460 0x7fecbc152e00 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:58.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.095+0000 7fecc1ea1700 1 --2- 172.21.15.146:0/1256213538 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fecbc0aefd0 0x7fecbc15d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:58.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.095+0000 7fecc1ea1700 1 -- 172.21.15.146:0/1256213538 >> 172.21.15.146:0/1256213538 conn(0x7fecbc0cfea0 msgr2=0x7fecbc06d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:58.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.095+0000 7fecc1ea1700 1 -- 172.21.15.146:0/1256213538 shutdown_connections 2023-05-24T03:29:58.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.095+0000 7fecc1ea1700 1 -- 172.21.15.146:0/1256213538 wait complete. 2023-05-24T03:29:58.112 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-24T03:29:58.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.228+0000 7fb118043700 1 Processor -- start 2023-05-24T03:29:58.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.228+0000 7fb118043700 1 -- start start 2023-05-24T03:29:58.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.229+0000 7fb118043700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1100cdf10 0x7fb110159c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:58.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.229+0000 7fb118043700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb11015dcf0 0x7fb1100ce2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:58.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.229+0000 7fb118043700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1100ce820 con 0x7fb110070f50 2023-05-24T03:29:58.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.229+0000 7fb118043700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb11015a1c0 con 0x7fb11015dcf0 2023-05-24T03:29:58.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.229+0000 7fb118043700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb11015a3c0 con 0x7fb1100cdf10 2023-05-24T03:29:58.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.229+0000 7fb1165e0700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb110070f50 0x7fb11006d6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45528/0 (socket says 172.21.15.146:45528) 2023-05-24T03:29:58.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.229+0000 7fb1165e0700 1 -- 172.21.15.146:0/2895986578 learned_addr learned my addr 172.21.15.146:0/2895986578 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:29:58.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.229+0000 7fb115ddf700 1 --2- 172.21.15.146:0/2895986578 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1100cdf10 0x7fb110159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:58.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.229+0000 7fb1155de700 1 --2- 172.21.15.146:0/2895986578 >> v2:172.21.15.151:3300/0 conn(0x7fb11015dcf0 0x7fb1100ce2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:58.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.230+0000 7fb114ddd700 1 -- 172.21.15.146:0/2895986578 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2395406573 0 0) 0x7fb1100ce820 con 0x7fb110070f50 2023-05-24T03:29:58.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.230+0000 7fb114ddd700 1 -- 172.21.15.146:0/2895986578 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0fc0035b0 con 0x7fb110070f50 2023-05-24T03:29:58.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.230+0000 7fb114ddd700 1 -- 172.21.15.146:0/2895986578 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1129461302 0 0) 0x7fb0fc0035b0 con 0x7fb110070f50 2023-05-24T03:29:58.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.230+0000 7fb114ddd700 1 -- 172.21.15.146:0/2895986578 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1100cdf10 msgr2=0x7fb110159c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:58.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.230+0000 7fb114ddd700 1 --2- 172.21.15.146:0/2895986578 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1100cdf10 0x7fb110159c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:58.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.230+0000 7fb114ddd700 1 -- 172.21.15.146:0/2895986578 >> v2:172.21.15.151:3300/0 conn(0x7fb11015dcf0 msgr2=0x7fb1100ce2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:58.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.230+0000 7fb114ddd700 1 --2- 172.21.15.146:0/2895986578 >> v2:172.21.15.151:3300/0 conn(0x7fb11015dcf0 0x7fb1100ce2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:58.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.230+0000 7fb114ddd700 1 -- 172.21.15.146:0/2895986578 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb11015a6a0 con 0x7fb110070f50 2023-05-24T03:29:58.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.230+0000 7fb114ddd700 1 -- 172.21.15.146:0/2895986578 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1301887351 0 0) 0x7fb1080019f0 con 0x7fb110070f50 2023-05-24T03:29:58.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.230+0000 7fb114ddd700 1 -- 172.21.15.146:0/2895986578 >> v1:172.21.15.146:6789/0 conn(0x7fb110070f50 legacy=0x7fb11006d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:58.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.230+0000 7fb114ddd700 1 --2- 172.21.15.146:0/2895986578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0fc003a00 0x7fb0fc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:58.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.230+0000 7fb114ddd700 1 --2- 172.21.15.146:0/2895986578 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0fc004430 0x7fb0fc0048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:58.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.230+0000 7fb114ddd700 1 --2- 172.21.15.146:0/2895986578 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1100cdf10 0x7fb0fc004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:58.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.230+0000 7fb114ddd700 1 -- 172.21.15.146:0/2895986578 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb11015a1c0 con 0x7fb0fc003a00 2023-05-24T03:29:58.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.230+0000 7fb114ddd700 1 -- 172.21.15.146:0/2895986578 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb11015a3c0 con 0x7fb0fc004430 2023-05-24T03:29:58.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.230+0000 7fb114ddd700 1 -- 172.21.15.146:0/2895986578 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc00ba10 con 0x7fb1100cdf10 2023-05-24T03:29:58.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.230+0000 7fb115ddf700 1 --2- 172.21.15.146:0/2895986578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0fc003a00 0x7fb0fc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:58.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.230+0000 7fb1165e0700 1 --2- 172.21.15.146:0/2895986578 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1100cdf10 0x7fb0fc004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:58.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.230+0000 7fb1155de700 1 --2- 172.21.15.146:0/2895986578 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0fc004430 0x7fb0fc0048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:58.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.230+0000 7fb115ddf700 1 -- 172.21.15.146:0/2895986578 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1100cdf10 msgr2=0x7fb0fc004fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:58.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.230+0000 7fb115ddf700 1 --2- 172.21.15.146:0/2895986578 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1100cdf10 0x7fb0fc004fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:58.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.230+0000 7fb115ddf700 1 -- 172.21.15.146:0/2895986578 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0fc004430 msgr2=0x7fb0fc0048f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:29:58.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.230+0000 7fb115ddf700 1 --2- 172.21.15.146:0/2895986578 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0fc004430 0x7fb0fc0048f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:58.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.230+0000 7fb115ddf700 1 -- 172.21.15.146:0/2895986578 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0fc0035b0 con 0x7fb0fc003a00 2023-05-24T03:29:58.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.231+0000 7fb115ddf700 1 --2- 172.21.15.146:0/2895986578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0fc003a00 0x7fb0fc003e10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb100009b60 tx=0x7fb0fc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a34748772cb28c12 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:58.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.231+0000 7fb114ddd700 1 -- 172.21.15.146:0/2895986578 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10000e6c0 con 0x7fb0fc003a00 2023-05-24T03:29:58.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.231+0000 7fb114ddd700 1 -- 172.21.15.146:0/2895986578 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb10000e820 con 0x7fb0fc003a00 2023-05-24T03:29:58.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.231+0000 7fb114ddd700 1 -- 172.21.15.146:0/2895986578 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10000eb90 con 0x7fb0fc003a00 2023-05-24T03:29:58.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.231+0000 7fb118043700 1 -- 172.21.15.146:0/2895986578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0fc003a00 msgr2=0x7fb0fc003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:58.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.231+0000 7fb118043700 1 --2- 172.21.15.146:0/2895986578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0fc003a00 0x7fb0fc003e10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb100009b60 tx=0x7fb0fc005880 comp rx=0 tx=0).stop 2023-05-24T03:29:58.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.231+0000 7fb1165e0700 1 -- 172.21.15.146:0/2895986578 reap_dead start 2023-05-24T03:29:58.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.231+0000 7fb118043700 1 -- 172.21.15.146:0/2895986578 shutdown_connections 2023-05-24T03:29:58.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.231+0000 7fb118043700 1 -- 172.21.15.146:0/2895986578 >> 172.21.15.146:0/2895986578 conn(0x7fb1100cfea0 msgr2=0x7fb1100d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:58.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.231+0000 7fb118043700 1 -- 172.21.15.146:0/2895986578 shutdown_connections 2023-05-24T03:29:58.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.231+0000 7fb118043700 1 -- 172.21.15.146:0/2895986578 wait complete. 2023-05-24T03:29:58.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.233+0000 7fb118043700 1 Processor -- start 2023-05-24T03:29:58.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.233+0000 7fb118043700 1 -- start start 2023-05-24T03:29:58.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.234+0000 7fb118043700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0fc003a00 0x7fb1101ed980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:58.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.234+0000 7fb118043700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1100af900 0x7fb1100c8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:58.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.234+0000 7fb118043700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb1100afd70 0x7fb1100c9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:58.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.234+0000 7fb118043700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1101edec0 con 0x7fb1100af900 2023-05-24T03:29:58.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.234+0000 7fb118043700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1100b0670 con 0x7fb1100afd70 2023-05-24T03:29:58.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.234+0000 7fb118043700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1100c35d0 con 0x7fb0fc003a00 2023-05-24T03:29:58.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.234+0000 7fb1155de700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1100af900 0x7fb1100c8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:58.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.234+0000 7fb1155de700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1100af900 0x7fb1100c8ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39086/0 (socket says 172.21.15.146:39086) 2023-05-24T03:29:58.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.234+0000 7fb1155de700 1 -- 172.21.15.146:0/1784496816 learned_addr learned my addr 172.21.15.146:0/1784496816 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:29:58.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.234+0000 7fb115ddf700 1 --2- 172.21.15.146:0/1784496816 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0fc003a00 0x7fb1101ed980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:58.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.234+0000 7fb1165e0700 1 --2- 172.21.15.146:0/1784496816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb1100afd70 0x7fb1100c9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:58.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.234+0000 7fb1155de700 1 -- 172.21.15.146:0/1784496816 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0fc003a00 msgr2=0x7fb1101ed980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:58.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.234+0000 7fb1155de700 1 --2- 172.21.15.146:0/1784496816 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0fc003a00 0x7fb1101ed980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:58.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.234+0000 7fb1155de700 1 -- 172.21.15.146:0/1784496816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb1100afd70 msgr2=0x7fb1100c9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:58.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.234+0000 7fb1155de700 1 --2- 172.21.15.146:0/1784496816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb1100afd70 0x7fb1100c9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:58.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.234+0000 7fb1155de700 1 -- 172.21.15.146:0/1784496816 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb11015ac60 con 0x7fb1100af900 2023-05-24T03:29:58.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.234+0000 7fb115ddf700 1 --2- 172.21.15.146:0/1784496816 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0fc003a00 0x7fb1101ed980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:29:58.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.234+0000 7fb1165e0700 1 --2- 172.21.15.146:0/1784496816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb1100afd70 0x7fb1100c9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:29:58.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.235+0000 7fb1155de700 1 --2- 172.21.15.146:0/1784496816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1100af900 0x7fb1100c8ef0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb10c011bb0 tx=0x7fb10c011f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:58.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.235+0000 7fb1067fc700 1 -- 172.21.15.146:0/1784496816 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10c016070 con 0x7fb1100af900 2023-05-24T03:29:58.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.235+0000 7fb1067fc700 1 -- 172.21.15.146:0/1784496816 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb10c010d10 con 0x7fb1100af900 2023-05-24T03:29:58.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.235+0000 7fb118043700 1 -- 172.21.15.146:0/1784496816 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb11015a980 con 0x7fb1100af900 2023-05-24T03:29:58.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.235+0000 7fb1067fc700 1 -- 172.21.15.146:0/1784496816 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10c01a610 con 0x7fb1100af900 2023-05-24T03:29:58.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.235+0000 7fb118043700 1 -- 172.21.15.146:0/1784496816 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb11006d190 con 0x7fb1100af900 2023-05-24T03:29:58.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.236+0000 7fb118043700 1 -- 172.21.15.146:0/1784496816 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb11004e810 con 0x7fb1100af900 2023-05-24T03:29:58.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.236+0000 7fb1067fc700 1 -- 172.21.15.146:0/1784496816 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb10c01a770 con 0x7fb1100af900 2023-05-24T03:29:58.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.237+0000 7fb1067fc700 1 --2- 172.21.15.146:0/1784496816 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fb0f406ace0 0x7fb0f406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:29:58.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.237+0000 7fb1067fc700 1 -- 172.21.15.146:0/1784496816 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb10c08bd50 con 0x7fb1100af900 2023-05-24T03:29:58.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.237+0000 7fb115ddf700 1 --2- 172.21.15.146:0/1784496816 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fb0f406ace0 0x7fb0f406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:29:58.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.237+0000 7fb115ddf700 1 --2- 172.21.15.146:0/1784496816 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fb0f406ace0 0x7fb0f406d190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb1100b2a90 tx=0x7fb100008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:29:58.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.241+0000 7fb1067fc700 1 -- 172.21.15.146:0/1784496816 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fb10c056bb0 con 0x7fb1100af900 2023-05-24T03:29:58.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.443+0000 7fb118043700 1 -- 172.21.15.146:0/1784496816 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb1100d0c60 con 0x7fb1100af900 2023-05-24T03:29:58.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.443+0000 7fb1067fc700 1 -- 172.21.15.146:0/1784496816 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb10c01f020 con 0x7fb1100af900 2023-05-24T03:29:58.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.445+0000 7fb118043700 1 -- 172.21.15.146:0/1784496816 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fb0f406ace0 msgr2=0x7fb0f406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:58.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.445+0000 7fb118043700 1 --2- 172.21.15.146:0/1784496816 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fb0f406ace0 0x7fb0f406d190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb1100b2a90 tx=0x7fb100008030 comp rx=0 tx=0).stop 2023-05-24T03:29:58.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.445+0000 7fb118043700 1 -- 172.21.15.146:0/1784496816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1100af900 msgr2=0x7fb1100c8ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:29:58.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.445+0000 7fb118043700 1 --2- 172.21.15.146:0/1784496816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1100af900 0x7fb1100c8ef0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb10c011bb0 tx=0x7fb10c011f70 comp rx=0 tx=0).stop 2023-05-24T03:29:58.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.445+0000 7fb118043700 1 -- 172.21.15.146:0/1784496816 shutdown_connections 2023-05-24T03:29:58.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.445+0000 7fb118043700 1 --2- 172.21.15.146:0/1784496816 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fb0f406ace0 0x7fb0f406d190 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:58.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.445+0000 7fb118043700 1 --2- 172.21.15.146:0/1784496816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb1100afd70 0x7fb1100c9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:58.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.445+0000 7fb118043700 1 --2- 172.21.15.146:0/1784496816 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0fc003a00 0x7fb1101ed980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:58.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.445+0000 7fb118043700 1 --2- 172.21.15.146:0/1784496816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1100af900 0x7fb1100c8ef0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:29:58.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.445+0000 7fb118043700 1 -- 172.21.15.146:0/1784496816 >> 172.21.15.146:0/1784496816 conn(0x7fb1100cfea0 msgr2=0x7fb1101573d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:29:58.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.445+0000 7fb118043700 1 -- 172.21.15.146:0/1784496816 shutdown_connections 2023-05-24T03:29:58.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:29:58.445+0000 7fb118043700 1 -- 172.21.15.146:0/1784496816 wait complete. 2023-05-24T03:29:58.452 INFO:teuthology.orchestra.run.smithi146.stderr:listed 0 entries 2023-05-24T03:29:58.462 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi146.front.sepia.ceph.com... 2023-05-24T03:29:58.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:29:58.462 DEBUG:teuthology.orchestra.run.smithi146:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-05-24T03:29:58.499 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi146.stderr:ceph-fuse[106519]: fuse finished with error 0 and tester_r 0 2023-05-24T03:29:58.500 INFO:teuthology.orchestra.run:waiting for 300 2023-05-24T03:30:04.602 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2023-05-24T03:30:04.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:04.604 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-05-24T03:30:04.706 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-24T03:30:04.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.835+0000 7fb42e960700 1 Processor -- start 2023-05-24T03:30:04.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.836+0000 7fb42e960700 1 -- start start 2023-05-24T03:30:04.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.836+0000 7fb42e960700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb4280b0e90 0x7fb4280ce490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:04.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.836+0000 7fb42e960700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb4280cca60 0x7fb428159cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:04.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.836+0000 7fb42e960700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb42806bf00 con 0x7fb4280b0ac0 2023-05-24T03:30:04.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.836+0000 7fb42e960700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4280c9430 con 0x7fb4280cca60 2023-05-24T03:30:04.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.836+0000 7fb42e960700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4280c9710 con 0x7fb4280b0e90 2023-05-24T03:30:04.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.836+0000 7fb42cefd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb4280cca60 0x7fb428159cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:04.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.836+0000 7fb427fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb4280b0ac0 0x7fb42815d410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45544/0 (socket says 172.21.15.146:45544) 2023-05-24T03:30:04.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.836+0000 7fb427fff700 1 -- 172.21.15.146:0/3091258600 learned_addr learned my addr 172.21.15.146:0/3091258600 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:30:04.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.837+0000 7fb4277fe700 1 --2- 172.21.15.146:0/3091258600 >> v2:172.21.15.151:3300/0 conn(0x7fb4280b0e90 0x7fb4280ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:04.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.837+0000 7fb42cefd700 1 -- 172.21.15.146:0/3091258600 >> v2:172.21.15.151:3300/0 conn(0x7fb4280b0e90 msgr2=0x7fb4280ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:04.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.837+0000 7fb42cefd700 1 --2- 172.21.15.146:0/3091258600 >> v2:172.21.15.151:3300/0 conn(0x7fb4280b0e90 0x7fb4280ce490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:04.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.837+0000 7fb42cefd700 1 -- 172.21.15.146:0/3091258600 >> v1:172.21.15.146:6789/0 conn(0x7fb4280b0ac0 legacy=0x7fb42815d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:04.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.837+0000 7fb42cefd700 1 -- 172.21.15.146:0/3091258600 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4280c99f0 con 0x7fb4280cca60 2023-05-24T03:30:04.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.837+0000 7fb426ffd700 1 -- 172.21.15.146:0/3091258600 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 253148884 0 0) 0x7fb42806bf00 con 0x7fb4280b0ac0 2023-05-24T03:30:04.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.837+0000 7fb4277fe700 1 --2- 172.21.15.146:0/3091258600 >> v2:172.21.15.151:3300/0 conn(0x7fb4280b0e90 0x7fb4280ce490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:30:04.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.837+0000 7fb42cefd700 1 --2- 172.21.15.146:0/3091258600 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4280cca60 0x7fb428159cd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb42806fad0 tx=0x7fb42000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c579c79ee65d2a5d server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:04.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.837+0000 7fb426ffd700 1 -- 172.21.15.146:0/3091258600 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42000e070 con 0x7fb4280cca60 2023-05-24T03:30:04.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.837+0000 7fb426ffd700 1 -- 172.21.15.146:0/3091258600 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb42000bbd0 con 0x7fb4280cca60 2023-05-24T03:30:04.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.837+0000 7fb426ffd700 1 -- 172.21.15.146:0/3091258600 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb420012430 con 0x7fb4280cca60 2023-05-24T03:30:04.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.838+0000 7fb42e960700 1 -- 172.21.15.146:0/3091258600 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4280cca60 msgr2=0x7fb428159cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:04.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.838+0000 7fb42e960700 1 --2- 172.21.15.146:0/3091258600 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4280cca60 0x7fb428159cd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb42806fad0 tx=0x7fb42000b330 comp rx=0 tx=0).stop 2023-05-24T03:30:04.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.838+0000 7fb42e960700 1 -- 172.21.15.146:0/3091258600 shutdown_connections 2023-05-24T03:30:04.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.838+0000 7fb42e960700 1 --2- 172.21.15.146:0/3091258600 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4280cca60 0x7fb428159cd0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:04.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.838+0000 7fb42e960700 1 --2- 172.21.15.146:0/3091258600 >> v2:172.21.15.151:3300/0 conn(0x7fb4280b0e90 0x7fb4280ce490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:04.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.838+0000 7fb42e960700 1 -- 172.21.15.146:0/3091258600 >> 172.21.15.146:0/3091258600 conn(0x7fb42806b0b0 msgr2=0x7fb4280cedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:04.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.838+0000 7fb42e960700 1 -- 172.21.15.146:0/3091258600 shutdown_connections 2023-05-24T03:30:04.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.838+0000 7fb42e960700 1 -- 172.21.15.146:0/3091258600 wait complete. 2023-05-24T03:30:04.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.839+0000 7fb42e960700 1 Processor -- start 2023-05-24T03:30:04.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.839+0000 7fb42e960700 1 -- start start 2023-05-24T03:30:04.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.840+0000 7fb42e960700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4280b0ac0 0x7fb4281550f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:04.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.840+0000 7fb42e960700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4280b0e90 0x7fb428155630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:04.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.840+0000 7fb42e960700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4280cca60 0x7fb428157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:04.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.840+0000 7fb42e960700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb428155f60 con 0x7fb4280b0ac0 2023-05-24T03:30:04.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.840+0000 7fb42e960700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb428158ca0 con 0x7fb4280cca60 2023-05-24T03:30:04.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.840+0000 7fb42e960700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb428158f80 con 0x7fb4280b0e90 2023-05-24T03:30:04.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.840+0000 7fb427fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4280b0ac0 0x7fb4281550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:04.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.840+0000 7fb427fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4280b0ac0 0x7fb4281550f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39098/0 (socket says 172.21.15.146:39098) 2023-05-24T03:30:04.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.840+0000 7fb427fff700 1 -- 172.21.15.146:0/1948917449 learned_addr learned my addr 172.21.15.146:0/1948917449 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:04.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.840+0000 7fb42cefd700 1 --2- 172.21.15.146:0/1948917449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4280cca60 0x7fb428157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:04.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.840+0000 7fb4277fe700 1 --2- 172.21.15.146:0/1948917449 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4280b0e90 0x7fb428155630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:04.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.840+0000 7fb427fff700 1 -- 172.21.15.146:0/1948917449 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4280b0e90 msgr2=0x7fb428155630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:04.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.840+0000 7fb427fff700 1 --2- 172.21.15.146:0/1948917449 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4280b0e90 0x7fb428155630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:04.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.840+0000 7fb427fff700 1 -- 172.21.15.146:0/1948917449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4280cca60 msgr2=0x7fb428157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:04.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.840+0000 7fb427fff700 1 --2- 172.21.15.146:0/1948917449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4280cca60 0x7fb428157ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:04.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.840+0000 7fb427fff700 1 -- 172.21.15.146:0/1948917449 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb420009a70 con 0x7fb4280b0ac0 2023-05-24T03:30:04.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.840+0000 7fb42cefd700 1 --2- 172.21.15.146:0/1948917449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4280cca60 0x7fb428157ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:30:04.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.841+0000 7fb427fff700 1 --2- 172.21.15.146:0/1948917449 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4280b0ac0 0x7fb4281550f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb41800c550 tx=0x7fb41800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:04.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.841+0000 7fb424ff9700 1 -- 172.21.15.146:0/1948917449 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb418004c80 con 0x7fb4280b0ac0 2023-05-24T03:30:04.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.841+0000 7fb424ff9700 1 -- 172.21.15.146:0/1948917449 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb418004e00 con 0x7fb4280b0ac0 2023-05-24T03:30:04.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.841+0000 7fb42e960700 1 -- 172.21.15.146:0/1948917449 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4280cea70 con 0x7fb4280b0ac0 2023-05-24T03:30:04.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.841+0000 7fb424ff9700 1 -- 172.21.15.146:0/1948917449 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb418007310 con 0x7fb4280b0ac0 2023-05-24T03:30:04.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.841+0000 7fb42e960700 1 -- 172.21.15.146:0/1948917449 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb42815a210 con 0x7fb4280b0ac0 2023-05-24T03:30:04.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.842+0000 7fb42e960700 1 -- 172.21.15.146:0/1948917449 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4280cce60 con 0x7fb4280b0ac0 2023-05-24T03:30:04.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.842+0000 7fb424ff9700 1 -- 172.21.15.146:0/1948917449 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb418007470 con 0x7fb4280b0ac0 2023-05-24T03:30:04.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.843+0000 7fb424ff9700 1 --2- 172.21.15.146:0/1948917449 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fb40806ace0 0x7fb40806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:04.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.843+0000 7fb4277fe700 1 --2- 172.21.15.146:0/1948917449 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fb40806ace0 0x7fb40806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:04.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.843+0000 7fb424ff9700 1 -- 172.21.15.146:0/1948917449 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb4180894b0 con 0x7fb4280b0ac0 2023-05-24T03:30:04.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.843+0000 7fb4277fe700 1 --2- 172.21.15.146:0/1948917449 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fb40806ace0 0x7fb40806d190 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb4280cd4b0 tx=0x7fb410008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:04.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:04.847+0000 7fb424ff9700 1 -- 172.21.15.146:0/1948917449 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fb418054270 con 0x7fb4280b0ac0 2023-05-24T03:30:05.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.037+0000 7fb42e960700 1 -- 172.21.15.146:0/1948917449 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb42804e810 con 0x7fb4280b0ac0 2023-05-24T03:30:05.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.038+0000 7fb424ff9700 1 -- 172.21.15.146:0/1948917449 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20156 (secure 0 0 0) 0x7fb418057890 con 0x7fb4280b0ac0 2023-05-24T03:30:05.044 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:30:05.044 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":28,"fsid":"11ca0adb-7672-4713-bde7-451e8b743ae9","created":"2023-05-24T03:29:19.113659+0000","modified":"2023-05-24T03:29:48.912599+0000","last_up_change":"2023-05-24T03:29:30.962339+0000","last_in_change":"2023-05-24T03:29:21.706540+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-24T03:29:32.749984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-24T03:29:37.719623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-24T03:29:42.165379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-24T03:29:43.431615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-24T03:29:46.503075+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f24b319b-fcc8-4385-b0cb-78138fc31417","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6801","nonce":3353593100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6803","nonce":3353593100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6807","nonce":3353593100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6805","nonce":3353593100}]},"public_addr":"172.21.15.146:6801/3353593100","cluster_addr":"172.21.15.146:6803/3353593100","heartbeat_back_addr":"172.21.15.146:6807/3353593100","heartbeat_front_addr":"172.21.15.146:6805/3353593100","state":["exists","up"]},{"osd":1,"uuid":"c9639ea9-8f9b-498e-92c8-aa976edbf1da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6821","nonce":2537488734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6825","nonce":2537488734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6831","nonce":2537488734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6827","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6829","nonce":2537488734}]},"public_addr":"172.21.15.146:6821/2537488734","cluster_addr":"172.21.15.146:6825/2537488734","heartbeat_back_addr":"172.21.15.146:6831/2537488734","heartbeat_front_addr":"172.21.15.146:6829/2537488734","state":["exists","up"]},{"osd":2,"uuid":"7a6cfc6d-b0ca-4cb6-a66d-4001ec184657","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6809","nonce":1800242932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6811","nonce":1800242932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6815","nonce":1800242932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6813","nonce":1800242932}]},"public_addr":"172.21.15.146:6809/1800242932","cluster_addr":"172.21.15.146:6811/1800242932","heartbeat_back_addr":"172.21.15.146:6815/1800242932","heartbeat_front_addr":"172.21.15.146:6813/1800242932","state":["exists","up"]},{"osd":3,"uuid":"401509f7-cecd-44a2-b0ae-22c81a5d93c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6817","nonce":1749783580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6820","nonce":1749783580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6828","nonce":1749783580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6824","nonce":1749783580}]},"public_addr":"172.21.15.146:6817/1749783580","cluster_addr":"172.21.15.146:6820/1749783580","heartbeat_back_addr":"172.21.15.146:6828/1749783580","heartbeat_front_addr":"172.21.15.146:6824/1749783580","state":["exists","up"]},{"osd":4,"uuid":"9d07f440-d125-4f99-a825-411fab894d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6811","nonce":163453435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6814","nonce":163453435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6819","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6821","nonce":163453435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6818","nonce":163453435}]},"public_addr":"172.21.15.151:6811/163453435","cluster_addr":"172.21.15.151:6814/163453435","heartbeat_back_addr":"172.21.15.151:6821/163453435","heartbeat_front_addr":"172.21.15.151:6818/163453435","state":["exists","up"]},{"osd":5,"uuid":"9b2266e2-9e52-4f0e-96da-e703a6c23a6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6801","nonce":3283474903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6803","nonce":3283474903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6807","nonce":3283474903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6805","nonce":3283474903}]},"public_addr":"172.21.15.151:6801/3283474903","cluster_addr":"172.21.15.151:6803/3283474903","heartbeat_back_addr":"172.21.15.151:6807/3283474903","heartbeat_front_addr":"172.21.15.151:6805/3283474903","state":["exists","up"]},{"osd":6,"uuid":"5daedf77-0a83-49e7-b497-d9ed10436972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6825","nonce":3889424178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6827","nonce":3889424178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6831","nonce":3889424178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6829","nonce":3889424178}]},"public_addr":"172.21.15.151:6825/3889424178","cluster_addr":"172.21.15.151:6827/3889424178","heartbeat_back_addr":"172.21.15.151:6831/3889424178","heartbeat_front_addr":"172.21.15.151:6829/3889424178","state":["exists","up"]},{"osd":7,"uuid":"86ae4f7e-c01f-4c3d-a0dd-98160c209309","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6810","nonce":563291208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6815","nonce":563291208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6823","nonce":563291208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6820","nonce":563291208}]},"public_addr":"172.21.15.151:6810/563291208","cluster_addr":"172.21.15.151:6815/563291208","heartbeat_back_addr":"172.21.15.151:6823/563291208","heartbeat_front_addr":"172.21.15.151:6820/563291208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.872472+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.937126+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.877234+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.884793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.881632+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.938293+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.857661+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.945883+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-24T03:30:05.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.040+0000 7fb42e960700 1 -- 172.21.15.146:0/1948917449 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fb40806ace0 msgr2=0x7fb40806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:05.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.040+0000 7fb42e960700 1 --2- 172.21.15.146:0/1948917449 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fb40806ace0 0x7fb40806d190 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb4280cd4b0 tx=0x7fb410008040 comp rx=0 tx=0).stop 2023-05-24T03:30:05.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.040+0000 7fb42e960700 1 -- 172.21.15.146:0/1948917449 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4280b0ac0 msgr2=0x7fb4281550f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:05.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.040+0000 7fb42e960700 1 --2- 172.21.15.146:0/1948917449 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4280b0ac0 0x7fb4281550f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb41800c550 tx=0x7fb41800c910 comp rx=0 tx=0).stop 2023-05-24T03:30:05.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.040+0000 7fb42e960700 1 -- 172.21.15.146:0/1948917449 shutdown_connections 2023-05-24T03:30:05.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.040+0000 7fb42e960700 1 --2- 172.21.15.146:0/1948917449 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fb40806ace0 0x7fb40806d190 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:05.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.040+0000 7fb42e960700 1 --2- 172.21.15.146:0/1948917449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4280cca60 0x7fb428157ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:05.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.040+0000 7fb42e960700 1 --2- 172.21.15.146:0/1948917449 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4280b0ac0 0x7fb4281550f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:05.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.040+0000 7fb42e960700 1 --2- 172.21.15.146:0/1948917449 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4280b0e90 0x7fb428155630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:05.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.040+0000 7fb42e960700 1 -- 172.21.15.146:0/1948917449 >> 172.21.15.146:0/1948917449 conn(0x7fb42806b0b0 msgr2=0x7fb428070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:05.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.040+0000 7fb42e960700 1 -- 172.21.15.146:0/1948917449 shutdown_connections 2023-05-24T03:30:05.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.040+0000 7fb42e960700 1 -- 172.21.15.146:0/1948917449 wait complete. 2023-05-24T03:30:05.058 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-24T03:30:05.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.176+0000 7fee15bec700 1 Processor -- start 2023-05-24T03:30:05.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.177+0000 7fee15bec700 1 -- start start 2023-05-24T03:30:05.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.177+0000 7fee15bec700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee10071f30 0x7fee100ca900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:05.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.177+0000 7fee15bec700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee100b20b0 con 0x7fee100ca460 2023-05-24T03:30:05.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.177+0000 7fee15bec700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee101602f0 con 0x7fee1015ff20 2023-05-24T03:30:05.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.177+0000 7fee15bec700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee100cd090 con 0x7fee10071f30 2023-05-24T03:30:05.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.177+0000 7fee0effd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fee100ca460 0x7fee10071820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45560/0 (socket says 172.21.15.146:45560) 2023-05-24T03:30:05.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.177+0000 7fee0effd700 1 -- 172.21.15.146:0/3134327577 learned_addr learned my addr 172.21.15.146:0/3134327577 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:30:05.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.178+0000 7fee0ffff700 1 --2- 172.21.15.146:0/3134327577 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee10071f30 0x7fee100ca900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:05.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.178+0000 7fee0e7fc700 1 -- 172.21.15.146:0/3134327577 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2836435377 0 0) 0x7fee100b20b0 con 0x7fee100ca460 2023-05-24T03:30:05.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.178+0000 7fee0e7fc700 1 -- 172.21.15.146:0/3134327577 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedfc0035b0 con 0x7fee100ca460 2023-05-24T03:30:05.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.178+0000 7fee0e7fc700 1 -- 172.21.15.146:0/3134327577 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2537463463 0 0) 0x7fee101602f0 con 0x7fee1015ff20 2023-05-24T03:30:05.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.178+0000 7fee0e7fc700 1 -- 172.21.15.146:0/3134327577 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee100b20b0 con 0x7fee1015ff20 2023-05-24T03:30:05.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.178+0000 7fee0e7fc700 1 -- 172.21.15.146:0/3134327577 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2131781763 0 0) 0x7fedfc0035b0 con 0x7fee100ca460 2023-05-24T03:30:05.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.178+0000 7fee0e7fc700 1 -- 172.21.15.146:0/3134327577 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee10071f30 msgr2=0x7fee100ca900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:05.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.178+0000 7fee0e7fc700 1 --2- 172.21.15.146:0/3134327577 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee10071f30 0x7fee100ca900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:05.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.178+0000 7fee0e7fc700 1 -- 172.21.15.146:0/3134327577 >> v1:172.21.15.151:6789/0 conn(0x7fee1015ff20 legacy=0x7fee1006dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:05.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.178+0000 7fee0e7fc700 1 -- 172.21.15.146:0/3134327577 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee100cd370 con 0x7fee100ca460 2023-05-24T03:30:05.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.178+0000 7fee0e7fc700 1 -- 172.21.15.146:0/3134327577 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1301887351 0 0) 0x7fedf8001670 con 0x7fee100ca460 2023-05-24T03:30:05.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.178+0000 7fee0e7fc700 1 -- 172.21.15.146:0/3134327577 >> v1:172.21.15.146:6789/0 conn(0x7fee100ca460 legacy=0x7fee10071820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:05.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.178+0000 7fee0e7fc700 1 --2- 172.21.15.146:0/3134327577 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fedfc003bc0 0x7fedfc003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:05.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.178+0000 7fee0e7fc700 1 --2- 172.21.15.146:0/3134327577 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee10071f30 0x7fedfc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:05.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.178+0000 7fee0e7fc700 1 --2- 172.21.15.146:0/3134327577 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fedfc004d90 0x7fedfc005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:05.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.178+0000 7fee0e7fc700 1 -- 172.21.15.146:0/3134327577 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee100cd090 con 0x7fedfc004d90 2023-05-24T03:30:05.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.178+0000 7fee0e7fc700 1 -- 172.21.15.146:0/3134327577 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedfc00bac0 con 0x7fedfc003bc0 2023-05-24T03:30:05.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.178+0000 7fee0e7fc700 1 -- 172.21.15.146:0/3134327577 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedfc00bc30 con 0x7fee10071f30 2023-05-24T03:30:05.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.178+0000 7fee0ffff700 1 --2- 172.21.15.146:0/3134327577 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fedfc004d90 0x7fedfc005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:05.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.178+0000 7fee0effd700 1 --2- 172.21.15.146:0/3134327577 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee10071f30 0x7fedfc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:05.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.178+0000 7fee0f7fe700 1 --2- 172.21.15.146:0/3134327577 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fedfc003bc0 0x7fedfc003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:05.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.178+0000 7fee0ffff700 1 -- 172.21.15.146:0/3134327577 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee10071f30 msgr2=0x7fedfc004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:05.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.178+0000 7fee0ffff700 1 --2- 172.21.15.146:0/3134327577 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee10071f30 0x7fedfc004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:05.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.178+0000 7fee0ffff700 1 -- 172.21.15.146:0/3134327577 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fedfc003bc0 msgr2=0x7fedfc003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:05.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.178+0000 7fee0ffff700 1 --2- 172.21.15.146:0/3134327577 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fedfc003bc0 0x7fedfc003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:05.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.178+0000 7fee0ffff700 1 -- 172.21.15.146:0/3134327577 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedfc0035b0 con 0x7fedfc004d90 2023-05-24T03:30:05.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.179+0000 7fee0ffff700 1 --2- 172.21.15.146:0/3134327577 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fedfc004d90 0x7fedfc005200 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fee08009fc0 tx=0x7fedfc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db074530888542ad server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:05.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.179+0000 7fee0e7fc700 1 -- 172.21.15.146:0/3134327577 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0800ebd0 con 0x7fedfc004d90 2023-05-24T03:30:05.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.179+0000 7fee0e7fc700 1 -- 172.21.15.146:0/3134327577 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee0800f040 con 0x7fedfc004d90 2023-05-24T03:30:05.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.179+0000 7fee0e7fc700 1 -- 172.21.15.146:0/3134327577 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee08014480 con 0x7fedfc004d90 2023-05-24T03:30:05.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.179+0000 7fee15bec700 1 -- 172.21.15.146:0/3134327577 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fedfc004d90 msgr2=0x7fedfc005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:05.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.179+0000 7fee15bec700 1 --2- 172.21.15.146:0/3134327577 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fedfc004d90 0x7fedfc005200 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fee08009fc0 tx=0x7fedfc005880 comp rx=0 tx=0).stop 2023-05-24T03:30:05.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.179+0000 7fee0ffff700 1 -- 172.21.15.146:0/3134327577 reap_dead start 2023-05-24T03:30:05.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.179+0000 7fee15bec700 1 -- 172.21.15.146:0/3134327577 shutdown_connections 2023-05-24T03:30:05.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.179+0000 7fee15bec700 1 -- 172.21.15.146:0/3134327577 >> 172.21.15.146:0/3134327577 conn(0x7fee1006ebf0 msgr2=0x7fee1006eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:05.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.179+0000 7fee15bec700 1 -- 172.21.15.146:0/3134327577 shutdown_connections 2023-05-24T03:30:05.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.179+0000 7fee15bec700 1 -- 172.21.15.146:0/3134327577 wait complete. 2023-05-24T03:30:05.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.180+0000 7fee15bec700 1 Processor -- start 2023-05-24T03:30:05.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.181+0000 7fee15bec700 1 -- start start 2023-05-24T03:30:05.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.181+0000 7fee15bec700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee101522f0 0x7fee101565a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:05.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.181+0000 7fee15bec700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee100c9560 0x7fee100b4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:05.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.181+0000 7fee15bec700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee100b4e50 0x7fee100b52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:05.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.181+0000 7fee15bec700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee100b44f0 con 0x7fee100b4e50 2023-05-24T03:30:05.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.181+0000 7fee15bec700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee100c9e20 con 0x7fee100c9560 2023-05-24T03:30:05.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.181+0000 7fee15bec700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee100b3b50 con 0x7fee101522f0 2023-05-24T03:30:05.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.182+0000 7fee0ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee100b4e50 0x7fee100b52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:05.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.182+0000 7fee0ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee100b4e50 0x7fee100b52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39122/0 (socket says 172.21.15.146:39122) 2023-05-24T03:30:05.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.182+0000 7fee0ffff700 1 -- 172.21.15.146:0/3043084945 learned_addr learned my addr 172.21.15.146:0/3043084945 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:05.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.182+0000 7fee0f7fe700 1 --2- 172.21.15.146:0/3043084945 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee101522f0 0x7fee101565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:05.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.182+0000 7fee0effd700 1 --2- 172.21.15.146:0/3043084945 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee100c9560 0x7fee100b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:05.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.182+0000 7fee0ffff700 1 -- 172.21.15.146:0/3043084945 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee101522f0 msgr2=0x7fee101565a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:05.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.182+0000 7fee0ffff700 1 --2- 172.21.15.146:0/3043084945 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee101522f0 0x7fee101565a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:05.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.182+0000 7fee0ffff700 1 -- 172.21.15.146:0/3043084945 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee100c9560 msgr2=0x7fee100b4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:05.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.182+0000 7fee0ffff700 1 --2- 172.21.15.146:0/3043084945 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee100c9560 0x7fee100b4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:05.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.182+0000 7fee0ffff700 1 -- 172.21.15.146:0/3043084945 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee1006d3d0 con 0x7fee100b4e50 2023-05-24T03:30:05.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.182+0000 7fee0ffff700 1 --2- 172.21.15.146:0/3043084945 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee100b4e50 0x7fee100b52c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fee08009f90 tx=0x7fee08009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:05.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.182+0000 7fee07fff700 1 -- 172.21.15.146:0/3043084945 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee08007000 con 0x7fee100b4e50 2023-05-24T03:30:05.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.182+0000 7fee07fff700 1 -- 172.21.15.146:0/3043084945 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee08022070 con 0x7fee100b4e50 2023-05-24T03:30:05.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.182+0000 7fee15bec700 1 -- 172.21.15.146:0/3043084945 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee1006d0f0 con 0x7fee100b4e50 2023-05-24T03:30:05.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.182+0000 7fee07fff700 1 -- 172.21.15.146:0/3043084945 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee08029480 con 0x7fee100b4e50 2023-05-24T03:30:05.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.182+0000 7fee15bec700 1 -- 172.21.15.146:0/3043084945 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee1006d6b0 con 0x7fee100b4e50 2023-05-24T03:30:05.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.183+0000 7fee15bec700 1 -- 172.21.15.146:0/3043084945 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee1004e810 con 0x7fee100b4e50 2023-05-24T03:30:05.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.184+0000 7fee07fff700 1 -- 172.21.15.146:0/3043084945 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fee0801e430 con 0x7fee100b4e50 2023-05-24T03:30:05.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.184+0000 7fee07fff700 1 --2- 172.21.15.146:0/3043084945 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fedf006ace0 0x7fedf006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:05.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.184+0000 7fee07fff700 1 -- 172.21.15.146:0/3043084945 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fee08024070 con 0x7fee100b4e50 2023-05-24T03:30:05.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.184+0000 7fee0f7fe700 1 --2- 172.21.15.146:0/3043084945 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fedf006ace0 0x7fedf006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:05.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.185+0000 7fee0f7fe700 1 --2- 172.21.15.146:0/3043084945 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fedf006ace0 0x7fedf006d190 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fee00007fd0 tx=0x7fee00009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:05.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.189+0000 7fee07fff700 1 -- 172.21.15.146:0/3043084945 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fee08056040 con 0x7fee100b4e50 2023-05-24T03:30:05.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.379+0000 7fee15bec700 1 -- 172.21.15.146:0/3043084945 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee100cadc0 con 0x7fee100b4e50 2023-05-24T03:30:05.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.380+0000 7fee07fff700 1 -- 172.21.15.146:0/3043084945 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20156 (secure 0 0 0) 0x7fee08059660 con 0x7fee100b4e50 2023-05-24T03:30:05.386 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:30:05.386 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":28,"fsid":"11ca0adb-7672-4713-bde7-451e8b743ae9","created":"2023-05-24T03:29:19.113659+0000","modified":"2023-05-24T03:29:48.912599+0000","last_up_change":"2023-05-24T03:29:30.962339+0000","last_in_change":"2023-05-24T03:29:21.706540+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-24T03:29:32.749984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-24T03:29:37.719623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-24T03:29:42.165379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-24T03:29:43.431615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-24T03:29:46.503075+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f24b319b-fcc8-4385-b0cb-78138fc31417","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6801","nonce":3353593100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6803","nonce":3353593100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6807","nonce":3353593100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6805","nonce":3353593100}]},"public_addr":"172.21.15.146:6801/3353593100","cluster_addr":"172.21.15.146:6803/3353593100","heartbeat_back_addr":"172.21.15.146:6807/3353593100","heartbeat_front_addr":"172.21.15.146:6805/3353593100","state":["exists","up"]},{"osd":1,"uuid":"c9639ea9-8f9b-498e-92c8-aa976edbf1da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6821","nonce":2537488734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6825","nonce":2537488734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6831","nonce":2537488734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6827","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6829","nonce":2537488734}]},"public_addr":"172.21.15.146:6821/2537488734","cluster_addr":"172.21.15.146:6825/2537488734","heartbeat_back_addr":"172.21.15.146:6831/2537488734","heartbeat_front_addr":"172.21.15.146:6829/2537488734","state":["exists","up"]},{"osd":2,"uuid":"7a6cfc6d-b0ca-4cb6-a66d-4001ec184657","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6809","nonce":1800242932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6811","nonce":1800242932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6815","nonce":1800242932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6813","nonce":1800242932}]},"public_addr":"172.21.15.146:6809/1800242932","cluster_addr":"172.21.15.146:6811/1800242932","heartbeat_back_addr":"172.21.15.146:6815/1800242932","heartbeat_front_addr":"172.21.15.146:6813/1800242932","state":["exists","up"]},{"osd":3,"uuid":"401509f7-cecd-44a2-b0ae-22c81a5d93c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6817","nonce":1749783580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6820","nonce":1749783580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6828","nonce":1749783580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6824","nonce":1749783580}]},"public_addr":"172.21.15.146:6817/1749783580","cluster_addr":"172.21.15.146:6820/1749783580","heartbeat_back_addr":"172.21.15.146:6828/1749783580","heartbeat_front_addr":"172.21.15.146:6824/1749783580","state":["exists","up"]},{"osd":4,"uuid":"9d07f440-d125-4f99-a825-411fab894d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6811","nonce":163453435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6814","nonce":163453435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6819","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6821","nonce":163453435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6818","nonce":163453435}]},"public_addr":"172.21.15.151:6811/163453435","cluster_addr":"172.21.15.151:6814/163453435","heartbeat_back_addr":"172.21.15.151:6821/163453435","heartbeat_front_addr":"172.21.15.151:6818/163453435","state":["exists","up"]},{"osd":5,"uuid":"9b2266e2-9e52-4f0e-96da-e703a6c23a6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6801","nonce":3283474903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6803","nonce":3283474903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6807","nonce":3283474903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6805","nonce":3283474903}]},"public_addr":"172.21.15.151:6801/3283474903","cluster_addr":"172.21.15.151:6803/3283474903","heartbeat_back_addr":"172.21.15.151:6807/3283474903","heartbeat_front_addr":"172.21.15.151:6805/3283474903","state":["exists","up"]},{"osd":6,"uuid":"5daedf77-0a83-49e7-b497-d9ed10436972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6825","nonce":3889424178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6827","nonce":3889424178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6831","nonce":3889424178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6829","nonce":3889424178}]},"public_addr":"172.21.15.151:6825/3889424178","cluster_addr":"172.21.15.151:6827/3889424178","heartbeat_back_addr":"172.21.15.151:6831/3889424178","heartbeat_front_addr":"172.21.15.151:6829/3889424178","state":["exists","up"]},{"osd":7,"uuid":"86ae4f7e-c01f-4c3d-a0dd-98160c209309","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6810","nonce":563291208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6815","nonce":563291208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6823","nonce":563291208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6820","nonce":563291208}]},"public_addr":"172.21.15.151:6810/563291208","cluster_addr":"172.21.15.151:6815/563291208","heartbeat_back_addr":"172.21.15.151:6823/563291208","heartbeat_front_addr":"172.21.15.151:6820/563291208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.872472+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.937126+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.877234+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.884793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.881632+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.938293+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.857661+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.945883+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-24T03:30:05.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.383+0000 7fee15bec700 1 -- 172.21.15.146:0/3043084945 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fedf006ace0 msgr2=0x7fedf006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:05.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.383+0000 7fee15bec700 1 --2- 172.21.15.146:0/3043084945 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fedf006ace0 0x7fedf006d190 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fee00007fd0 tx=0x7fee00009040 comp rx=0 tx=0).stop 2023-05-24T03:30:05.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.383+0000 7fee15bec700 1 -- 172.21.15.146:0/3043084945 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee100b4e50 msgr2=0x7fee100b52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:05.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.383+0000 7fee15bec700 1 --2- 172.21.15.146:0/3043084945 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee100b4e50 0x7fee100b52c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fee08009f90 tx=0x7fee08009750 comp rx=0 tx=0).stop 2023-05-24T03:30:05.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.383+0000 7fee15bec700 1 -- 172.21.15.146:0/3043084945 shutdown_connections 2023-05-24T03:30:05.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.383+0000 7fee15bec700 1 --2- 172.21.15.146:0/3043084945 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fedf006ace0 0x7fedf006d190 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:05.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.383+0000 7fee15bec700 1 --2- 172.21.15.146:0/3043084945 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee100b4e50 0x7fee100b52c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:05.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.383+0000 7fee15bec700 1 --2- 172.21.15.146:0/3043084945 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee101522f0 0x7fee101565a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:05.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.383+0000 7fee15bec700 1 --2- 172.21.15.146:0/3043084945 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee100c9560 0x7fee100b4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:05.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.383+0000 7fee15bec700 1 -- 172.21.15.146:0/3043084945 >> 172.21.15.146:0/3043084945 conn(0x7fee1006ebf0 msgr2=0x7fee100cc210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:05.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.383+0000 7fee15bec700 1 -- 172.21.15.146:0/3043084945 shutdown_connections 2023-05-24T03:30:05.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.383+0000 7fee15bec700 1 -- 172.21.15.146:0/3043084945 wait complete. 2023-05-24T03:30:05.400 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-05-24T03:30:05.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.519+0000 7f9ac91ff700 1 Processor -- start 2023-05-24T03:30:05.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.519+0000 7f9ac91ff700 1 -- start start 2023-05-24T03:30:05.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.520+0000 7f9ac91ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9ac415cd90 0x7f9ac40cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:05.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.520+0000 7f9ac91ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ac40aefd0 0x7f9ac4160d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:05.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.520+0000 7f9ac91ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ac40cfd00 con 0x7f9ac406a460 2023-05-24T03:30:05.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.520+0000 7f9ac91ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ac4072350 con 0x7f9ac415cd90 2023-05-24T03:30:05.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.520+0000 7f9ac91ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac40cf460 con 0x7f9ac40aefd0 2023-05-24T03:30:05.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.520+0000 7f9ac2d9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f9ac406a460 0x7f9ac406a830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45578/0 (socket says 172.21.15.146:45578) 2023-05-24T03:30:05.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.520+0000 7f9ac2d9d700 1 -- 172.21.15.146:0/3468634874 learned_addr learned my addr 172.21.15.146:0/3468634874 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:30:05.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.520+0000 7f9aba59c700 1 --2- 172.21.15.146:0/3468634874 >> v2:172.21.15.146:3300/0 conn(0x7f9ac415cd90 0x7f9ac40cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:05.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.520+0000 7f9ac359e700 1 --2- 172.21.15.146:0/3468634874 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ac40aefd0 0x7f9ac4160d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:05.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.520+0000 7f9ac259c700 1 -- 172.21.15.146:0/3468634874 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2084424708 0 0) 0x7f9ab4001110 con 0x7f9ac406a460 2023-05-24T03:30:05.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.520+0000 7f9ac259c700 1 -- 172.21.15.146:0/3468634874 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ab00035b0 con 0x7f9ac406a460 2023-05-24T03:30:05.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.520+0000 7f9aba59c700 1 -- 172.21.15.146:0/3468634874 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ac40aefd0 msgr2=0x7f9ac4160d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:05.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.520+0000 7f9aba59c700 1 --2- 172.21.15.146:0/3468634874 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ac40aefd0 0x7f9ac4160d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:05.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.520+0000 7f9aba59c700 1 -- 172.21.15.146:0/3468634874 >> v1:172.21.15.146:6789/0 conn(0x7f9ac406a460 legacy=0x7f9ac406a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:05.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.520+0000 7f9aba59c700 1 -- 172.21.15.146:0/3468634874 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac40cf740 con 0x7f9ac415cd90 2023-05-24T03:30:05.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.520+0000 7f9aba59c700 1 --2- 172.21.15.146:0/3468634874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ac415cd90 0x7f9ac40cede0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9aac009840 tx=0x7f9aac009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9d2bd1f4db53987 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:05.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.520+0000 7f9ac259c700 1 -- 172.21.15.146:0/3468634874 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aac011830 con 0x7f9ac415cd90 2023-05-24T03:30:05.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.520+0000 7f9ac259c700 1 -- 172.21.15.146:0/3468634874 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aac011990 con 0x7f9ac415cd90 2023-05-24T03:30:05.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.520+0000 7f9ac259c700 1 -- 172.21.15.146:0/3468634874 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aac011d20 con 0x7f9ac415cd90 2023-05-24T03:30:05.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.521+0000 7f9ac91ff700 1 -- 172.21.15.146:0/3468634874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ac415cd90 msgr2=0x7f9ac40cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:05.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.521+0000 7f9ac91ff700 1 --2- 172.21.15.146:0/3468634874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ac415cd90 0x7f9ac40cede0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9aac009840 tx=0x7f9aac009b50 comp rx=0 tx=0).stop 2023-05-24T03:30:05.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.521+0000 7f9ac91ff700 1 -- 172.21.15.146:0/3468634874 shutdown_connections 2023-05-24T03:30:05.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.521+0000 7f9ac91ff700 1 --2- 172.21.15.146:0/3468634874 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ac40aefd0 0x7f9ac4160d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:05.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.521+0000 7f9ac91ff700 1 --2- 172.21.15.146:0/3468634874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ac415cd90 0x7f9ac40cede0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:05.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.521+0000 7f9ac91ff700 1 -- 172.21.15.146:0/3468634874 >> 172.21.15.146:0/3468634874 conn(0x7f9ac40cfea0 msgr2=0x7f9ac40d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:05.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.521+0000 7f9ac91ff700 1 -- 172.21.15.146:0/3468634874 shutdown_connections 2023-05-24T03:30:05.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.521+0000 7f9ac91ff700 1 -- 172.21.15.146:0/3468634874 wait complete. 2023-05-24T03:30:05.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.522+0000 7f9ac91ff700 1 Processor -- start 2023-05-24T03:30:05.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.523+0000 7f9ac91ff700 1 -- start start 2023-05-24T03:30:05.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.523+0000 7f9ac91ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ac406a460 0x7f9ac414f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:05.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.523+0000 7f9ac91ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ac40aefd0 0x7f9ac415f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:05.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.523+0000 7f9ac91ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ac415cd90 0x7f9ac40b2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:05.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.523+0000 7f9ac91ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac415bc10 con 0x7f9ac406a460 2023-05-24T03:30:05.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.523+0000 7f9ac91ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac40b27d0 con 0x7f9ac40aefd0 2023-05-24T03:30:05.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.523+0000 7f9ac91ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac40b2210 con 0x7f9ac415cd90 2023-05-24T03:30:05.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.523+0000 7f9ac2d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ac406a460 0x7f9ac414f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:05.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.523+0000 7f9ac2d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ac406a460 0x7f9ac414f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39132/0 (socket says 172.21.15.146:39132) 2023-05-24T03:30:05.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.523+0000 7f9ac2d9d700 1 -- 172.21.15.146:0/550746303 learned_addr learned my addr 172.21.15.146:0/550746303 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:05.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.524+0000 7f9ac359e700 1 --2- 172.21.15.146:0/550746303 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ac415cd90 0x7f9ac40b2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:05.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.524+0000 7f9aba59c700 1 --2- 172.21.15.146:0/550746303 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ac40aefd0 0x7f9ac415f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:05.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.524+0000 7f9ac2d9d700 1 -- 172.21.15.146:0/550746303 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ac415cd90 msgr2=0x7f9ac40b2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:05.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.524+0000 7f9ac2d9d700 1 --2- 172.21.15.146:0/550746303 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ac415cd90 0x7f9ac40b2cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:05.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.524+0000 7f9ac2d9d700 1 -- 172.21.15.146:0/550746303 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ac40aefd0 msgr2=0x7f9ac415f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:05.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.524+0000 7f9ac2d9d700 1 --2- 172.21.15.146:0/550746303 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ac40aefd0 0x7f9ac415f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:05.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.524+0000 7f9ac2d9d700 1 -- 172.21.15.146:0/550746303 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aac0094a0 con 0x7f9ac406a460 2023-05-24T03:30:05.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.524+0000 7f9ac359e700 1 --2- 172.21.15.146:0/550746303 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ac415cd90 0x7f9ac40b2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:30:05.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.524+0000 7f9ac2d9d700 1 --2- 172.21.15.146:0/550746303 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ac406a460 0x7f9ac414f2c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4007fd0 tx=0x7f9ab400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:05.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.524+0000 7f9abbfff700 1 -- 172.21.15.146:0/550746303 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab4005d70 con 0x7f9ac406a460 2023-05-24T03:30:05.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.524+0000 7f9abbfff700 1 -- 172.21.15.146:0/550746303 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab40070d0 con 0x7f9ac406a460 2023-05-24T03:30:05.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.524+0000 7f9abbfff700 1 -- 172.21.15.146:0/550746303 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab4007460 con 0x7f9ac406a460 2023-05-24T03:30:05.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.524+0000 7f9ac91ff700 1 -- 172.21.15.146:0/550746303 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ac4160800 con 0x7f9ac406a460 2023-05-24T03:30:05.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.524+0000 7f9ac91ff700 1 -- 172.21.15.146:0/550746303 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ac40cfa20 con 0x7f9ac406a460 2023-05-24T03:30:05.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.525+0000 7f9ac91ff700 1 -- 172.21.15.146:0/550746303 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ac40af620 con 0x7f9ac406a460 2023-05-24T03:30:05.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.525+0000 7f9abbfff700 1 -- 172.21.15.146:0/550746303 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9ab40075c0 con 0x7f9ac406a460 2023-05-24T03:30:05.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.526+0000 7f9abbfff700 1 --2- 172.21.15.146:0/550746303 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f9aa406ace0 0x7f9aa406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:05.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.526+0000 7f9abbfff700 1 -- 172.21.15.146:0/550746303 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9ab4088b40 con 0x7f9ac406a460 2023-05-24T03:30:05.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.526+0000 7f9aba59c700 1 --2- 172.21.15.146:0/550746303 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f9aa406ace0 0x7f9aa406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:05.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.526+0000 7f9aba59c700 1 --2- 172.21.15.146:0/550746303 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f9aa406ace0 0x7f9aa406d190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9aac000c00 tx=0x7f9aac008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:05.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.530+0000 7f9abbfff700 1 -- 172.21.15.146:0/550746303 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f9ab4053900 con 0x7f9ac406a460 2023-05-24T03:30:05.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.759+0000 7f9ac91ff700 1 -- 172.21.15.146:0/550746303 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9ac40cfd00 con 0x7f9ac406a460 2023-05-24T03:30:05.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.763+0000 7f9abbfff700 1 -- 172.21.15.146:0/550746303 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9ac40cfd00 con 0x7f9ac406a460 2023-05-24T03:30:05.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.765+0000 7f9ac91ff700 1 -- 172.21.15.146:0/550746303 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f9aa406ace0 msgr2=0x7f9aa406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:05.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.765+0000 7f9ac91ff700 1 --2- 172.21.15.146:0/550746303 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f9aa406ace0 0x7f9aa406d190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9aac000c00 tx=0x7f9aac008030 comp rx=0 tx=0).stop 2023-05-24T03:30:05.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.765+0000 7f9ac91ff700 1 -- 172.21.15.146:0/550746303 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ac406a460 msgr2=0x7f9ac414f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:05.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.765+0000 7f9ac91ff700 1 --2- 172.21.15.146:0/550746303 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ac406a460 0x7f9ac414f2c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4007fd0 tx=0x7f9ab400c860 comp rx=0 tx=0).stop 2023-05-24T03:30:05.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.765+0000 7f9ac91ff700 1 -- 172.21.15.146:0/550746303 shutdown_connections 2023-05-24T03:30:05.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.765+0000 7f9ac91ff700 1 --2- 172.21.15.146:0/550746303 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f9aa406ace0 0x7f9aa406d190 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:05.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.765+0000 7f9ac91ff700 1 --2- 172.21.15.146:0/550746303 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ac415cd90 0x7f9ac40b2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:05.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.765+0000 7f9ac91ff700 1 --2- 172.21.15.146:0/550746303 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ac406a460 0x7f9ac414f2c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:05.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.765+0000 7f9ac91ff700 1 --2- 172.21.15.146:0/550746303 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ac40aefd0 0x7f9ac415f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:05.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.765+0000 7f9ac91ff700 1 -- 172.21.15.146:0/550746303 >> 172.21.15.146:0/550746303 conn(0x7f9ac40cfea0 msgr2=0x7f9ac406a830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:05.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.765+0000 7f9ac91ff700 1 -- 172.21.15.146:0/550746303 shutdown_connections 2023-05-24T03:30:05.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.765+0000 7f9ac91ff700 1 -- 172.21.15.146:0/550746303 wait complete. 2023-05-24T03:30:05.782 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-05-24T03:30:05.782 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-05-24T03:30:05.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.901+0000 7f314017e700 1 Processor -- start 2023-05-24T03:30:05.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.901+0000 7f314017e700 1 -- start start 2023-05-24T03:30:05.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.902+0000 7f314017e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31380d0110 0x7f31380ce110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:05.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.902+0000 7f314017e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31380cd950 con 0x7f31380b2d00 2023-05-24T03:30:05.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.902+0000 7f314017e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31380b36b0 con 0x7f313815af00 2023-05-24T03:30:05.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.902+0000 7f314017e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31380b3990 con 0x7f31380d0110 2023-05-24T03:30:05.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.902+0000 7f313d719700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f31380b2d00 0x7f31380d0660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45594/0 (socket says 172.21.15.146:45594) 2023-05-24T03:30:05.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.902+0000 7f313d719700 1 -- 172.21.15.146:0/3751683811 learned_addr learned my addr 172.21.15.146:0/3751683811 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:30:05.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.902+0000 7f313cf18700 1 -- 172.21.15.146:0/3751683811 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2862239852 0 0) 0x7f31380cd950 con 0x7f31380b2d00 2023-05-24T03:30:05.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.902+0000 7f313e71b700 1 --2- 172.21.15.146:0/3751683811 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31380d0110 0x7f31380ce110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:05.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.902+0000 7f313cf18700 1 -- 172.21.15.146:0/3751683811 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31240035b0 con 0x7f31380b2d00 2023-05-24T03:30:05.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.902+0000 7f313cf18700 1 -- 172.21.15.146:0/3751683811 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3076711582 0 0) 0x7f31240035b0 con 0x7f31380b2d00 2023-05-24T03:30:05.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.902+0000 7f313cf18700 1 -- 172.21.15.146:0/3751683811 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31380d0110 msgr2=0x7f31380ce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:05.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.902+0000 7f313cf18700 1 --2- 172.21.15.146:0/3751683811 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31380d0110 0x7f31380ce110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:05.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.902+0000 7f313cf18700 1 -- 172.21.15.146:0/3751683811 >> v1:172.21.15.151:6789/0 conn(0x7f313815af00 legacy=0x7f313815e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:05.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.902+0000 7f313cf18700 1 -- 172.21.15.146:0/3751683811 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f313815f6b0 con 0x7f31380b2d00 2023-05-24T03:30:05.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.902+0000 7f313cf18700 1 -- 172.21.15.146:0/3751683811 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1301887351 0 0) 0x7f3128001670 con 0x7f31380b2d00 2023-05-24T03:30:05.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.902+0000 7f313cf18700 1 -- 172.21.15.146:0/3751683811 >> v1:172.21.15.146:6789/0 conn(0x7f31380b2d00 legacy=0x7f31380d0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:05.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.902+0000 7f313cf18700 1 --2- 172.21.15.146:0/3751683811 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3124003a30 0x7f3124003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:05.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.902+0000 7f313cf18700 1 --2- 172.21.15.146:0/3751683811 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31380d0110 0x7f3124004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:05.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.902+0000 7f313cf18700 1 --2- 172.21.15.146:0/3751683811 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3124004d90 0x7f3124005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:05.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.902+0000 7f313cf18700 1 -- 172.21.15.146:0/3751683811 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31380b3990 con 0x7f3124003a30 2023-05-24T03:30:05.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.902+0000 7f313cf18700 1 -- 172.21.15.146:0/3751683811 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f312400bac0 con 0x7f3124004d90 2023-05-24T03:30:05.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.902+0000 7f313cf18700 1 -- 172.21.15.146:0/3751683811 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f312400bc80 con 0x7f31380d0110 2023-05-24T03:30:05.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.903+0000 7f313df1a700 1 --2- 172.21.15.146:0/3751683811 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3124003a30 0x7f3124003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:05.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.903+0000 7f313d719700 1 --2- 172.21.15.146:0/3751683811 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31380d0110 0x7f3124004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:05.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.903+0000 7f313e71b700 1 --2- 172.21.15.146:0/3751683811 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3124004d90 0x7f3124005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:05.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.903+0000 7f313df1a700 1 -- 172.21.15.146:0/3751683811 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31380d0110 msgr2=0x7f3124004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:05.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.903+0000 7f313df1a700 1 --2- 172.21.15.146:0/3751683811 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31380d0110 0x7f3124004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:05.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.903+0000 7f313df1a700 1 -- 172.21.15.146:0/3751683811 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3124004d90 msgr2=0x7f3124005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:05.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.903+0000 7f313df1a700 1 --2- 172.21.15.146:0/3751683811 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3124004d90 0x7f3124005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:05.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.903+0000 7f313df1a700 1 -- 172.21.15.146:0/3751683811 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31240035b0 con 0x7f3124003a30 2023-05-24T03:30:05.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.903+0000 7f313df1a700 1 --2- 172.21.15.146:0/3751683811 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3124003a30 0x7f3124003e40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3134001800 tx=0x7f3124005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5c93fb867ca4a6e server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:05.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.903+0000 7f313cf18700 1 -- 172.21.15.146:0/3751683811 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31340012f0 con 0x7f3124003a30 2023-05-24T03:30:05.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.903+0000 7f313cf18700 1 -- 172.21.15.146:0/3751683811 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31340052f0 con 0x7f3124003a30 2023-05-24T03:30:05.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.903+0000 7f313cf18700 1 -- 172.21.15.146:0/3751683811 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3134006860 con 0x7f3124003a30 2023-05-24T03:30:05.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.904+0000 7f314017e700 1 -- 172.21.15.146:0/3751683811 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3124003a30 msgr2=0x7f3124003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:05.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.904+0000 7f314017e700 1 --2- 172.21.15.146:0/3751683811 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3124003a30 0x7f3124003e40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3134001800 tx=0x7f3124005880 comp rx=0 tx=0).stop 2023-05-24T03:30:05.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.904+0000 7f313e71b700 1 -- 172.21.15.146:0/3751683811 reap_dead start 2023-05-24T03:30:05.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.904+0000 7f314017e700 1 -- 172.21.15.146:0/3751683811 shutdown_connections 2023-05-24T03:30:05.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.904+0000 7f314017e700 1 -- 172.21.15.146:0/3751683811 >> 172.21.15.146:0/3751683811 conn(0x7f313806e2a0 msgr2=0x7f313806e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:05.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.904+0000 7f314017e700 1 -- 172.21.15.146:0/3751683811 shutdown_connections 2023-05-24T03:30:05.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.904+0000 7f314017e700 1 -- 172.21.15.146:0/3751683811 wait complete. 2023-05-24T03:30:05.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.905+0000 7f314017e700 1 Processor -- start 2023-05-24T03:30:05.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.905+0000 7f314017e700 1 -- start start 2023-05-24T03:30:05.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.906+0000 7f314017e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3124003a30 0x7f31380c8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:05.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.906+0000 7f314017e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f313814f140 0x7f313815dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:05.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.906+0000 7f314017e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f313815e1d0 0x7f31380b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:05.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.906+0000 7f314017e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31380c6a10 con 0x7f313815e1d0 2023-05-24T03:30:05.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.906+0000 7f314017e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31380c6070 con 0x7f3124003a30 2023-05-24T03:30:05.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.906+0000 7f314017e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31380c66e0 con 0x7f313814f140 2023-05-24T03:30:05.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.906+0000 7f313e71b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f313815e1d0 0x7f31380b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:05.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.906+0000 7f313e71b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f313815e1d0 0x7f31380b4f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39156/0 (socket says 172.21.15.146:39156) 2023-05-24T03:30:05.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.906+0000 7f313e71b700 1 -- 172.21.15.146:0/1636648515 learned_addr learned my addr 172.21.15.146:0/1636648515 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:05.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.906+0000 7f313df1a700 1 --2- 172.21.15.146:0/1636648515 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3124003a30 0x7f31380c8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:05.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.906+0000 7f313d719700 1 --2- 172.21.15.146:0/1636648515 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f313814f140 0x7f313815dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:05.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.906+0000 7f313e71b700 1 -- 172.21.15.146:0/1636648515 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f313814f140 msgr2=0x7f313815dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:05.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.906+0000 7f313e71b700 1 --2- 172.21.15.146:0/1636648515 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f313814f140 0x7f313815dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:05.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.906+0000 7f313e71b700 1 -- 172.21.15.146:0/1636648515 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3124003a30 msgr2=0x7f31380c8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:05.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.906+0000 7f313e71b700 1 --2- 172.21.15.146:0/1636648515 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3124003a30 0x7f31380c8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:05.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.906+0000 7f313e71b700 1 -- 172.21.15.146:0/1636648515 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31380cb970 con 0x7f313815e1d0 2023-05-24T03:30:05.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.906+0000 7f313e71b700 1 --2- 172.21.15.146:0/1636648515 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f313815e1d0 0x7f31380b4f00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3138067940 tx=0x7f3130011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:05.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.906+0000 7f312e7fc700 1 -- 172.21.15.146:0/1636648515 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313000e040 con 0x7f313815e1d0 2023-05-24T03:30:05.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.906+0000 7f312e7fc700 1 -- 172.21.15.146:0/1636648515 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f313000f040 con 0x7f313815e1d0 2023-05-24T03:30:05.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.906+0000 7f314017e700 1 -- 172.21.15.146:0/1636648515 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31380cdbf0 con 0x7f313815e1d0 2023-05-24T03:30:05.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.906+0000 7f312e7fc700 1 -- 172.21.15.146:0/1636648515 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313000fdb0 con 0x7f313815e1d0 2023-05-24T03:30:05.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.906+0000 7f314017e700 1 -- 172.21.15.146:0/1636648515 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31380ce110 con 0x7f313815e1d0 2023-05-24T03:30:05.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.907+0000 7f314017e700 1 -- 172.21.15.146:0/1636648515 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3138068d00 con 0x7f313815e1d0 2023-05-24T03:30:05.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.908+0000 7f312e7fc700 1 -- 172.21.15.146:0/1636648515 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3130022460 con 0x7f313815e1d0 2023-05-24T03:30:05.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.908+0000 7f312e7fc700 1 --2- 172.21.15.146:0/1636648515 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f311c06ace0 0x7f311c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:05.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.908+0000 7f313df1a700 1 --2- 172.21.15.146:0/1636648515 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f311c06ace0 0x7f311c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:05.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.908+0000 7f312e7fc700 1 -- 172.21.15.146:0/1636648515 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3130089c30 con 0x7f313815e1d0 2023-05-24T03:30:05.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.909+0000 7f313df1a700 1 --2- 172.21.15.146:0/1636648515 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f311c06ace0 0x7f311c06d190 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3134014040 tx=0x7f3134009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:05.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:05.913+0000 7f312e7fc700 1 -- 172.21.15.146:0/1636648515 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f31300549f0 con 0x7f313815e1d0 2023-05-24T03:30:06.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.145+0000 7f314017e700 1 -- 172.21.15.146:0/1636648515 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f3138159790 con 0x7f313815e1d0 2023-05-24T03:30:06.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.149+0000 7f312e7fc700 1 -- 172.21.15.146:0/1636648515 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3130058010 con 0x7f313815e1d0 2023-05-24T03:30:06.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.151+0000 7f314017e700 1 -- 172.21.15.146:0/1636648515 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f311c06ace0 msgr2=0x7f311c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:06.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.151+0000 7f314017e700 1 --2- 172.21.15.146:0/1636648515 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f311c06ace0 0x7f311c06d190 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3134014040 tx=0x7f3134009030 comp rx=0 tx=0).stop 2023-05-24T03:30:06.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.151+0000 7f314017e700 1 -- 172.21.15.146:0/1636648515 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f313815e1d0 msgr2=0x7f31380b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:06.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.151+0000 7f314017e700 1 --2- 172.21.15.146:0/1636648515 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f313815e1d0 0x7f31380b4f00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3138067940 tx=0x7f3130011f80 comp rx=0 tx=0).stop 2023-05-24T03:30:06.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.151+0000 7f314017e700 1 -- 172.21.15.146:0/1636648515 shutdown_connections 2023-05-24T03:30:06.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.151+0000 7f314017e700 1 --2- 172.21.15.146:0/1636648515 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f311c06ace0 0x7f311c06d190 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:06.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.151+0000 7f314017e700 1 --2- 172.21.15.146:0/1636648515 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f313815e1d0 0x7f31380b4f00 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:06.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.151+0000 7f314017e700 1 --2- 172.21.15.146:0/1636648515 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3124003a30 0x7f31380c8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:06.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.151+0000 7f314017e700 1 --2- 172.21.15.146:0/1636648515 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f313814f140 0x7f313815dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:06.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.151+0000 7f314017e700 1 -- 172.21.15.146:0/1636648515 >> 172.21.15.146:0/1636648515 conn(0x7f313806e2a0 msgr2=0x7f31380cce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:06.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.151+0000 7f314017e700 1 -- 172.21.15.146:0/1636648515 shutdown_connections 2023-05-24T03:30:06.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.151+0000 7f314017e700 1 -- 172.21.15.146:0/1636648515 wait complete. 2023-05-24T03:30:06.167 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-05-24T03:30:06.168 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-24T03:30:06.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.283+0000 7f99785bf700 1 Processor -- start 2023-05-24T03:30:06.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.283+0000 7f99785bf700 1 -- start start 2023-05-24T03:30:06.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.284+0000 7f99785bf700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f99700cdf10 0x7f9970159c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:06.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.284+0000 7f99785bf700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9970070f50 0x7f997006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:06.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.284+0000 7f99785bf700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f997015a3c0 con 0x7f997015dcf0 2023-05-24T03:30:06.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.284+0000 7f99785bf700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f997015a1c0 con 0x7f99700cdf10 2023-05-24T03:30:06.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.284+0000 7f99785bf700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f997015a6a0 con 0x7f9970070f50 2023-05-24T03:30:06.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.285+0000 7f9976b5c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9970070f50 0x7f997006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:06.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.285+0000 7f997635b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f99700cdf10 0x7f9970159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:06.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.285+0000 7f9976b5c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9970070f50 0x7f997006d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:52028/0 (socket says 172.21.15.146:52028) 2023-05-24T03:30:06.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.285+0000 7f9976b5c700 1 -- 172.21.15.146:0/3543713749 learned_addr learned my addr 172.21.15.146:0/3543713749 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:06.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.285+0000 7f9975b5a700 1 --1- 172.21.15.146:0/3543713749 >> v1:172.21.15.151:6789/0 conn(0x7f997015dcf0 0x7f99700ce2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:44646/0 (socket says 172.21.15.146:44646) 2023-05-24T03:30:06.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.285+0000 7f9976b5c700 1 -- 172.21.15.146:0/3543713749 >> v2:172.21.15.151:3300/0 conn(0x7f99700cdf10 msgr2=0x7f9970159c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:06.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.285+0000 7f9976b5c700 1 --2- 172.21.15.146:0/3543713749 >> v2:172.21.15.151:3300/0 conn(0x7f99700cdf10 0x7f9970159c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:06.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.285+0000 7f9976b5c700 1 -- 172.21.15.146:0/3543713749 >> v1:172.21.15.151:6789/0 conn(0x7f997015dcf0 legacy=0x7f99700ce2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:06.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.285+0000 7f9976b5c700 1 -- 172.21.15.146:0/3543713749 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f997015a980 con 0x7f9970070f50 2023-05-24T03:30:06.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.285+0000 7f9975359700 1 -- 172.21.15.146:0/3543713749 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2578923274 0 0) 0x7f997015a3c0 con 0x7f997015dcf0 2023-05-24T03:30:06.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.285+0000 7f997635b700 1 --2- 172.21.15.146:0/3543713749 >> v2:172.21.15.151:3300/0 conn(0x7f99700cdf10 0x7f9970159c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T03:30:06.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.285+0000 7f9976b5c700 1 --2- 172.21.15.146:0/3543713749 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9970070f50 0x7f997006d6b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9968009e50 tx=0x7f996800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0fce25590edeff3 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:06.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.285+0000 7f9975359700 1 -- 172.21.15.146:0/3543713749 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996800e070 con 0x7f9970070f50 2023-05-24T03:30:06.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.285+0000 7f9975359700 1 -- 172.21.15.146:0/3543713749 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f996800b910 con 0x7f9970070f50 2023-05-24T03:30:06.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.285+0000 7f9975359700 1 -- 172.21.15.146:0/3543713749 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996800bcc0 con 0x7f9970070f50 2023-05-24T03:30:06.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.286+0000 7f99785bf700 1 -- 172.21.15.146:0/3543713749 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9970070f50 msgr2=0x7f997006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:06.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.286+0000 7f99785bf700 1 --2- 172.21.15.146:0/3543713749 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9970070f50 0x7f997006d6b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9968009e50 tx=0x7f996800b330 comp rx=0 tx=0).stop 2023-05-24T03:30:06.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.286+0000 7f99785bf700 1 -- 172.21.15.146:0/3543713749 shutdown_connections 2023-05-24T03:30:06.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.286+0000 7f99785bf700 1 --2- 172.21.15.146:0/3543713749 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9970070f50 0x7f997006d6b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:06.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.286+0000 7f99785bf700 1 --2- 172.21.15.146:0/3543713749 >> v2:172.21.15.151:3300/0 conn(0x7f99700cdf10 0x7f9970159c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:06.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.286+0000 7f99785bf700 1 -- 172.21.15.146:0/3543713749 >> 172.21.15.146:0/3543713749 conn(0x7f99700cfea0 msgr2=0x7f99700d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:06.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.286+0000 7f99785bf700 1 -- 172.21.15.146:0/3543713749 shutdown_connections 2023-05-24T03:30:06.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.286+0000 7f99785bf700 1 -- 172.21.15.146:0/3543713749 wait complete. 2023-05-24T03:30:06.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.287+0000 7f99785bf700 1 Processor -- start 2023-05-24T03:30:06.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.287+0000 7f99785bf700 1 -- start start 2023-05-24T03:30:06.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.288+0000 7f99785bf700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9970070f50 0x7f9970149510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:06.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.288+0000 7f99785bf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99700cdf10 0x7f99700c9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:06.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.288+0000 7f99785bf700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f997015dcf0 0x7f99700c98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:06.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.288+0000 7f99785bf700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99701f33d0 con 0x7f99700cdf10 2023-05-24T03:30:06.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.288+0000 7f99785bf700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9970149a50 con 0x7f9970070f50 2023-05-24T03:30:06.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.288+0000 7f99785bf700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99701f27c0 con 0x7f997015dcf0 2023-05-24T03:30:06.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.288+0000 7f9975b5a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99700cdf10 0x7f99700c9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:06.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.288+0000 7f9975b5a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99700cdf10 0x7f99700c9390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39168/0 (socket says 172.21.15.146:39168) 2023-05-24T03:30:06.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.288+0000 7f9975b5a700 1 -- 172.21.15.146:0/1698395108 learned_addr learned my addr 172.21.15.146:0/1698395108 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:06.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.288+0000 7f997635b700 1 --2- 172.21.15.146:0/1698395108 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9970070f50 0x7f9970149510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:06.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.288+0000 7f9976b5c700 1 --2- 172.21.15.146:0/1698395108 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f997015dcf0 0x7f99700c98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:06.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.288+0000 7f9975b5a700 1 -- 172.21.15.146:0/1698395108 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f997015dcf0 msgr2=0x7f99700c98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:06.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.288+0000 7f9975b5a700 1 --2- 172.21.15.146:0/1698395108 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f997015dcf0 0x7f99700c98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:06.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.288+0000 7f9975b5a700 1 -- 172.21.15.146:0/1698395108 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9970070f50 msgr2=0x7f9970149510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:06.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.288+0000 7f9975b5a700 1 --2- 172.21.15.146:0/1698395108 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9970070f50 0x7f9970149510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:06.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.288+0000 7f9975b5a700 1 -- 172.21.15.146:0/1698395108 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99600094a0 con 0x7f99700cdf10 2023-05-24T03:30:06.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.288+0000 7f9976b5c700 1 --2- 172.21.15.146:0/1698395108 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f997015dcf0 0x7f99700c98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:30:06.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.289+0000 7f9975b5a700 1 --2- 172.21.15.146:0/1698395108 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99700cdf10 0x7f99700c9390 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f996c00c550 tx=0x7f996c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:06.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.289+0000 7f9966ffd700 1 -- 172.21.15.146:0/1698395108 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996c004c80 con 0x7f99700cdf10 2023-05-24T03:30:06.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.289+0000 7f9966ffd700 1 -- 172.21.15.146:0/1698395108 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f996c004e00 con 0x7f99700cdf10 2023-05-24T03:30:06.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.289+0000 7f99785bf700 1 -- 172.21.15.146:0/1698395108 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9968009b30 con 0x7f99700cdf10 2023-05-24T03:30:06.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.289+0000 7f9966ffd700 1 -- 172.21.15.146:0/1698395108 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996c007310 con 0x7f99700cdf10 2023-05-24T03:30:06.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.289+0000 7f99785bf700 1 -- 172.21.15.146:0/1698395108 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f997006d190 con 0x7f99700cdf10 2023-05-24T03:30:06.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.290+0000 7f99785bf700 1 -- 172.21.15.146:0/1698395108 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f997015ac60 con 0x7f99700cdf10 2023-05-24T03:30:06.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.290+0000 7f9966ffd700 1 -- 172.21.15.146:0/1698395108 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f996c007470 con 0x7f99700cdf10 2023-05-24T03:30:06.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.290+0000 7f9966ffd700 1 --2- 172.21.15.146:0/1698395108 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f995406ace0 0x7f995406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:06.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.291+0000 7f9966ffd700 1 -- 172.21.15.146:0/1698395108 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f996c089470 con 0x7f99700cdf10 2023-05-24T03:30:06.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.291+0000 7f997635b700 1 --2- 172.21.15.146:0/1698395108 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f995406ace0 0x7f995406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:06.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.291+0000 7f997635b700 1 --2- 172.21.15.146:0/1698395108 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f995406ace0 0x7f995406d190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9960009c60 tx=0x7f9960008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:06.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.295+0000 7f9966ffd700 1 -- 172.21.15.146:0/1698395108 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f996c054240 con 0x7f99700cdf10 2023-05-24T03:30:06.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.524+0000 7f99785bf700 1 -- 172.21.15.146:0/1698395108 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f997015e190 con 0x7f99700cdf10 2023-05-24T03:30:06.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.524+0000 7f9966ffd700 1 -- 172.21.15.146:0/1698395108 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4883 (secure 0 0 0) 0x7f996c057860 con 0x7f99700cdf10 2023-05-24T03:30:06.529 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:30:06.529 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1500590330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1500590330},{"type":"v1","addr":"172.21.15.151:6835","nonce":1500590330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/3574684057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3574684057},{"type":"v1","addr":"172.21.15.146:6837","nonce":3574684057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/3420469594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3420469594},{"type":"v1","addr":"172.21.15.151:6833","nonce":3420469594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-24T03:29:44.469134+0000","modified":"2023-05-24T03:30:06.147392+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6836/4012487240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":4012487240},{"type":"v1","addr":"172.21.15.146:6836","nonce":4012487240}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-24T03:30:06.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.526+0000 7f99785bf700 1 -- 172.21.15.146:0/1698395108 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f995406ace0 msgr2=0x7f995406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:06.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.526+0000 7f99785bf700 1 --2- 172.21.15.146:0/1698395108 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f995406ace0 0x7f995406d190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9960009c60 tx=0x7f9960008040 comp rx=0 tx=0).stop 2023-05-24T03:30:06.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.526+0000 7f99785bf700 1 -- 172.21.15.146:0/1698395108 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99700cdf10 msgr2=0x7f99700c9390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:06.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.526+0000 7f99785bf700 1 --2- 172.21.15.146:0/1698395108 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99700cdf10 0x7f99700c9390 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f996c00c550 tx=0x7f996c00c910 comp rx=0 tx=0).stop 2023-05-24T03:30:06.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.526+0000 7f99785bf700 1 -- 172.21.15.146:0/1698395108 shutdown_connections 2023-05-24T03:30:06.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.526+0000 7f99785bf700 1 --2- 172.21.15.146:0/1698395108 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f995406ace0 0x7f995406d190 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:06.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.526+0000 7f99785bf700 1 --2- 172.21.15.146:0/1698395108 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f997015dcf0 0x7f99700c98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:06.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.526+0000 7f99785bf700 1 --2- 172.21.15.146:0/1698395108 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9970070f50 0x7f9970149510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:06.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.526+0000 7f99785bf700 1 --2- 172.21.15.146:0/1698395108 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99700cdf10 0x7f99700c9390 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:06.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.526+0000 7f99785bf700 1 -- 172.21.15.146:0/1698395108 >> 172.21.15.146:0/1698395108 conn(0x7f99700cfea0 msgr2=0x7f997015ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:06.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.526+0000 7f99785bf700 1 -- 172.21.15.146:0/1698395108 shutdown_connections 2023-05-24T03:30:06.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.526+0000 7f99785bf700 1 -- 172.21.15.146:0/1698395108 wait complete. 2023-05-24T03:30:06.533 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 9 2023-05-24T03:30:06.543 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-24T03:30:06.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.660+0000 7f771f37f700 1 Processor -- start 2023-05-24T03:30:06.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.661+0000 7f771f37f700 1 -- start start 2023-05-24T03:30:06.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.661+0000 7f771f37f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f77180cdf10 0x7f7718159c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:06.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.661+0000 7f771f37f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f771815dcf0 0x7f77180ce2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:06.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.661+0000 7f771f37f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77180ce820 con 0x7f7718070f50 2023-05-24T03:30:06.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.661+0000 7f771f37f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f771815a1c0 con 0x7f77180cdf10 2023-05-24T03:30:06.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.661+0000 7f771f37f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f771815a3c0 con 0x7f771815dcf0 2023-05-24T03:30:06.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.662+0000 7f771d11b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f77180cdf10 0x7f7718159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:06.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.662+0000 7f771d91c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f7718070f50 0x7f771806d6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45628/0 (socket says 172.21.15.146:45628) 2023-05-24T03:30:06.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.662+0000 7f771d91c700 1 -- 172.21.15.146:0/785368450 learned_addr learned my addr 172.21.15.146:0/785368450 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:30:06.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.662+0000 7f771c91a700 1 --2- 172.21.15.146:0/785368450 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f771815dcf0 0x7f77180ce2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:06.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.662+0000 7f771d11b700 1 -- 172.21.15.146:0/785368450 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f771815dcf0 msgr2=0x7f77180ce2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:06.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.662+0000 7f771d11b700 1 --2- 172.21.15.146:0/785368450 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f771815dcf0 0x7f77180ce2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:06.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.662+0000 7f771d11b700 1 -- 172.21.15.146:0/785368450 >> v1:172.21.15.146:6789/0 conn(0x7f7718070f50 legacy=0x7f771806d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:06.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.662+0000 7f771d11b700 1 -- 172.21.15.146:0/785368450 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f771815a6a0 con 0x7f77180cdf10 2023-05-24T03:30:06.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.662+0000 7f770ffff700 1 -- 172.21.15.146:0/785368450 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1757790986 0 0) 0x7f77180ce820 con 0x7f7718070f50 2023-05-24T03:30:06.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.662+0000 7f771d11b700 1 --2- 172.21.15.146:0/785368450 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77180cdf10 0x7f7718159c80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7708009840 tx=0x7f7708009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aae4470b3659e6a9 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:06.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.662+0000 7f770ffff700 1 -- 172.21.15.146:0/785368450 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7708011830 con 0x7f77180cdf10 2023-05-24T03:30:06.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.662+0000 7f770ffff700 1 -- 172.21.15.146:0/785368450 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7708011990 con 0x7f77180cdf10 2023-05-24T03:30:06.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.662+0000 7f770ffff700 1 -- 172.21.15.146:0/785368450 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7708011d20 con 0x7f77180cdf10 2023-05-24T03:30:06.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.663+0000 7f771f37f700 1 -- 172.21.15.146:0/785368450 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77180cdf10 msgr2=0x7f7718159c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:06.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.663+0000 7f771f37f700 1 --2- 172.21.15.146:0/785368450 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77180cdf10 0x7f7718159c80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7708009840 tx=0x7f7708009b50 comp rx=0 tx=0).stop 2023-05-24T03:30:06.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.663+0000 7f771f37f700 1 -- 172.21.15.146:0/785368450 shutdown_connections 2023-05-24T03:30:06.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.663+0000 7f771f37f700 1 --2- 172.21.15.146:0/785368450 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77180cdf10 0x7f7718159c80 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:06.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.663+0000 7f771f37f700 1 --2- 172.21.15.146:0/785368450 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f771815dcf0 0x7f77180ce2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:06.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.663+0000 7f771f37f700 1 -- 172.21.15.146:0/785368450 >> 172.21.15.146:0/785368450 conn(0x7f77180cfea0 msgr2=0x7f77180d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:06.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.663+0000 7f771f37f700 1 -- 172.21.15.146:0/785368450 shutdown_connections 2023-05-24T03:30:06.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.663+0000 7f771f37f700 1 -- 172.21.15.146:0/785368450 wait complete. 2023-05-24T03:30:06.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.664+0000 7f771f37f700 1 Processor -- start 2023-05-24T03:30:06.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.664+0000 7f771f37f700 1 -- start start 2023-05-24T03:30:06.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.665+0000 7f771f37f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7718070f50 0x7f77181ee970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:06.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.665+0000 7f771f37f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77180cdf10 0x7f77180b45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:06.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.665+0000 7f771f37f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f771815dcf0 0x7f77180c78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:06.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.665+0000 7f771f37f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77180b3e50 con 0x7f7718070f50 2023-05-24T03:30:06.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.665+0000 7f771f37f700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77180b4130 con 0x7f771815dcf0 2023-05-24T03:30:06.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.665+0000 7f771f37f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77180c9a60 con 0x7f77180cdf10 2023-05-24T03:30:06.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.665+0000 7f771d11b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7718070f50 0x7f77181ee970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:06.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.665+0000 7f771d11b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7718070f50 0x7f77181ee970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39178/0 (socket says 172.21.15.146:39178) 2023-05-24T03:30:06.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.665+0000 7f771d11b700 1 -- 172.21.15.146:0/2425593484 learned_addr learned my addr 172.21.15.146:0/2425593484 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:06.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.666+0000 7f771d91c700 1 --2- 172.21.15.146:0/2425593484 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f771815dcf0 0x7f77180c78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:06.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.666+0000 7f771c91a700 1 --2- 172.21.15.146:0/2425593484 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77180cdf10 0x7f77180b45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:06.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.666+0000 7f771d11b700 1 -- 172.21.15.146:0/2425593484 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77180cdf10 msgr2=0x7f77180b45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:06.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.666+0000 7f771d11b700 1 --2- 172.21.15.146:0/2425593484 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77180cdf10 0x7f77180b45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:06.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.666+0000 7f771d11b700 1 -- 172.21.15.146:0/2425593484 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f771815dcf0 msgr2=0x7f77180c78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:06.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.666+0000 7f771d11b700 1 --2- 172.21.15.146:0/2425593484 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f771815dcf0 0x7f77180c78e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:06.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.666+0000 7f771d11b700 1 -- 172.21.15.146:0/2425593484 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77080094a0 con 0x7f7718070f50 2023-05-24T03:30:06.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.666+0000 7f771d11b700 1 --2- 172.21.15.146:0/2425593484 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7718070f50 0x7f77181ee970 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7708014040 tx=0x7f7708004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:06.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.666+0000 7f770dffb700 1 -- 172.21.15.146:0/2425593484 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77080038a0 con 0x7f7718070f50 2023-05-24T03:30:06.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.666+0000 7f770dffb700 1 -- 172.21.15.146:0/2425593484 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770801e070 con 0x7f7718070f50 2023-05-24T03:30:06.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.666+0000 7f771f37f700 1 -- 172.21.15.146:0/2425593484 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f771815ac60 con 0x7f7718070f50 2023-05-24T03:30:06.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.666+0000 7f770dffb700 1 -- 172.21.15.146:0/2425593484 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7708003c20 con 0x7f7718070f50 2023-05-24T03:30:06.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.666+0000 7f771f37f700 1 -- 172.21.15.146:0/2425593484 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f771815a980 con 0x7f7718070f50 2023-05-24T03:30:06.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.667+0000 7f771f37f700 1 -- 172.21.15.146:0/2425593484 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f771806d190 con 0x7f7718070f50 2023-05-24T03:30:06.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.668+0000 7f770dffb700 1 -- 172.21.15.146:0/2425593484 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f770802d450 con 0x7f7718070f50 2023-05-24T03:30:06.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.668+0000 7f770dffb700 1 --2- 172.21.15.146:0/2425593484 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f76fc06ace0 0x7f76fc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:06.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.668+0000 7f770dffb700 1 -- 172.21.15.146:0/2425593484 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f770808a7b0 con 0x7f7718070f50 2023-05-24T03:30:06.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.668+0000 7f771c91a700 1 --2- 172.21.15.146:0/2425593484 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f76fc06ace0 0x7f76fc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:06.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.669+0000 7f771c91a700 1 --2- 172.21.15.146:0/2425593484 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f76fc06ace0 0x7f76fc06d190 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7718155af0 tx=0x7f7714008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:06.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.672+0000 7f770dffb700 1 -- 172.21.15.146:0/2425593484 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f7708055600 con 0x7f7718070f50 2023-05-24T03:30:06.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.859+0000 7f771f37f700 1 -- 172.21.15.146:0/2425593484 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f77180b4410 con 0x7f7718070f50 2023-05-24T03:30:06.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.861+0000 7f770dffb700 1 -- 172.21.15.146:0/2425593484 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20156 (secure 0 0 0) 0x7f7708058c20 con 0x7f7718070f50 2023-05-24T03:30:06.866 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:30:06.866 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":28,"fsid":"11ca0adb-7672-4713-bde7-451e8b743ae9","created":"2023-05-24T03:29:19.113659+0000","modified":"2023-05-24T03:29:48.912599+0000","last_up_change":"2023-05-24T03:29:30.962339+0000","last_in_change":"2023-05-24T03:29:21.706540+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-24T03:29:32.749984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-24T03:29:37.719623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-24T03:29:42.165379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-24T03:29:43.431615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-24T03:29:46.503075+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f24b319b-fcc8-4385-b0cb-78138fc31417","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6801","nonce":3353593100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6803","nonce":3353593100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6807","nonce":3353593100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6805","nonce":3353593100}]},"public_addr":"172.21.15.146:6801/3353593100","cluster_addr":"172.21.15.146:6803/3353593100","heartbeat_back_addr":"172.21.15.146:6807/3353593100","heartbeat_front_addr":"172.21.15.146:6805/3353593100","state":["exists","up"]},{"osd":1,"uuid":"c9639ea9-8f9b-498e-92c8-aa976edbf1da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6821","nonce":2537488734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6825","nonce":2537488734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6831","nonce":2537488734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6827","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6829","nonce":2537488734}]},"public_addr":"172.21.15.146:6821/2537488734","cluster_addr":"172.21.15.146:6825/2537488734","heartbeat_back_addr":"172.21.15.146:6831/2537488734","heartbeat_front_addr":"172.21.15.146:6829/2537488734","state":["exists","up"]},{"osd":2,"uuid":"7a6cfc6d-b0ca-4cb6-a66d-4001ec184657","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6809","nonce":1800242932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6811","nonce":1800242932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6815","nonce":1800242932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6813","nonce":1800242932}]},"public_addr":"172.21.15.146:6809/1800242932","cluster_addr":"172.21.15.146:6811/1800242932","heartbeat_back_addr":"172.21.15.146:6815/1800242932","heartbeat_front_addr":"172.21.15.146:6813/1800242932","state":["exists","up"]},{"osd":3,"uuid":"401509f7-cecd-44a2-b0ae-22c81a5d93c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6817","nonce":1749783580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6820","nonce":1749783580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6828","nonce":1749783580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6824","nonce":1749783580}]},"public_addr":"172.21.15.146:6817/1749783580","cluster_addr":"172.21.15.146:6820/1749783580","heartbeat_back_addr":"172.21.15.146:6828/1749783580","heartbeat_front_addr":"172.21.15.146:6824/1749783580","state":["exists","up"]},{"osd":4,"uuid":"9d07f440-d125-4f99-a825-411fab894d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6811","nonce":163453435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6814","nonce":163453435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6819","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6821","nonce":163453435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6818","nonce":163453435}]},"public_addr":"172.21.15.151:6811/163453435","cluster_addr":"172.21.15.151:6814/163453435","heartbeat_back_addr":"172.21.15.151:6821/163453435","heartbeat_front_addr":"172.21.15.151:6818/163453435","state":["exists","up"]},{"osd":5,"uuid":"9b2266e2-9e52-4f0e-96da-e703a6c23a6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6801","nonce":3283474903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6803","nonce":3283474903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6807","nonce":3283474903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6805","nonce":3283474903}]},"public_addr":"172.21.15.151:6801/3283474903","cluster_addr":"172.21.15.151:6803/3283474903","heartbeat_back_addr":"172.21.15.151:6807/3283474903","heartbeat_front_addr":"172.21.15.151:6805/3283474903","state":["exists","up"]},{"osd":6,"uuid":"5daedf77-0a83-49e7-b497-d9ed10436972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6825","nonce":3889424178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6827","nonce":3889424178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6831","nonce":3889424178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6829","nonce":3889424178}]},"public_addr":"172.21.15.151:6825/3889424178","cluster_addr":"172.21.15.151:6827/3889424178","heartbeat_back_addr":"172.21.15.151:6831/3889424178","heartbeat_front_addr":"172.21.15.151:6829/3889424178","state":["exists","up"]},{"osd":7,"uuid":"86ae4f7e-c01f-4c3d-a0dd-98160c209309","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6810","nonce":563291208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6815","nonce":563291208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6823","nonce":563291208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6820","nonce":563291208}]},"public_addr":"172.21.15.151:6810/563291208","cluster_addr":"172.21.15.151:6815/563291208","heartbeat_back_addr":"172.21.15.151:6823/563291208","heartbeat_front_addr":"172.21.15.151:6820/563291208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.872472+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.937126+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.877234+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.884793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.881632+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.938293+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.857661+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.945883+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-24T03:30:06.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.863+0000 7f771f37f700 1 -- 172.21.15.146:0/2425593484 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f76fc06ace0 msgr2=0x7f76fc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:06.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.863+0000 7f771f37f700 1 --2- 172.21.15.146:0/2425593484 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f76fc06ace0 0x7f76fc06d190 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7718155af0 tx=0x7f7714008040 comp rx=0 tx=0).stop 2023-05-24T03:30:06.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.863+0000 7f771f37f700 1 -- 172.21.15.146:0/2425593484 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7718070f50 msgr2=0x7f77181ee970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:06.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.863+0000 7f771f37f700 1 --2- 172.21.15.146:0/2425593484 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7718070f50 0x7f77181ee970 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7708014040 tx=0x7f7708004750 comp rx=0 tx=0).stop 2023-05-24T03:30:06.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.863+0000 7f771f37f700 1 -- 172.21.15.146:0/2425593484 shutdown_connections 2023-05-24T03:30:06.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.863+0000 7f771f37f700 1 --2- 172.21.15.146:0/2425593484 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f76fc06ace0 0x7f76fc06d190 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:06.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.863+0000 7f771f37f700 1 --2- 172.21.15.146:0/2425593484 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f771815dcf0 0x7f77180c78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:06.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.863+0000 7f771f37f700 1 --2- 172.21.15.146:0/2425593484 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7718070f50 0x7f77181ee970 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:06.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.863+0000 7f771f37f700 1 --2- 172.21.15.146:0/2425593484 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77180cdf10 0x7f77180b45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:06.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.863+0000 7f771f37f700 1 -- 172.21.15.146:0/2425593484 >> 172.21.15.146:0/2425593484 conn(0x7f77180cfea0 msgr2=0x7f77180d0270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:06.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.863+0000 7f771f37f700 1 -- 172.21.15.146:0/2425593484 shutdown_connections 2023-05-24T03:30:06.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.863+0000 7f771f37f700 1 -- 172.21.15.146:0/2425593484 wait complete. 2023-05-24T03:30:06.880 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-05-24T03:30:06.880 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-24T03:30:07.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.998+0000 7f2dc45ed700 1 Processor -- start 2023-05-24T03:30:07.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.998+0000 7f2dc45ed700 1 -- start start 2023-05-24T03:30:07.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.999+0000 7f2dc45ed700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2dbc15acd0 0x7f2dbc0ce100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:07.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.999+0000 7f2dc45ed700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2dbc0d1260 0x7f2dbc0cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:07.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.999+0000 7f2dc45ed700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dbc0cd940 con 0x7f2dbc0d06d0 2023-05-24T03:30:07.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.999+0000 7f2dc45ed700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dbc0b33d0 con 0x7f2dbc15acd0 2023-05-24T03:30:07.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.999+0000 7f2dc45ed700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dbc0b3690 con 0x7f2dbc0d1260 2023-05-24T03:30:07.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.999+0000 7f2dc2b8a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2dbc0d1260 0x7f2dbc0cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:07.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.999+0000 7f2dc2389700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2dbc15acd0 0x7f2dbc0ce100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:07.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.999+0000 7f2dc2b8a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2dbc0d1260 0x7f2dbc0cec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:52054/0 (socket says 172.21.15.146:52054) 2023-05-24T03:30:07.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.999+0000 7f2dc1b88700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f2dbc0d06d0 0x7f2dbc0d0b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:44672/0 (socket says 172.21.15.146:44672) 2023-05-24T03:30:07.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.999+0000 7f2dc2b8a700 1 -- 172.21.15.146:0/1008296384 learned_addr learned my addr 172.21.15.146:0/1008296384 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:07.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.999+0000 7f2dc2389700 1 -- 172.21.15.146:0/1008296384 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2dbc0d1260 msgr2=0x7f2dbc0cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:07.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.999+0000 7f2dc2389700 1 --2- 172.21.15.146:0/1008296384 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2dbc0d1260 0x7f2dbc0cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:07.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.999+0000 7f2dc2389700 1 -- 172.21.15.146:0/1008296384 >> v1:172.21.15.151:6789/0 conn(0x7f2dbc0d06d0 legacy=0x7f2dbc0d0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:07.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.999+0000 7f2dc2389700 1 -- 172.21.15.146:0/1008296384 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dbc0cdbe0 con 0x7f2dbc15acd0 2023-05-24T03:30:07.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.999+0000 7f2dc1387700 1 -- 172.21.15.146:0/1008296384 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1501697857 0 0) 0x7f2dbc0cd940 con 0x7f2dbc0d06d0 2023-05-24T03:30:07.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:06.999+0000 7f2dc2b8a700 1 --2- 172.21.15.146:0/1008296384 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2dbc0d1260 0x7f2dbc0cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T03:30:07.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.000+0000 7f2dc2389700 1 --2- 172.21.15.146:0/1008296384 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2dbc15acd0 0x7f2dbc0ce100 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2db8009840 tx=0x7f2db8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3a7d1372e9453f5 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:07.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.000+0000 7f2dc1387700 1 -- 172.21.15.146:0/1008296384 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db8011830 con 0x7f2dbc15acd0 2023-05-24T03:30:07.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.000+0000 7f2dc1387700 1 -- 172.21.15.146:0/1008296384 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2db8011990 con 0x7f2dbc15acd0 2023-05-24T03:30:07.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.000+0000 7f2dc1387700 1 -- 172.21.15.146:0/1008296384 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db8011d20 con 0x7f2dbc15acd0 2023-05-24T03:30:07.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.000+0000 7f2dc45ed700 1 -- 172.21.15.146:0/1008296384 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2dbc15acd0 msgr2=0x7f2dbc0ce100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:07.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.000+0000 7f2dc45ed700 1 --2- 172.21.15.146:0/1008296384 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2dbc15acd0 0x7f2dbc0ce100 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2db8009840 tx=0x7f2db8009b50 comp rx=0 tx=0).stop 2023-05-24T03:30:07.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.000+0000 7f2dc45ed700 1 -- 172.21.15.146:0/1008296384 shutdown_connections 2023-05-24T03:30:07.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.000+0000 7f2dc45ed700 1 --2- 172.21.15.146:0/1008296384 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2dbc0d1260 0x7f2dbc0cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:07.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.000+0000 7f2dc45ed700 1 --2- 172.21.15.146:0/1008296384 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2dbc15acd0 0x7f2dbc0ce100 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:07.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.000+0000 7f2dc45ed700 1 -- 172.21.15.146:0/1008296384 >> 172.21.15.146:0/1008296384 conn(0x7f2dbc06e2a0 msgr2=0x7f2dbc06e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:07.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.000+0000 7f2dc45ed700 1 -- 172.21.15.146:0/1008296384 shutdown_connections 2023-05-24T03:30:07.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.000+0000 7f2dc45ed700 1 -- 172.21.15.146:0/1008296384 wait complete. 2023-05-24T03:30:07.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.002+0000 7f2dc45ed700 1 Processor -- start 2023-05-24T03:30:07.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.002+0000 7f2dc45ed700 1 -- start start 2023-05-24T03:30:07.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.002+0000 7f2dc45ed700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2dbc0d06d0 0x7f2dbc152390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:07.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.002+0000 7f2dc45ed700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dbc0d1260 0x7f2dbc15bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:07.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.002+0000 7f2dc45ed700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2dbc15acd0 0x7f2dbc0b17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:07.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.002+0000 7f2dc45ed700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dbc15c2b0 con 0x7f2dbc0d1260 2023-05-24T03:30:07.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.002+0000 7f2dc45ed700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dbc0c9590 con 0x7f2dbc0d06d0 2023-05-24T03:30:07.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.002+0000 7f2dc45ed700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dbc0c9870 con 0x7f2dbc15acd0 2023-05-24T03:30:07.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.002+0000 7f2dc1b88700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dbc0d1260 0x7f2dbc15bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:07.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.002+0000 7f2dc1b88700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dbc0d1260 0x7f2dbc15bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39194/0 (socket says 172.21.15.146:39194) 2023-05-24T03:30:07.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.002+0000 7f2dc1b88700 1 -- 172.21.15.146:0/4146415695 learned_addr learned my addr 172.21.15.146:0/4146415695 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:07.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.003+0000 7f2dc2389700 1 --2- 172.21.15.146:0/4146415695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2dbc0d06d0 0x7f2dbc152390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:07.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.003+0000 7f2dc2b8a700 1 --2- 172.21.15.146:0/4146415695 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2dbc15acd0 0x7f2dbc0b17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:07.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.003+0000 7f2dc1b88700 1 -- 172.21.15.146:0/4146415695 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2dbc15acd0 msgr2=0x7f2dbc0b17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:07.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.003+0000 7f2dc1b88700 1 --2- 172.21.15.146:0/4146415695 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2dbc15acd0 0x7f2dbc0b17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:07.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.003+0000 7f2dc1b88700 1 -- 172.21.15.146:0/4146415695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2dbc0d06d0 msgr2=0x7f2dbc152390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:07.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.003+0000 7f2dc1b88700 1 --2- 172.21.15.146:0/4146415695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2dbc0d06d0 0x7f2dbc152390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:07.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.003+0000 7f2dc1b88700 1 -- 172.21.15.146:0/4146415695 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db4009b30 con 0x7f2dbc0d1260 2023-05-24T03:30:07.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.003+0000 7f2dc2389700 1 --2- 172.21.15.146:0/4146415695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2dbc0d06d0 0x7f2dbc152390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:30:07.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.003+0000 7f2dc2b8a700 1 --2- 172.21.15.146:0/4146415695 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2dbc15acd0 0x7f2dbc0b17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:30:07.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.003+0000 7f2dc1b88700 1 --2- 172.21.15.146:0/4146415695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dbc0d1260 0x7f2dbc15bd70 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2dac00c550 tx=0x7f2dac00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:07.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.003+0000 7f2db2ffd700 1 -- 172.21.15.146:0/4146415695 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dac004c80 con 0x7f2dbc0d1260 2023-05-24T03:30:07.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.003+0000 7f2db2ffd700 1 -- 172.21.15.146:0/4146415695 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dac004e00 con 0x7f2dbc0d1260 2023-05-24T03:30:07.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.003+0000 7f2dc45ed700 1 -- 172.21.15.146:0/4146415695 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2db80094a0 con 0x7f2dbc0d1260 2023-05-24T03:30:07.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.003+0000 7f2db2ffd700 1 -- 172.21.15.146:0/4146415695 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dac007310 con 0x7f2dbc0d1260 2023-05-24T03:30:07.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.003+0000 7f2dc45ed700 1 -- 172.21.15.146:0/4146415695 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dbc0d03b0 con 0x7f2dbc0d1260 2023-05-24T03:30:07.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.004+0000 7f2dc45ed700 1 -- 172.21.15.146:0/4146415695 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dbc0b3970 con 0x7f2dbc0d1260 2023-05-24T03:30:07.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.005+0000 7f2db2ffd700 1 -- 172.21.15.146:0/4146415695 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2dac007470 con 0x7f2dbc0d1260 2023-05-24T03:30:07.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.005+0000 7f2db2ffd700 1 --2- 172.21.15.146:0/4146415695 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f2da006ace0 0x7f2da006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:07.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.005+0000 7f2db2ffd700 1 -- 172.21.15.146:0/4146415695 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2dac0893f0 con 0x7f2dbc0d1260 2023-05-24T03:30:07.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.005+0000 7f2dc2389700 1 --2- 172.21.15.146:0/4146415695 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f2da006ace0 0x7f2da006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:07.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.006+0000 7f2dc2389700 1 --2- 172.21.15.146:0/4146415695 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f2da006ace0 0x7f2da006d190 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2db80090b0 tx=0x7f2db8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:07.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.009+0000 7f2db2ffd700 1 -- 172.21.15.146:0/4146415695 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f2dac054240 con 0x7f2dbc0d1260 2023-05-24T03:30:07.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.197+0000 7f2dc45ed700 1 -- 172.21.15.146:0/4146415695 --> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2dbc15b0a0 con 0x7f2da006ace0 2023-05-24T03:30:07.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.207+0000 7f2db2ffd700 1 -- 172.21.15.146:0/4146415695 <== mgr.4104 v2:172.21.15.146:6832/1985394169 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367334 (secure 0 0 0) 0x7f2dbc15b0a0 con 0x7f2da006ace0 2023-05-24T03:30:07.215 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:30:07.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.211+0000 7f2dc45ed700 1 -- 172.21.15.146:0/4146415695 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f2da006ace0 msgr2=0x7f2da006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:07.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.211+0000 7f2dc45ed700 1 --2- 172.21.15.146:0/4146415695 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f2da006ace0 0x7f2da006d190 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2db80090b0 tx=0x7f2db8008030 comp rx=0 tx=0).stop 2023-05-24T03:30:07.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.211+0000 7f2dc45ed700 1 -- 172.21.15.146:0/4146415695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dbc0d1260 msgr2=0x7f2dbc15bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:07.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.211+0000 7f2dc45ed700 1 --2- 172.21.15.146:0/4146415695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dbc0d1260 0x7f2dbc15bd70 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2dac00c550 tx=0x7f2dac00c910 comp rx=0 tx=0).stop 2023-05-24T03:30:07.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.211+0000 7f2dc45ed700 1 -- 172.21.15.146:0/4146415695 shutdown_connections 2023-05-24T03:30:07.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.211+0000 7f2dc45ed700 1 --2- 172.21.15.146:0/4146415695 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f2da006ace0 0x7f2da006d190 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:07.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.211+0000 7f2dc45ed700 1 --2- 172.21.15.146:0/4146415695 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2dbc15acd0 0x7f2dbc0b17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:07.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.211+0000 7f2dc45ed700 1 --2- 172.21.15.146:0/4146415695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2dbc0d06d0 0x7f2dbc152390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:07.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.211+0000 7f2dc45ed700 1 --2- 172.21.15.146:0/4146415695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dbc0d1260 0x7f2dbc15bd70 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:07.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.211+0000 7f2dc45ed700 1 -- 172.21.15.146:0/4146415695 >> 172.21.15.146:0/4146415695 conn(0x7f2dbc06e2a0 msgr2=0x7f2dbc0cef40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:07.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.211+0000 7f2dc45ed700 1 -- 172.21.15.146:0/4146415695 shutdown_connections 2023-05-24T03:30:07.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.211+0000 7f2dc45ed700 1 -- 172.21.15.146:0/4146415695 wait complete. 2023-05-24T03:30:07.219 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-05-24T03:30:07.228 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2023-05-24T03:30:06.712344+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":147016,"kb_used_data":3592,"kb_used_omap":0,"kb_used_meta":143360,"kb_avail":754827704,"statfs":{"total":773094113280,"available":772943568896,"internally_reserved":0,"allocated":3678208,"data_stored":2186592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":146800640},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003233"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.232284+0000","last_change":"2023-05-24T03:29:44.490120+0000","last_active":"2023-05-24T03:29:49.232284+0000","last_peered":"2023-05-24T03:29:49.232284+0000","last_clean":"2023-05-24T03:29:49.232284+0000","last_became_active":"2023-05-24T03:29:44.489854+0000","last_became_peered":"2023-05-24T03:29:44.489854+0000","last_unstale":"2023-05-24T03:29:49.232284+0000","last_undegraded":"2023-05-24T03:29:49.232284+0000","last_fullsized":"2023-05-24T03:29:49.232284+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:33:03.914585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.923811+0000","last_change":"2023-05-24T03:29:44.495973+0000","last_active":"2023-05-24T03:29:48.923811+0000","last_peered":"2023-05-24T03:29:48.923811+0000","last_clean":"2023-05-24T03:29:48.923811+0000","last_became_active":"2023-05-24T03:29:44.495700+0000","last_became_peered":"2023-05-24T03:29:44.495700+0000","last_unstale":"2023-05-24T03:29:48.923811+0000","last_undegraded":"2023-05-24T03:29:48.923811+0000","last_fullsized":"2023-05-24T03:29:48.923811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:27:09.189901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925500+0000","last_change":"2023-05-24T03:29:44.499947+0000","last_active":"2023-05-24T03:29:48.925500+0000","last_peered":"2023-05-24T03:29:48.925500+0000","last_clean":"2023-05-24T03:29:48.925500+0000","last_became_active":"2023-05-24T03:29:44.499663+0000","last_became_peered":"2023-05-24T03:29:44.499663+0000","last_unstale":"2023-05-24T03:29:48.925500+0000","last_undegraded":"2023-05-24T03:29:48.925500+0000","last_fullsized":"2023-05-24T03:29:48.925500+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:14:55.806370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798091+0000","last_change":"2023-05-24T03:29:44.498790+0000","last_active":"2023-05-24T03:29:49.798091+0000","last_peered":"2023-05-24T03:29:49.798091+0000","last_clean":"2023-05-24T03:29:49.798091+0000","last_became_active":"2023-05-24T03:29:44.498528+0000","last_became_peered":"2023-05-24T03:29:44.498528+0000","last_unstale":"2023-05-24T03:29:49.798091+0000","last_undegraded":"2023-05-24T03:29:49.798091+0000","last_fullsized":"2023-05-24T03:29:49.798091+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:37:55.804539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156224+0000","last_change":"2023-05-24T03:29:44.504225+0000","last_active":"2023-05-24T03:29:49.156224+0000","last_peered":"2023-05-24T03:29:49.156224+0000","last_clean":"2023-05-24T03:29:49.156224+0000","last_became_active":"2023-05-24T03:29:44.503998+0000","last_became_peered":"2023-05-24T03:29:44.503998+0000","last_unstale":"2023-05-24T03:29:49.156224+0000","last_undegraded":"2023-05-24T03:29:49.156224+0000","last_fullsized":"2023-05-24T03:29:49.156224+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:12:39.912312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925136+0000","last_change":"2023-05-24T03:29:44.500355+0000","last_active":"2023-05-24T03:29:48.925136+0000","last_peered":"2023-05-24T03:29:48.925136+0000","last_clean":"2023-05-24T03:29:48.925136+0000","last_became_active":"2023-05-24T03:29:44.500065+0000","last_became_peered":"2023-05-24T03:29:44.500065+0000","last_unstale":"2023-05-24T03:29:48.925136+0000","last_undegraded":"2023-05-24T03:29:48.925136+0000","last_fullsized":"2023-05-24T03:29:48.925136+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:43:04.720238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.711626+0000","last_change":"2023-05-24T03:29:44.499607+0000","last_active":"2023-05-24T03:29:49.711626+0000","last_peered":"2023-05-24T03:29:49.711626+0000","last_clean":"2023-05-24T03:29:49.711626+0000","last_became_active":"2023-05-24T03:29:44.499324+0000","last_became_peered":"2023-05-24T03:29:44.499324+0000","last_unstale":"2023-05-24T03:29:49.711626+0000","last_undegraded":"2023-05-24T03:29:49.711626+0000","last_fullsized":"2023-05-24T03:29:49.711626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:54:54.025911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.923288+0000","last_change":"2023-05-24T03:29:44.500576+0000","last_active":"2023-05-24T03:29:48.923288+0000","last_peered":"2023-05-24T03:29:48.923288+0000","last_clean":"2023-05-24T03:29:48.923288+0000","last_became_active":"2023-05-24T03:29:44.500260+0000","last_became_peered":"2023-05-24T03:29:44.500260+0000","last_unstale":"2023-05-24T03:29:48.923288+0000","last_undegraded":"2023-05-24T03:29:48.923288+0000","last_fullsized":"2023-05-24T03:29:48.923288+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:16:38.784464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156365+0000","last_change":"2023-05-24T03:29:44.502655+0000","last_active":"2023-05-24T03:29:49.156365+0000","last_peered":"2023-05-24T03:29:49.156365+0000","last_clean":"2023-05-24T03:29:49.156365+0000","last_became_active":"2023-05-24T03:29:44.502341+0000","last_became_peered":"2023-05-24T03:29:44.502341+0000","last_unstale":"2023-05-24T03:29:49.156365+0000","last_undegraded":"2023-05-24T03:29:49.156365+0000","last_fullsized":"2023-05-24T03:29:49.156365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:17:26.378756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924197+0000","last_change":"2023-05-24T03:29:44.500505+0000","last_active":"2023-05-24T03:29:48.924197+0000","last_peered":"2023-05-24T03:29:48.924197+0000","last_clean":"2023-05-24T03:29:48.924197+0000","last_became_active":"2023-05-24T03:29:44.500156+0000","last_became_peered":"2023-05-24T03:29:44.500156+0000","last_unstale":"2023-05-24T03:29:48.924197+0000","last_undegraded":"2023-05-24T03:29:48.924197+0000","last_fullsized":"2023-05-24T03:29:48.924197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:52:13.818279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925752+0000","last_change":"2023-05-24T03:29:44.492850+0000","last_active":"2023-05-24T03:29:48.925752+0000","last_peered":"2023-05-24T03:29:48.925752+0000","last_clean":"2023-05-24T03:29:48.925752+0000","last_became_active":"2023-05-24T03:29:44.492573+0000","last_became_peered":"2023-05-24T03:29:44.492573+0000","last_unstale":"2023-05-24T03:29:48.925752+0000","last_undegraded":"2023-05-24T03:29:48.925752+0000","last_fullsized":"2023-05-24T03:29:48.925752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:27:24.810532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.232125+0000","last_change":"2023-05-24T03:29:44.501565+0000","last_active":"2023-05-24T03:29:49.232125+0000","last_peered":"2023-05-24T03:29:49.232125+0000","last_clean":"2023-05-24T03:29:49.232125+0000","last_became_active":"2023-05-24T03:29:44.501371+0000","last_became_peered":"2023-05-24T03:29:44.501371+0000","last_unstale":"2023-05-24T03:29:49.232125+0000","last_undegraded":"2023-05-24T03:29:49.232125+0000","last_fullsized":"2023-05-24T03:29:49.232125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:51:11.755899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.232142+0000","last_change":"2023-05-24T03:29:44.490972+0000","last_active":"2023-05-24T03:29:49.232142+0000","last_peered":"2023-05-24T03:29:49.232142+0000","last_clean":"2023-05-24T03:29:49.232142+0000","last_became_active":"2023-05-24T03:29:44.490411+0000","last_became_peered":"2023-05-24T03:29:44.490411+0000","last_unstale":"2023-05-24T03:29:49.232142+0000","last_undegraded":"2023-05-24T03:29:49.232142+0000","last_fullsized":"2023-05-24T03:29:49.232142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:43:24.929689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.923436+0000","last_change":"2023-05-24T03:29:44.495213+0000","last_active":"2023-05-24T03:29:48.923436+0000","last_peered":"2023-05-24T03:29:48.923436+0000","last_clean":"2023-05-24T03:29:48.923436+0000","last_became_active":"2023-05-24T03:29:44.494879+0000","last_became_peered":"2023-05-24T03:29:44.494879+0000","last_unstale":"2023-05-24T03:29:48.923436+0000","last_undegraded":"2023-05-24T03:29:48.923436+0000","last_fullsized":"2023-05-24T03:29:48.923436+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:12:39.912312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.711461+0000","last_change":"2023-05-24T03:29:44.499673+0000","last_active":"2023-05-24T03:29:49.711461+0000","last_peered":"2023-05-24T03:29:49.711461+0000","last_clean":"2023-05-24T03:29:49.711461+0000","last_became_active":"2023-05-24T03:29:44.499393+0000","last_became_peered":"2023-05-24T03:29:44.499393+0000","last_unstale":"2023-05-24T03:29:49.711461+0000","last_undegraded":"2023-05-24T03:29:49.711461+0000","last_fullsized":"2023-05-24T03:29:49.711461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:55:32.189744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925151+0000","last_change":"2023-05-24T03:29:44.501101+0000","last_active":"2023-05-24T03:29:48.925151+0000","last_peered":"2023-05-24T03:29:48.925151+0000","last_clean":"2023-05-24T03:29:48.925151+0000","last_became_active":"2023-05-24T03:29:44.500818+0000","last_became_peered":"2023-05-24T03:29:44.500818+0000","last_unstale":"2023-05-24T03:29:48.925151+0000","last_undegraded":"2023-05-24T03:29:48.925151+0000","last_fullsized":"2023-05-24T03:29:48.925151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:44:17.635928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156394+0000","last_change":"2023-05-24T03:29:44.500209+0000","last_active":"2023-05-24T03:29:49.156394+0000","last_peered":"2023-05-24T03:29:49.156394+0000","last_clean":"2023-05-24T03:29:49.156394+0000","last_became_active":"2023-05-24T03:29:44.499543+0000","last_became_peered":"2023-05-24T03:29:44.499543+0000","last_unstale":"2023-05-24T03:29:49.156394+0000","last_undegraded":"2023-05-24T03:29:49.156394+0000","last_fullsized":"2023-05-24T03:29:49.156394+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:54:54.025911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925839+0000","last_change":"2023-05-24T03:29:44.492545+0000","last_active":"2023-05-24T03:29:48.925839+0000","last_peered":"2023-05-24T03:29:48.925839+0000","last_clean":"2023-05-24T03:29:48.925839+0000","last_became_active":"2023-05-24T03:29:44.492109+0000","last_became_peered":"2023-05-24T03:29:44.492109+0000","last_unstale":"2023-05-24T03:29:48.925839+0000","last_undegraded":"2023-05-24T03:29:48.925839+0000","last_fullsized":"2023-05-24T03:29:48.925839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:14:30.274935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.232313+0000","last_change":"2023-05-24T03:29:44.480834+0000","last_active":"2023-05-24T03:29:49.232313+0000","last_peered":"2023-05-24T03:29:49.232313+0000","last_clean":"2023-05-24T03:29:49.232313+0000","last_became_active":"2023-05-24T03:29:44.480597+0000","last_became_peered":"2023-05-24T03:29:44.480597+0000","last_unstale":"2023-05-24T03:29:49.232313+0000","last_undegraded":"2023-05-24T03:29:49.232313+0000","last_fullsized":"2023-05-24T03:29:49.232313+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:10:15.509028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925476+0000","last_change":"2023-05-24T03:29:44.501003+0000","last_active":"2023-05-24T03:29:48.925476+0000","last_peered":"2023-05-24T03:29:48.925476+0000","last_clean":"2023-05-24T03:29:48.925476+0000","last_became_active":"2023-05-24T03:29:44.499405+0000","last_became_peered":"2023-05-24T03:29:44.499405+0000","last_unstale":"2023-05-24T03:29:48.925476+0000","last_undegraded":"2023-05-24T03:29:48.925476+0000","last_fullsized":"2023-05-24T03:29:48.925476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:26:26.500917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.711735+0000","last_change":"2023-05-24T03:29:44.499151+0000","last_active":"2023-05-24T03:29:49.711735+0000","last_peered":"2023-05-24T03:29:49.711735+0000","last_clean":"2023-05-24T03:29:49.711735+0000","last_became_active":"2023-05-24T03:29:44.498782+0000","last_became_peered":"2023-05-24T03:29:44.498782+0000","last_unstale":"2023-05-24T03:29:49.711735+0000","last_undegraded":"2023-05-24T03:29:49.711735+0000","last_fullsized":"2023-05-24T03:29:49.711735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:48:28.516583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.155935+0000","last_change":"2023-05-24T03:29:44.498675+0000","last_active":"2023-05-24T03:29:49.155935+0000","last_peered":"2023-05-24T03:29:49.155935+0000","last_clean":"2023-05-24T03:29:49.155935+0000","last_became_active":"2023-05-24T03:29:44.498463+0000","last_became_peered":"2023-05-24T03:29:44.498463+0000","last_unstale":"2023-05-24T03:29:49.155935+0000","last_undegraded":"2023-05-24T03:29:49.155935+0000","last_fullsized":"2023-05-24T03:29:49.155935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:51:21.843236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.797699+0000","last_change":"2023-05-24T03:29:44.500169+0000","last_active":"2023-05-24T03:29:49.797699+0000","last_peered":"2023-05-24T03:29:49.797699+0000","last_clean":"2023-05-24T03:29:49.797699+0000","last_became_active":"2023-05-24T03:29:44.499960+0000","last_became_peered":"2023-05-24T03:29:44.499960+0000","last_unstale":"2023-05-24T03:29:49.797699+0000","last_undegraded":"2023-05-24T03:29:49.797699+0000","last_fullsized":"2023-05-24T03:29:49.797699+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:55:32.189744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.711518+0000","last_change":"2023-05-24T03:29:44.499015+0000","last_active":"2023-05-24T03:29:49.711518+0000","last_peered":"2023-05-24T03:29:49.711518+0000","last_clean":"2023-05-24T03:29:49.711518+0000","last_became_active":"2023-05-24T03:29:44.498437+0000","last_became_peered":"2023-05-24T03:29:44.498437+0000","last_unstale":"2023-05-24T03:29:49.711518+0000","last_undegraded":"2023-05-24T03:29:49.711518+0000","last_fullsized":"2023-05-24T03:29:49.711518+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:27:09.189901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920628+0000","last_change":"2023-05-24T03:29:44.481162+0000","last_active":"2023-05-24T03:29:48.920628+0000","last_peered":"2023-05-24T03:29:48.920628+0000","last_clean":"2023-05-24T03:29:48.920628+0000","last_became_active":"2023-05-24T03:29:44.481004+0000","last_became_peered":"2023-05-24T03:29:44.481004+0000","last_unstale":"2023-05-24T03:29:48.920628+0000","last_undegraded":"2023-05-24T03:29:48.920628+0000","last_fullsized":"2023-05-24T03:29:48.920628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:55:32.189744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920849+0000","last_change":"2023-05-24T03:29:44.481942+0000","last_active":"2023-05-24T03:29:48.920849+0000","last_peered":"2023-05-24T03:29:48.920849+0000","last_clean":"2023-05-24T03:29:48.920849+0000","last_became_active":"2023-05-24T03:29:44.481686+0000","last_became_peered":"2023-05-24T03:29:44.481686+0000","last_unstale":"2023-05-24T03:29:48.920849+0000","last_undegraded":"2023-05-24T03:29:48.920849+0000","last_fullsized":"2023-05-24T03:29:48.920849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:13:02.352900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924263+0000","last_change":"2023-05-24T03:29:44.502948+0000","last_active":"2023-05-24T03:29:48.924263+0000","last_peered":"2023-05-24T03:29:48.924263+0000","last_clean":"2023-05-24T03:29:48.924263+0000","last_became_active":"2023-05-24T03:29:44.502669+0000","last_became_peered":"2023-05-24T03:29:44.502669+0000","last_unstale":"2023-05-24T03:29:48.924263+0000","last_undegraded":"2023-05-24T03:29:48.924263+0000","last_fullsized":"2023-05-24T03:29:48.924263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:04:07.700748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925372+0000","last_change":"2023-05-24T03:29:48.523138+0000","last_active":"2023-05-24T03:29:48.925372+0000","last_peered":"2023-05-24T03:29:48.925372+0000","last_clean":"2023-05-24T03:29:48.925372+0000","last_became_active":"2023-05-24T03:29:48.522749+0000","last_became_peered":"2023-05-24T03:29:48.522749+0000","last_unstale":"2023-05-24T03:29:48.925372+0000","last_undegraded":"2023-05-24T03:29:48.925372+0000","last_fullsized":"2023-05-24T03:29:48.925372+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:20:12.731273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925118+0000","last_change":"2023-05-24T03:29:44.086543+0000","last_active":"2023-05-24T03:29:48.925118+0000","last_peered":"2023-05-24T03:29:48.925118+0000","last_clean":"2023-05-24T03:29:48.925118+0000","last_became_active":"2023-05-24T03:29:44.086143+0000","last_became_peered":"2023-05-24T03:29:44.086143+0000","last_unstale":"2023-05-24T03:29:48.925118+0000","last_undegraded":"2023-05-24T03:29:48.925118+0000","last_fullsized":"2023-05-24T03:29:48.925118+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:22:00.186684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798333+0000","last_change":"2023-05-24T03:29:44.491005+0000","last_active":"2023-05-24T03:29:49.798333+0000","last_peered":"2023-05-24T03:29:49.798333+0000","last_clean":"2023-05-24T03:29:49.798333+0000","last_became_active":"2023-05-24T03:29:44.490772+0000","last_became_peered":"2023-05-24T03:29:44.490772+0000","last_unstale":"2023-05-24T03:29:49.798333+0000","last_undegraded":"2023-05-24T03:29:49.798333+0000","last_fullsized":"2023-05-24T03:29:49.798333+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:04:07.700748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798539+0000","last_change":"2023-05-24T03:29:48.523521+0000","last_active":"2023-05-24T03:29:49.798539+0000","last_peered":"2023-05-24T03:29:49.798539+0000","last_clean":"2023-05-24T03:29:49.798539+0000","last_became_active":"2023-05-24T03:29:48.523125+0000","last_became_peered":"2023-05-24T03:29:48.523125+0000","last_unstale":"2023-05-24T03:29:49.798539+0000","last_undegraded":"2023-05-24T03:29:49.798539+0000","last_fullsized":"2023-05-24T03:29:49.798539+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:44:02.617382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920004+0000","last_change":"2023-05-24T03:29:44.084408+0000","last_active":"2023-05-24T03:29:48.920004+0000","last_peered":"2023-05-24T03:29:48.920004+0000","last_clean":"2023-05-24T03:29:48.920004+0000","last_became_active":"2023-05-24T03:29:44.084099+0000","last_became_peered":"2023-05-24T03:29:44.084099+0000","last_unstale":"2023-05-24T03:29:48.920004+0000","last_undegraded":"2023-05-24T03:29:48.920004+0000","last_fullsized":"2023-05-24T03:29:48.920004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:14:05.716019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156351+0000","last_change":"2023-05-24T03:29:44.503346+0000","last_active":"2023-05-24T03:29:49.156351+0000","last_peered":"2023-05-24T03:29:49.156351+0000","last_clean":"2023-05-24T03:29:49.156351+0000","last_became_active":"2023-05-24T03:29:44.503039+0000","last_became_peered":"2023-05-24T03:29:44.503039+0000","last_unstale":"2023-05-24T03:29:49.156351+0000","last_undegraded":"2023-05-24T03:29:49.156351+0000","last_fullsized":"2023-05-24T03:29:49.156351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:55:32.189744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156521+0000","last_change":"2023-05-24T03:29:48.529615+0000","last_active":"2023-05-24T03:29:49.156521+0000","last_peered":"2023-05-24T03:29:49.156521+0000","last_clean":"2023-05-24T03:29:49.156521+0000","last_became_active":"2023-05-24T03:29:48.529142+0000","last_became_peered":"2023-05-24T03:29:48.529142+0000","last_unstale":"2023-05-24T03:29:49.156521+0000","last_undegraded":"2023-05-24T03:29:49.156521+0000","last_fullsized":"2023-05-24T03:29:49.156521+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:48:31.938863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798028+0000","last_change":"2023-05-24T03:29:44.085410+0000","last_active":"2023-05-24T03:29:49.798028+0000","last_peered":"2023-05-24T03:29:49.798028+0000","last_clean":"2023-05-24T03:29:49.798028+0000","last_became_active":"2023-05-24T03:29:44.084907+0000","last_became_peered":"2023-05-24T03:29:44.084907+0000","last_unstale":"2023-05-24T03:29:49.798028+0000","last_undegraded":"2023-05-24T03:29:49.798028+0000","last_fullsized":"2023-05-24T03:29:49.798028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:06:44.879201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798596+0000","last_change":"2023-05-24T03:29:44.497128+0000","last_active":"2023-05-24T03:29:49.798596+0000","last_peered":"2023-05-24T03:29:49.798596+0000","last_clean":"2023-05-24T03:29:49.798596+0000","last_became_active":"2023-05-24T03:29:44.496746+0000","last_became_peered":"2023-05-24T03:29:44.496746+0000","last_unstale":"2023-05-24T03:29:49.798596+0000","last_undegraded":"2023-05-24T03:29:49.798596+0000","last_fullsized":"2023-05-24T03:29:49.798596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:50:28.601742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798309+0000","last_change":"2023-05-24T03:29:48.520693+0000","last_active":"2023-05-24T03:29:49.798309+0000","last_peered":"2023-05-24T03:29:49.798309+0000","last_clean":"2023-05-24T03:29:49.798309+0000","last_became_active":"2023-05-24T03:29:48.520319+0000","last_became_peered":"2023-05-24T03:29:48.520319+0000","last_unstale":"2023-05-24T03:29:49.798309+0000","last_undegraded":"2023-05-24T03:29:49.798309+0000","last_fullsized":"2023-05-24T03:29:49.798309+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:55:04.423811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156490+0000","last_change":"2023-05-24T03:29:44.088769+0000","last_active":"2023-05-24T03:29:49.156490+0000","last_peered":"2023-05-24T03:29:49.156490+0000","last_clean":"2023-05-24T03:29:49.156490+0000","last_became_active":"2023-05-24T03:29:44.088267+0000","last_became_peered":"2023-05-24T03:29:44.088267+0000","last_unstale":"2023-05-24T03:29:49.156490+0000","last_undegraded":"2023-05-24T03:29:49.156490+0000","last_fullsized":"2023-05-24T03:29:49.156490+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:06:44.879201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.797921+0000","last_change":"2023-05-24T03:29:44.489309+0000","last_active":"2023-05-24T03:29:49.797921+0000","last_peered":"2023-05-24T03:29:49.797921+0000","last_clean":"2023-05-24T03:29:49.797921+0000","last_became_active":"2023-05-24T03:29:44.488666+0000","last_became_peered":"2023-05-24T03:29:44.488666+0000","last_unstale":"2023-05-24T03:29:49.797921+0000","last_undegraded":"2023-05-24T03:29:49.797921+0000","last_fullsized":"2023-05-24T03:29:49.797921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:27:09.189901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.711386+0000","last_change":"2023-05-24T03:29:48.518108+0000","last_active":"2023-05-24T03:29:49.711386+0000","last_peered":"2023-05-24T03:29:49.711386+0000","last_clean":"2023-05-24T03:29:49.711386+0000","last_became_active":"2023-05-24T03:29:48.517771+0000","last_became_peered":"2023-05-24T03:29:48.517771+0000","last_unstale":"2023-05-24T03:29:49.711386+0000","last_undegraded":"2023-05-24T03:29:49.711386+0000","last_fullsized":"2023-05-24T03:29:49.711386+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:37:26.748143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.923964+0000","last_change":"2023-05-24T03:29:44.087910+0000","last_active":"2023-05-24T03:29:48.923964+0000","last_peered":"2023-05-24T03:29:48.923964+0000","last_clean":"2023-05-24T03:29:48.923964+0000","last_became_active":"2023-05-24T03:29:44.087601+0000","last_became_peered":"2023-05-24T03:29:44.087601+0000","last_unstale":"2023-05-24T03:29:48.923964+0000","last_undegraded":"2023-05-24T03:29:48.923964+0000","last_fullsized":"2023-05-24T03:29:48.923964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:59:05.268973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.797675+0000","last_change":"2023-05-24T03:29:44.496020+0000","last_active":"2023-05-24T03:29:49.797675+0000","last_peered":"2023-05-24T03:29:49.797675+0000","last_clean":"2023-05-24T03:29:49.797675+0000","last_became_active":"2023-05-24T03:29:44.495752+0000","last_became_peered":"2023-05-24T03:29:44.495752+0000","last_unstale":"2023-05-24T03:29:49.797675+0000","last_undegraded":"2023-05-24T03:29:49.797675+0000","last_fullsized":"2023-05-24T03:29:49.797675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:42:07.310986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798229+0000","last_change":"2023-05-24T03:29:48.529893+0000","last_active":"2023-05-24T03:29:49.798229+0000","last_peered":"2023-05-24T03:29:49.798229+0000","last_clean":"2023-05-24T03:29:49.798229+0000","last_became_active":"2023-05-24T03:29:48.529514+0000","last_became_peered":"2023-05-24T03:29:48.529514+0000","last_unstale":"2023-05-24T03:29:49.798229+0000","last_undegraded":"2023-05-24T03:29:49.798229+0000","last_fullsized":"2023-05-24T03:29:49.798229+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:19:31.096262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.711996+0000","last_change":"2023-05-24T03:29:44.091648+0000","last_active":"2023-05-24T03:29:49.711996+0000","last_peered":"2023-05-24T03:29:49.711996+0000","last_clean":"2023-05-24T03:29:49.711996+0000","last_became_active":"2023-05-24T03:29:44.091390+0000","last_became_peered":"2023-05-24T03:29:44.091390+0000","last_unstale":"2023-05-24T03:29:49.711996+0000","last_undegraded":"2023-05-24T03:29:49.711996+0000","last_fullsized":"2023-05-24T03:29:49.711996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:37:43.011120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920406+0000","last_change":"2023-05-24T03:29:44.481629+0000","last_active":"2023-05-24T03:29:48.920406+0000","last_peered":"2023-05-24T03:29:48.920406+0000","last_clean":"2023-05-24T03:29:48.920406+0000","last_became_active":"2023-05-24T03:29:44.481385+0000","last_became_peered":"2023-05-24T03:29:44.481385+0000","last_unstale":"2023-05-24T03:29:48.920406+0000","last_undegraded":"2023-05-24T03:29:48.920406+0000","last_fullsized":"2023-05-24T03:29:48.920406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:27:52.176207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920327+0000","last_change":"2023-05-24T03:29:48.524712+0000","last_active":"2023-05-24T03:29:48.920327+0000","last_peered":"2023-05-24T03:29:48.920327+0000","last_clean":"2023-05-24T03:29:48.920327+0000","last_became_active":"2023-05-24T03:29:48.524312+0000","last_became_peered":"2023-05-24T03:29:48.524312+0000","last_unstale":"2023-05-24T03:29:48.920327+0000","last_undegraded":"2023-05-24T03:29:48.920327+0000","last_fullsized":"2023-05-24T03:29:48.920327+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:13:47.041051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'9","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:53.574777+0000","last_change":"2023-05-24T03:29:44.079067+0000","last_active":"2023-05-24T03:29:53.574777+0000","last_peered":"2023-05-24T03:29:53.574777+0000","last_clean":"2023-05-24T03:29:53.574777+0000","last_became_active":"2023-05-24T03:29:44.078785+0000","last_became_peered":"2023-05-24T03:29:44.078785+0000","last_unstale":"2023-05-24T03:29:53.574777+0000","last_undegraded":"2023-05-24T03:29:53.574777+0000","last_fullsized":"2023-05-24T03:29:53.574777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:32:31.553230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925391+0000","last_change":"2023-05-24T03:29:44.497603+0000","last_active":"2023-05-24T03:29:48.925391+0000","last_peered":"2023-05-24T03:29:48.925391+0000","last_clean":"2023-05-24T03:29:48.925391+0000","last_became_active":"2023-05-24T03:29:44.497120+0000","last_became_peered":"2023-05-24T03:29:44.497120+0000","last_unstale":"2023-05-24T03:29:48.925391+0000","last_undegraded":"2023-05-24T03:29:48.925391+0000","last_fullsized":"2023-05-24T03:29:48.925391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:18:47.235377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924432+0000","last_change":"2023-05-24T03:29:48.531846+0000","last_active":"2023-05-24T03:29:48.924432+0000","last_peered":"2023-05-24T03:29:48.924432+0000","last_clean":"2023-05-24T03:29:48.924432+0000","last_became_active":"2023-05-24T03:29:48.531538+0000","last_became_peered":"2023-05-24T03:29:48.531538+0000","last_unstale":"2023-05-24T03:29:48.924432+0000","last_undegraded":"2023-05-24T03:29:48.924432+0000","last_fullsized":"2023-05-24T03:29:48.924432+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:59:12.868748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.711788+0000","last_change":"2023-05-24T03:29:44.087315+0000","last_active":"2023-05-24T03:29:49.711788+0000","last_peered":"2023-05-24T03:29:49.711788+0000","last_clean":"2023-05-24T03:29:49.711788+0000","last_became_active":"2023-05-24T03:29:44.086997+0000","last_became_peered":"2023-05-24T03:29:44.086997+0000","last_unstale":"2023-05-24T03:29:49.711788+0000","last_undegraded":"2023-05-24T03:29:49.711788+0000","last_fullsized":"2023-05-24T03:29:49.711788+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:06:44.879201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798223+0000","last_change":"2023-05-24T03:29:44.487497+0000","last_active":"2023-05-24T03:29:49.798223+0000","last_peered":"2023-05-24T03:29:49.798223+0000","last_clean":"2023-05-24T03:29:49.798223+0000","last_became_active":"2023-05-24T03:29:44.487257+0000","last_became_peered":"2023-05-24T03:29:44.487257+0000","last_unstale":"2023-05-24T03:29:49.798223+0000","last_undegraded":"2023-05-24T03:29:49.798223+0000","last_fullsized":"2023-05-24T03:29:49.798223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:37:44.017565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798223+0000","last_change":"2023-05-24T03:29:48.526115+0000","last_active":"2023-05-24T03:29:49.798223+0000","last_peered":"2023-05-24T03:29:49.798223+0000","last_clean":"2023-05-24T03:29:49.798223+0000","last_became_active":"2023-05-24T03:29:48.525726+0000","last_became_peered":"2023-05-24T03:29:48.525726+0000","last_unstale":"2023-05-24T03:29:49.798223+0000","last_undegraded":"2023-05-24T03:29:49.798223+0000","last_fullsized":"2023-05-24T03:29:49.798223+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:59:09.697698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.155791+0000","last_change":"2023-05-24T03:29:44.084599+0000","last_active":"2023-05-24T03:29:49.155791+0000","last_peered":"2023-05-24T03:29:49.155791+0000","last_clean":"2023-05-24T03:29:49.155791+0000","last_became_active":"2023-05-24T03:29:44.084278+0000","last_became_peered":"2023-05-24T03:29:44.084278+0000","last_unstale":"2023-05-24T03:29:49.155791+0000","last_undegraded":"2023-05-24T03:29:49.155791+0000","last_fullsized":"2023-05-24T03:29:49.155791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:13:42.612325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924229+0000","last_change":"2023-05-24T03:29:44.498378+0000","last_active":"2023-05-24T03:29:48.924229+0000","last_peered":"2023-05-24T03:29:48.924229+0000","last_clean":"2023-05-24T03:29:48.924229+0000","last_became_active":"2023-05-24T03:29:44.498097+0000","last_became_peered":"2023-05-24T03:29:44.498097+0000","last_unstale":"2023-05-24T03:29:48.924229+0000","last_undegraded":"2023-05-24T03:29:48.924229+0000","last_fullsized":"2023-05-24T03:29:48.924229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:37:44.017565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798670+0000","last_change":"2023-05-24T03:29:48.525018+0000","last_active":"2023-05-24T03:29:49.798670+0000","last_peered":"2023-05-24T03:29:49.798670+0000","last_clean":"2023-05-24T03:29:49.798670+0000","last_became_active":"2023-05-24T03:29:48.524602+0000","last_became_peered":"2023-05-24T03:29:48.524602+0000","last_unstale":"2023-05-24T03:29:49.798670+0000","last_undegraded":"2023-05-24T03:29:49.798670+0000","last_fullsized":"2023-05-24T03:29:49.798670+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:25:43.600049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.711568+0000","last_change":"2023-05-24T03:29:44.085212+0000","last_active":"2023-05-24T03:29:49.711568+0000","last_peered":"2023-05-24T03:29:49.711568+0000","last_clean":"2023-05-24T03:29:49.711568+0000","last_became_active":"2023-05-24T03:29:44.085001+0000","last_became_peered":"2023-05-24T03:29:44.085001+0000","last_unstale":"2023-05-24T03:29:49.711568+0000","last_undegraded":"2023-05-24T03:29:49.711568+0000","last_fullsized":"2023-05-24T03:29:49.711568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:13:01.346454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156439+0000","last_change":"2023-05-24T03:29:44.500883+0000","last_active":"2023-05-24T03:29:49.156439+0000","last_peered":"2023-05-24T03:29:49.156439+0000","last_clean":"2023-05-24T03:29:49.156439+0000","last_became_active":"2023-05-24T03:29:44.500631+0000","last_became_peered":"2023-05-24T03:29:44.500631+0000","last_unstale":"2023-05-24T03:29:49.156439+0000","last_undegraded":"2023-05-24T03:29:49.156439+0000","last_fullsized":"2023-05-24T03:29:49.156439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:47:24.077381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.923764+0000","last_change":"2023-05-24T03:29:48.523523+0000","last_active":"2023-05-24T03:29:48.923764+0000","last_peered":"2023-05-24T03:29:48.923764+0000","last_clean":"2023-05-24T03:29:48.923764+0000","last_became_active":"2023-05-24T03:29:48.523138+0000","last_became_peered":"2023-05-24T03:29:48.523138+0000","last_unstale":"2023-05-24T03:29:48.923764+0000","last_undegraded":"2023-05-24T03:29:48.923764+0000","last_fullsized":"2023-05-24T03:29:48.923764+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:17:29.801036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.797983+0000","last_change":"2023-05-24T03:29:44.085229+0000","last_active":"2023-05-24T03:29:49.797983+0000","last_peered":"2023-05-24T03:29:49.797983+0000","last_clean":"2023-05-24T03:29:49.797983+0000","last_became_active":"2023-05-24T03:29:44.084914+0000","last_became_peered":"2023-05-24T03:29:44.084914+0000","last_unstale":"2023-05-24T03:29:49.797983+0000","last_undegraded":"2023-05-24T03:29:49.797983+0000","last_fullsized":"2023-05-24T03:29:49.797983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:13:33.993784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798728+0000","last_change":"2023-05-24T03:29:44.496038+0000","last_active":"2023-05-24T03:29:49.798728+0000","last_peered":"2023-05-24T03:29:49.798728+0000","last_clean":"2023-05-24T03:29:49.798728+0000","last_became_active":"2023-05-24T03:29:44.495795+0000","last_became_peered":"2023-05-24T03:29:44.495795+0000","last_unstale":"2023-05-24T03:29:49.798728+0000","last_undegraded":"2023-05-24T03:29:49.798728+0000","last_fullsized":"2023-05-24T03:29:49.798728+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:09:24.928940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.712227+0000","last_change":"2023-05-24T03:29:48.518930+0000","last_active":"2023-05-24T03:29:49.712227+0000","last_peered":"2023-05-24T03:29:49.712227+0000","last_clean":"2023-05-24T03:29:49.712227+0000","last_became_active":"2023-05-24T03:29:48.518531+0000","last_became_peered":"2023-05-24T03:29:48.518531+0000","last_unstale":"2023-05-24T03:29:49.712227+0000","last_undegraded":"2023-05-24T03:29:49.712227+0000","last_fullsized":"2023-05-24T03:29:49.712227+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:04:11.123028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.712271+0000","last_change":"2023-05-24T03:29:44.089650+0000","last_active":"2023-05-24T03:29:49.712271+0000","last_peered":"2023-05-24T03:29:49.712271+0000","last_clean":"2023-05-24T03:29:49.712271+0000","last_became_active":"2023-05-24T03:29:44.089340+0000","last_became_peered":"2023-05-24T03:29:44.089340+0000","last_unstale":"2023-05-24T03:29:49.712271+0000","last_undegraded":"2023-05-24T03:29:49.712271+0000","last_fullsized":"2023-05-24T03:29:49.712271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:25:39.171324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.923182+0000","last_change":"2023-05-24T03:29:44.498089+0000","last_active":"2023-05-24T03:29:48.923182+0000","last_peered":"2023-05-24T03:29:48.923182+0000","last_clean":"2023-05-24T03:29:48.923182+0000","last_became_active":"2023-05-24T03:29:44.497795+0000","last_became_peered":"2023-05-24T03:29:44.497795+0000","last_unstale":"2023-05-24T03:29:48.923182+0000","last_undegraded":"2023-05-24T03:29:48.923182+0000","last_fullsized":"2023-05-24T03:29:48.923182+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:30:56.976033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.231935+0000","last_change":"2023-05-24T03:29:48.521349+0000","last_active":"2023-05-24T03:29:49.231935+0000","last_peered":"2023-05-24T03:29:49.231935+0000","last_clean":"2023-05-24T03:29:49.231935+0000","last_became_active":"2023-05-24T03:29:48.520899+0000","last_became_peered":"2023-05-24T03:29:48.520899+0000","last_unstale":"2023-05-24T03:29:49.231935+0000","last_undegraded":"2023-05-24T03:29:49.231935+0000","last_fullsized":"2023-05-24T03:29:49.231935+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:39:27.313301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.712201+0000","last_change":"2023-05-24T03:29:44.086355+0000","last_active":"2023-05-24T03:29:49.712201+0000","last_peered":"2023-05-24T03:29:49.712201+0000","last_clean":"2023-05-24T03:29:49.712201+0000","last_became_active":"2023-05-24T03:29:44.086054+0000","last_became_peered":"2023-05-24T03:29:44.086054+0000","last_unstale":"2023-05-24T03:29:49.712201+0000","last_undegraded":"2023-05-24T03:29:49.712201+0000","last_fullsized":"2023-05-24T03:29:49.712201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:59:08.440023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924885+0000","last_change":"2023-05-24T03:29:44.492413+0000","last_active":"2023-05-24T03:29:48.924885+0000","last_peered":"2023-05-24T03:29:48.924885+0000","last_clean":"2023-05-24T03:29:48.924885+0000","last_became_active":"2023-05-24T03:29:44.492099+0000","last_became_peered":"2023-05-24T03:29:44.492099+0000","last_unstale":"2023-05-24T03:29:48.924885+0000","last_undegraded":"2023-05-24T03:29:48.924885+0000","last_fullsized":"2023-05-24T03:29:48.924885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:10:14.728343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.232089+0000","last_change":"2023-05-24T03:29:48.522128+0000","last_active":"2023-05-24T03:29:49.232089+0000","last_peered":"2023-05-24T03:29:49.232089+0000","last_clean":"2023-05-24T03:29:49.232089+0000","last_became_active":"2023-05-24T03:29:48.521729+0000","last_became_peered":"2023-05-24T03:29:48.521729+0000","last_unstale":"2023-05-24T03:29:49.232089+0000","last_undegraded":"2023-05-24T03:29:49.232089+0000","last_fullsized":"2023-05-24T03:29:49.232089+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:56:43.026692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.712235+0000","last_change":"2023-05-24T03:29:44.088761+0000","last_active":"2023-05-24T03:29:49.712235+0000","last_peered":"2023-05-24T03:29:49.712235+0000","last_clean":"2023-05-24T03:29:49.712235+0000","last_became_active":"2023-05-24T03:29:44.088459+0000","last_became_peered":"2023-05-24T03:29:44.088459+0000","last_unstale":"2023-05-24T03:29:49.712235+0000","last_undegraded":"2023-05-24T03:29:49.712235+0000","last_fullsized":"2023-05-24T03:29:49.712235+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:59:51.303175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.797882+0000","last_change":"2023-05-24T03:29:44.490252+0000","last_active":"2023-05-24T03:29:49.797882+0000","last_peered":"2023-05-24T03:29:49.797882+0000","last_clean":"2023-05-24T03:29:49.797882+0000","last_became_active":"2023-05-24T03:29:44.489975+0000","last_became_peered":"2023-05-24T03:29:44.489975+0000","last_unstale":"2023-05-24T03:29:49.797882+0000","last_undegraded":"2023-05-24T03:29:49.797882+0000","last_fullsized":"2023-05-24T03:29:49.797882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:23:37.430993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.232052+0000","last_change":"2023-05-24T03:29:48.523911+0000","last_active":"2023-05-24T03:29:49.232052+0000","last_peered":"2023-05-24T03:29:49.232052+0000","last_clean":"2023-05-24T03:29:49.232052+0000","last_became_active":"2023-05-24T03:29:48.523545+0000","last_became_peered":"2023-05-24T03:29:48.523545+0000","last_unstale":"2023-05-24T03:29:49.232052+0000","last_undegraded":"2023-05-24T03:29:49.232052+0000","last_fullsized":"2023-05-24T03:29:49.232052+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:03:23.555501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.923539+0000","last_change":"2023-05-24T03:29:44.091185+0000","last_active":"2023-05-24T03:29:48.923539+0000","last_peered":"2023-05-24T03:29:48.923539+0000","last_clean":"2023-05-24T03:29:48.923539+0000","last_became_active":"2023-05-24T03:29:44.090887+0000","last_became_peered":"2023-05-24T03:29:44.090887+0000","last_unstale":"2023-05-24T03:29:48.923539+0000","last_undegraded":"2023-05-24T03:29:48.923539+0000","last_fullsized":"2023-05-24T03:29:48.923539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:37:22.319418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156514+0000","last_change":"2023-05-24T03:29:44.502570+0000","last_active":"2023-05-24T03:29:49.156514+0000","last_peered":"2023-05-24T03:29:49.156514+0000","last_clean":"2023-05-24T03:29:49.156514+0000","last_became_active":"2023-05-24T03:29:44.502286+0000","last_became_peered":"2023-05-24T03:29:44.502286+0000","last_unstale":"2023-05-24T03:29:49.156514+0000","last_undegraded":"2023-05-24T03:29:49.156514+0000","last_fullsized":"2023-05-24T03:29:49.156514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:59:06.275418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.232426+0000","last_change":"2023-05-24T03:29:48.521750+0000","last_active":"2023-05-24T03:29:49.232426+0000","last_peered":"2023-05-24T03:29:49.232426+0000","last_clean":"2023-05-24T03:29:49.232426+0000","last_became_active":"2023-05-24T03:29:48.520960+0000","last_became_peered":"2023-05-24T03:29:48.520960+0000","last_unstale":"2023-05-24T03:29:49.232426+0000","last_undegraded":"2023-05-24T03:29:49.232426+0000","last_fullsized":"2023-05-24T03:29:49.232426+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T03:39:23.517439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.797919+0000","last_change":"2023-05-24T03:29:44.088157+0000","last_active":"2023-05-24T03:29:49.797919+0000","last_peered":"2023-05-24T03:29:49.797919+0000","last_clean":"2023-05-24T03:29:49.797919+0000","last_became_active":"2023-05-24T03:29:44.087869+0000","last_became_peered":"2023-05-24T03:29:44.087869+0000","last_unstale":"2023-05-24T03:29:49.797919+0000","last_undegraded":"2023-05-24T03:29:49.797919+0000","last_fullsized":"2023-05-24T03:29:49.797919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:47:23.070936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925265+0000","last_change":"2023-05-24T03:29:44.501176+0000","last_active":"2023-05-24T03:29:48.925265+0000","last_peered":"2023-05-24T03:29:48.925265+0000","last_clean":"2023-05-24T03:29:48.925265+0000","last_became_active":"2023-05-24T03:29:44.499700+0000","last_became_peered":"2023-05-24T03:29:44.499700+0000","last_unstale":"2023-05-24T03:29:48.925265+0000","last_undegraded":"2023-05-24T03:29:48.925265+0000","last_fullsized":"2023-05-24T03:29:48.925265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:31:52.511256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920217+0000","last_change":"2023-05-24T03:29:48.522778+0000","last_active":"2023-05-24T03:29:48.920217+0000","last_peered":"2023-05-24T03:29:48.920217+0000","last_clean":"2023-05-24T03:29:48.920217+0000","last_became_active":"2023-05-24T03:29:48.522104+0000","last_became_peered":"2023-05-24T03:29:48.522104+0000","last_unstale":"2023-05-24T03:29:48.920217+0000","last_undegraded":"2023-05-24T03:29:48.920217+0000","last_fullsized":"2023-05-24T03:29:48.920217+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:43:13.521320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.797884+0000","last_change":"2023-05-24T03:29:44.085211+0000","last_active":"2023-05-24T03:29:49.797884+0000","last_peered":"2023-05-24T03:29:49.797884+0000","last_clean":"2023-05-24T03:29:49.797884+0000","last_became_active":"2023-05-24T03:29:44.084894+0000","last_became_peered":"2023-05-24T03:29:44.084894+0000","last_unstale":"2023-05-24T03:29:49.797884+0000","last_undegraded":"2023-05-24T03:29:49.797884+0000","last_fullsized":"2023-05-24T03:29:49.797884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:12:00.580737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925495+0000","last_change":"2023-05-24T03:29:44.492807+0000","last_active":"2023-05-24T03:29:48.925495+0000","last_peered":"2023-05-24T03:29:48.925495+0000","last_clean":"2023-05-24T03:29:48.925495+0000","last_became_active":"2023-05-24T03:29:44.492462+0000","last_became_peered":"2023-05-24T03:29:44.492462+0000","last_unstale":"2023-05-24T03:29:48.925495+0000","last_undegraded":"2023-05-24T03:29:48.925495+0000","last_fullsized":"2023-05-24T03:29:48.925495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:58:20.689097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924069+0000","last_change":"2023-05-24T03:29:48.524960+0000","last_active":"2023-05-24T03:29:48.924069+0000","last_peered":"2023-05-24T03:29:48.924069+0000","last_clean":"2023-05-24T03:29:48.924069+0000","last_became_active":"2023-05-24T03:29:48.524023+0000","last_became_peered":"2023-05-24T03:29:48.524023+0000","last_unstale":"2023-05-24T03:29:48.924069+0000","last_undegraded":"2023-05-24T03:29:48.924069+0000","last_fullsized":"2023-05-24T03:29:48.924069+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:06:49.307926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924625+0000","last_change":"2023-05-24T03:29:44.082700+0000","last_active":"2023-05-24T03:29:48.924625+0000","last_peered":"2023-05-24T03:29:48.924625+0000","last_clean":"2023-05-24T03:29:48.924625+0000","last_became_active":"2023-05-24T03:29:44.082382+0000","last_became_peered":"2023-05-24T03:29:44.082382+0000","last_unstale":"2023-05-24T03:29:48.924625+0000","last_undegraded":"2023-05-24T03:29:48.924625+0000","last_fullsized":"2023-05-24T03:29:48.924625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:25:39.171324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925735+0000","last_change":"2023-05-24T03:29:44.501409+0000","last_active":"2023-05-24T03:29:48.925735+0000","last_peered":"2023-05-24T03:29:48.925735+0000","last_clean":"2023-05-24T03:29:48.925735+0000","last_became_active":"2023-05-24T03:29:44.501080+0000","last_became_peered":"2023-05-24T03:29:44.501080+0000","last_unstale":"2023-05-24T03:29:48.925735+0000","last_undegraded":"2023-05-24T03:29:48.925735+0000","last_fullsized":"2023-05-24T03:29:48.925735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T03:40:05.771938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925745+0000","last_change":"2023-05-24T03:29:48.519383+0000","last_active":"2023-05-24T03:29:48.925745+0000","last_peered":"2023-05-24T03:29:48.925745+0000","last_clean":"2023-05-24T03:29:48.925745+0000","last_became_active":"2023-05-24T03:29:48.519046+0000","last_became_peered":"2023-05-24T03:29:48.519046+0000","last_unstale":"2023-05-24T03:29:48.925745+0000","last_undegraded":"2023-05-24T03:29:48.925745+0000","last_fullsized":"2023-05-24T03:29:48.925745+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:55:49.240935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.797812+0000","last_change":"2023-05-24T03:29:44.085771+0000","last_active":"2023-05-24T03:29:49.797812+0000","last_peered":"2023-05-24T03:29:49.797812+0000","last_clean":"2023-05-24T03:29:49.797812+0000","last_became_active":"2023-05-24T03:29:44.085420+0000","last_became_peered":"2023-05-24T03:29:44.085420+0000","last_unstale":"2023-05-24T03:29:49.797812+0000","last_undegraded":"2023-05-24T03:29:49.797812+0000","last_fullsized":"2023-05-24T03:29:49.797812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:17:25.372310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920855+0000","last_change":"2023-05-24T03:29:44.491345+0000","last_active":"2023-05-24T03:29:48.920855+0000","last_peered":"2023-05-24T03:29:48.920855+0000","last_clean":"2023-05-24T03:29:48.920855+0000","last_became_active":"2023-05-24T03:29:44.491089+0000","last_became_peered":"2023-05-24T03:29:44.491089+0000","last_unstale":"2023-05-24T03:29:48.920855+0000","last_undegraded":"2023-05-24T03:29:48.920855+0000","last_fullsized":"2023-05-24T03:29:48.920855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:27:09.189901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156263+0000","last_change":"2023-05-24T03:29:48.530105+0000","last_active":"2023-05-24T03:29:49.156263+0000","last_peered":"2023-05-24T03:29:49.156263+0000","last_clean":"2023-05-24T03:29:49.156263+0000","last_became_active":"2023-05-24T03:29:48.529157+0000","last_became_peered":"2023-05-24T03:29:48.529157+0000","last_unstale":"2023-05-24T03:29:49.156263+0000","last_undegraded":"2023-05-24T03:29:49.156263+0000","last_fullsized":"2023-05-24T03:29:49.156263+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:16:42.206744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920406+0000","last_change":"2023-05-24T03:29:39.143199+0000","last_active":"2023-05-24T03:29:48.920406+0000","last_peered":"2023-05-24T03:29:48.920406+0000","last_clean":"2023-05-24T03:29:48.920406+0000","last_became_active":"2023-05-24T03:29:39.142867+0000","last_became_peered":"2023-05-24T03:29:39.142867+0000","last_unstale":"2023-05-24T03:29:48.920406+0000","last_undegraded":"2023-05-24T03:29:48.920406+0000","last_fullsized":"2023-05-24T03:29:48.920406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:30:50.951434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924073+0000","last_change":"2023-05-24T03:29:44.087790+0000","last_active":"2023-05-24T03:29:48.924073+0000","last_peered":"2023-05-24T03:29:48.924073+0000","last_clean":"2023-05-24T03:29:48.924073+0000","last_became_active":"2023-05-24T03:29:44.087475+0000","last_became_peered":"2023-05-24T03:29:44.087475+0000","last_unstale":"2023-05-24T03:29:48.924073+0000","last_undegraded":"2023-05-24T03:29:48.924073+0000","last_fullsized":"2023-05-24T03:29:48.924073+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:19:26.667537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920215+0000","last_change":"2023-05-24T03:29:44.497235+0000","last_active":"2023-05-24T03:29:48.920215+0000","last_peered":"2023-05-24T03:29:48.920215+0000","last_clean":"2023-05-24T03:29:48.920215+0000","last_became_active":"2023-05-24T03:29:44.497015+0000","last_became_peered":"2023-05-24T03:29:44.497015+0000","last_unstale":"2023-05-24T03:29:48.920215+0000","last_undegraded":"2023-05-24T03:29:48.920215+0000","last_fullsized":"2023-05-24T03:29:48.920215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:57:57.662351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156092+0000","last_change":"2023-05-24T03:29:48.527805+0000","last_active":"2023-05-24T03:29:49.156092+0000","last_peered":"2023-05-24T03:29:49.156092+0000","last_clean":"2023-05-24T03:29:49.156092+0000","last_became_active":"2023-05-24T03:29:48.527010+0000","last_became_peered":"2023-05-24T03:29:48.527010+0000","last_unstale":"2023-05-24T03:29:49.156092+0000","last_undegraded":"2023-05-24T03:29:49.156092+0000","last_fullsized":"2023-05-24T03:29:49.156092+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:27:55.598487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.923462+0000","last_change":"2023-05-24T03:29:39.048516+0000","last_active":"2023-05-24T03:29:48.923462+0000","last_peered":"2023-05-24T03:29:48.923462+0000","last_clean":"2023-05-24T03:29:48.923462+0000","last_became_active":"2023-05-24T03:29:39.048141+0000","last_became_peered":"2023-05-24T03:29:39.048141+0000","last_unstale":"2023-05-24T03:29:48.923462+0000","last_undegraded":"2023-05-24T03:29:48.923462+0000","last_fullsized":"2023-05-24T03:29:48.923462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:42:01.286387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925527+0000","last_change":"2023-05-24T03:29:44.085282+0000","last_active":"2023-05-24T03:29:48.925527+0000","last_peered":"2023-05-24T03:29:48.925527+0000","last_clean":"2023-05-24T03:29:48.925527+0000","last_became_active":"2023-05-24T03:29:44.084944+0000","last_became_peered":"2023-05-24T03:29:44.084944+0000","last_unstale":"2023-05-24T03:29:48.925527+0000","last_undegraded":"2023-05-24T03:29:48.925527+0000","last_fullsized":"2023-05-24T03:29:48.925527+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:09:43.787048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920293+0000","last_change":"2023-05-24T03:29:44.483553+0000","last_active":"2023-05-24T03:29:48.920293+0000","last_peered":"2023-05-24T03:29:48.920293+0000","last_clean":"2023-05-24T03:29:48.920293+0000","last_became_active":"2023-05-24T03:29:44.483134+0000","last_became_peered":"2023-05-24T03:29:44.483134+0000","last_unstale":"2023-05-24T03:29:48.920293+0000","last_undegraded":"2023-05-24T03:29:48.920293+0000","last_fullsized":"2023-05-24T03:29:48.920293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:51:21.843236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.232485+0000","last_change":"2023-05-24T03:29:48.519249+0000","last_active":"2023-05-24T03:29:49.232485+0000","last_peered":"2023-05-24T03:29:49.232485+0000","last_clean":"2023-05-24T03:29:49.232485+0000","last_became_active":"2023-05-24T03:29:48.518546+0000","last_became_peered":"2023-05-24T03:29:48.518546+0000","last_unstale":"2023-05-24T03:29:49.232485+0000","last_undegraded":"2023-05-24T03:29:49.232485+0000","last_fullsized":"2023-05-24T03:29:49.232485+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:03:54.662293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.232195+0000","last_change":"2023-05-24T03:29:39.310351+0000","last_active":"2023-05-24T03:29:49.232195+0000","last_peered":"2023-05-24T03:29:49.232195+0000","last_clean":"2023-05-24T03:29:49.232195+0000","last_became_active":"2023-05-24T03:29:39.310070+0000","last_became_peered":"2023-05-24T03:29:39.310070+0000","last_unstale":"2023-05-24T03:29:49.232195+0000","last_undegraded":"2023-05-24T03:29:49.232195+0000","last_fullsized":"2023-05-24T03:29:49.232195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:13:08.585653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.919973+0000","last_change":"2023-05-24T03:29:44.075504+0000","last_active":"2023-05-24T03:29:48.919973+0000","last_peered":"2023-05-24T03:29:48.919973+0000","last_clean":"2023-05-24T03:29:48.919973+0000","last_became_active":"2023-05-24T03:29:44.074551+0000","last_became_peered":"2023-05-24T03:29:44.074551+0000","last_unstale":"2023-05-24T03:29:48.919973+0000","last_undegraded":"2023-05-24T03:29:48.919973+0000","last_fullsized":"2023-05-24T03:29:48.919973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:00:51.565754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920676+0000","last_change":"2023-05-24T03:29:44.496225+0000","last_active":"2023-05-24T03:29:48.920676+0000","last_peered":"2023-05-24T03:29:48.920676+0000","last_clean":"2023-05-24T03:29:48.920676+0000","last_became_active":"2023-05-24T03:29:44.496030+0000","last_became_peered":"2023-05-24T03:29:44.496030+0000","last_unstale":"2023-05-24T03:29:48.920676+0000","last_undegraded":"2023-05-24T03:29:48.920676+0000","last_fullsized":"2023-05-24T03:29:48.920676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:37:23.325863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.711961+0000","last_change":"2023-05-24T03:29:48.523816+0000","last_active":"2023-05-24T03:29:49.711961+0000","last_peered":"2023-05-24T03:29:49.711961+0000","last_clean":"2023-05-24T03:29:49.711961+0000","last_became_active":"2023-05-24T03:29:48.523380+0000","last_became_peered":"2023-05-24T03:29:48.523380+0000","last_unstale":"2023-05-24T03:29:49.711961+0000","last_undegraded":"2023-05-24T03:29:49.711961+0000","last_fullsized":"2023-05-24T03:29:49.711961+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:59:09.697698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.923885+0000","last_change":"2023-05-24T03:29:39.051113+0000","last_active":"2023-05-24T03:29:48.923885+0000","last_peered":"2023-05-24T03:29:48.923885+0000","last_clean":"2023-05-24T03:29:48.923885+0000","last_became_active":"2023-05-24T03:29:39.050751+0000","last_became_peered":"2023-05-24T03:29:39.050751+0000","last_unstale":"2023-05-24T03:29:48.923885+0000","last_undegraded":"2023-05-24T03:29:48.923885+0000","last_fullsized":"2023-05-24T03:29:48.923885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:54:48.001313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":183,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.711482+0000","last_change":"2023-05-24T03:29:34.025679+0000","last_active":"2023-05-24T03:29:49.711482+0000","last_peered":"2023-05-24T03:29:49.711482+0000","last_clean":"2023-05-24T03:29:49.711482+0000","last_became_active":"2023-05-24T03:29:34.024728+0000","last_became_peered":"2023-05-24T03:29:34.024728+0000","last_unstale":"2023-05-24T03:29:49.711482+0000","last_undegraded":"2023-05-24T03:29:49.711482+0000","last_fullsized":"2023-05-24T03:29:49.711482+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:32.968348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:32.968348+0000","last_clean_scrub_stamp":"2023-05-24T03:29:32.968348+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:17:15.286781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.797849+0000","last_change":"2023-05-24T03:29:44.086373+0000","last_active":"2023-05-24T03:29:49.797849+0000","last_peered":"2023-05-24T03:29:49.797849+0000","last_clean":"2023-05-24T03:29:49.797849+0000","last_became_active":"2023-05-24T03:29:44.086125+0000","last_became_peered":"2023-05-24T03:29:44.086125+0000","last_unstale":"2023-05-24T03:29:49.797849+0000","last_undegraded":"2023-05-24T03:29:49.797849+0000","last_fullsized":"2023-05-24T03:29:49.797849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:13:01.346454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798145+0000","last_change":"2023-05-24T03:29:44.492654+0000","last_active":"2023-05-24T03:29:49.798145+0000","last_peered":"2023-05-24T03:29:49.798145+0000","last_clean":"2023-05-24T03:29:49.798145+0000","last_became_active":"2023-05-24T03:29:44.492375+0000","last_became_peered":"2023-05-24T03:29:44.492375+0000","last_unstale":"2023-05-24T03:29:49.798145+0000","last_undegraded":"2023-05-24T03:29:49.798145+0000","last_fullsized":"2023-05-24T03:29:49.798145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:59:38.574199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.923773+0000","last_change":"2023-05-24T03:29:48.525206+0000","last_active":"2023-05-24T03:29:48.923773+0000","last_peered":"2023-05-24T03:29:48.923773+0000","last_clean":"2023-05-24T03:29:48.923773+0000","last_became_active":"2023-05-24T03:29:48.524615+0000","last_became_peered":"2023-05-24T03:29:48.524615+0000","last_unstale":"2023-05-24T03:29:48.923773+0000","last_undegraded":"2023-05-24T03:29:48.923773+0000","last_fullsized":"2023-05-24T03:29:48.923773+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:13:05.775179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.711704+0000","last_change":"2023-05-24T03:29:39.054117+0000","last_active":"2023-05-24T03:29:49.711704+0000","last_peered":"2023-05-24T03:29:49.711704+0000","last_clean":"2023-05-24T03:29:49.711704+0000","last_became_active":"2023-05-24T03:29:39.053813+0000","last_became_peered":"2023-05-24T03:29:39.053813+0000","last_unstale":"2023-05-24T03:29:49.711704+0000","last_undegraded":"2023-05-24T03:29:49.711704+0000","last_fullsized":"2023-05-24T03:29:49.711704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:47:18.052783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156076+0000","last_change":"2023-05-24T03:29:44.090147+0000","last_active":"2023-05-24T03:29:49.156076+0000","last_peered":"2023-05-24T03:29:49.156076+0000","last_clean":"2023-05-24T03:29:49.156076+0000","last_became_active":"2023-05-24T03:29:44.089943+0000","last_became_peered":"2023-05-24T03:29:44.089943+0000","last_unstale":"2023-05-24T03:29:49.156076+0000","last_undegraded":"2023-05-24T03:29:49.156076+0000","last_fullsized":"2023-05-24T03:29:49.156076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:30:55.969587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156224+0000","last_change":"2023-05-24T03:29:44.498467+0000","last_active":"2023-05-24T03:29:49.156224+0000","last_peered":"2023-05-24T03:29:49.156224+0000","last_clean":"2023-05-24T03:29:49.156224+0000","last_became_active":"2023-05-24T03:29:44.498130+0000","last_became_peered":"2023-05-24T03:29:44.498130+0000","last_unstale":"2023-05-24T03:29:49.156224+0000","last_undegraded":"2023-05-24T03:29:49.156224+0000","last_fullsized":"2023-05-24T03:29:49.156224+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:42:07.310986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798266+0000","last_change":"2023-05-24T03:29:48.520034+0000","last_active":"2023-05-24T03:29:49.798266+0000","last_peered":"2023-05-24T03:29:49.798266+0000","last_clean":"2023-05-24T03:29:49.798266+0000","last_became_active":"2023-05-24T03:29:48.519673+0000","last_became_peered":"2023-05-24T03:29:48.519673+0000","last_unstale":"2023-05-24T03:29:49.798266+0000","last_undegraded":"2023-05-24T03:29:49.798266+0000","last_fullsized":"2023-05-24T03:29:49.798266+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:47:00.839865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.711979+0000","last_change":"2023-05-24T03:29:39.143215+0000","last_active":"2023-05-24T03:29:49.711979+0000","last_peered":"2023-05-24T03:29:49.711979+0000","last_clean":"2023-05-24T03:29:49.711979+0000","last_became_active":"2023-05-24T03:29:39.142949+0000","last_became_peered":"2023-05-24T03:29:39.142949+0000","last_unstale":"2023-05-24T03:29:49.711979+0000","last_undegraded":"2023-05-24T03:29:49.711979+0000","last_fullsized":"2023-05-24T03:29:49.711979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:52:07.793681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920538+0000","last_change":"2023-05-24T03:29:44.074869+0000","last_active":"2023-05-24T03:29:48.920538+0000","last_peered":"2023-05-24T03:29:48.920538+0000","last_clean":"2023-05-24T03:29:48.920538+0000","last_became_active":"2023-05-24T03:29:44.074374+0000","last_became_peered":"2023-05-24T03:29:44.074374+0000","last_unstale":"2023-05-24T03:29:48.920538+0000","last_undegraded":"2023-05-24T03:29:48.920538+0000","last_fullsized":"2023-05-24T03:29:48.920538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:16:37.778018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156370+0000","last_change":"2023-05-24T03:29:44.499979+0000","last_active":"2023-05-24T03:29:49.156370+0000","last_peered":"2023-05-24T03:29:49.156370+0000","last_clean":"2023-05-24T03:29:49.156370+0000","last_became_active":"2023-05-24T03:29:44.499768+0000","last_became_peered":"2023-05-24T03:29:44.499768+0000","last_unstale":"2023-05-24T03:29:49.156370+0000","last_undegraded":"2023-05-24T03:29:49.156370+0000","last_fullsized":"2023-05-24T03:29:49.156370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:13:02.352900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924990+0000","last_change":"2023-05-24T03:29:48.530781+0000","last_active":"2023-05-24T03:29:48.924990+0000","last_peered":"2023-05-24T03:29:48.924990+0000","last_clean":"2023-05-24T03:29:48.924990+0000","last_became_active":"2023-05-24T03:29:48.530401+0000","last_became_peered":"2023-05-24T03:29:48.530401+0000","last_unstale":"2023-05-24T03:29:48.924990+0000","last_undegraded":"2023-05-24T03:29:48.924990+0000","last_fullsized":"2023-05-24T03:29:48.924990+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:56:52.111906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798616+0000","last_change":"2023-05-24T03:29:44.084278+0000","last_active":"2023-05-24T03:29:49.798616+0000","last_peered":"2023-05-24T03:29:49.798616+0000","last_clean":"2023-05-24T03:29:49.798616+0000","last_became_active":"2023-05-24T03:29:44.083929+0000","last_became_peered":"2023-05-24T03:29:44.083929+0000","last_unstale":"2023-05-24T03:29:49.798616+0000","last_undegraded":"2023-05-24T03:29:49.798616+0000","last_fullsized":"2023-05-24T03:29:49.798616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:59:51.303175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920595+0000","last_change":"2023-05-24T03:29:39.045821+0000","last_active":"2023-05-24T03:29:48.920595+0000","last_peered":"2023-05-24T03:29:48.920595+0000","last_clean":"2023-05-24T03:29:48.920595+0000","last_became_active":"2023-05-24T03:29:39.045543+0000","last_became_peered":"2023-05-24T03:29:39.045543+0000","last_unstale":"2023-05-24T03:29:48.920595+0000","last_undegraded":"2023-05-24T03:29:48.920595+0000","last_fullsized":"2023-05-24T03:29:48.920595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:12:33.887713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.797728+0000","last_change":"2023-05-24T03:29:44.496106+0000","last_active":"2023-05-24T03:29:49.797728+0000","last_peered":"2023-05-24T03:29:49.797728+0000","last_clean":"2023-05-24T03:29:49.797728+0000","last_became_active":"2023-05-24T03:29:44.495816+0000","last_became_peered":"2023-05-24T03:29:44.495816+0000","last_unstale":"2023-05-24T03:29:49.797728+0000","last_undegraded":"2023-05-24T03:29:49.797728+0000","last_fullsized":"2023-05-24T03:29:49.797728+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:37:23.325863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.797716+0000","last_change":"2023-05-24T03:29:48.527602+0000","last_active":"2023-05-24T03:29:49.797716+0000","last_peered":"2023-05-24T03:29:49.797716+0000","last_clean":"2023-05-24T03:29:49.797716+0000","last_became_active":"2023-05-24T03:29:48.527196+0000","last_became_peered":"2023-05-24T03:29:48.527196+0000","last_unstale":"2023-05-24T03:29:49.797716+0000","last_undegraded":"2023-05-24T03:29:49.797716+0000","last_fullsized":"2023-05-24T03:29:49.797716+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:12:43.334592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798516+0000","last_change":"2023-05-24T03:29:39.046445+0000","last_active":"2023-05-24T03:29:49.798516+0000","last_peered":"2023-05-24T03:29:49.798516+0000","last_clean":"2023-05-24T03:29:49.798516+0000","last_became_active":"2023-05-24T03:29:39.046149+0000","last_became_peered":"2023-05-24T03:29:39.046149+0000","last_unstale":"2023-05-24T03:29:49.798516+0000","last_undegraded":"2023-05-24T03:29:49.798516+0000","last_fullsized":"2023-05-24T03:29:49.798516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:11:20.972024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"28'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156361+0000","last_change":"2023-05-24T03:29:44.088780+0000","last_active":"2023-05-24T03:29:49.156361+0000","last_peered":"2023-05-24T03:29:49.156361+0000","last_clean":"2023-05-24T03:29:49.156361+0000","last_became_active":"2023-05-24T03:29:44.088495+0000","last_became_peered":"2023-05-24T03:29:44.088495+0000","last_unstale":"2023-05-24T03:29:49.156361+0000","last_undegraded":"2023-05-24T03:29:49.156361+0000","last_fullsized":"2023-05-24T03:29:49.156361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:37:22.319418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924732+0000","last_change":"2023-05-24T03:29:44.496966+0000","last_active":"2023-05-24T03:29:48.924732+0000","last_peered":"2023-05-24T03:29:48.924732+0000","last_clean":"2023-05-24T03:29:48.924732+0000","last_became_active":"2023-05-24T03:29:44.496597+0000","last_became_peered":"2023-05-24T03:29:44.496597+0000","last_unstale":"2023-05-24T03:29:48.924732+0000","last_undegraded":"2023-05-24T03:29:48.924732+0000","last_fullsized":"2023-05-24T03:29:48.924732+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:09:24.928940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920813+0000","last_change":"2023-05-24T03:29:48.524541+0000","last_active":"2023-05-24T03:29:48.920813+0000","last_peered":"2023-05-24T03:29:48.920813+0000","last_clean":"2023-05-24T03:29:48.920813+0000","last_became_active":"2023-05-24T03:29:48.524170+0000","last_became_peered":"2023-05-24T03:29:48.524170+0000","last_unstale":"2023-05-24T03:29:48.920813+0000","last_undegraded":"2023-05-24T03:29:48.920813+0000","last_fullsized":"2023-05-24T03:29:48.920813+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:17:29.801036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156385+0000","last_change":"2023-05-24T03:29:44.090259+0000","last_active":"2023-05-24T03:29:49.156385+0000","last_peered":"2023-05-24T03:29:49.156385+0000","last_clean":"2023-05-24T03:29:49.156385+0000","last_became_active":"2023-05-24T03:29:44.089993+0000","last_became_peered":"2023-05-24T03:29:44.089993+0000","last_unstale":"2023-05-24T03:29:49.156385+0000","last_undegraded":"2023-05-24T03:29:49.156385+0000","last_fullsized":"2023-05-24T03:29:49.156385+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:27:08.183456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.232199+0000","last_change":"2023-05-24T03:29:44.481933+0000","last_active":"2023-05-24T03:29:49.232199+0000","last_peered":"2023-05-24T03:29:49.232199+0000","last_clean":"2023-05-24T03:29:49.232199+0000","last_became_active":"2023-05-24T03:29:44.481655+0000","last_became_peered":"2023-05-24T03:29:44.481655+0000","last_unstale":"2023-05-24T03:29:49.232199+0000","last_undegraded":"2023-05-24T03:29:49.232199+0000","last_fullsized":"2023-05-24T03:29:49.232199+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:06:36.510598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.712009+0000","last_change":"2023-05-24T03:29:48.516800+0000","last_active":"2023-05-24T03:29:49.712009+0000","last_peered":"2023-05-24T03:29:49.712009+0000","last_clean":"2023-05-24T03:29:49.712009+0000","last_became_active":"2023-05-24T03:29:48.516366+0000","last_became_peered":"2023-05-24T03:29:48.516366+0000","last_unstale":"2023-05-24T03:29:49.712009+0000","last_undegraded":"2023-05-24T03:29:49.712009+0000","last_fullsized":"2023-05-24T03:29:49.712009+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:19:31.096262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.923650+0000","last_change":"2023-05-24T03:29:44.094179+0000","last_active":"2023-05-24T03:29:48.923650+0000","last_peered":"2023-05-24T03:29:48.923650+0000","last_clean":"2023-05-24T03:29:48.923650+0000","last_became_active":"2023-05-24T03:29:44.093909+0000","last_became_peered":"2023-05-24T03:29:44.093909+0000","last_unstale":"2023-05-24T03:29:48.923650+0000","last_undegraded":"2023-05-24T03:29:48.923650+0000","last_fullsized":"2023-05-24T03:29:48.923650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:55:31.183299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924979+0000","last_change":"2023-05-24T03:29:44.497379+0000","last_active":"2023-05-24T03:29:48.924979+0000","last_peered":"2023-05-24T03:29:48.924979+0000","last_clean":"2023-05-24T03:29:48.924979+0000","last_became_active":"2023-05-24T03:29:44.496679+0000","last_became_peered":"2023-05-24T03:29:44.496679+0000","last_unstale":"2023-05-24T03:29:48.924979+0000","last_undegraded":"2023-05-24T03:29:48.924979+0000","last_fullsized":"2023-05-24T03:29:48.924979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:53:47.591081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924043+0000","last_change":"2023-05-24T03:29:48.529231+0000","last_active":"2023-05-24T03:29:48.924043+0000","last_peered":"2023-05-24T03:29:48.924043+0000","last_clean":"2023-05-24T03:29:48.924043+0000","last_became_active":"2023-05-24T03:29:48.528862+0000","last_became_peered":"2023-05-24T03:29:48.528862+0000","last_unstale":"2023-05-24T03:29:48.924043+0000","last_undegraded":"2023-05-24T03:29:48.924043+0000","last_fullsized":"2023-05-24T03:29:48.924043+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:48:31.938863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.923932+0000","last_change":"2023-05-24T03:29:44.090289+0000","last_active":"2023-05-24T03:29:48.923932+0000","last_peered":"2023-05-24T03:29:48.923932+0000","last_clean":"2023-05-24T03:29:48.923932+0000","last_became_active":"2023-05-24T03:29:44.089949+0000","last_became_peered":"2023-05-24T03:29:44.089949+0000","last_unstale":"2023-05-24T03:29:48.923932+0000","last_undegraded":"2023-05-24T03:29:48.923932+0000","last_fullsized":"2023-05-24T03:29:48.923932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:47:23.070936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924880+0000","last_change":"2023-05-24T03:29:44.498632+0000","last_active":"2023-05-24T03:29:48.924880+0000","last_peered":"2023-05-24T03:29:48.924880+0000","last_clean":"2023-05-24T03:29:48.924880+0000","last_became_active":"2023-05-24T03:29:44.498350+0000","last_became_peered":"2023-05-24T03:29:44.498350+0000","last_unstale":"2023-05-24T03:29:48.924880+0000","last_undegraded":"2023-05-24T03:29:48.924880+0000","last_fullsized":"2023-05-24T03:29:48.924880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:02:32.050380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924648+0000","last_change":"2023-05-24T03:29:48.523434+0000","last_active":"2023-05-24T03:29:48.924648+0000","last_peered":"2023-05-24T03:29:48.924648+0000","last_clean":"2023-05-24T03:29:48.924648+0000","last_became_active":"2023-05-24T03:29:48.522228+0000","last_became_peered":"2023-05-24T03:29:48.522228+0000","last_unstale":"2023-05-24T03:29:48.924648+0000","last_undegraded":"2023-05-24T03:29:48.924648+0000","last_fullsized":"2023-05-24T03:29:48.924648+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:59:55.731900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798448+0000","last_change":"2023-05-24T03:29:44.083178+0000","last_active":"2023-05-24T03:29:49.798448+0000","last_peered":"2023-05-24T03:29:49.798448+0000","last_clean":"2023-05-24T03:29:49.798448+0000","last_became_active":"2023-05-24T03:29:44.082903+0000","last_became_peered":"2023-05-24T03:29:44.082903+0000","last_unstale":"2023-05-24T03:29:49.798448+0000","last_undegraded":"2023-05-24T03:29:49.798448+0000","last_fullsized":"2023-05-24T03:29:49.798448+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:59:08.440023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798028+0000","last_change":"2023-05-24T03:29:44.488206+0000","last_active":"2023-05-24T03:29:49.798028+0000","last_peered":"2023-05-24T03:29:49.798028+0000","last_clean":"2023-05-24T03:29:49.798028+0000","last_became_active":"2023-05-24T03:29:44.487925+0000","last_became_peered":"2023-05-24T03:29:44.487925+0000","last_unstale":"2023-05-24T03:29:49.798028+0000","last_undegraded":"2023-05-24T03:29:49.798028+0000","last_fullsized":"2023-05-24T03:29:49.798028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:48:28.516583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920063+0000","last_change":"2023-05-24T03:29:48.519899+0000","last_active":"2023-05-24T03:29:48.920063+0000","last_peered":"2023-05-24T03:29:48.920063+0000","last_clean":"2023-05-24T03:29:48.920063+0000","last_became_active":"2023-05-24T03:29:48.519517+0000","last_became_peered":"2023-05-24T03:29:48.519517+0000","last_unstale":"2023-05-24T03:29:48.920063+0000","last_undegraded":"2023-05-24T03:29:48.920063+0000","last_fullsized":"2023-05-24T03:29:48.920063+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:26:20.594013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156596+0000","last_change":"2023-05-24T03:29:44.088545+0000","last_active":"2023-05-24T03:29:49.156596+0000","last_peered":"2023-05-24T03:29:49.156596+0000","last_clean":"2023-05-24T03:29:49.156596+0000","last_became_active":"2023-05-24T03:29:44.087891+0000","last_became_peered":"2023-05-24T03:29:44.087891+0000","last_unstale":"2023-05-24T03:29:49.156596+0000","last_undegraded":"2023-05-24T03:29:49.156596+0000","last_fullsized":"2023-05-24T03:29:49.156596+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:19:26.667537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925035+0000","last_change":"2023-05-24T03:29:44.493246+0000","last_active":"2023-05-24T03:29:48.925035+0000","last_peered":"2023-05-24T03:29:48.925035+0000","last_clean":"2023-05-24T03:29:48.925035+0000","last_became_active":"2023-05-24T03:29:44.492923+0000","last_became_peered":"2023-05-24T03:29:44.492923+0000","last_unstale":"2023-05-24T03:29:48.925035+0000","last_undegraded":"2023-05-24T03:29:48.925035+0000","last_fullsized":"2023-05-24T03:29:48.925035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:59:05.161810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798054+0000","last_change":"2023-05-24T03:29:44.486961+0000","last_active":"2023-05-24T03:29:49.798054+0000","last_peered":"2023-05-24T03:29:49.798054+0000","last_clean":"2023-05-24T03:29:49.798054+0000","last_became_active":"2023-05-24T03:29:44.483898+0000","last_became_peered":"2023-05-24T03:29:44.483898+0000","last_unstale":"2023-05-24T03:29:49.798054+0000","last_undegraded":"2023-05-24T03:29:49.798054+0000","last_fullsized":"2023-05-24T03:29:49.798054+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:17:10.507341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798199+0000","last_change":"2023-05-24T03:29:44.494451+0000","last_active":"2023-05-24T03:29:49.798199+0000","last_peered":"2023-05-24T03:29:49.798199+0000","last_clean":"2023-05-24T03:29:49.798199+0000","last_became_active":"2023-05-24T03:29:44.494073+0000","last_became_peered":"2023-05-24T03:29:44.494073+0000","last_unstale":"2023-05-24T03:29:49.798199+0000","last_undegraded":"2023-05-24T03:29:49.798199+0000","last_fullsized":"2023-05-24T03:29:49.798199+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:52:13.818279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925451+0000","last_change":"2023-05-24T03:29:44.498119+0000","last_active":"2023-05-24T03:29:48.925451+0000","last_peered":"2023-05-24T03:29:48.925451+0000","last_clean":"2023-05-24T03:29:48.925451+0000","last_became_active":"2023-05-24T03:29:44.497832+0000","last_became_peered":"2023-05-24T03:29:44.497832+0000","last_unstale":"2023-05-24T03:29:48.925451+0000","last_undegraded":"2023-05-24T03:29:48.925451+0000","last_fullsized":"2023-05-24T03:29:48.925451+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:27:13.487917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.797913+0000","last_change":"2023-05-24T03:29:44.496468+0000","last_active":"2023-05-24T03:29:49.797913+0000","last_peered":"2023-05-24T03:29:49.797913+0000","last_clean":"2023-05-24T03:29:49.797913+0000","last_became_active":"2023-05-24T03:29:44.496197+0000","last_became_peered":"2023-05-24T03:29:44.496197+0000","last_unstale":"2023-05-24T03:29:49.797913+0000","last_undegraded":"2023-05-24T03:29:49.797913+0000","last_fullsized":"2023-05-24T03:29:49.797913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:54:54.025911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920554+0000","last_change":"2023-05-24T03:29:44.495194+0000","last_active":"2023-05-24T03:29:48.920554+0000","last_peered":"2023-05-24T03:29:48.920554+0000","last_clean":"2023-05-24T03:29:48.920554+0000","last_became_active":"2023-05-24T03:29:44.494928+0000","last_became_peered":"2023-05-24T03:29:44.494928+0000","last_unstale":"2023-05-24T03:29:48.920554+0000","last_undegraded":"2023-05-24T03:29:48.920554+0000","last_fullsized":"2023-05-24T03:29:48.920554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:42:07.310986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18832,"kb_used_data":904,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353008,"statfs":{"total":96636764160,"available":96617480192,"internally_reserved":0,"allocated":925696,"data_stored":718998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18224,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353616,"statfs":{"total":96636764160,"available":96618102784,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18224,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353616,"statfs":{"total":96636764160,"available":96618102784,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18808,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353032,"statfs":{"total":96636764160,"available":96617504768,"internally_reserved":0,"allocated":901120,"data_stored":715522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18224,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353616,"statfs":{"total":96636764160,"available":96618102784,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18228,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353612,"statfs":{"total":96636764160,"available":96618098688,"internally_reserved":0,"allocated":307200,"data_stored":124662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18244,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353596,"statfs":{"total":96636764160,"available":96618082304,"internally_reserved":0,"allocated":323584,"data_stored":128470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18232,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353608,"statfs":{"total":96636764160,"available":96618094592,"internally_reserved":0,"allocated":311296,"data_stored":125224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-24T03:30:07.238 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-24T03:30:07.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.385+0000 7f059d60e700 1 Processor -- start 2023-05-24T03:30:07.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.385+0000 7f059d60e700 1 -- start start 2023-05-24T03:30:07.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.386+0000 7f059d60e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f05980cd480 0x7f05980d09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:07.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.386+0000 7f059d60e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05980d0560 con 0x7f05980b0180 2023-05-24T03:30:07.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.386+0000 7f059d60e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05980cdf30 con 0x7f05980cd990 2023-05-24T03:30:07.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.386+0000 7f059d60e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05980d1e20 con 0x7f05980cd480 2023-05-24T03:30:07.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.386+0000 7f0596ffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f05980b0180 0x7f05980ccd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45652/0 (socket says 172.21.15.146:45652) 2023-05-24T03:30:07.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.386+0000 7f0596ffd700 1 -- 172.21.15.146:0/3974683906 learned_addr learned my addr 172.21.15.146:0/3974683906 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:30:07.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.386+0000 7f05967fc700 1 --2- 172.21.15.146:0/3974683906 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f05980cd480 0x7f05980d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:07.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.386+0000 7f0595ffb700 1 -- 172.21.15.146:0/3974683906 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3413582903 0 0) 0x7f05980d0560 con 0x7f05980b0180 2023-05-24T03:30:07.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.386+0000 7f0595ffb700 1 -- 172.21.15.146:0/3974683906 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05800035b0 con 0x7f05980b0180 2023-05-24T03:30:07.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.386+0000 7f0595ffb700 1 -- 172.21.15.146:0/3974683906 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1199489284 0 0) 0x7f05800035b0 con 0x7f05980b0180 2023-05-24T03:30:07.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.386+0000 7f0595ffb700 1 -- 172.21.15.146:0/3974683906 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f05980cd480 msgr2=0x7f05980d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:07.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.386+0000 7f0595ffb700 1 --2- 172.21.15.146:0/3974683906 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f05980cd480 0x7f05980d09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:07.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.386+0000 7f0595ffb700 1 -- 172.21.15.146:0/3974683906 >> v1:172.21.15.151:6789/0 conn(0x7f05980cd990 legacy=0x7f05980b2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:07.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.386+0000 7f0595ffb700 1 -- 172.21.15.146:0/3974683906 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05980ce210 con 0x7f05980b0180 2023-05-24T03:30:07.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.386+0000 7f0595ffb700 1 -- 172.21.15.146:0/3974683906 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1301887351 0 0) 0x7f058c001670 con 0x7f05980b0180 2023-05-24T03:30:07.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.386+0000 7f0595ffb700 1 -- 172.21.15.146:0/3974683906 >> v1:172.21.15.146:6789/0 conn(0x7f05980b0180 legacy=0x7f05980ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:07.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.386+0000 7f0595ffb700 1 --2- 172.21.15.146:0/3974683906 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0580003a30 0x7f0580003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:07.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.386+0000 7f0595ffb700 1 --2- 172.21.15.146:0/3974683906 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f05980cd480 0x7f0580004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:07.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.386+0000 7f0595ffb700 1 --2- 172.21.15.146:0/3974683906 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0580004d90 0x7f0580005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:07.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.386+0000 7f0595ffb700 1 -- 172.21.15.146:0/3974683906 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05980d1e20 con 0x7f0580003a30 2023-05-24T03:30:07.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.386+0000 7f0595ffb700 1 -- 172.21.15.146:0/3974683906 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058000ba10 con 0x7f0580004d90 2023-05-24T03:30:07.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.386+0000 7f0595ffb700 1 -- 172.21.15.146:0/3974683906 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f058000bba0 con 0x7f05980cd480 2023-05-24T03:30:07.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.387+0000 7f0596ffd700 1 --2- 172.21.15.146:0/3974683906 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0580003a30 0x7f0580003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:07.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.387+0000 7f05967fc700 1 --2- 172.21.15.146:0/3974683906 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f05980cd480 0x7f0580004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:07.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.387+0000 7f05977fe700 1 --2- 172.21.15.146:0/3974683906 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0580004d90 0x7f0580005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:07.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.387+0000 7f0596ffd700 1 -- 172.21.15.146:0/3974683906 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f05980cd480 msgr2=0x7f0580004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:07.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.387+0000 7f0596ffd700 1 --2- 172.21.15.146:0/3974683906 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f05980cd480 0x7f0580004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:07.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.387+0000 7f0596ffd700 1 -- 172.21.15.146:0/3974683906 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0580004d90 msgr2=0x7f0580005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:07.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.387+0000 7f0596ffd700 1 --2- 172.21.15.146:0/3974683906 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0580004d90 0x7f0580005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:07.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.387+0000 7f0596ffd700 1 -- 172.21.15.146:0/3974683906 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05800035b0 con 0x7f0580003a30 2023-05-24T03:30:07.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.387+0000 7f0596ffd700 1 --2- 172.21.15.146:0/3974683906 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0580003a30 0x7f0580003e00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f058c00c2f0 tx=0x7f0580005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce9fecd7106fdf95 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:07.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.387+0000 7f0595ffb700 1 -- 172.21.15.146:0/3974683906 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058c00ce30 con 0x7f0580003a30 2023-05-24T03:30:07.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.387+0000 7f0595ffb700 1 -- 172.21.15.146:0/3974683906 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f058c005960 con 0x7f0580003a30 2023-05-24T03:30:07.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.387+0000 7f0595ffb700 1 -- 172.21.15.146:0/3974683906 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058c005cf0 con 0x7f0580003a30 2023-05-24T03:30:07.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.388+0000 7f059d60e700 1 -- 172.21.15.146:0/3974683906 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0580003a30 msgr2=0x7f0580003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:07.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.388+0000 7f059d60e700 1 --2- 172.21.15.146:0/3974683906 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0580003a30 0x7f0580003e00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f058c00c2f0 tx=0x7f0580005880 comp rx=0 tx=0).stop 2023-05-24T03:30:07.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.388+0000 7f05977fe700 1 -- 172.21.15.146:0/3974683906 reap_dead start 2023-05-24T03:30:07.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.388+0000 7f059d60e700 1 -- 172.21.15.146:0/3974683906 shutdown_connections 2023-05-24T03:30:07.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.388+0000 7f059d60e700 1 -- 172.21.15.146:0/3974683906 >> 172.21.15.146:0/3974683906 conn(0x7f05980743f0 msgr2=0x7f05980d0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:07.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.388+0000 7f059d60e700 1 -- 172.21.15.146:0/3974683906 shutdown_connections 2023-05-24T03:30:07.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.388+0000 7f059d60e700 1 -- 172.21.15.146:0/3974683906 wait complete. 2023-05-24T03:30:07.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.389+0000 7f059d60e700 1 Processor -- start 2023-05-24T03:30:07.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.389+0000 7f059d60e700 1 -- start start 2023-05-24T03:30:07.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.390+0000 7f059d60e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0580003a30 0x7f0598154600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:07.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.390+0000 7f059d60e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0598154000 0x7f059815dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:07.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.390+0000 7f059d60e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f05980aeb80 0x7f05980af000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:07.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.390+0000 7f059d60e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0598154470 con 0x7f0580003a30 2023-05-24T03:30:07.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.390+0000 7f059d60e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05981601a0 con 0x7f0598154000 2023-05-24T03:30:07.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.390+0000 7f059d60e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05980ade00 con 0x7f05980aeb80 2023-05-24T03:30:07.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.390+0000 7f0596ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0580003a30 0x7f0598154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:07.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.390+0000 7f0596ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0580003a30 0x7f0598154600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39212/0 (socket says 172.21.15.146:39212) 2023-05-24T03:30:07.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.390+0000 7f0596ffd700 1 -- 172.21.15.146:0/1799738728 learned_addr learned my addr 172.21.15.146:0/1799738728 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:07.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.390+0000 7f05967fc700 1 --2- 172.21.15.146:0/1799738728 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0598154000 0x7f059815dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:07.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.390+0000 7f05977fe700 1 --2- 172.21.15.146:0/1799738728 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f05980aeb80 0x7f05980af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:07.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.390+0000 7f0596ffd700 1 -- 172.21.15.146:0/1799738728 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f05980aeb80 msgr2=0x7f05980af000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:07.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.390+0000 7f0596ffd700 1 --2- 172.21.15.146:0/1799738728 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f05980aeb80 0x7f05980af000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:07.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.390+0000 7f0596ffd700 1 -- 172.21.15.146:0/1799738728 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0598154000 msgr2=0x7f059815dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:07.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.390+0000 7f0596ffd700 1 --2- 172.21.15.146:0/1799738728 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0598154000 0x7f059815dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:07.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.390+0000 7f0596ffd700 1 -- 172.21.15.146:0/1799738728 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05980cfe70 con 0x7f0580003a30 2023-05-24T03:30:07.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.390+0000 7f0596ffd700 1 --2- 172.21.15.146:0/1799738728 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0580003a30 0x7f0598154600 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f058c001930 tx=0x7f058c001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:07.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.390+0000 7f057f7fe700 1 -- 172.21.15.146:0/1799738728 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058c001660 con 0x7f0580003a30 2023-05-24T03:30:07.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.390+0000 7f057f7fe700 1 -- 172.21.15.146:0/1799738728 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f058c004a80 con 0x7f0580003a30 2023-05-24T03:30:07.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.390+0000 7f057f7fe700 1 -- 172.21.15.146:0/1799738728 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058c004e30 con 0x7f0580003a30 2023-05-24T03:30:07.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.391+0000 7f059d60e700 1 -- 172.21.15.146:0/1799738728 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05980d01f0 con 0x7f0580003a30 2023-05-24T03:30:07.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.391+0000 7f059d60e700 1 -- 172.21.15.146:0/1799738728 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05980b0550 con 0x7f0580003a30 2023-05-24T03:30:07.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.392+0000 7f059d60e700 1 -- 172.21.15.146:0/1799738728 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05981543d0 con 0x7f0580003a30 2023-05-24T03:30:07.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.392+0000 7f057f7fe700 1 -- 172.21.15.146:0/1799738728 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f058c0070d0 con 0x7f0580003a30 2023-05-24T03:30:07.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.392+0000 7f057f7fe700 1 --2- 172.21.15.146:0/1799738728 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f058406ace0 0x7f058406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:07.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.392+0000 7f057f7fe700 1 -- 172.21.15.146:0/1799738728 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f058c08ab00 con 0x7f0580003a30 2023-05-24T03:30:07.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.392+0000 7f05967fc700 1 --2- 172.21.15.146:0/1799738728 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f058406ace0 0x7f058406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:07.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.393+0000 7f05967fc700 1 --2- 172.21.15.146:0/1799738728 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f058406ace0 0x7f058406d190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f05980cd870 tx=0x7f0588009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:07.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.396+0000 7f057f7fe700 1 -- 172.21.15.146:0/1799738728 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f058c055b30 con 0x7f0580003a30 2023-05-24T03:30:07.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.580+0000 7f059d60e700 1 -- 172.21.15.146:0/1799738728 --> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0598068d70 con 0x7f058406ace0 2023-05-24T03:30:07.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.589+0000 7f057f7fe700 1 -- 172.21.15.146:0/1799738728 <== mgr.4104 v2:172.21.15.146:6832/1985394169 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367334 (secure 0 0 0) 0x7f0598068d70 con 0x7f058406ace0 2023-05-24T03:30:07.598 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:30:07.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.593+0000 7f059d60e700 1 -- 172.21.15.146:0/1799738728 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f058406ace0 msgr2=0x7f058406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:07.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.593+0000 7f059d60e700 1 --2- 172.21.15.146:0/1799738728 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f058406ace0 0x7f058406d190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f05980cd870 tx=0x7f0588009210 comp rx=0 tx=0).stop 2023-05-24T03:30:07.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.593+0000 7f059d60e700 1 -- 172.21.15.146:0/1799738728 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0580003a30 msgr2=0x7f0598154600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:07.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.593+0000 7f059d60e700 1 --2- 172.21.15.146:0/1799738728 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0580003a30 0x7f0598154600 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f058c001930 tx=0x7f058c001a00 comp rx=0 tx=0).stop 2023-05-24T03:30:07.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.593+0000 7f059d60e700 1 -- 172.21.15.146:0/1799738728 shutdown_connections 2023-05-24T03:30:07.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.593+0000 7f059d60e700 1 --2- 172.21.15.146:0/1799738728 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f058406ace0 0x7f058406d190 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:07.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.593+0000 7f059d60e700 1 --2- 172.21.15.146:0/1799738728 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f05980aeb80 0x7f05980af000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:07.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.593+0000 7f059d60e700 1 --2- 172.21.15.146:0/1799738728 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0580003a30 0x7f0598154600 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:07.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.593+0000 7f059d60e700 1 --2- 172.21.15.146:0/1799738728 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0598154000 0x7f059815dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:07.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.593+0000 7f059d60e700 1 -- 172.21.15.146:0/1799738728 >> 172.21.15.146:0/1799738728 conn(0x7f05980743f0 msgr2=0x7f05980d1690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:07.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.593+0000 7f059d60e700 1 -- 172.21.15.146:0/1799738728 shutdown_connections 2023-05-24T03:30:07.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.593+0000 7f059d60e700 1 -- 172.21.15.146:0/1799738728 wait complete. 2023-05-24T03:30:07.602 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-05-24T03:30:07.610 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2023-05-24T03:30:06.712344+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":147016,"kb_used_data":3592,"kb_used_omap":0,"kb_used_meta":143360,"kb_avail":754827704,"statfs":{"total":773094113280,"available":772943568896,"internally_reserved":0,"allocated":3678208,"data_stored":2186592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":146800640},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003233"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.232284+0000","last_change":"2023-05-24T03:29:44.490120+0000","last_active":"2023-05-24T03:29:49.232284+0000","last_peered":"2023-05-24T03:29:49.232284+0000","last_clean":"2023-05-24T03:29:49.232284+0000","last_became_active":"2023-05-24T03:29:44.489854+0000","last_became_peered":"2023-05-24T03:29:44.489854+0000","last_unstale":"2023-05-24T03:29:49.232284+0000","last_undegraded":"2023-05-24T03:29:49.232284+0000","last_fullsized":"2023-05-24T03:29:49.232284+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:33:03.914585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.923811+0000","last_change":"2023-05-24T03:29:44.495973+0000","last_active":"2023-05-24T03:29:48.923811+0000","last_peered":"2023-05-24T03:29:48.923811+0000","last_clean":"2023-05-24T03:29:48.923811+0000","last_became_active":"2023-05-24T03:29:44.495700+0000","last_became_peered":"2023-05-24T03:29:44.495700+0000","last_unstale":"2023-05-24T03:29:48.923811+0000","last_undegraded":"2023-05-24T03:29:48.923811+0000","last_fullsized":"2023-05-24T03:29:48.923811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:27:09.189901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925500+0000","last_change":"2023-05-24T03:29:44.499947+0000","last_active":"2023-05-24T03:29:48.925500+0000","last_peered":"2023-05-24T03:29:48.925500+0000","last_clean":"2023-05-24T03:29:48.925500+0000","last_became_active":"2023-05-24T03:29:44.499663+0000","last_became_peered":"2023-05-24T03:29:44.499663+0000","last_unstale":"2023-05-24T03:29:48.925500+0000","last_undegraded":"2023-05-24T03:29:48.925500+0000","last_fullsized":"2023-05-24T03:29:48.925500+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:14:55.806370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798091+0000","last_change":"2023-05-24T03:29:44.498790+0000","last_active":"2023-05-24T03:29:49.798091+0000","last_peered":"2023-05-24T03:29:49.798091+0000","last_clean":"2023-05-24T03:29:49.798091+0000","last_became_active":"2023-05-24T03:29:44.498528+0000","last_became_peered":"2023-05-24T03:29:44.498528+0000","last_unstale":"2023-05-24T03:29:49.798091+0000","last_undegraded":"2023-05-24T03:29:49.798091+0000","last_fullsized":"2023-05-24T03:29:49.798091+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:37:55.804539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156224+0000","last_change":"2023-05-24T03:29:44.504225+0000","last_active":"2023-05-24T03:29:49.156224+0000","last_peered":"2023-05-24T03:29:49.156224+0000","last_clean":"2023-05-24T03:29:49.156224+0000","last_became_active":"2023-05-24T03:29:44.503998+0000","last_became_peered":"2023-05-24T03:29:44.503998+0000","last_unstale":"2023-05-24T03:29:49.156224+0000","last_undegraded":"2023-05-24T03:29:49.156224+0000","last_fullsized":"2023-05-24T03:29:49.156224+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:12:39.912312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925136+0000","last_change":"2023-05-24T03:29:44.500355+0000","last_active":"2023-05-24T03:29:48.925136+0000","last_peered":"2023-05-24T03:29:48.925136+0000","last_clean":"2023-05-24T03:29:48.925136+0000","last_became_active":"2023-05-24T03:29:44.500065+0000","last_became_peered":"2023-05-24T03:29:44.500065+0000","last_unstale":"2023-05-24T03:29:48.925136+0000","last_undegraded":"2023-05-24T03:29:48.925136+0000","last_fullsized":"2023-05-24T03:29:48.925136+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:43:04.720238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.711626+0000","last_change":"2023-05-24T03:29:44.499607+0000","last_active":"2023-05-24T03:29:49.711626+0000","last_peered":"2023-05-24T03:29:49.711626+0000","last_clean":"2023-05-24T03:29:49.711626+0000","last_became_active":"2023-05-24T03:29:44.499324+0000","last_became_peered":"2023-05-24T03:29:44.499324+0000","last_unstale":"2023-05-24T03:29:49.711626+0000","last_undegraded":"2023-05-24T03:29:49.711626+0000","last_fullsized":"2023-05-24T03:29:49.711626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:54:54.025911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.923288+0000","last_change":"2023-05-24T03:29:44.500576+0000","last_active":"2023-05-24T03:29:48.923288+0000","last_peered":"2023-05-24T03:29:48.923288+0000","last_clean":"2023-05-24T03:29:48.923288+0000","last_became_active":"2023-05-24T03:29:44.500260+0000","last_became_peered":"2023-05-24T03:29:44.500260+0000","last_unstale":"2023-05-24T03:29:48.923288+0000","last_undegraded":"2023-05-24T03:29:48.923288+0000","last_fullsized":"2023-05-24T03:29:48.923288+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:16:38.784464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156365+0000","last_change":"2023-05-24T03:29:44.502655+0000","last_active":"2023-05-24T03:29:49.156365+0000","last_peered":"2023-05-24T03:29:49.156365+0000","last_clean":"2023-05-24T03:29:49.156365+0000","last_became_active":"2023-05-24T03:29:44.502341+0000","last_became_peered":"2023-05-24T03:29:44.502341+0000","last_unstale":"2023-05-24T03:29:49.156365+0000","last_undegraded":"2023-05-24T03:29:49.156365+0000","last_fullsized":"2023-05-24T03:29:49.156365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:17:26.378756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924197+0000","last_change":"2023-05-24T03:29:44.500505+0000","last_active":"2023-05-24T03:29:48.924197+0000","last_peered":"2023-05-24T03:29:48.924197+0000","last_clean":"2023-05-24T03:29:48.924197+0000","last_became_active":"2023-05-24T03:29:44.500156+0000","last_became_peered":"2023-05-24T03:29:44.500156+0000","last_unstale":"2023-05-24T03:29:48.924197+0000","last_undegraded":"2023-05-24T03:29:48.924197+0000","last_fullsized":"2023-05-24T03:29:48.924197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:52:13.818279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925752+0000","last_change":"2023-05-24T03:29:44.492850+0000","last_active":"2023-05-24T03:29:48.925752+0000","last_peered":"2023-05-24T03:29:48.925752+0000","last_clean":"2023-05-24T03:29:48.925752+0000","last_became_active":"2023-05-24T03:29:44.492573+0000","last_became_peered":"2023-05-24T03:29:44.492573+0000","last_unstale":"2023-05-24T03:29:48.925752+0000","last_undegraded":"2023-05-24T03:29:48.925752+0000","last_fullsized":"2023-05-24T03:29:48.925752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:27:24.810532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.232125+0000","last_change":"2023-05-24T03:29:44.501565+0000","last_active":"2023-05-24T03:29:49.232125+0000","last_peered":"2023-05-24T03:29:49.232125+0000","last_clean":"2023-05-24T03:29:49.232125+0000","last_became_active":"2023-05-24T03:29:44.501371+0000","last_became_peered":"2023-05-24T03:29:44.501371+0000","last_unstale":"2023-05-24T03:29:49.232125+0000","last_undegraded":"2023-05-24T03:29:49.232125+0000","last_fullsized":"2023-05-24T03:29:49.232125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:51:11.755899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.232142+0000","last_change":"2023-05-24T03:29:44.490972+0000","last_active":"2023-05-24T03:29:49.232142+0000","last_peered":"2023-05-24T03:29:49.232142+0000","last_clean":"2023-05-24T03:29:49.232142+0000","last_became_active":"2023-05-24T03:29:44.490411+0000","last_became_peered":"2023-05-24T03:29:44.490411+0000","last_unstale":"2023-05-24T03:29:49.232142+0000","last_undegraded":"2023-05-24T03:29:49.232142+0000","last_fullsized":"2023-05-24T03:29:49.232142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:43:24.929689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.923436+0000","last_change":"2023-05-24T03:29:44.495213+0000","last_active":"2023-05-24T03:29:48.923436+0000","last_peered":"2023-05-24T03:29:48.923436+0000","last_clean":"2023-05-24T03:29:48.923436+0000","last_became_active":"2023-05-24T03:29:44.494879+0000","last_became_peered":"2023-05-24T03:29:44.494879+0000","last_unstale":"2023-05-24T03:29:48.923436+0000","last_undegraded":"2023-05-24T03:29:48.923436+0000","last_fullsized":"2023-05-24T03:29:48.923436+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:12:39.912312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.711461+0000","last_change":"2023-05-24T03:29:44.499673+0000","last_active":"2023-05-24T03:29:49.711461+0000","last_peered":"2023-05-24T03:29:49.711461+0000","last_clean":"2023-05-24T03:29:49.711461+0000","last_became_active":"2023-05-24T03:29:44.499393+0000","last_became_peered":"2023-05-24T03:29:44.499393+0000","last_unstale":"2023-05-24T03:29:49.711461+0000","last_undegraded":"2023-05-24T03:29:49.711461+0000","last_fullsized":"2023-05-24T03:29:49.711461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:55:32.189744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925151+0000","last_change":"2023-05-24T03:29:44.501101+0000","last_active":"2023-05-24T03:29:48.925151+0000","last_peered":"2023-05-24T03:29:48.925151+0000","last_clean":"2023-05-24T03:29:48.925151+0000","last_became_active":"2023-05-24T03:29:44.500818+0000","last_became_peered":"2023-05-24T03:29:44.500818+0000","last_unstale":"2023-05-24T03:29:48.925151+0000","last_undegraded":"2023-05-24T03:29:48.925151+0000","last_fullsized":"2023-05-24T03:29:48.925151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:44:17.635928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156394+0000","last_change":"2023-05-24T03:29:44.500209+0000","last_active":"2023-05-24T03:29:49.156394+0000","last_peered":"2023-05-24T03:29:49.156394+0000","last_clean":"2023-05-24T03:29:49.156394+0000","last_became_active":"2023-05-24T03:29:44.499543+0000","last_became_peered":"2023-05-24T03:29:44.499543+0000","last_unstale":"2023-05-24T03:29:49.156394+0000","last_undegraded":"2023-05-24T03:29:49.156394+0000","last_fullsized":"2023-05-24T03:29:49.156394+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:54:54.025911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925839+0000","last_change":"2023-05-24T03:29:44.492545+0000","last_active":"2023-05-24T03:29:48.925839+0000","last_peered":"2023-05-24T03:29:48.925839+0000","last_clean":"2023-05-24T03:29:48.925839+0000","last_became_active":"2023-05-24T03:29:44.492109+0000","last_became_peered":"2023-05-24T03:29:44.492109+0000","last_unstale":"2023-05-24T03:29:48.925839+0000","last_undegraded":"2023-05-24T03:29:48.925839+0000","last_fullsized":"2023-05-24T03:29:48.925839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:14:30.274935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.232313+0000","last_change":"2023-05-24T03:29:44.480834+0000","last_active":"2023-05-24T03:29:49.232313+0000","last_peered":"2023-05-24T03:29:49.232313+0000","last_clean":"2023-05-24T03:29:49.232313+0000","last_became_active":"2023-05-24T03:29:44.480597+0000","last_became_peered":"2023-05-24T03:29:44.480597+0000","last_unstale":"2023-05-24T03:29:49.232313+0000","last_undegraded":"2023-05-24T03:29:49.232313+0000","last_fullsized":"2023-05-24T03:29:49.232313+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:10:15.509028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925476+0000","last_change":"2023-05-24T03:29:44.501003+0000","last_active":"2023-05-24T03:29:48.925476+0000","last_peered":"2023-05-24T03:29:48.925476+0000","last_clean":"2023-05-24T03:29:48.925476+0000","last_became_active":"2023-05-24T03:29:44.499405+0000","last_became_peered":"2023-05-24T03:29:44.499405+0000","last_unstale":"2023-05-24T03:29:48.925476+0000","last_undegraded":"2023-05-24T03:29:48.925476+0000","last_fullsized":"2023-05-24T03:29:48.925476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:26:26.500917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.711735+0000","last_change":"2023-05-24T03:29:44.499151+0000","last_active":"2023-05-24T03:29:49.711735+0000","last_peered":"2023-05-24T03:29:49.711735+0000","last_clean":"2023-05-24T03:29:49.711735+0000","last_became_active":"2023-05-24T03:29:44.498782+0000","last_became_peered":"2023-05-24T03:29:44.498782+0000","last_unstale":"2023-05-24T03:29:49.711735+0000","last_undegraded":"2023-05-24T03:29:49.711735+0000","last_fullsized":"2023-05-24T03:29:49.711735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:48:28.516583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.155935+0000","last_change":"2023-05-24T03:29:44.498675+0000","last_active":"2023-05-24T03:29:49.155935+0000","last_peered":"2023-05-24T03:29:49.155935+0000","last_clean":"2023-05-24T03:29:49.155935+0000","last_became_active":"2023-05-24T03:29:44.498463+0000","last_became_peered":"2023-05-24T03:29:44.498463+0000","last_unstale":"2023-05-24T03:29:49.155935+0000","last_undegraded":"2023-05-24T03:29:49.155935+0000","last_fullsized":"2023-05-24T03:29:49.155935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:51:21.843236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.797699+0000","last_change":"2023-05-24T03:29:44.500169+0000","last_active":"2023-05-24T03:29:49.797699+0000","last_peered":"2023-05-24T03:29:49.797699+0000","last_clean":"2023-05-24T03:29:49.797699+0000","last_became_active":"2023-05-24T03:29:44.499960+0000","last_became_peered":"2023-05-24T03:29:44.499960+0000","last_unstale":"2023-05-24T03:29:49.797699+0000","last_undegraded":"2023-05-24T03:29:49.797699+0000","last_fullsized":"2023-05-24T03:29:49.797699+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:55:32.189744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.711518+0000","last_change":"2023-05-24T03:29:44.499015+0000","last_active":"2023-05-24T03:29:49.711518+0000","last_peered":"2023-05-24T03:29:49.711518+0000","last_clean":"2023-05-24T03:29:49.711518+0000","last_became_active":"2023-05-24T03:29:44.498437+0000","last_became_peered":"2023-05-24T03:29:44.498437+0000","last_unstale":"2023-05-24T03:29:49.711518+0000","last_undegraded":"2023-05-24T03:29:49.711518+0000","last_fullsized":"2023-05-24T03:29:49.711518+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:27:09.189901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920628+0000","last_change":"2023-05-24T03:29:44.481162+0000","last_active":"2023-05-24T03:29:48.920628+0000","last_peered":"2023-05-24T03:29:48.920628+0000","last_clean":"2023-05-24T03:29:48.920628+0000","last_became_active":"2023-05-24T03:29:44.481004+0000","last_became_peered":"2023-05-24T03:29:44.481004+0000","last_unstale":"2023-05-24T03:29:48.920628+0000","last_undegraded":"2023-05-24T03:29:48.920628+0000","last_fullsized":"2023-05-24T03:29:48.920628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:55:32.189744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920849+0000","last_change":"2023-05-24T03:29:44.481942+0000","last_active":"2023-05-24T03:29:48.920849+0000","last_peered":"2023-05-24T03:29:48.920849+0000","last_clean":"2023-05-24T03:29:48.920849+0000","last_became_active":"2023-05-24T03:29:44.481686+0000","last_became_peered":"2023-05-24T03:29:44.481686+0000","last_unstale":"2023-05-24T03:29:48.920849+0000","last_undegraded":"2023-05-24T03:29:48.920849+0000","last_fullsized":"2023-05-24T03:29:48.920849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:13:02.352900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924263+0000","last_change":"2023-05-24T03:29:44.502948+0000","last_active":"2023-05-24T03:29:48.924263+0000","last_peered":"2023-05-24T03:29:48.924263+0000","last_clean":"2023-05-24T03:29:48.924263+0000","last_became_active":"2023-05-24T03:29:44.502669+0000","last_became_peered":"2023-05-24T03:29:44.502669+0000","last_unstale":"2023-05-24T03:29:48.924263+0000","last_undegraded":"2023-05-24T03:29:48.924263+0000","last_fullsized":"2023-05-24T03:29:48.924263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:04:07.700748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925372+0000","last_change":"2023-05-24T03:29:48.523138+0000","last_active":"2023-05-24T03:29:48.925372+0000","last_peered":"2023-05-24T03:29:48.925372+0000","last_clean":"2023-05-24T03:29:48.925372+0000","last_became_active":"2023-05-24T03:29:48.522749+0000","last_became_peered":"2023-05-24T03:29:48.522749+0000","last_unstale":"2023-05-24T03:29:48.925372+0000","last_undegraded":"2023-05-24T03:29:48.925372+0000","last_fullsized":"2023-05-24T03:29:48.925372+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:20:12.731273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925118+0000","last_change":"2023-05-24T03:29:44.086543+0000","last_active":"2023-05-24T03:29:48.925118+0000","last_peered":"2023-05-24T03:29:48.925118+0000","last_clean":"2023-05-24T03:29:48.925118+0000","last_became_active":"2023-05-24T03:29:44.086143+0000","last_became_peered":"2023-05-24T03:29:44.086143+0000","last_unstale":"2023-05-24T03:29:48.925118+0000","last_undegraded":"2023-05-24T03:29:48.925118+0000","last_fullsized":"2023-05-24T03:29:48.925118+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:22:00.186684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798333+0000","last_change":"2023-05-24T03:29:44.491005+0000","last_active":"2023-05-24T03:29:49.798333+0000","last_peered":"2023-05-24T03:29:49.798333+0000","last_clean":"2023-05-24T03:29:49.798333+0000","last_became_active":"2023-05-24T03:29:44.490772+0000","last_became_peered":"2023-05-24T03:29:44.490772+0000","last_unstale":"2023-05-24T03:29:49.798333+0000","last_undegraded":"2023-05-24T03:29:49.798333+0000","last_fullsized":"2023-05-24T03:29:49.798333+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:04:07.700748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798539+0000","last_change":"2023-05-24T03:29:48.523521+0000","last_active":"2023-05-24T03:29:49.798539+0000","last_peered":"2023-05-24T03:29:49.798539+0000","last_clean":"2023-05-24T03:29:49.798539+0000","last_became_active":"2023-05-24T03:29:48.523125+0000","last_became_peered":"2023-05-24T03:29:48.523125+0000","last_unstale":"2023-05-24T03:29:49.798539+0000","last_undegraded":"2023-05-24T03:29:49.798539+0000","last_fullsized":"2023-05-24T03:29:49.798539+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:44:02.617382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920004+0000","last_change":"2023-05-24T03:29:44.084408+0000","last_active":"2023-05-24T03:29:48.920004+0000","last_peered":"2023-05-24T03:29:48.920004+0000","last_clean":"2023-05-24T03:29:48.920004+0000","last_became_active":"2023-05-24T03:29:44.084099+0000","last_became_peered":"2023-05-24T03:29:44.084099+0000","last_unstale":"2023-05-24T03:29:48.920004+0000","last_undegraded":"2023-05-24T03:29:48.920004+0000","last_fullsized":"2023-05-24T03:29:48.920004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:14:05.716019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156351+0000","last_change":"2023-05-24T03:29:44.503346+0000","last_active":"2023-05-24T03:29:49.156351+0000","last_peered":"2023-05-24T03:29:49.156351+0000","last_clean":"2023-05-24T03:29:49.156351+0000","last_became_active":"2023-05-24T03:29:44.503039+0000","last_became_peered":"2023-05-24T03:29:44.503039+0000","last_unstale":"2023-05-24T03:29:49.156351+0000","last_undegraded":"2023-05-24T03:29:49.156351+0000","last_fullsized":"2023-05-24T03:29:49.156351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:55:32.189744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156521+0000","last_change":"2023-05-24T03:29:48.529615+0000","last_active":"2023-05-24T03:29:49.156521+0000","last_peered":"2023-05-24T03:29:49.156521+0000","last_clean":"2023-05-24T03:29:49.156521+0000","last_became_active":"2023-05-24T03:29:48.529142+0000","last_became_peered":"2023-05-24T03:29:48.529142+0000","last_unstale":"2023-05-24T03:29:49.156521+0000","last_undegraded":"2023-05-24T03:29:49.156521+0000","last_fullsized":"2023-05-24T03:29:49.156521+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:48:31.938863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798028+0000","last_change":"2023-05-24T03:29:44.085410+0000","last_active":"2023-05-24T03:29:49.798028+0000","last_peered":"2023-05-24T03:29:49.798028+0000","last_clean":"2023-05-24T03:29:49.798028+0000","last_became_active":"2023-05-24T03:29:44.084907+0000","last_became_peered":"2023-05-24T03:29:44.084907+0000","last_unstale":"2023-05-24T03:29:49.798028+0000","last_undegraded":"2023-05-24T03:29:49.798028+0000","last_fullsized":"2023-05-24T03:29:49.798028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:06:44.879201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798596+0000","last_change":"2023-05-24T03:29:44.497128+0000","last_active":"2023-05-24T03:29:49.798596+0000","last_peered":"2023-05-24T03:29:49.798596+0000","last_clean":"2023-05-24T03:29:49.798596+0000","last_became_active":"2023-05-24T03:29:44.496746+0000","last_became_peered":"2023-05-24T03:29:44.496746+0000","last_unstale":"2023-05-24T03:29:49.798596+0000","last_undegraded":"2023-05-24T03:29:49.798596+0000","last_fullsized":"2023-05-24T03:29:49.798596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:50:28.601742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798309+0000","last_change":"2023-05-24T03:29:48.520693+0000","last_active":"2023-05-24T03:29:49.798309+0000","last_peered":"2023-05-24T03:29:49.798309+0000","last_clean":"2023-05-24T03:29:49.798309+0000","last_became_active":"2023-05-24T03:29:48.520319+0000","last_became_peered":"2023-05-24T03:29:48.520319+0000","last_unstale":"2023-05-24T03:29:49.798309+0000","last_undegraded":"2023-05-24T03:29:49.798309+0000","last_fullsized":"2023-05-24T03:29:49.798309+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:55:04.423811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156490+0000","last_change":"2023-05-24T03:29:44.088769+0000","last_active":"2023-05-24T03:29:49.156490+0000","last_peered":"2023-05-24T03:29:49.156490+0000","last_clean":"2023-05-24T03:29:49.156490+0000","last_became_active":"2023-05-24T03:29:44.088267+0000","last_became_peered":"2023-05-24T03:29:44.088267+0000","last_unstale":"2023-05-24T03:29:49.156490+0000","last_undegraded":"2023-05-24T03:29:49.156490+0000","last_fullsized":"2023-05-24T03:29:49.156490+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:06:44.879201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.797921+0000","last_change":"2023-05-24T03:29:44.489309+0000","last_active":"2023-05-24T03:29:49.797921+0000","last_peered":"2023-05-24T03:29:49.797921+0000","last_clean":"2023-05-24T03:29:49.797921+0000","last_became_active":"2023-05-24T03:29:44.488666+0000","last_became_peered":"2023-05-24T03:29:44.488666+0000","last_unstale":"2023-05-24T03:29:49.797921+0000","last_undegraded":"2023-05-24T03:29:49.797921+0000","last_fullsized":"2023-05-24T03:29:49.797921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:27:09.189901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.711386+0000","last_change":"2023-05-24T03:29:48.518108+0000","last_active":"2023-05-24T03:29:49.711386+0000","last_peered":"2023-05-24T03:29:49.711386+0000","last_clean":"2023-05-24T03:29:49.711386+0000","last_became_active":"2023-05-24T03:29:48.517771+0000","last_became_peered":"2023-05-24T03:29:48.517771+0000","last_unstale":"2023-05-24T03:29:49.711386+0000","last_undegraded":"2023-05-24T03:29:49.711386+0000","last_fullsized":"2023-05-24T03:29:49.711386+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:37:26.748143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.923964+0000","last_change":"2023-05-24T03:29:44.087910+0000","last_active":"2023-05-24T03:29:48.923964+0000","last_peered":"2023-05-24T03:29:48.923964+0000","last_clean":"2023-05-24T03:29:48.923964+0000","last_became_active":"2023-05-24T03:29:44.087601+0000","last_became_peered":"2023-05-24T03:29:44.087601+0000","last_unstale":"2023-05-24T03:29:48.923964+0000","last_undegraded":"2023-05-24T03:29:48.923964+0000","last_fullsized":"2023-05-24T03:29:48.923964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:59:05.268973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.797675+0000","last_change":"2023-05-24T03:29:44.496020+0000","last_active":"2023-05-24T03:29:49.797675+0000","last_peered":"2023-05-24T03:29:49.797675+0000","last_clean":"2023-05-24T03:29:49.797675+0000","last_became_active":"2023-05-24T03:29:44.495752+0000","last_became_peered":"2023-05-24T03:29:44.495752+0000","last_unstale":"2023-05-24T03:29:49.797675+0000","last_undegraded":"2023-05-24T03:29:49.797675+0000","last_fullsized":"2023-05-24T03:29:49.797675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:42:07.310986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798229+0000","last_change":"2023-05-24T03:29:48.529893+0000","last_active":"2023-05-24T03:29:49.798229+0000","last_peered":"2023-05-24T03:29:49.798229+0000","last_clean":"2023-05-24T03:29:49.798229+0000","last_became_active":"2023-05-24T03:29:48.529514+0000","last_became_peered":"2023-05-24T03:29:48.529514+0000","last_unstale":"2023-05-24T03:29:49.798229+0000","last_undegraded":"2023-05-24T03:29:49.798229+0000","last_fullsized":"2023-05-24T03:29:49.798229+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:19:31.096262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.711996+0000","last_change":"2023-05-24T03:29:44.091648+0000","last_active":"2023-05-24T03:29:49.711996+0000","last_peered":"2023-05-24T03:29:49.711996+0000","last_clean":"2023-05-24T03:29:49.711996+0000","last_became_active":"2023-05-24T03:29:44.091390+0000","last_became_peered":"2023-05-24T03:29:44.091390+0000","last_unstale":"2023-05-24T03:29:49.711996+0000","last_undegraded":"2023-05-24T03:29:49.711996+0000","last_fullsized":"2023-05-24T03:29:49.711996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:37:43.011120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920406+0000","last_change":"2023-05-24T03:29:44.481629+0000","last_active":"2023-05-24T03:29:48.920406+0000","last_peered":"2023-05-24T03:29:48.920406+0000","last_clean":"2023-05-24T03:29:48.920406+0000","last_became_active":"2023-05-24T03:29:44.481385+0000","last_became_peered":"2023-05-24T03:29:44.481385+0000","last_unstale":"2023-05-24T03:29:48.920406+0000","last_undegraded":"2023-05-24T03:29:48.920406+0000","last_fullsized":"2023-05-24T03:29:48.920406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:27:52.176207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920327+0000","last_change":"2023-05-24T03:29:48.524712+0000","last_active":"2023-05-24T03:29:48.920327+0000","last_peered":"2023-05-24T03:29:48.920327+0000","last_clean":"2023-05-24T03:29:48.920327+0000","last_became_active":"2023-05-24T03:29:48.524312+0000","last_became_peered":"2023-05-24T03:29:48.524312+0000","last_unstale":"2023-05-24T03:29:48.920327+0000","last_undegraded":"2023-05-24T03:29:48.920327+0000","last_fullsized":"2023-05-24T03:29:48.920327+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:13:47.041051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'9","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:53.574777+0000","last_change":"2023-05-24T03:29:44.079067+0000","last_active":"2023-05-24T03:29:53.574777+0000","last_peered":"2023-05-24T03:29:53.574777+0000","last_clean":"2023-05-24T03:29:53.574777+0000","last_became_active":"2023-05-24T03:29:44.078785+0000","last_became_peered":"2023-05-24T03:29:44.078785+0000","last_unstale":"2023-05-24T03:29:53.574777+0000","last_undegraded":"2023-05-24T03:29:53.574777+0000","last_fullsized":"2023-05-24T03:29:53.574777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:32:31.553230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925391+0000","last_change":"2023-05-24T03:29:44.497603+0000","last_active":"2023-05-24T03:29:48.925391+0000","last_peered":"2023-05-24T03:29:48.925391+0000","last_clean":"2023-05-24T03:29:48.925391+0000","last_became_active":"2023-05-24T03:29:44.497120+0000","last_became_peered":"2023-05-24T03:29:44.497120+0000","last_unstale":"2023-05-24T03:29:48.925391+0000","last_undegraded":"2023-05-24T03:29:48.925391+0000","last_fullsized":"2023-05-24T03:29:48.925391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:18:47.235377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924432+0000","last_change":"2023-05-24T03:29:48.531846+0000","last_active":"2023-05-24T03:29:48.924432+0000","last_peered":"2023-05-24T03:29:48.924432+0000","last_clean":"2023-05-24T03:29:48.924432+0000","last_became_active":"2023-05-24T03:29:48.531538+0000","last_became_peered":"2023-05-24T03:29:48.531538+0000","last_unstale":"2023-05-24T03:29:48.924432+0000","last_undegraded":"2023-05-24T03:29:48.924432+0000","last_fullsized":"2023-05-24T03:29:48.924432+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:59:12.868748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.711788+0000","last_change":"2023-05-24T03:29:44.087315+0000","last_active":"2023-05-24T03:29:49.711788+0000","last_peered":"2023-05-24T03:29:49.711788+0000","last_clean":"2023-05-24T03:29:49.711788+0000","last_became_active":"2023-05-24T03:29:44.086997+0000","last_became_peered":"2023-05-24T03:29:44.086997+0000","last_unstale":"2023-05-24T03:29:49.711788+0000","last_undegraded":"2023-05-24T03:29:49.711788+0000","last_fullsized":"2023-05-24T03:29:49.711788+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:06:44.879201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798223+0000","last_change":"2023-05-24T03:29:44.487497+0000","last_active":"2023-05-24T03:29:49.798223+0000","last_peered":"2023-05-24T03:29:49.798223+0000","last_clean":"2023-05-24T03:29:49.798223+0000","last_became_active":"2023-05-24T03:29:44.487257+0000","last_became_peered":"2023-05-24T03:29:44.487257+0000","last_unstale":"2023-05-24T03:29:49.798223+0000","last_undegraded":"2023-05-24T03:29:49.798223+0000","last_fullsized":"2023-05-24T03:29:49.798223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:37:44.017565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798223+0000","last_change":"2023-05-24T03:29:48.526115+0000","last_active":"2023-05-24T03:29:49.798223+0000","last_peered":"2023-05-24T03:29:49.798223+0000","last_clean":"2023-05-24T03:29:49.798223+0000","last_became_active":"2023-05-24T03:29:48.525726+0000","last_became_peered":"2023-05-24T03:29:48.525726+0000","last_unstale":"2023-05-24T03:29:49.798223+0000","last_undegraded":"2023-05-24T03:29:49.798223+0000","last_fullsized":"2023-05-24T03:29:49.798223+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:59:09.697698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.155791+0000","last_change":"2023-05-24T03:29:44.084599+0000","last_active":"2023-05-24T03:29:49.155791+0000","last_peered":"2023-05-24T03:29:49.155791+0000","last_clean":"2023-05-24T03:29:49.155791+0000","last_became_active":"2023-05-24T03:29:44.084278+0000","last_became_peered":"2023-05-24T03:29:44.084278+0000","last_unstale":"2023-05-24T03:29:49.155791+0000","last_undegraded":"2023-05-24T03:29:49.155791+0000","last_fullsized":"2023-05-24T03:29:49.155791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:13:42.612325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924229+0000","last_change":"2023-05-24T03:29:44.498378+0000","last_active":"2023-05-24T03:29:48.924229+0000","last_peered":"2023-05-24T03:29:48.924229+0000","last_clean":"2023-05-24T03:29:48.924229+0000","last_became_active":"2023-05-24T03:29:44.498097+0000","last_became_peered":"2023-05-24T03:29:44.498097+0000","last_unstale":"2023-05-24T03:29:48.924229+0000","last_undegraded":"2023-05-24T03:29:48.924229+0000","last_fullsized":"2023-05-24T03:29:48.924229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:37:44.017565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798670+0000","last_change":"2023-05-24T03:29:48.525018+0000","last_active":"2023-05-24T03:29:49.798670+0000","last_peered":"2023-05-24T03:29:49.798670+0000","last_clean":"2023-05-24T03:29:49.798670+0000","last_became_active":"2023-05-24T03:29:48.524602+0000","last_became_peered":"2023-05-24T03:29:48.524602+0000","last_unstale":"2023-05-24T03:29:49.798670+0000","last_undegraded":"2023-05-24T03:29:49.798670+0000","last_fullsized":"2023-05-24T03:29:49.798670+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:25:43.600049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.711568+0000","last_change":"2023-05-24T03:29:44.085212+0000","last_active":"2023-05-24T03:29:49.711568+0000","last_peered":"2023-05-24T03:29:49.711568+0000","last_clean":"2023-05-24T03:29:49.711568+0000","last_became_active":"2023-05-24T03:29:44.085001+0000","last_became_peered":"2023-05-24T03:29:44.085001+0000","last_unstale":"2023-05-24T03:29:49.711568+0000","last_undegraded":"2023-05-24T03:29:49.711568+0000","last_fullsized":"2023-05-24T03:29:49.711568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:13:01.346454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156439+0000","last_change":"2023-05-24T03:29:44.500883+0000","last_active":"2023-05-24T03:29:49.156439+0000","last_peered":"2023-05-24T03:29:49.156439+0000","last_clean":"2023-05-24T03:29:49.156439+0000","last_became_active":"2023-05-24T03:29:44.500631+0000","last_became_peered":"2023-05-24T03:29:44.500631+0000","last_unstale":"2023-05-24T03:29:49.156439+0000","last_undegraded":"2023-05-24T03:29:49.156439+0000","last_fullsized":"2023-05-24T03:29:49.156439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:47:24.077381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.923764+0000","last_change":"2023-05-24T03:29:48.523523+0000","last_active":"2023-05-24T03:29:48.923764+0000","last_peered":"2023-05-24T03:29:48.923764+0000","last_clean":"2023-05-24T03:29:48.923764+0000","last_became_active":"2023-05-24T03:29:48.523138+0000","last_became_peered":"2023-05-24T03:29:48.523138+0000","last_unstale":"2023-05-24T03:29:48.923764+0000","last_undegraded":"2023-05-24T03:29:48.923764+0000","last_fullsized":"2023-05-24T03:29:48.923764+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:17:29.801036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.797983+0000","last_change":"2023-05-24T03:29:44.085229+0000","last_active":"2023-05-24T03:29:49.797983+0000","last_peered":"2023-05-24T03:29:49.797983+0000","last_clean":"2023-05-24T03:29:49.797983+0000","last_became_active":"2023-05-24T03:29:44.084914+0000","last_became_peered":"2023-05-24T03:29:44.084914+0000","last_unstale":"2023-05-24T03:29:49.797983+0000","last_undegraded":"2023-05-24T03:29:49.797983+0000","last_fullsized":"2023-05-24T03:29:49.797983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:13:33.993784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798728+0000","last_change":"2023-05-24T03:29:44.496038+0000","last_active":"2023-05-24T03:29:49.798728+0000","last_peered":"2023-05-24T03:29:49.798728+0000","last_clean":"2023-05-24T03:29:49.798728+0000","last_became_active":"2023-05-24T03:29:44.495795+0000","last_became_peered":"2023-05-24T03:29:44.495795+0000","last_unstale":"2023-05-24T03:29:49.798728+0000","last_undegraded":"2023-05-24T03:29:49.798728+0000","last_fullsized":"2023-05-24T03:29:49.798728+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:09:24.928940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.712227+0000","last_change":"2023-05-24T03:29:48.518930+0000","last_active":"2023-05-24T03:29:49.712227+0000","last_peered":"2023-05-24T03:29:49.712227+0000","last_clean":"2023-05-24T03:29:49.712227+0000","last_became_active":"2023-05-24T03:29:48.518531+0000","last_became_peered":"2023-05-24T03:29:48.518531+0000","last_unstale":"2023-05-24T03:29:49.712227+0000","last_undegraded":"2023-05-24T03:29:49.712227+0000","last_fullsized":"2023-05-24T03:29:49.712227+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:04:11.123028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.712271+0000","last_change":"2023-05-24T03:29:44.089650+0000","last_active":"2023-05-24T03:29:49.712271+0000","last_peered":"2023-05-24T03:29:49.712271+0000","last_clean":"2023-05-24T03:29:49.712271+0000","last_became_active":"2023-05-24T03:29:44.089340+0000","last_became_peered":"2023-05-24T03:29:44.089340+0000","last_unstale":"2023-05-24T03:29:49.712271+0000","last_undegraded":"2023-05-24T03:29:49.712271+0000","last_fullsized":"2023-05-24T03:29:49.712271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:25:39.171324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.923182+0000","last_change":"2023-05-24T03:29:44.498089+0000","last_active":"2023-05-24T03:29:48.923182+0000","last_peered":"2023-05-24T03:29:48.923182+0000","last_clean":"2023-05-24T03:29:48.923182+0000","last_became_active":"2023-05-24T03:29:44.497795+0000","last_became_peered":"2023-05-24T03:29:44.497795+0000","last_unstale":"2023-05-24T03:29:48.923182+0000","last_undegraded":"2023-05-24T03:29:48.923182+0000","last_fullsized":"2023-05-24T03:29:48.923182+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:30:56.976033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.231935+0000","last_change":"2023-05-24T03:29:48.521349+0000","last_active":"2023-05-24T03:29:49.231935+0000","last_peered":"2023-05-24T03:29:49.231935+0000","last_clean":"2023-05-24T03:29:49.231935+0000","last_became_active":"2023-05-24T03:29:48.520899+0000","last_became_peered":"2023-05-24T03:29:48.520899+0000","last_unstale":"2023-05-24T03:29:49.231935+0000","last_undegraded":"2023-05-24T03:29:49.231935+0000","last_fullsized":"2023-05-24T03:29:49.231935+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:39:27.313301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.712201+0000","last_change":"2023-05-24T03:29:44.086355+0000","last_active":"2023-05-24T03:29:49.712201+0000","last_peered":"2023-05-24T03:29:49.712201+0000","last_clean":"2023-05-24T03:29:49.712201+0000","last_became_active":"2023-05-24T03:29:44.086054+0000","last_became_peered":"2023-05-24T03:29:44.086054+0000","last_unstale":"2023-05-24T03:29:49.712201+0000","last_undegraded":"2023-05-24T03:29:49.712201+0000","last_fullsized":"2023-05-24T03:29:49.712201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:59:08.440023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924885+0000","last_change":"2023-05-24T03:29:44.492413+0000","last_active":"2023-05-24T03:29:48.924885+0000","last_peered":"2023-05-24T03:29:48.924885+0000","last_clean":"2023-05-24T03:29:48.924885+0000","last_became_active":"2023-05-24T03:29:44.492099+0000","last_became_peered":"2023-05-24T03:29:44.492099+0000","last_unstale":"2023-05-24T03:29:48.924885+0000","last_undegraded":"2023-05-24T03:29:48.924885+0000","last_fullsized":"2023-05-24T03:29:48.924885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:10:14.728343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.232089+0000","last_change":"2023-05-24T03:29:48.522128+0000","last_active":"2023-05-24T03:29:49.232089+0000","last_peered":"2023-05-24T03:29:49.232089+0000","last_clean":"2023-05-24T03:29:49.232089+0000","last_became_active":"2023-05-24T03:29:48.521729+0000","last_became_peered":"2023-05-24T03:29:48.521729+0000","last_unstale":"2023-05-24T03:29:49.232089+0000","last_undegraded":"2023-05-24T03:29:49.232089+0000","last_fullsized":"2023-05-24T03:29:49.232089+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:56:43.026692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.712235+0000","last_change":"2023-05-24T03:29:44.088761+0000","last_active":"2023-05-24T03:29:49.712235+0000","last_peered":"2023-05-24T03:29:49.712235+0000","last_clean":"2023-05-24T03:29:49.712235+0000","last_became_active":"2023-05-24T03:29:44.088459+0000","last_became_peered":"2023-05-24T03:29:44.088459+0000","last_unstale":"2023-05-24T03:29:49.712235+0000","last_undegraded":"2023-05-24T03:29:49.712235+0000","last_fullsized":"2023-05-24T03:29:49.712235+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:59:51.303175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.797882+0000","last_change":"2023-05-24T03:29:44.490252+0000","last_active":"2023-05-24T03:29:49.797882+0000","last_peered":"2023-05-24T03:29:49.797882+0000","last_clean":"2023-05-24T03:29:49.797882+0000","last_became_active":"2023-05-24T03:29:44.489975+0000","last_became_peered":"2023-05-24T03:29:44.489975+0000","last_unstale":"2023-05-24T03:29:49.797882+0000","last_undegraded":"2023-05-24T03:29:49.797882+0000","last_fullsized":"2023-05-24T03:29:49.797882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:23:37.430993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.232052+0000","last_change":"2023-05-24T03:29:48.523911+0000","last_active":"2023-05-24T03:29:49.232052+0000","last_peered":"2023-05-24T03:29:49.232052+0000","last_clean":"2023-05-24T03:29:49.232052+0000","last_became_active":"2023-05-24T03:29:48.523545+0000","last_became_peered":"2023-05-24T03:29:48.523545+0000","last_unstale":"2023-05-24T03:29:49.232052+0000","last_undegraded":"2023-05-24T03:29:49.232052+0000","last_fullsized":"2023-05-24T03:29:49.232052+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:03:23.555501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.923539+0000","last_change":"2023-05-24T03:29:44.091185+0000","last_active":"2023-05-24T03:29:48.923539+0000","last_peered":"2023-05-24T03:29:48.923539+0000","last_clean":"2023-05-24T03:29:48.923539+0000","last_became_active":"2023-05-24T03:29:44.090887+0000","last_became_peered":"2023-05-24T03:29:44.090887+0000","last_unstale":"2023-05-24T03:29:48.923539+0000","last_undegraded":"2023-05-24T03:29:48.923539+0000","last_fullsized":"2023-05-24T03:29:48.923539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:37:22.319418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156514+0000","last_change":"2023-05-24T03:29:44.502570+0000","last_active":"2023-05-24T03:29:49.156514+0000","last_peered":"2023-05-24T03:29:49.156514+0000","last_clean":"2023-05-24T03:29:49.156514+0000","last_became_active":"2023-05-24T03:29:44.502286+0000","last_became_peered":"2023-05-24T03:29:44.502286+0000","last_unstale":"2023-05-24T03:29:49.156514+0000","last_undegraded":"2023-05-24T03:29:49.156514+0000","last_fullsized":"2023-05-24T03:29:49.156514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:59:06.275418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.232426+0000","last_change":"2023-05-24T03:29:48.521750+0000","last_active":"2023-05-24T03:29:49.232426+0000","last_peered":"2023-05-24T03:29:49.232426+0000","last_clean":"2023-05-24T03:29:49.232426+0000","last_became_active":"2023-05-24T03:29:48.520960+0000","last_became_peered":"2023-05-24T03:29:48.520960+0000","last_unstale":"2023-05-24T03:29:49.232426+0000","last_undegraded":"2023-05-24T03:29:49.232426+0000","last_fullsized":"2023-05-24T03:29:49.232426+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T03:39:23.517439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.797919+0000","last_change":"2023-05-24T03:29:44.088157+0000","last_active":"2023-05-24T03:29:49.797919+0000","last_peered":"2023-05-24T03:29:49.797919+0000","last_clean":"2023-05-24T03:29:49.797919+0000","last_became_active":"2023-05-24T03:29:44.087869+0000","last_became_peered":"2023-05-24T03:29:44.087869+0000","last_unstale":"2023-05-24T03:29:49.797919+0000","last_undegraded":"2023-05-24T03:29:49.797919+0000","last_fullsized":"2023-05-24T03:29:49.797919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:47:23.070936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925265+0000","last_change":"2023-05-24T03:29:44.501176+0000","last_active":"2023-05-24T03:29:48.925265+0000","last_peered":"2023-05-24T03:29:48.925265+0000","last_clean":"2023-05-24T03:29:48.925265+0000","last_became_active":"2023-05-24T03:29:44.499700+0000","last_became_peered":"2023-05-24T03:29:44.499700+0000","last_unstale":"2023-05-24T03:29:48.925265+0000","last_undegraded":"2023-05-24T03:29:48.925265+0000","last_fullsized":"2023-05-24T03:29:48.925265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:31:52.511256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920217+0000","last_change":"2023-05-24T03:29:48.522778+0000","last_active":"2023-05-24T03:29:48.920217+0000","last_peered":"2023-05-24T03:29:48.920217+0000","last_clean":"2023-05-24T03:29:48.920217+0000","last_became_active":"2023-05-24T03:29:48.522104+0000","last_became_peered":"2023-05-24T03:29:48.522104+0000","last_unstale":"2023-05-24T03:29:48.920217+0000","last_undegraded":"2023-05-24T03:29:48.920217+0000","last_fullsized":"2023-05-24T03:29:48.920217+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:43:13.521320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.797884+0000","last_change":"2023-05-24T03:29:44.085211+0000","last_active":"2023-05-24T03:29:49.797884+0000","last_peered":"2023-05-24T03:29:49.797884+0000","last_clean":"2023-05-24T03:29:49.797884+0000","last_became_active":"2023-05-24T03:29:44.084894+0000","last_became_peered":"2023-05-24T03:29:44.084894+0000","last_unstale":"2023-05-24T03:29:49.797884+0000","last_undegraded":"2023-05-24T03:29:49.797884+0000","last_fullsized":"2023-05-24T03:29:49.797884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:12:00.580737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925495+0000","last_change":"2023-05-24T03:29:44.492807+0000","last_active":"2023-05-24T03:29:48.925495+0000","last_peered":"2023-05-24T03:29:48.925495+0000","last_clean":"2023-05-24T03:29:48.925495+0000","last_became_active":"2023-05-24T03:29:44.492462+0000","last_became_peered":"2023-05-24T03:29:44.492462+0000","last_unstale":"2023-05-24T03:29:48.925495+0000","last_undegraded":"2023-05-24T03:29:48.925495+0000","last_fullsized":"2023-05-24T03:29:48.925495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:58:20.689097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924069+0000","last_change":"2023-05-24T03:29:48.524960+0000","last_active":"2023-05-24T03:29:48.924069+0000","last_peered":"2023-05-24T03:29:48.924069+0000","last_clean":"2023-05-24T03:29:48.924069+0000","last_became_active":"2023-05-24T03:29:48.524023+0000","last_became_peered":"2023-05-24T03:29:48.524023+0000","last_unstale":"2023-05-24T03:29:48.924069+0000","last_undegraded":"2023-05-24T03:29:48.924069+0000","last_fullsized":"2023-05-24T03:29:48.924069+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:06:49.307926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924625+0000","last_change":"2023-05-24T03:29:44.082700+0000","last_active":"2023-05-24T03:29:48.924625+0000","last_peered":"2023-05-24T03:29:48.924625+0000","last_clean":"2023-05-24T03:29:48.924625+0000","last_became_active":"2023-05-24T03:29:44.082382+0000","last_became_peered":"2023-05-24T03:29:44.082382+0000","last_unstale":"2023-05-24T03:29:48.924625+0000","last_undegraded":"2023-05-24T03:29:48.924625+0000","last_fullsized":"2023-05-24T03:29:48.924625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:25:39.171324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925735+0000","last_change":"2023-05-24T03:29:44.501409+0000","last_active":"2023-05-24T03:29:48.925735+0000","last_peered":"2023-05-24T03:29:48.925735+0000","last_clean":"2023-05-24T03:29:48.925735+0000","last_became_active":"2023-05-24T03:29:44.501080+0000","last_became_peered":"2023-05-24T03:29:44.501080+0000","last_unstale":"2023-05-24T03:29:48.925735+0000","last_undegraded":"2023-05-24T03:29:48.925735+0000","last_fullsized":"2023-05-24T03:29:48.925735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T03:40:05.771938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925745+0000","last_change":"2023-05-24T03:29:48.519383+0000","last_active":"2023-05-24T03:29:48.925745+0000","last_peered":"2023-05-24T03:29:48.925745+0000","last_clean":"2023-05-24T03:29:48.925745+0000","last_became_active":"2023-05-24T03:29:48.519046+0000","last_became_peered":"2023-05-24T03:29:48.519046+0000","last_unstale":"2023-05-24T03:29:48.925745+0000","last_undegraded":"2023-05-24T03:29:48.925745+0000","last_fullsized":"2023-05-24T03:29:48.925745+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:55:49.240935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.797812+0000","last_change":"2023-05-24T03:29:44.085771+0000","last_active":"2023-05-24T03:29:49.797812+0000","last_peered":"2023-05-24T03:29:49.797812+0000","last_clean":"2023-05-24T03:29:49.797812+0000","last_became_active":"2023-05-24T03:29:44.085420+0000","last_became_peered":"2023-05-24T03:29:44.085420+0000","last_unstale":"2023-05-24T03:29:49.797812+0000","last_undegraded":"2023-05-24T03:29:49.797812+0000","last_fullsized":"2023-05-24T03:29:49.797812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:17:25.372310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920855+0000","last_change":"2023-05-24T03:29:44.491345+0000","last_active":"2023-05-24T03:29:48.920855+0000","last_peered":"2023-05-24T03:29:48.920855+0000","last_clean":"2023-05-24T03:29:48.920855+0000","last_became_active":"2023-05-24T03:29:44.491089+0000","last_became_peered":"2023-05-24T03:29:44.491089+0000","last_unstale":"2023-05-24T03:29:48.920855+0000","last_undegraded":"2023-05-24T03:29:48.920855+0000","last_fullsized":"2023-05-24T03:29:48.920855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:27:09.189901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156263+0000","last_change":"2023-05-24T03:29:48.530105+0000","last_active":"2023-05-24T03:29:49.156263+0000","last_peered":"2023-05-24T03:29:49.156263+0000","last_clean":"2023-05-24T03:29:49.156263+0000","last_became_active":"2023-05-24T03:29:48.529157+0000","last_became_peered":"2023-05-24T03:29:48.529157+0000","last_unstale":"2023-05-24T03:29:49.156263+0000","last_undegraded":"2023-05-24T03:29:49.156263+0000","last_fullsized":"2023-05-24T03:29:49.156263+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:16:42.206744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920406+0000","last_change":"2023-05-24T03:29:39.143199+0000","last_active":"2023-05-24T03:29:48.920406+0000","last_peered":"2023-05-24T03:29:48.920406+0000","last_clean":"2023-05-24T03:29:48.920406+0000","last_became_active":"2023-05-24T03:29:39.142867+0000","last_became_peered":"2023-05-24T03:29:39.142867+0000","last_unstale":"2023-05-24T03:29:48.920406+0000","last_undegraded":"2023-05-24T03:29:48.920406+0000","last_fullsized":"2023-05-24T03:29:48.920406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:30:50.951434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924073+0000","last_change":"2023-05-24T03:29:44.087790+0000","last_active":"2023-05-24T03:29:48.924073+0000","last_peered":"2023-05-24T03:29:48.924073+0000","last_clean":"2023-05-24T03:29:48.924073+0000","last_became_active":"2023-05-24T03:29:44.087475+0000","last_became_peered":"2023-05-24T03:29:44.087475+0000","last_unstale":"2023-05-24T03:29:48.924073+0000","last_undegraded":"2023-05-24T03:29:48.924073+0000","last_fullsized":"2023-05-24T03:29:48.924073+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:19:26.667537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920215+0000","last_change":"2023-05-24T03:29:44.497235+0000","last_active":"2023-05-24T03:29:48.920215+0000","last_peered":"2023-05-24T03:29:48.920215+0000","last_clean":"2023-05-24T03:29:48.920215+0000","last_became_active":"2023-05-24T03:29:44.497015+0000","last_became_peered":"2023-05-24T03:29:44.497015+0000","last_unstale":"2023-05-24T03:29:48.920215+0000","last_undegraded":"2023-05-24T03:29:48.920215+0000","last_fullsized":"2023-05-24T03:29:48.920215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:57:57.662351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156092+0000","last_change":"2023-05-24T03:29:48.527805+0000","last_active":"2023-05-24T03:29:49.156092+0000","last_peered":"2023-05-24T03:29:49.156092+0000","last_clean":"2023-05-24T03:29:49.156092+0000","last_became_active":"2023-05-24T03:29:48.527010+0000","last_became_peered":"2023-05-24T03:29:48.527010+0000","last_unstale":"2023-05-24T03:29:49.156092+0000","last_undegraded":"2023-05-24T03:29:49.156092+0000","last_fullsized":"2023-05-24T03:29:49.156092+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:27:55.598487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.923462+0000","last_change":"2023-05-24T03:29:39.048516+0000","last_active":"2023-05-24T03:29:48.923462+0000","last_peered":"2023-05-24T03:29:48.923462+0000","last_clean":"2023-05-24T03:29:48.923462+0000","last_became_active":"2023-05-24T03:29:39.048141+0000","last_became_peered":"2023-05-24T03:29:39.048141+0000","last_unstale":"2023-05-24T03:29:48.923462+0000","last_undegraded":"2023-05-24T03:29:48.923462+0000","last_fullsized":"2023-05-24T03:29:48.923462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:42:01.286387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925527+0000","last_change":"2023-05-24T03:29:44.085282+0000","last_active":"2023-05-24T03:29:48.925527+0000","last_peered":"2023-05-24T03:29:48.925527+0000","last_clean":"2023-05-24T03:29:48.925527+0000","last_became_active":"2023-05-24T03:29:44.084944+0000","last_became_peered":"2023-05-24T03:29:44.084944+0000","last_unstale":"2023-05-24T03:29:48.925527+0000","last_undegraded":"2023-05-24T03:29:48.925527+0000","last_fullsized":"2023-05-24T03:29:48.925527+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:09:43.787048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920293+0000","last_change":"2023-05-24T03:29:44.483553+0000","last_active":"2023-05-24T03:29:48.920293+0000","last_peered":"2023-05-24T03:29:48.920293+0000","last_clean":"2023-05-24T03:29:48.920293+0000","last_became_active":"2023-05-24T03:29:44.483134+0000","last_became_peered":"2023-05-24T03:29:44.483134+0000","last_unstale":"2023-05-24T03:29:48.920293+0000","last_undegraded":"2023-05-24T03:29:48.920293+0000","last_fullsized":"2023-05-24T03:29:48.920293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:51:21.843236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.232485+0000","last_change":"2023-05-24T03:29:48.519249+0000","last_active":"2023-05-24T03:29:49.232485+0000","last_peered":"2023-05-24T03:29:49.232485+0000","last_clean":"2023-05-24T03:29:49.232485+0000","last_became_active":"2023-05-24T03:29:48.518546+0000","last_became_peered":"2023-05-24T03:29:48.518546+0000","last_unstale":"2023-05-24T03:29:49.232485+0000","last_undegraded":"2023-05-24T03:29:49.232485+0000","last_fullsized":"2023-05-24T03:29:49.232485+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:03:54.662293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.232195+0000","last_change":"2023-05-24T03:29:39.310351+0000","last_active":"2023-05-24T03:29:49.232195+0000","last_peered":"2023-05-24T03:29:49.232195+0000","last_clean":"2023-05-24T03:29:49.232195+0000","last_became_active":"2023-05-24T03:29:39.310070+0000","last_became_peered":"2023-05-24T03:29:39.310070+0000","last_unstale":"2023-05-24T03:29:49.232195+0000","last_undegraded":"2023-05-24T03:29:49.232195+0000","last_fullsized":"2023-05-24T03:29:49.232195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:13:08.585653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.919973+0000","last_change":"2023-05-24T03:29:44.075504+0000","last_active":"2023-05-24T03:29:48.919973+0000","last_peered":"2023-05-24T03:29:48.919973+0000","last_clean":"2023-05-24T03:29:48.919973+0000","last_became_active":"2023-05-24T03:29:44.074551+0000","last_became_peered":"2023-05-24T03:29:44.074551+0000","last_unstale":"2023-05-24T03:29:48.919973+0000","last_undegraded":"2023-05-24T03:29:48.919973+0000","last_fullsized":"2023-05-24T03:29:48.919973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:00:51.565754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920676+0000","last_change":"2023-05-24T03:29:44.496225+0000","last_active":"2023-05-24T03:29:48.920676+0000","last_peered":"2023-05-24T03:29:48.920676+0000","last_clean":"2023-05-24T03:29:48.920676+0000","last_became_active":"2023-05-24T03:29:44.496030+0000","last_became_peered":"2023-05-24T03:29:44.496030+0000","last_unstale":"2023-05-24T03:29:48.920676+0000","last_undegraded":"2023-05-24T03:29:48.920676+0000","last_fullsized":"2023-05-24T03:29:48.920676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:37:23.325863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.711961+0000","last_change":"2023-05-24T03:29:48.523816+0000","last_active":"2023-05-24T03:29:49.711961+0000","last_peered":"2023-05-24T03:29:49.711961+0000","last_clean":"2023-05-24T03:29:49.711961+0000","last_became_active":"2023-05-24T03:29:48.523380+0000","last_became_peered":"2023-05-24T03:29:48.523380+0000","last_unstale":"2023-05-24T03:29:49.711961+0000","last_undegraded":"2023-05-24T03:29:49.711961+0000","last_fullsized":"2023-05-24T03:29:49.711961+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:59:09.697698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.923885+0000","last_change":"2023-05-24T03:29:39.051113+0000","last_active":"2023-05-24T03:29:48.923885+0000","last_peered":"2023-05-24T03:29:48.923885+0000","last_clean":"2023-05-24T03:29:48.923885+0000","last_became_active":"2023-05-24T03:29:39.050751+0000","last_became_peered":"2023-05-24T03:29:39.050751+0000","last_unstale":"2023-05-24T03:29:48.923885+0000","last_undegraded":"2023-05-24T03:29:48.923885+0000","last_fullsized":"2023-05-24T03:29:48.923885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:54:48.001313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":183,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.711482+0000","last_change":"2023-05-24T03:29:34.025679+0000","last_active":"2023-05-24T03:29:49.711482+0000","last_peered":"2023-05-24T03:29:49.711482+0000","last_clean":"2023-05-24T03:29:49.711482+0000","last_became_active":"2023-05-24T03:29:34.024728+0000","last_became_peered":"2023-05-24T03:29:34.024728+0000","last_unstale":"2023-05-24T03:29:49.711482+0000","last_undegraded":"2023-05-24T03:29:49.711482+0000","last_fullsized":"2023-05-24T03:29:49.711482+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:32.968348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:32.968348+0000","last_clean_scrub_stamp":"2023-05-24T03:29:32.968348+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:17:15.286781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.797849+0000","last_change":"2023-05-24T03:29:44.086373+0000","last_active":"2023-05-24T03:29:49.797849+0000","last_peered":"2023-05-24T03:29:49.797849+0000","last_clean":"2023-05-24T03:29:49.797849+0000","last_became_active":"2023-05-24T03:29:44.086125+0000","last_became_peered":"2023-05-24T03:29:44.086125+0000","last_unstale":"2023-05-24T03:29:49.797849+0000","last_undegraded":"2023-05-24T03:29:49.797849+0000","last_fullsized":"2023-05-24T03:29:49.797849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:13:01.346454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798145+0000","last_change":"2023-05-24T03:29:44.492654+0000","last_active":"2023-05-24T03:29:49.798145+0000","last_peered":"2023-05-24T03:29:49.798145+0000","last_clean":"2023-05-24T03:29:49.798145+0000","last_became_active":"2023-05-24T03:29:44.492375+0000","last_became_peered":"2023-05-24T03:29:44.492375+0000","last_unstale":"2023-05-24T03:29:49.798145+0000","last_undegraded":"2023-05-24T03:29:49.798145+0000","last_fullsized":"2023-05-24T03:29:49.798145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:59:38.574199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.923773+0000","last_change":"2023-05-24T03:29:48.525206+0000","last_active":"2023-05-24T03:29:48.923773+0000","last_peered":"2023-05-24T03:29:48.923773+0000","last_clean":"2023-05-24T03:29:48.923773+0000","last_became_active":"2023-05-24T03:29:48.524615+0000","last_became_peered":"2023-05-24T03:29:48.524615+0000","last_unstale":"2023-05-24T03:29:48.923773+0000","last_undegraded":"2023-05-24T03:29:48.923773+0000","last_fullsized":"2023-05-24T03:29:48.923773+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:13:05.775179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.711704+0000","last_change":"2023-05-24T03:29:39.054117+0000","last_active":"2023-05-24T03:29:49.711704+0000","last_peered":"2023-05-24T03:29:49.711704+0000","last_clean":"2023-05-24T03:29:49.711704+0000","last_became_active":"2023-05-24T03:29:39.053813+0000","last_became_peered":"2023-05-24T03:29:39.053813+0000","last_unstale":"2023-05-24T03:29:49.711704+0000","last_undegraded":"2023-05-24T03:29:49.711704+0000","last_fullsized":"2023-05-24T03:29:49.711704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:47:18.052783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156076+0000","last_change":"2023-05-24T03:29:44.090147+0000","last_active":"2023-05-24T03:29:49.156076+0000","last_peered":"2023-05-24T03:29:49.156076+0000","last_clean":"2023-05-24T03:29:49.156076+0000","last_became_active":"2023-05-24T03:29:44.089943+0000","last_became_peered":"2023-05-24T03:29:44.089943+0000","last_unstale":"2023-05-24T03:29:49.156076+0000","last_undegraded":"2023-05-24T03:29:49.156076+0000","last_fullsized":"2023-05-24T03:29:49.156076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:30:55.969587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156224+0000","last_change":"2023-05-24T03:29:44.498467+0000","last_active":"2023-05-24T03:29:49.156224+0000","last_peered":"2023-05-24T03:29:49.156224+0000","last_clean":"2023-05-24T03:29:49.156224+0000","last_became_active":"2023-05-24T03:29:44.498130+0000","last_became_peered":"2023-05-24T03:29:44.498130+0000","last_unstale":"2023-05-24T03:29:49.156224+0000","last_undegraded":"2023-05-24T03:29:49.156224+0000","last_fullsized":"2023-05-24T03:29:49.156224+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:42:07.310986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798266+0000","last_change":"2023-05-24T03:29:48.520034+0000","last_active":"2023-05-24T03:29:49.798266+0000","last_peered":"2023-05-24T03:29:49.798266+0000","last_clean":"2023-05-24T03:29:49.798266+0000","last_became_active":"2023-05-24T03:29:48.519673+0000","last_became_peered":"2023-05-24T03:29:48.519673+0000","last_unstale":"2023-05-24T03:29:49.798266+0000","last_undegraded":"2023-05-24T03:29:49.798266+0000","last_fullsized":"2023-05-24T03:29:49.798266+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:47:00.839865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.711979+0000","last_change":"2023-05-24T03:29:39.143215+0000","last_active":"2023-05-24T03:29:49.711979+0000","last_peered":"2023-05-24T03:29:49.711979+0000","last_clean":"2023-05-24T03:29:49.711979+0000","last_became_active":"2023-05-24T03:29:39.142949+0000","last_became_peered":"2023-05-24T03:29:39.142949+0000","last_unstale":"2023-05-24T03:29:49.711979+0000","last_undegraded":"2023-05-24T03:29:49.711979+0000","last_fullsized":"2023-05-24T03:29:49.711979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:52:07.793681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920538+0000","last_change":"2023-05-24T03:29:44.074869+0000","last_active":"2023-05-24T03:29:48.920538+0000","last_peered":"2023-05-24T03:29:48.920538+0000","last_clean":"2023-05-24T03:29:48.920538+0000","last_became_active":"2023-05-24T03:29:44.074374+0000","last_became_peered":"2023-05-24T03:29:44.074374+0000","last_unstale":"2023-05-24T03:29:48.920538+0000","last_undegraded":"2023-05-24T03:29:48.920538+0000","last_fullsized":"2023-05-24T03:29:48.920538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:16:37.778018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156370+0000","last_change":"2023-05-24T03:29:44.499979+0000","last_active":"2023-05-24T03:29:49.156370+0000","last_peered":"2023-05-24T03:29:49.156370+0000","last_clean":"2023-05-24T03:29:49.156370+0000","last_became_active":"2023-05-24T03:29:44.499768+0000","last_became_peered":"2023-05-24T03:29:44.499768+0000","last_unstale":"2023-05-24T03:29:49.156370+0000","last_undegraded":"2023-05-24T03:29:49.156370+0000","last_fullsized":"2023-05-24T03:29:49.156370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:13:02.352900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924990+0000","last_change":"2023-05-24T03:29:48.530781+0000","last_active":"2023-05-24T03:29:48.924990+0000","last_peered":"2023-05-24T03:29:48.924990+0000","last_clean":"2023-05-24T03:29:48.924990+0000","last_became_active":"2023-05-24T03:29:48.530401+0000","last_became_peered":"2023-05-24T03:29:48.530401+0000","last_unstale":"2023-05-24T03:29:48.924990+0000","last_undegraded":"2023-05-24T03:29:48.924990+0000","last_fullsized":"2023-05-24T03:29:48.924990+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:56:52.111906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798616+0000","last_change":"2023-05-24T03:29:44.084278+0000","last_active":"2023-05-24T03:29:49.798616+0000","last_peered":"2023-05-24T03:29:49.798616+0000","last_clean":"2023-05-24T03:29:49.798616+0000","last_became_active":"2023-05-24T03:29:44.083929+0000","last_became_peered":"2023-05-24T03:29:44.083929+0000","last_unstale":"2023-05-24T03:29:49.798616+0000","last_undegraded":"2023-05-24T03:29:49.798616+0000","last_fullsized":"2023-05-24T03:29:49.798616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:59:51.303175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920595+0000","last_change":"2023-05-24T03:29:39.045821+0000","last_active":"2023-05-24T03:29:48.920595+0000","last_peered":"2023-05-24T03:29:48.920595+0000","last_clean":"2023-05-24T03:29:48.920595+0000","last_became_active":"2023-05-24T03:29:39.045543+0000","last_became_peered":"2023-05-24T03:29:39.045543+0000","last_unstale":"2023-05-24T03:29:48.920595+0000","last_undegraded":"2023-05-24T03:29:48.920595+0000","last_fullsized":"2023-05-24T03:29:48.920595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:12:33.887713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.797728+0000","last_change":"2023-05-24T03:29:44.496106+0000","last_active":"2023-05-24T03:29:49.797728+0000","last_peered":"2023-05-24T03:29:49.797728+0000","last_clean":"2023-05-24T03:29:49.797728+0000","last_became_active":"2023-05-24T03:29:44.495816+0000","last_became_peered":"2023-05-24T03:29:44.495816+0000","last_unstale":"2023-05-24T03:29:49.797728+0000","last_undegraded":"2023-05-24T03:29:49.797728+0000","last_fullsized":"2023-05-24T03:29:49.797728+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:37:23.325863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.797716+0000","last_change":"2023-05-24T03:29:48.527602+0000","last_active":"2023-05-24T03:29:49.797716+0000","last_peered":"2023-05-24T03:29:49.797716+0000","last_clean":"2023-05-24T03:29:49.797716+0000","last_became_active":"2023-05-24T03:29:48.527196+0000","last_became_peered":"2023-05-24T03:29:48.527196+0000","last_unstale":"2023-05-24T03:29:49.797716+0000","last_undegraded":"2023-05-24T03:29:49.797716+0000","last_fullsized":"2023-05-24T03:29:49.797716+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:12:43.334592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798516+0000","last_change":"2023-05-24T03:29:39.046445+0000","last_active":"2023-05-24T03:29:49.798516+0000","last_peered":"2023-05-24T03:29:49.798516+0000","last_clean":"2023-05-24T03:29:49.798516+0000","last_became_active":"2023-05-24T03:29:39.046149+0000","last_became_peered":"2023-05-24T03:29:39.046149+0000","last_unstale":"2023-05-24T03:29:49.798516+0000","last_undegraded":"2023-05-24T03:29:49.798516+0000","last_fullsized":"2023-05-24T03:29:49.798516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:11:20.972024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"28'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156361+0000","last_change":"2023-05-24T03:29:44.088780+0000","last_active":"2023-05-24T03:29:49.156361+0000","last_peered":"2023-05-24T03:29:49.156361+0000","last_clean":"2023-05-24T03:29:49.156361+0000","last_became_active":"2023-05-24T03:29:44.088495+0000","last_became_peered":"2023-05-24T03:29:44.088495+0000","last_unstale":"2023-05-24T03:29:49.156361+0000","last_undegraded":"2023-05-24T03:29:49.156361+0000","last_fullsized":"2023-05-24T03:29:49.156361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:37:22.319418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924732+0000","last_change":"2023-05-24T03:29:44.496966+0000","last_active":"2023-05-24T03:29:48.924732+0000","last_peered":"2023-05-24T03:29:48.924732+0000","last_clean":"2023-05-24T03:29:48.924732+0000","last_became_active":"2023-05-24T03:29:44.496597+0000","last_became_peered":"2023-05-24T03:29:44.496597+0000","last_unstale":"2023-05-24T03:29:48.924732+0000","last_undegraded":"2023-05-24T03:29:48.924732+0000","last_fullsized":"2023-05-24T03:29:48.924732+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:09:24.928940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920813+0000","last_change":"2023-05-24T03:29:48.524541+0000","last_active":"2023-05-24T03:29:48.920813+0000","last_peered":"2023-05-24T03:29:48.920813+0000","last_clean":"2023-05-24T03:29:48.920813+0000","last_became_active":"2023-05-24T03:29:48.524170+0000","last_became_peered":"2023-05-24T03:29:48.524170+0000","last_unstale":"2023-05-24T03:29:48.920813+0000","last_undegraded":"2023-05-24T03:29:48.920813+0000","last_fullsized":"2023-05-24T03:29:48.920813+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:17:29.801036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156385+0000","last_change":"2023-05-24T03:29:44.090259+0000","last_active":"2023-05-24T03:29:49.156385+0000","last_peered":"2023-05-24T03:29:49.156385+0000","last_clean":"2023-05-24T03:29:49.156385+0000","last_became_active":"2023-05-24T03:29:44.089993+0000","last_became_peered":"2023-05-24T03:29:44.089993+0000","last_unstale":"2023-05-24T03:29:49.156385+0000","last_undegraded":"2023-05-24T03:29:49.156385+0000","last_fullsized":"2023-05-24T03:29:49.156385+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:27:08.183456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.232199+0000","last_change":"2023-05-24T03:29:44.481933+0000","last_active":"2023-05-24T03:29:49.232199+0000","last_peered":"2023-05-24T03:29:49.232199+0000","last_clean":"2023-05-24T03:29:49.232199+0000","last_became_active":"2023-05-24T03:29:44.481655+0000","last_became_peered":"2023-05-24T03:29:44.481655+0000","last_unstale":"2023-05-24T03:29:49.232199+0000","last_undegraded":"2023-05-24T03:29:49.232199+0000","last_fullsized":"2023-05-24T03:29:49.232199+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:06:36.510598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.712009+0000","last_change":"2023-05-24T03:29:48.516800+0000","last_active":"2023-05-24T03:29:49.712009+0000","last_peered":"2023-05-24T03:29:49.712009+0000","last_clean":"2023-05-24T03:29:49.712009+0000","last_became_active":"2023-05-24T03:29:48.516366+0000","last_became_peered":"2023-05-24T03:29:48.516366+0000","last_unstale":"2023-05-24T03:29:49.712009+0000","last_undegraded":"2023-05-24T03:29:49.712009+0000","last_fullsized":"2023-05-24T03:29:49.712009+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:19:31.096262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.923650+0000","last_change":"2023-05-24T03:29:44.094179+0000","last_active":"2023-05-24T03:29:48.923650+0000","last_peered":"2023-05-24T03:29:48.923650+0000","last_clean":"2023-05-24T03:29:48.923650+0000","last_became_active":"2023-05-24T03:29:44.093909+0000","last_became_peered":"2023-05-24T03:29:44.093909+0000","last_unstale":"2023-05-24T03:29:48.923650+0000","last_undegraded":"2023-05-24T03:29:48.923650+0000","last_fullsized":"2023-05-24T03:29:48.923650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:55:31.183299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924979+0000","last_change":"2023-05-24T03:29:44.497379+0000","last_active":"2023-05-24T03:29:48.924979+0000","last_peered":"2023-05-24T03:29:48.924979+0000","last_clean":"2023-05-24T03:29:48.924979+0000","last_became_active":"2023-05-24T03:29:44.496679+0000","last_became_peered":"2023-05-24T03:29:44.496679+0000","last_unstale":"2023-05-24T03:29:48.924979+0000","last_undegraded":"2023-05-24T03:29:48.924979+0000","last_fullsized":"2023-05-24T03:29:48.924979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:53:47.591081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924043+0000","last_change":"2023-05-24T03:29:48.529231+0000","last_active":"2023-05-24T03:29:48.924043+0000","last_peered":"2023-05-24T03:29:48.924043+0000","last_clean":"2023-05-24T03:29:48.924043+0000","last_became_active":"2023-05-24T03:29:48.528862+0000","last_became_peered":"2023-05-24T03:29:48.528862+0000","last_unstale":"2023-05-24T03:29:48.924043+0000","last_undegraded":"2023-05-24T03:29:48.924043+0000","last_fullsized":"2023-05-24T03:29:48.924043+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:48:31.938863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.923932+0000","last_change":"2023-05-24T03:29:44.090289+0000","last_active":"2023-05-24T03:29:48.923932+0000","last_peered":"2023-05-24T03:29:48.923932+0000","last_clean":"2023-05-24T03:29:48.923932+0000","last_became_active":"2023-05-24T03:29:44.089949+0000","last_became_peered":"2023-05-24T03:29:44.089949+0000","last_unstale":"2023-05-24T03:29:48.923932+0000","last_undegraded":"2023-05-24T03:29:48.923932+0000","last_fullsized":"2023-05-24T03:29:48.923932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:47:23.070936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924880+0000","last_change":"2023-05-24T03:29:44.498632+0000","last_active":"2023-05-24T03:29:48.924880+0000","last_peered":"2023-05-24T03:29:48.924880+0000","last_clean":"2023-05-24T03:29:48.924880+0000","last_became_active":"2023-05-24T03:29:44.498350+0000","last_became_peered":"2023-05-24T03:29:44.498350+0000","last_unstale":"2023-05-24T03:29:48.924880+0000","last_undegraded":"2023-05-24T03:29:48.924880+0000","last_fullsized":"2023-05-24T03:29:48.924880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:02:32.050380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924648+0000","last_change":"2023-05-24T03:29:48.523434+0000","last_active":"2023-05-24T03:29:48.924648+0000","last_peered":"2023-05-24T03:29:48.924648+0000","last_clean":"2023-05-24T03:29:48.924648+0000","last_became_active":"2023-05-24T03:29:48.522228+0000","last_became_peered":"2023-05-24T03:29:48.522228+0000","last_unstale":"2023-05-24T03:29:48.924648+0000","last_undegraded":"2023-05-24T03:29:48.924648+0000","last_fullsized":"2023-05-24T03:29:48.924648+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:59:55.731900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798448+0000","last_change":"2023-05-24T03:29:44.083178+0000","last_active":"2023-05-24T03:29:49.798448+0000","last_peered":"2023-05-24T03:29:49.798448+0000","last_clean":"2023-05-24T03:29:49.798448+0000","last_became_active":"2023-05-24T03:29:44.082903+0000","last_became_peered":"2023-05-24T03:29:44.082903+0000","last_unstale":"2023-05-24T03:29:49.798448+0000","last_undegraded":"2023-05-24T03:29:49.798448+0000","last_fullsized":"2023-05-24T03:29:49.798448+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:59:08.440023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798028+0000","last_change":"2023-05-24T03:29:44.488206+0000","last_active":"2023-05-24T03:29:49.798028+0000","last_peered":"2023-05-24T03:29:49.798028+0000","last_clean":"2023-05-24T03:29:49.798028+0000","last_became_active":"2023-05-24T03:29:44.487925+0000","last_became_peered":"2023-05-24T03:29:44.487925+0000","last_unstale":"2023-05-24T03:29:49.798028+0000","last_undegraded":"2023-05-24T03:29:49.798028+0000","last_fullsized":"2023-05-24T03:29:49.798028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:48:28.516583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920063+0000","last_change":"2023-05-24T03:29:48.519899+0000","last_active":"2023-05-24T03:29:48.920063+0000","last_peered":"2023-05-24T03:29:48.920063+0000","last_clean":"2023-05-24T03:29:48.920063+0000","last_became_active":"2023-05-24T03:29:48.519517+0000","last_became_peered":"2023-05-24T03:29:48.519517+0000","last_unstale":"2023-05-24T03:29:48.920063+0000","last_undegraded":"2023-05-24T03:29:48.920063+0000","last_fullsized":"2023-05-24T03:29:48.920063+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:26:20.594013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156596+0000","last_change":"2023-05-24T03:29:44.088545+0000","last_active":"2023-05-24T03:29:49.156596+0000","last_peered":"2023-05-24T03:29:49.156596+0000","last_clean":"2023-05-24T03:29:49.156596+0000","last_became_active":"2023-05-24T03:29:44.087891+0000","last_became_peered":"2023-05-24T03:29:44.087891+0000","last_unstale":"2023-05-24T03:29:49.156596+0000","last_undegraded":"2023-05-24T03:29:49.156596+0000","last_fullsized":"2023-05-24T03:29:49.156596+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:19:26.667537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925035+0000","last_change":"2023-05-24T03:29:44.493246+0000","last_active":"2023-05-24T03:29:48.925035+0000","last_peered":"2023-05-24T03:29:48.925035+0000","last_clean":"2023-05-24T03:29:48.925035+0000","last_became_active":"2023-05-24T03:29:44.492923+0000","last_became_peered":"2023-05-24T03:29:44.492923+0000","last_unstale":"2023-05-24T03:29:48.925035+0000","last_undegraded":"2023-05-24T03:29:48.925035+0000","last_fullsized":"2023-05-24T03:29:48.925035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:59:05.161810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798054+0000","last_change":"2023-05-24T03:29:44.486961+0000","last_active":"2023-05-24T03:29:49.798054+0000","last_peered":"2023-05-24T03:29:49.798054+0000","last_clean":"2023-05-24T03:29:49.798054+0000","last_became_active":"2023-05-24T03:29:44.483898+0000","last_became_peered":"2023-05-24T03:29:44.483898+0000","last_unstale":"2023-05-24T03:29:49.798054+0000","last_undegraded":"2023-05-24T03:29:49.798054+0000","last_fullsized":"2023-05-24T03:29:49.798054+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:17:10.507341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798199+0000","last_change":"2023-05-24T03:29:44.494451+0000","last_active":"2023-05-24T03:29:49.798199+0000","last_peered":"2023-05-24T03:29:49.798199+0000","last_clean":"2023-05-24T03:29:49.798199+0000","last_became_active":"2023-05-24T03:29:44.494073+0000","last_became_peered":"2023-05-24T03:29:44.494073+0000","last_unstale":"2023-05-24T03:29:49.798199+0000","last_undegraded":"2023-05-24T03:29:49.798199+0000","last_fullsized":"2023-05-24T03:29:49.798199+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:52:13.818279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925451+0000","last_change":"2023-05-24T03:29:44.498119+0000","last_active":"2023-05-24T03:29:48.925451+0000","last_peered":"2023-05-24T03:29:48.925451+0000","last_clean":"2023-05-24T03:29:48.925451+0000","last_became_active":"2023-05-24T03:29:44.497832+0000","last_became_peered":"2023-05-24T03:29:44.497832+0000","last_unstale":"2023-05-24T03:29:48.925451+0000","last_undegraded":"2023-05-24T03:29:48.925451+0000","last_fullsized":"2023-05-24T03:29:48.925451+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:27:13.487917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.797913+0000","last_change":"2023-05-24T03:29:44.496468+0000","last_active":"2023-05-24T03:29:49.797913+0000","last_peered":"2023-05-24T03:29:49.797913+0000","last_clean":"2023-05-24T03:29:49.797913+0000","last_became_active":"2023-05-24T03:29:44.496197+0000","last_became_peered":"2023-05-24T03:29:44.496197+0000","last_unstale":"2023-05-24T03:29:49.797913+0000","last_undegraded":"2023-05-24T03:29:49.797913+0000","last_fullsized":"2023-05-24T03:29:49.797913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:54:54.025911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920554+0000","last_change":"2023-05-24T03:29:44.495194+0000","last_active":"2023-05-24T03:29:48.920554+0000","last_peered":"2023-05-24T03:29:48.920554+0000","last_clean":"2023-05-24T03:29:48.920554+0000","last_became_active":"2023-05-24T03:29:44.494928+0000","last_became_peered":"2023-05-24T03:29:44.494928+0000","last_unstale":"2023-05-24T03:29:48.920554+0000","last_undegraded":"2023-05-24T03:29:48.920554+0000","last_fullsized":"2023-05-24T03:29:48.920554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:42:07.310986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18832,"kb_used_data":904,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353008,"statfs":{"total":96636764160,"available":96617480192,"internally_reserved":0,"allocated":925696,"data_stored":718998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18224,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353616,"statfs":{"total":96636764160,"available":96618102784,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18224,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353616,"statfs":{"total":96636764160,"available":96618102784,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18808,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353032,"statfs":{"total":96636764160,"available":96617504768,"internally_reserved":0,"allocated":901120,"data_stored":715522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18224,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353616,"statfs":{"total":96636764160,"available":96618102784,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18228,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353612,"statfs":{"total":96636764160,"available":96618098688,"internally_reserved":0,"allocated":307200,"data_stored":124662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18244,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353596,"statfs":{"total":96636764160,"available":96618082304,"internally_reserved":0,"allocated":323584,"data_stored":128470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18232,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353608,"statfs":{"total":96636764160,"available":96618094592,"internally_reserved":0,"allocated":311296,"data_stored":125224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-24T03:30:07.618 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-05-24T03:30:07.618 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-05-24T03:30:07.619 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-05-24T03:30:07.619 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-05-24T03:30:07.619 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-05-24T03:30:07.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.766+0000 7fa1dfa22700 1 Processor -- start 2023-05-24T03:30:07.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.766+0000 7fa1dfa22700 1 -- start start 2023-05-24T03:30:07.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.767+0000 7fa1dfa22700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa1d80cdf10 0x7fa1d8159c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:07.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.767+0000 7fa1dfa22700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa1d815dcf0 0x7fa1d80ce2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:07.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.767+0000 7fa1dfa22700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1d8070f50 0x7fa1d806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:07.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.767+0000 7fa1dfa22700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1d815a1c0 con 0x7fa1d80cdf10 2023-05-24T03:30:07.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.767+0000 7fa1dfa22700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1d80ce820 con 0x7fa1d815dcf0 2023-05-24T03:30:07.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.767+0000 7fa1dfa22700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d815a3c0 con 0x7fa1d8070f50 2023-05-24T03:30:07.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.767+0000 7fa1dd7be700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa1d80cdf10 0x7fa1d8159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:07.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.767+0000 7fa1dd7be700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa1d80cdf10 0x7fa1d8159c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39218/0 (socket says 172.21.15.146:39218) 2023-05-24T03:30:07.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.767+0000 7fa1dd7be700 1 -- 172.21.15.146:0/3143523119 learned_addr learned my addr 172.21.15.146:0/3143523119 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:07.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.767+0000 7fa1dcfbd700 1 --2- 172.21.15.146:0/3143523119 >> v2:172.21.15.151:3300/0 conn(0x7fa1d815dcf0 0x7fa1d80ce2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:07.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.767+0000 7fa1ddfbf700 1 --2- 172.21.15.146:0/3143523119 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1d8070f50 0x7fa1d806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:07.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.767+0000 7fa1dd7be700 1 -- 172.21.15.146:0/3143523119 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1d8070f50 msgr2=0x7fa1d806d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:07.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.767+0000 7fa1dd7be700 1 --2- 172.21.15.146:0/3143523119 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1d8070f50 0x7fa1d806d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:07.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.767+0000 7fa1dd7be700 1 -- 172.21.15.146:0/3143523119 >> v2:172.21.15.151:3300/0 conn(0x7fa1d815dcf0 msgr2=0x7fa1d80ce2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:07.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.767+0000 7fa1dd7be700 1 --2- 172.21.15.146:0/3143523119 >> v2:172.21.15.151:3300/0 conn(0x7fa1d815dcf0 0x7fa1d80ce2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:07.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.767+0000 7fa1dd7be700 1 -- 172.21.15.146:0/3143523119 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d815a6a0 con 0x7fa1d80cdf10 2023-05-24T03:30:07.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.767+0000 7fa1dcfbd700 1 --2- 172.21.15.146:0/3143523119 >> v2:172.21.15.151:3300/0 conn(0x7fa1d815dcf0 0x7fa1d80ce2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:30:07.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.767+0000 7fa1dd7be700 1 --2- 172.21.15.146:0/3143523119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1d80cdf10 0x7fa1d8159c80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8070d40 tx=0x7fa1d4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c316f3d12370f43 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:07.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.767+0000 7fa1cffff700 1 -- 172.21.15.146:0/3143523119 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d400b870 con 0x7fa1d80cdf10 2023-05-24T03:30:07.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.768+0000 7fa1cffff700 1 -- 172.21.15.146:0/3143523119 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d400b9d0 con 0x7fa1d80cdf10 2023-05-24T03:30:07.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.768+0000 7fa1cffff700 1 -- 172.21.15.146:0/3143523119 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d400bd60 con 0x7fa1d80cdf10 2023-05-24T03:30:07.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.768+0000 7fa1dfa22700 1 -- 172.21.15.146:0/3143523119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1d80cdf10 msgr2=0x7fa1d8159c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:07.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.768+0000 7fa1dfa22700 1 --2- 172.21.15.146:0/3143523119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1d80cdf10 0x7fa1d8159c80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8070d40 tx=0x7fa1d4009bd0 comp rx=0 tx=0).stop 2023-05-24T03:30:07.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.768+0000 7fa1dfa22700 1 -- 172.21.15.146:0/3143523119 shutdown_connections 2023-05-24T03:30:07.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.768+0000 7fa1dfa22700 1 --2- 172.21.15.146:0/3143523119 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1d8070f50 0x7fa1d806d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:07.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.768+0000 7fa1dfa22700 1 --2- 172.21.15.146:0/3143523119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1d80cdf10 0x7fa1d8159c80 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:07.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.768+0000 7fa1dfa22700 1 --2- 172.21.15.146:0/3143523119 >> v2:172.21.15.151:3300/0 conn(0x7fa1d815dcf0 0x7fa1d80ce2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:07.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.768+0000 7fa1dfa22700 1 -- 172.21.15.146:0/3143523119 >> 172.21.15.146:0/3143523119 conn(0x7fa1d80cfea0 msgr2=0x7fa1d80d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:07.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.768+0000 7fa1dfa22700 1 -- 172.21.15.146:0/3143523119 shutdown_connections 2023-05-24T03:30:07.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.768+0000 7fa1dfa22700 1 -- 172.21.15.146:0/3143523119 wait complete. 2023-05-24T03:30:07.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.769+0000 7fa1dfa22700 1 Processor -- start 2023-05-24T03:30:07.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.769+0000 7fa1dfa22700 1 -- start start 2023-05-24T03:30:07.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.770+0000 7fa1dfa22700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1d8070f50 0x7fa1d8155060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:07.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.770+0000 7fa1dfa22700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1d80cdf10 0x7fa1d80b1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:07.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.770+0000 7fa1dfa22700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1d815dcf0 0x7fa1d80b2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:07.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.770+0000 7fa1dfa22700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d80b09e0 con 0x7fa1d80cdf10 2023-05-24T03:30:07.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.770+0000 7fa1dfa22700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d80afb10 con 0x7fa1d815dcf0 2023-05-24T03:30:07.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.770+0000 7fa1dfa22700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d80afd60 con 0x7fa1d8070f50 2023-05-24T03:30:07.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.770+0000 7fa1dcfbd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1d80cdf10 0x7fa1d80b1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:07.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.770+0000 7fa1dcfbd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1d80cdf10 0x7fa1d80b1ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39226/0 (socket says 172.21.15.146:39226) 2023-05-24T03:30:07.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.770+0000 7fa1dcfbd700 1 -- 172.21.15.146:0/1917090462 learned_addr learned my addr 172.21.15.146:0/1917090462 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:07.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.770+0000 7fa1ddfbf700 1 --2- 172.21.15.146:0/1917090462 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1d815dcf0 0x7fa1d80b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:07.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.770+0000 7fa1dcfbd700 1 -- 172.21.15.146:0/1917090462 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1d8070f50 msgr2=0x7fa1d8155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:07.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.770+0000 7fa1dd7be700 1 --2- 172.21.15.146:0/1917090462 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1d8070f50 0x7fa1d8155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:07.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.770+0000 7fa1dcfbd700 1 --2- 172.21.15.146:0/1917090462 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1d8070f50 0x7fa1d8155060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:07.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.770+0000 7fa1dcfbd700 1 -- 172.21.15.146:0/1917090462 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1d815dcf0 msgr2=0x7fa1d80b2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:07.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.770+0000 7fa1dcfbd700 1 --2- 172.21.15.146:0/1917090462 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1d815dcf0 0x7fa1d80b2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:07.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.770+0000 7fa1dcfbd700 1 -- 172.21.15.146:0/1917090462 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d4009550 con 0x7fa1d80cdf10 2023-05-24T03:30:07.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.770+0000 7fa1ddfbf700 1 --2- 172.21.15.146:0/1917090462 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1d815dcf0 0x7fa1d80b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:30:07.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.771+0000 7fa1dcfbd700 1 --2- 172.21.15.146:0/1917090462 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1d80cdf10 0x7fa1d80b1ff0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8010720 tx=0x7fa1c8010ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:07.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.771+0000 7fa1cdffb700 1 -- 172.21.15.146:0/1917090462 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c8004230 con 0x7fa1d80cdf10 2023-05-24T03:30:07.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.771+0000 7fa1cdffb700 1 -- 172.21.15.146:0/1917090462 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1c80043b0 con 0x7fa1d80cdf10 2023-05-24T03:30:07.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.771+0000 7fa1cdffb700 1 -- 172.21.15.146:0/1917090462 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c8011900 con 0x7fa1d80cdf10 2023-05-24T03:30:07.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.771+0000 7fa1dfa22700 1 -- 172.21.15.146:0/1917090462 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1d815ac60 con 0x7fa1d80cdf10 2023-05-24T03:30:07.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.771+0000 7fa1dfa22700 1 -- 172.21.15.146:0/1917090462 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1d815a980 con 0x7fa1d80cdf10 2023-05-24T03:30:07.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.772+0000 7fa1dfa22700 1 -- 172.21.15.146:0/1917090462 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1d806d190 con 0x7fa1d80cdf10 2023-05-24T03:30:07.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.772+0000 7fa1cdffb700 1 -- 172.21.15.146:0/1917090462 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa1c8011a60 con 0x7fa1d80cdf10 2023-05-24T03:30:07.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.772+0000 7fa1cdffb700 1 --2- 172.21.15.146:0/1917090462 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fa1bc06ace0 0x7fa1bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:07.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.773+0000 7fa1cdffb700 1 -- 172.21.15.146:0/1917090462 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa1c808b770 con 0x7fa1d80cdf10 2023-05-24T03:30:07.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.773+0000 7fa1dd7be700 1 --2- 172.21.15.146:0/1917090462 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fa1bc06ace0 0x7fa1bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:07.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.773+0000 7fa1dd7be700 1 --2- 172.21.15.146:0/1917090462 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fa1bc06ace0 0x7fa1bc06d190 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4009c10 tx=0x7fa1d4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:07.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:07.777+0000 7fa1cdffb700 1 -- 172.21.15.146:0/1917090462 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fa1c805a100 con 0x7fa1d80cdf10 2023-05-24T03:30:08.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.019+0000 7fa1dfa22700 1 -- 172.21.15.146:0/1917090462 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fa1d804e810 con 0x7fa1d80cdf10 2023-05-24T03:30:08.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.022+0000 7fa1cdffb700 1 -- 172.21.15.146:0/1917090462 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170848 (secure 0 0 0) 0x7fa1c8059c90 con 0x7fa1d80cdf10 2023-05-24T03:30:08.029 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:30:08.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.025+0000 7fa1dfa22700 1 -- 172.21.15.146:0/1917090462 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fa1bc06ace0 msgr2=0x7fa1bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:08.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.025+0000 7fa1dfa22700 1 --2- 172.21.15.146:0/1917090462 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fa1bc06ace0 0x7fa1bc06d190 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4009c10 tx=0x7fa1d4008030 comp rx=0 tx=0).stop 2023-05-24T03:30:08.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.025+0000 7fa1dfa22700 1 -- 172.21.15.146:0/1917090462 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1d80cdf10 msgr2=0x7fa1d80b1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:08.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.025+0000 7fa1dfa22700 1 --2- 172.21.15.146:0/1917090462 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1d80cdf10 0x7fa1d80b1ff0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8010720 tx=0x7fa1c8010ae0 comp rx=0 tx=0).stop 2023-05-24T03:30:08.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.025+0000 7fa1dfa22700 1 -- 172.21.15.146:0/1917090462 shutdown_connections 2023-05-24T03:30:08.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.025+0000 7fa1dfa22700 1 --2- 172.21.15.146:0/1917090462 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fa1bc06ace0 0x7fa1bc06d190 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:08.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.025+0000 7fa1dfa22700 1 --2- 172.21.15.146:0/1917090462 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1d815dcf0 0x7fa1d80b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:08.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.025+0000 7fa1dfa22700 1 --2- 172.21.15.146:0/1917090462 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1d8070f50 0x7fa1d8155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:08.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.025+0000 7fa1dfa22700 1 --2- 172.21.15.146:0/1917090462 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1d80cdf10 0x7fa1d80b1ff0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:08.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.025+0000 7fa1dfa22700 1 -- 172.21.15.146:0/1917090462 >> 172.21.15.146:0/1917090462 conn(0x7fa1d80cfea0 msgr2=0x7fa1d80cb830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:08.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.025+0000 7fa1dfa22700 1 -- 172.21.15.146:0/1917090462 shutdown_connections 2023-05-24T03:30:08.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.025+0000 7fa1dfa22700 1 -- 172.21.15.146:0/1917090462 wait complete. 2023-05-24T03:30:08.041 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":5,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1985394169},{"type":"v1","addr":"172.21.15.146:6833","nonce":1985394169}]},"active_addr":"172.21.15.146:6833/1985394169","active_change":"2023-05-24T03:29:24.698379+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4106,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.146:0","nonce":834574214}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.146:0","nonce":1945814212}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.146:0","nonce":2506620058}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.146:0","nonce":3600198533}]}]} 2023-05-24T03:30:08.046 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-05-24T03:30:08.047 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-05-24T03:30:08.047 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-24T03:30:08.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.164+0000 7fc57ab43700 1 Processor -- start 2023-05-24T03:30:08.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.165+0000 7fc57ab43700 1 -- start start 2023-05-24T03:30:08.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.165+0000 7fc57ab43700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc5740ca460 0x7fc5740ca900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:08.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.165+0000 7fc57ab43700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc574071820 0x7fc574071c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:08.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.165+0000 7fc57ab43700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5740b20b0 con 0x7fc57415ff20 2023-05-24T03:30:08.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.165+0000 7fc57ab43700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc574072160 con 0x7fc574071820 2023-05-24T03:30:08.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.165+0000 7fc57ab43700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5741602f0 con 0x7fc5740ca460 2023-05-24T03:30:08.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.165+0000 7fc5790e0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc574071820 0x7fc574071c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:08.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.166+0000 7fc5790e0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc574071820 0x7fc574071c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39236/0 (socket says 172.21.15.146:39236) 2023-05-24T03:30:08.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.166+0000 7fc5790e0700 1 -- 172.21.15.146:0/3077862743 learned_addr learned my addr 172.21.15.146:0/3077862743 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:08.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.166+0000 7fc573fff700 1 --2- 172.21.15.146:0/3077862743 >> v2:172.21.15.151:3300/0 conn(0x7fc5740ca460 0x7fc5740ca900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:08.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.166+0000 7fc5790e0700 1 -- 172.21.15.146:0/3077862743 >> v2:172.21.15.151:3300/0 conn(0x7fc5740ca460 msgr2=0x7fc5740ca900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:08.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.166+0000 7fc5790e0700 1 --2- 172.21.15.146:0/3077862743 >> v2:172.21.15.151:3300/0 conn(0x7fc5740ca460 0x7fc5740ca900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:08.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.166+0000 7fc5790e0700 1 -- 172.21.15.146:0/3077862743 >> v1:172.21.15.151:6789/0 conn(0x7fc57415ff20 legacy=0x7fc57406dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:08.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.166+0000 7fc5790e0700 1 -- 172.21.15.146:0/3077862743 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5740cd090 con 0x7fc574071820 2023-05-24T03:30:08.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.166+0000 7fc573fff700 1 --2- 172.21.15.146:0/3077862743 >> v2:172.21.15.151:3300/0 conn(0x7fc5740ca460 0x7fc5740ca900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:30:08.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.166+0000 7fc5790e0700 1 --2- 172.21.15.146:0/3077862743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc574071820 0x7fc574071c20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc5740cc440 tx=0x7fc56c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf3848f7339ee171 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:08.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.166+0000 7fc5737fe700 1 -- 172.21.15.146:0/3077862743 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56c00e070 con 0x7fc574071820 2023-05-24T03:30:08.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.166+0000 7fc5737fe700 1 -- 172.21.15.146:0/3077862743 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc56c00b9c0 con 0x7fc574071820 2023-05-24T03:30:08.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.166+0000 7fc5737fe700 1 -- 172.21.15.146:0/3077862743 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56c00bd70 con 0x7fc574071820 2023-05-24T03:30:08.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.167+0000 7fc57ab43700 1 -- 172.21.15.146:0/3077862743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc574071820 msgr2=0x7fc574071c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:08.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.167+0000 7fc57ab43700 1 --2- 172.21.15.146:0/3077862743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc574071820 0x7fc574071c20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc5740cc440 tx=0x7fc56c00b330 comp rx=0 tx=0).stop 2023-05-24T03:30:08.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.167+0000 7fc57ab43700 1 -- 172.21.15.146:0/3077862743 shutdown_connections 2023-05-24T03:30:08.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.167+0000 7fc57ab43700 1 --2- 172.21.15.146:0/3077862743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc574071820 0x7fc574071c20 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:08.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.167+0000 7fc57ab43700 1 --2- 172.21.15.146:0/3077862743 >> v2:172.21.15.151:3300/0 conn(0x7fc5740ca460 0x7fc5740ca900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:08.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.167+0000 7fc57ab43700 1 -- 172.21.15.146:0/3077862743 >> 172.21.15.146:0/3077862743 conn(0x7fc57406ebf0 msgr2=0x7fc57406eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:08.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.167+0000 7fc57ab43700 1 -- 172.21.15.146:0/3077862743 shutdown_connections 2023-05-24T03:30:08.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.167+0000 7fc57ab43700 1 -- 172.21.15.146:0/3077862743 wait complete. 2023-05-24T03:30:08.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.168+0000 7fc57ab43700 1 Processor -- start 2023-05-24T03:30:08.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.168+0000 7fc57ab43700 1 -- start start 2023-05-24T03:30:08.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.169+0000 7fc57ab43700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc574071820 0x7fc5740b2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:08.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.169+0000 7fc57ab43700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5740ca460 0x7fc574156de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:08.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.169+0000 7fc57ab43700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc57415ff20 0x7fc574142b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:08.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.169+0000 7fc57ab43700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc574157320 con 0x7fc5740ca460 2023-05-24T03:30:08.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.169+0000 7fc57ab43700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc574154940 con 0x7fc57415ff20 2023-05-24T03:30:08.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.169+0000 7fc57ab43700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc574154630 con 0x7fc574071820 2023-05-24T03:30:08.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.169+0000 7fc573fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5740ca460 0x7fc574156de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:08.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.169+0000 7fc573fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5740ca460 0x7fc574156de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39240/0 (socket says 172.21.15.146:39240) 2023-05-24T03:30:08.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.169+0000 7fc573fff700 1 -- 172.21.15.146:0/38932249 learned_addr learned my addr 172.21.15.146:0/38932249 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:08.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.169+0000 7fc5788df700 1 --2- 172.21.15.146:0/38932249 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc574071820 0x7fc5740b2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:08.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.169+0000 7fc5790e0700 1 --2- 172.21.15.146:0/38932249 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc57415ff20 0x7fc574142b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:08.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.169+0000 7fc573fff700 1 -- 172.21.15.146:0/38932249 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc574071820 msgr2=0x7fc5740b2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:08.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.169+0000 7fc573fff700 1 --2- 172.21.15.146:0/38932249 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc574071820 0x7fc5740b2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:08.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.169+0000 7fc573fff700 1 -- 172.21.15.146:0/38932249 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc57415ff20 msgr2=0x7fc574142b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:08.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.169+0000 7fc573fff700 1 --2- 172.21.15.146:0/38932249 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc57415ff20 0x7fc574142b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:08.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.169+0000 7fc573fff700 1 -- 172.21.15.146:0/38932249 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc56c009b30 con 0x7fc5740ca460 2023-05-24T03:30:08.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.169+0000 7fc573fff700 1 --2- 172.21.15.146:0/38932249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5740ca460 0x7fc574156de0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc55c00e810 tx=0x7fc55c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:08.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.170+0000 7fc5717fa700 1 -- 172.21.15.146:0/38932249 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55c013610 con 0x7fc5740ca460 2023-05-24T03:30:08.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.170+0000 7fc5717fa700 1 -- 172.21.15.146:0/38932249 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc55c013770 con 0x7fc5740ca460 2023-05-24T03:30:08.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.170+0000 7fc57ab43700 1 -- 172.21.15.146:0/38932249 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc57406d0f0 con 0x7fc5740ca460 2023-05-24T03:30:08.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.170+0000 7fc5717fa700 1 -- 172.21.15.146:0/38932249 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55c013b20 con 0x7fc5740ca460 2023-05-24T03:30:08.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.170+0000 7fc57ab43700 1 -- 172.21.15.146:0/38932249 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5740cd370 con 0x7fc5740ca460 2023-05-24T03:30:08.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.171+0000 7fc57ab43700 1 -- 172.21.15.146:0/38932249 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc57406d3d0 con 0x7fc5740ca460 2023-05-24T03:30:08.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.171+0000 7fc5717fa700 1 -- 172.21.15.146:0/38932249 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc55c013c80 con 0x7fc5740ca460 2023-05-24T03:30:08.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.171+0000 7fc5717fa700 1 --2- 172.21.15.146:0/38932249 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fc55406ace0 0x7fc55406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:08.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.172+0000 7fc5717fa700 1 -- 172.21.15.146:0/38932249 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc55c089440 con 0x7fc5740ca460 2023-05-24T03:30:08.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.172+0000 7fc5788df700 1 --2- 172.21.15.146:0/38932249 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fc55406ace0 0x7fc55406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:08.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.172+0000 7fc5788df700 1 --2- 172.21.15.146:0/38932249 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fc55406ace0 0x7fc55406d190 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc564000f60 tx=0x7fc564009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:08.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.176+0000 7fc5717fa700 1 -- 172.21.15.146:0/38932249 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc55c054290 con 0x7fc5740ca460 2023-05-24T03:30:08.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.366+0000 7fc57ab43700 1 -- 172.21.15.146:0/38932249 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc57404e810 con 0x7fc5740ca460 2023-05-24T03:30:08.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.367+0000 7fc5717fa700 1 -- 172.21.15.146:0/38932249 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20156 (secure 0 0 0) 0x7fc55c0578b0 con 0x7fc5740ca460 2023-05-24T03:30:08.372 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:30:08.372 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":28,"fsid":"11ca0adb-7672-4713-bde7-451e8b743ae9","created":"2023-05-24T03:29:19.113659+0000","modified":"2023-05-24T03:29:48.912599+0000","last_up_change":"2023-05-24T03:29:30.962339+0000","last_in_change":"2023-05-24T03:29:21.706540+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-24T03:29:32.749984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-24T03:29:37.719623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-24T03:29:42.165379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-24T03:29:43.431615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-24T03:29:46.503075+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f24b319b-fcc8-4385-b0cb-78138fc31417","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6801","nonce":3353593100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6803","nonce":3353593100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6807","nonce":3353593100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6805","nonce":3353593100}]},"public_addr":"172.21.15.146:6801/3353593100","cluster_addr":"172.21.15.146:6803/3353593100","heartbeat_back_addr":"172.21.15.146:6807/3353593100","heartbeat_front_addr":"172.21.15.146:6805/3353593100","state":["exists","up"]},{"osd":1,"uuid":"c9639ea9-8f9b-498e-92c8-aa976edbf1da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6821","nonce":2537488734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6825","nonce":2537488734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6831","nonce":2537488734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6827","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6829","nonce":2537488734}]},"public_addr":"172.21.15.146:6821/2537488734","cluster_addr":"172.21.15.146:6825/2537488734","heartbeat_back_addr":"172.21.15.146:6831/2537488734","heartbeat_front_addr":"172.21.15.146:6829/2537488734","state":["exists","up"]},{"osd":2,"uuid":"7a6cfc6d-b0ca-4cb6-a66d-4001ec184657","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6809","nonce":1800242932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6811","nonce":1800242932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6815","nonce":1800242932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6813","nonce":1800242932}]},"public_addr":"172.21.15.146:6809/1800242932","cluster_addr":"172.21.15.146:6811/1800242932","heartbeat_back_addr":"172.21.15.146:6815/1800242932","heartbeat_front_addr":"172.21.15.146:6813/1800242932","state":["exists","up"]},{"osd":3,"uuid":"401509f7-cecd-44a2-b0ae-22c81a5d93c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6817","nonce":1749783580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6820","nonce":1749783580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6828","nonce":1749783580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6824","nonce":1749783580}]},"public_addr":"172.21.15.146:6817/1749783580","cluster_addr":"172.21.15.146:6820/1749783580","heartbeat_back_addr":"172.21.15.146:6828/1749783580","heartbeat_front_addr":"172.21.15.146:6824/1749783580","state":["exists","up"]},{"osd":4,"uuid":"9d07f440-d125-4f99-a825-411fab894d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6811","nonce":163453435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6814","nonce":163453435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6819","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6821","nonce":163453435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6818","nonce":163453435}]},"public_addr":"172.21.15.151:6811/163453435","cluster_addr":"172.21.15.151:6814/163453435","heartbeat_back_addr":"172.21.15.151:6821/163453435","heartbeat_front_addr":"172.21.15.151:6818/163453435","state":["exists","up"]},{"osd":5,"uuid":"9b2266e2-9e52-4f0e-96da-e703a6c23a6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6801","nonce":3283474903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6803","nonce":3283474903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6807","nonce":3283474903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6805","nonce":3283474903}]},"public_addr":"172.21.15.151:6801/3283474903","cluster_addr":"172.21.15.151:6803/3283474903","heartbeat_back_addr":"172.21.15.151:6807/3283474903","heartbeat_front_addr":"172.21.15.151:6805/3283474903","state":["exists","up"]},{"osd":6,"uuid":"5daedf77-0a83-49e7-b497-d9ed10436972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6825","nonce":3889424178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6827","nonce":3889424178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6831","nonce":3889424178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6829","nonce":3889424178}]},"public_addr":"172.21.15.151:6825/3889424178","cluster_addr":"172.21.15.151:6827/3889424178","heartbeat_back_addr":"172.21.15.151:6831/3889424178","heartbeat_front_addr":"172.21.15.151:6829/3889424178","state":["exists","up"]},{"osd":7,"uuid":"86ae4f7e-c01f-4c3d-a0dd-98160c209309","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6810","nonce":563291208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6815","nonce":563291208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6823","nonce":563291208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6820","nonce":563291208}]},"public_addr":"172.21.15.151:6810/563291208","cluster_addr":"172.21.15.151:6815/563291208","heartbeat_back_addr":"172.21.15.151:6823/563291208","heartbeat_front_addr":"172.21.15.151:6820/563291208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.872472+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.937126+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.877234+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.884793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.881632+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.938293+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.857661+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.945883+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-24T03:30:08.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.369+0000 7fc57ab43700 1 -- 172.21.15.146:0/38932249 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fc55406ace0 msgr2=0x7fc55406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:08.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.369+0000 7fc57ab43700 1 --2- 172.21.15.146:0/38932249 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fc55406ace0 0x7fc55406d190 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc564000f60 tx=0x7fc564009040 comp rx=0 tx=0).stop 2023-05-24T03:30:08.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.370+0000 7fc57ab43700 1 -- 172.21.15.146:0/38932249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5740ca460 msgr2=0x7fc574156de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:08.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.370+0000 7fc57ab43700 1 --2- 172.21.15.146:0/38932249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5740ca460 0x7fc574156de0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc55c00e810 tx=0x7fc55c00ebd0 comp rx=0 tx=0).stop 2023-05-24T03:30:08.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.370+0000 7fc57ab43700 1 -- 172.21.15.146:0/38932249 shutdown_connections 2023-05-24T03:30:08.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.370+0000 7fc57ab43700 1 --2- 172.21.15.146:0/38932249 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fc55406ace0 0x7fc55406d190 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:08.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.370+0000 7fc57ab43700 1 --2- 172.21.15.146:0/38932249 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc57415ff20 0x7fc574142b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:08.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.370+0000 7fc57ab43700 1 --2- 172.21.15.146:0/38932249 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc574071820 0x7fc5740b2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:08.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.370+0000 7fc57ab43700 1 --2- 172.21.15.146:0/38932249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5740ca460 0x7fc574156de0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:08.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.370+0000 7fc57ab43700 1 -- 172.21.15.146:0/38932249 >> 172.21.15.146:0/38932249 conn(0x7fc57406ebf0 msgr2=0x7fc57415f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:08.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.370+0000 7fc57ab43700 1 -- 172.21.15.146:0/38932249 shutdown_connections 2023-05-24T03:30:08.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.370+0000 7fc57ab43700 1 -- 172.21.15.146:0/38932249 wait complete. 2023-05-24T03:30:08.386 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-05-24T03:30:08.387 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-24T03:30:08.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.504+0000 7f3a72be0700 1 Processor -- start 2023-05-24T03:30:08.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.504+0000 7f3a72be0700 1 -- start start 2023-05-24T03:30:08.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.505+0000 7f3a72be0700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a6c0cc1d0 0x7f3a6c0b1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:08.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.505+0000 7f3a72be0700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a6c0b27e0 con 0x7f3a6c0cb8c0 2023-05-24T03:30:08.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.505+0000 7f3a72be0700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a6c0b2220 con 0x7f3a6c0cbc90 2023-05-24T03:30:08.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.505+0000 7f3a72be0700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6c0b2500 con 0x7f3a6c0cc1d0 2023-05-24T03:30:08.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.505+0000 7f3a7097c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3a6c0cb8c0 0x7f3a6c161030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45698/0 (socket says 172.21.15.146:45698) 2023-05-24T03:30:08.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.505+0000 7f3a7097c700 1 -- 172.21.15.146:0/3864666592 learned_addr learned my addr 172.21.15.146:0/3864666592 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:30:08.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.505+0000 7f3a6bfff700 1 --2- 172.21.15.146:0/3864666592 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a6c0cc1d0 0x7f3a6c0b1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:08.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.505+0000 7f3a6b7fe700 1 -- 172.21.15.146:0/3864666592 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 316326484 0 0) 0x7f3a6c0b27e0 con 0x7f3a6c0cb8c0 2023-05-24T03:30:08.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.505+0000 7f3a6b7fe700 1 -- 172.21.15.146:0/3864666592 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a5c0035b0 con 0x7f3a6c0cb8c0 2023-05-24T03:30:08.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.506+0000 7f3a6b7fe700 1 -- 172.21.15.146:0/3864666592 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 21064336 0 0) 0x7f3a6c0b2220 con 0x7f3a6c0cbc90 2023-05-24T03:30:08.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.506+0000 7f3a6b7fe700 1 -- 172.21.15.146:0/3864666592 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a6c0b27e0 con 0x7f3a6c0cbc90 2023-05-24T03:30:08.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.506+0000 7f3a6b7fe700 1 -- 172.21.15.146:0/3864666592 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1584207894 0 0) 0x7f3a5c0035b0 con 0x7f3a6c0cb8c0 2023-05-24T03:30:08.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.506+0000 7f3a6b7fe700 1 -- 172.21.15.146:0/3864666592 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a6c0cc1d0 msgr2=0x7f3a6c0b1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:08.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.506+0000 7f3a6b7fe700 1 --2- 172.21.15.146:0/3864666592 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a6c0cc1d0 0x7f3a6c0b1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:08.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.506+0000 7f3a6b7fe700 1 -- 172.21.15.146:0/3864666592 >> v1:172.21.15.151:6789/0 conn(0x7f3a6c0cbc90 legacy=0x7f3a6c06a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:08.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.506+0000 7f3a6b7fe700 1 -- 172.21.15.146:0/3864666592 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a6c160830 con 0x7f3a6c0cb8c0 2023-05-24T03:30:08.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.506+0000 7f3a6b7fe700 1 -- 172.21.15.146:0/3864666592 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1301887351 0 0) 0x7f3a600015f0 con 0x7f3a6c0cb8c0 2023-05-24T03:30:08.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.506+0000 7f3a6b7fe700 1 -- 172.21.15.146:0/3864666592 >> v1:172.21.15.146:6789/0 conn(0x7f3a6c0cb8c0 legacy=0x7f3a6c161030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:08.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.506+0000 7f3a6b7fe700 1 --2- 172.21.15.146:0/3864666592 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a6c0cc1d0 0x7f3a5c003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:08.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.506+0000 7f3a6b7fe700 1 --2- 172.21.15.146:0/3864666592 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a5c004170 0x7f3a5c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:08.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.506+0000 7f3a6b7fe700 1 --2- 172.21.15.146:0/3864666592 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a5c004d90 0x7f3a5c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:08.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.506+0000 7f3a6b7fe700 1 -- 172.21.15.146:0/3864666592 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6c0b2500 con 0x7f3a5c004d90 2023-05-24T03:30:08.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.506+0000 7f3a6b7fe700 1 -- 172.21.15.146:0/3864666592 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5c00bb20 con 0x7f3a5c004170 2023-05-24T03:30:08.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.506+0000 7f3a6b7fe700 1 -- 172.21.15.146:0/3864666592 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5c00bce0 con 0x7f3a6c0cc1d0 2023-05-24T03:30:08.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.506+0000 7f3a7117d700 1 --2- 172.21.15.146:0/3864666592 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a5c004d90 0x7f3a5c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:08.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.506+0000 7f3a7097c700 1 --2- 172.21.15.146:0/3864666592 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a6c0cc1d0 0x7f3a5c003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:08.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.506+0000 7f3a6bfff700 1 --2- 172.21.15.146:0/3864666592 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a5c004170 0x7f3a5c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:08.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.506+0000 7f3a7117d700 1 -- 172.21.15.146:0/3864666592 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a6c0cc1d0 msgr2=0x7f3a5c003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:08.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.506+0000 7f3a7117d700 1 --2- 172.21.15.146:0/3864666592 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a6c0cc1d0 0x7f3a5c003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:08.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.506+0000 7f3a7117d700 1 -- 172.21.15.146:0/3864666592 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a5c004170 msgr2=0x7f3a5c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:08.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.506+0000 7f3a7117d700 1 --2- 172.21.15.146:0/3864666592 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a5c004170 0x7f3a5c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:08.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.506+0000 7f3a7117d700 1 -- 172.21.15.146:0/3864666592 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a5c0035b0 con 0x7f3a5c004d90 2023-05-24T03:30:08.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.506+0000 7f3a7117d700 1 --2- 172.21.15.146:0/3864666592 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a5c004d90 0x7f3a5c005200 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3a64002230 tx=0x7f3a5c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=390fafb08570d859 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:08.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.506+0000 7f3a6b7fe700 1 -- 172.21.15.146:0/3864666592 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a64001f30 con 0x7f3a5c004d90 2023-05-24T03:30:08.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.506+0000 7f3a6b7fe700 1 -- 172.21.15.146:0/3864666592 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a6400ce60 con 0x7f3a5c004d90 2023-05-24T03:30:08.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.506+0000 7f3a6b7fe700 1 -- 172.21.15.146:0/3864666592 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a64003c40 con 0x7f3a5c004d90 2023-05-24T03:30:08.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.507+0000 7f3a72be0700 1 -- 172.21.15.146:0/3864666592 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a5c004d90 msgr2=0x7f3a5c005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:08.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.507+0000 7f3a72be0700 1 --2- 172.21.15.146:0/3864666592 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a5c004d90 0x7f3a5c005200 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3a64002230 tx=0x7f3a5c005880 comp rx=0 tx=0).stop 2023-05-24T03:30:08.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.507+0000 7f3a7117d700 1 -- 172.21.15.146:0/3864666592 reap_dead start 2023-05-24T03:30:08.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.507+0000 7f3a72be0700 1 -- 172.21.15.146:0/3864666592 shutdown_connections 2023-05-24T03:30:08.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.507+0000 7f3a72be0700 1 -- 172.21.15.146:0/3864666592 >> 172.21.15.146:0/3864666592 conn(0x7f3a6c0cfea0 msgr2=0x7f3a6c0d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:08.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.507+0000 7f3a72be0700 1 -- 172.21.15.146:0/3864666592 shutdown_connections 2023-05-24T03:30:08.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.507+0000 7f3a72be0700 1 -- 172.21.15.146:0/3864666592 wait complete. 2023-05-24T03:30:08.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.508+0000 7f3a72be0700 1 Processor -- start 2023-05-24T03:30:08.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.508+0000 7f3a72be0700 1 -- start start 2023-05-24T03:30:08.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.509+0000 7f3a72be0700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a6c1f1e50 0x7f3a6c1f2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:08.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.509+0000 7f3a72be0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a6c0ca7c0 0x7f3a6c0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:08.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.509+0000 7f3a72be0700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a6c0cac30 0x7f3a6c0b52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:08.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.509+0000 7f3a72be0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6c0c7e90 con 0x7f3a6c0ca7c0 2023-05-24T03:30:08.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.509+0000 7f3a72be0700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6c1f2760 con 0x7f3a6c0cac30 2023-05-24T03:30:08.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.509+0000 7f3a72be0700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6c0b5bf0 con 0x7f3a6c1f1e50 2023-05-24T03:30:08.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.509+0000 7f3a6bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a6c0ca7c0 0x7f3a6c0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:08.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.509+0000 7f3a6bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a6c0ca7c0 0x7f3a6c0b4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39260/0 (socket says 172.21.15.146:39260) 2023-05-24T03:30:08.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.509+0000 7f3a6bfff700 1 -- 172.21.15.146:0/2438046278 learned_addr learned my addr 172.21.15.146:0/2438046278 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:08.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.509+0000 7f3a7117d700 1 --2- 172.21.15.146:0/2438046278 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a6c0cac30 0x7f3a6c0b52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:08.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.509+0000 7f3a7097c700 1 --2- 172.21.15.146:0/2438046278 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a6c1f1e50 0x7f3a6c1f2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:08.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.510+0000 7f3a6bfff700 1 -- 172.21.15.146:0/2438046278 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a6c1f1e50 msgr2=0x7f3a6c1f2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:08.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.510+0000 7f3a6bfff700 1 --2- 172.21.15.146:0/2438046278 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a6c1f1e50 0x7f3a6c1f2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:08.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.510+0000 7f3a6bfff700 1 -- 172.21.15.146:0/2438046278 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a6c0cac30 msgr2=0x7f3a6c0b52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:08.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.510+0000 7f3a6bfff700 1 --2- 172.21.15.146:0/2438046278 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a6c0cac30 0x7f3a6c0b52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:08.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.510+0000 7f3a6bfff700 1 -- 172.21.15.146:0/2438046278 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a6c06ab70 con 0x7f3a6c0ca7c0 2023-05-24T03:30:08.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.510+0000 7f3a7117d700 1 --2- 172.21.15.146:0/2438046278 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a6c0cac30 0x7f3a6c0b52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:30:08.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.510+0000 7f3a6bfff700 1 --2- 172.21.15.146:0/2438046278 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a6c0ca7c0 0x7f3a6c0b4d90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3a58011aa0 tx=0x7f3a58011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:08.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.510+0000 7f3a697fa700 1 -- 172.21.15.146:0/2438046278 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5800f980 con 0x7f3a6c0ca7c0 2023-05-24T03:30:08.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.510+0000 7f3a697fa700 1 -- 172.21.15.146:0/2438046278 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5800fae0 con 0x7f3a6c0ca7c0 2023-05-24T03:30:08.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.510+0000 7f3a72be0700 1 -- 172.21.15.146:0/2438046278 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a6c160b10 con 0x7f3a6c0ca7c0 2023-05-24T03:30:08.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.510+0000 7f3a697fa700 1 -- 172.21.15.146:0/2438046278 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5800fe90 con 0x7f3a6c0ca7c0 2023-05-24T03:30:08.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.510+0000 7f3a72be0700 1 -- 172.21.15.146:0/2438046278 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a6c06ad00 con 0x7f3a6c0ca7c0 2023-05-24T03:30:08.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.511+0000 7f3a72be0700 1 -- 172.21.15.146:0/2438046278 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a6c04e810 con 0x7f3a6c0ca7c0 2023-05-24T03:30:08.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.511+0000 7f3a697fa700 1 -- 172.21.15.146:0/2438046278 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3a58014440 con 0x7f3a6c0ca7c0 2023-05-24T03:30:08.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.512+0000 7f3a697fa700 1 --2- 172.21.15.146:0/2438046278 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f3a5006ace0 0x7f3a5006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:08.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.512+0000 7f3a697fa700 1 -- 172.21.15.146:0/2438046278 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3a58089f10 con 0x7f3a6c0ca7c0 2023-05-24T03:30:08.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.512+0000 7f3a7097c700 1 --2- 172.21.15.146:0/2438046278 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f3a5006ace0 0x7f3a5006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:08.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.512+0000 7f3a7097c700 1 --2- 172.21.15.146:0/2438046278 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f3a5006ace0 0x7f3a5006d190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3a600048d0 tx=0x7f3a60009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:08.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.516+0000 7f3a697fa700 1 -- 172.21.15.146:0/2438046278 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3a580588b0 con 0x7f3a6c0ca7c0 2023-05-24T03:30:08.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.703+0000 7f3a72be0700 1 -- 172.21.15.146:0/2438046278 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3a6c0cb2c0 con 0x7f3a6c0ca7c0 2023-05-24T03:30:08.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.704+0000 7f3a697fa700 1 -- 172.21.15.146:0/2438046278 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20156 (secure 0 0 0) 0x7f3a58022090 con 0x7f3a6c0ca7c0 2023-05-24T03:30:08.709 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:30:08.709 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":28,"fsid":"11ca0adb-7672-4713-bde7-451e8b743ae9","created":"2023-05-24T03:29:19.113659+0000","modified":"2023-05-24T03:29:48.912599+0000","last_up_change":"2023-05-24T03:29:30.962339+0000","last_in_change":"2023-05-24T03:29:21.706540+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-24T03:29:32.749984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-24T03:29:37.719623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-24T03:29:42.165379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-24T03:29:43.431615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-24T03:29:46.503075+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f24b319b-fcc8-4385-b0cb-78138fc31417","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6801","nonce":3353593100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6803","nonce":3353593100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6807","nonce":3353593100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6805","nonce":3353593100}]},"public_addr":"172.21.15.146:6801/3353593100","cluster_addr":"172.21.15.146:6803/3353593100","heartbeat_back_addr":"172.21.15.146:6807/3353593100","heartbeat_front_addr":"172.21.15.146:6805/3353593100","state":["exists","up"]},{"osd":1,"uuid":"c9639ea9-8f9b-498e-92c8-aa976edbf1da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6821","nonce":2537488734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6825","nonce":2537488734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6831","nonce":2537488734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6827","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6829","nonce":2537488734}]},"public_addr":"172.21.15.146:6821/2537488734","cluster_addr":"172.21.15.146:6825/2537488734","heartbeat_back_addr":"172.21.15.146:6831/2537488734","heartbeat_front_addr":"172.21.15.146:6829/2537488734","state":["exists","up"]},{"osd":2,"uuid":"7a6cfc6d-b0ca-4cb6-a66d-4001ec184657","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6809","nonce":1800242932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6811","nonce":1800242932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6815","nonce":1800242932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6813","nonce":1800242932}]},"public_addr":"172.21.15.146:6809/1800242932","cluster_addr":"172.21.15.146:6811/1800242932","heartbeat_back_addr":"172.21.15.146:6815/1800242932","heartbeat_front_addr":"172.21.15.146:6813/1800242932","state":["exists","up"]},{"osd":3,"uuid":"401509f7-cecd-44a2-b0ae-22c81a5d93c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6817","nonce":1749783580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6820","nonce":1749783580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6828","nonce":1749783580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6824","nonce":1749783580}]},"public_addr":"172.21.15.146:6817/1749783580","cluster_addr":"172.21.15.146:6820/1749783580","heartbeat_back_addr":"172.21.15.146:6828/1749783580","heartbeat_front_addr":"172.21.15.146:6824/1749783580","state":["exists","up"]},{"osd":4,"uuid":"9d07f440-d125-4f99-a825-411fab894d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6811","nonce":163453435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6814","nonce":163453435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6819","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6821","nonce":163453435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6818","nonce":163453435}]},"public_addr":"172.21.15.151:6811/163453435","cluster_addr":"172.21.15.151:6814/163453435","heartbeat_back_addr":"172.21.15.151:6821/163453435","heartbeat_front_addr":"172.21.15.151:6818/163453435","state":["exists","up"]},{"osd":5,"uuid":"9b2266e2-9e52-4f0e-96da-e703a6c23a6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6801","nonce":3283474903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6803","nonce":3283474903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6807","nonce":3283474903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6805","nonce":3283474903}]},"public_addr":"172.21.15.151:6801/3283474903","cluster_addr":"172.21.15.151:6803/3283474903","heartbeat_back_addr":"172.21.15.151:6807/3283474903","heartbeat_front_addr":"172.21.15.151:6805/3283474903","state":["exists","up"]},{"osd":6,"uuid":"5daedf77-0a83-49e7-b497-d9ed10436972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6825","nonce":3889424178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6827","nonce":3889424178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6831","nonce":3889424178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6829","nonce":3889424178}]},"public_addr":"172.21.15.151:6825/3889424178","cluster_addr":"172.21.15.151:6827/3889424178","heartbeat_back_addr":"172.21.15.151:6831/3889424178","heartbeat_front_addr":"172.21.15.151:6829/3889424178","state":["exists","up"]},{"osd":7,"uuid":"86ae4f7e-c01f-4c3d-a0dd-98160c209309","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6810","nonce":563291208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6815","nonce":563291208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6823","nonce":563291208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6820","nonce":563291208}]},"public_addr":"172.21.15.151:6810/563291208","cluster_addr":"172.21.15.151:6815/563291208","heartbeat_back_addr":"172.21.15.151:6823/563291208","heartbeat_front_addr":"172.21.15.151:6820/563291208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.872472+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.937126+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.877234+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.884793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.881632+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.938293+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.857661+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.945883+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-24T03:30:08.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.706+0000 7f3a72be0700 1 -- 172.21.15.146:0/2438046278 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f3a5006ace0 msgr2=0x7f3a5006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:08.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.706+0000 7f3a72be0700 1 --2- 172.21.15.146:0/2438046278 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f3a5006ace0 0x7f3a5006d190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3a600048d0 tx=0x7f3a60009040 comp rx=0 tx=0).stop 2023-05-24T03:30:08.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.706+0000 7f3a72be0700 1 -- 172.21.15.146:0/2438046278 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a6c0ca7c0 msgr2=0x7f3a6c0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:08.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.706+0000 7f3a72be0700 1 --2- 172.21.15.146:0/2438046278 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a6c0ca7c0 0x7f3a6c0b4d90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3a58011aa0 tx=0x7f3a58011e60 comp rx=0 tx=0).stop 2023-05-24T03:30:08.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.706+0000 7f3a72be0700 1 -- 172.21.15.146:0/2438046278 shutdown_connections 2023-05-24T03:30:08.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.706+0000 7f3a72be0700 1 --2- 172.21.15.146:0/2438046278 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f3a5006ace0 0x7f3a5006d190 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:08.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.706+0000 7f3a72be0700 1 --2- 172.21.15.146:0/2438046278 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a6c0cac30 0x7f3a6c0b52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:08.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.706+0000 7f3a72be0700 1 --2- 172.21.15.146:0/2438046278 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a6c1f1e50 0x7f3a6c1f2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:08.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.706+0000 7f3a72be0700 1 --2- 172.21.15.146:0/2438046278 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a6c0ca7c0 0x7f3a6c0b4d90 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:08.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.706+0000 7f3a72be0700 1 -- 172.21.15.146:0/2438046278 >> 172.21.15.146:0/2438046278 conn(0x7f3a6c0cfea0 msgr2=0x7f3a6c071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:08.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.706+0000 7f3a72be0700 1 -- 172.21.15.146:0/2438046278 shutdown_connections 2023-05-24T03:30:08.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.706+0000 7f3a72be0700 1 -- 172.21.15.146:0/2438046278 wait complete. 2023-05-24T03:30:08.724 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-05-24T03:30:08.724 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-05-24T03:30:08.725 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-05-24T03:30:08.725 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-05-24T03:30:08.726 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-05-24T03:30:08.726 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-05-24T03:30:08.727 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-05-24T03:30:08.727 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-05-24T03:30:08.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.924+0000 7efc0cb3c700 1 Processor -- start 2023-05-24T03:30:08.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.924+0000 7efc0cb3c700 1 -- start start 2023-05-24T03:30:08.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.925+0000 7efc0cb3c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efc0806e140 0x7efc080b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:08.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.925+0000 7efc0cb3c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc08159c80 con 0x7efc080cf8e0 2023-05-24T03:30:08.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.925+0000 7efc0cb3c700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc08159350 con 0x7efc08071670 2023-05-24T03:30:08.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.925+0000 7efc0cb3c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc08159630 con 0x7efc0806e140 2023-05-24T03:30:08.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.925+0000 7efc0659c700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7efc08071670 0x7efc0806da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:44752/0 (socket says 172.21.15.146:44752) 2023-05-24T03:30:08.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.925+0000 7efc0659c700 1 -- 172.21.15.146:0/4216990011 learned_addr learned my addr 172.21.15.146:0/4216990011 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:30:08.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.926+0000 7efc05d9b700 1 --2- 172.21.15.146:0/4216990011 >> v2:172.21.15.146:3300/0 conn(0x7efc0806e140 0x7efc080b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:08.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.926+0000 7efc05d9b700 1 -- 172.21.15.146:0/4216990011 >> v1:172.21.15.151:6789/0 conn(0x7efc08071670 legacy=0x7efc0806da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:08.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.926+0000 7efc05d9b700 1 -- 172.21.15.146:0/4216990011 >> v1:172.21.15.146:6789/0 conn(0x7efc080cf8e0 legacy=0x7efc080b0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:08.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.926+0000 7efc05d9b700 1 -- 172.21.15.146:0/4216990011 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc08159910 con 0x7efc0806e140 2023-05-24T03:30:08.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.926+0000 7efc05d9b700 1 --2- 172.21.15.146:0/4216990011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc0806e140 0x7efc080b08c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efbfc009840 tx=0x7efbfc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24fbf7cc20a3ae34 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:08.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.927+0000 7efc0559a700 1 -- 172.21.15.146:0/4216990011 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbfc011830 con 0x7efc0806e140 2023-05-24T03:30:08.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.927+0000 7efc0559a700 1 -- 172.21.15.146:0/4216990011 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbfc011990 con 0x7efc0806e140 2023-05-24T03:30:08.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.927+0000 7efc0559a700 1 -- 172.21.15.146:0/4216990011 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbfc011d20 con 0x7efc0806e140 2023-05-24T03:30:08.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.928+0000 7efc0cb3c700 1 -- 172.21.15.146:0/4216990011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc0806e140 msgr2=0x7efc080b08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:08.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.928+0000 7efc0cb3c700 1 --2- 172.21.15.146:0/4216990011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc0806e140 0x7efc080b08c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efbfc009840 tx=0x7efbfc009b50 comp rx=0 tx=0).stop 2023-05-24T03:30:08.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.929+0000 7efc0cb3c700 1 -- 172.21.15.146:0/4216990011 shutdown_connections 2023-05-24T03:30:08.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.929+0000 7efc0cb3c700 1 --2- 172.21.15.146:0/4216990011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc0806e140 0x7efc080b08c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:08.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.929+0000 7efc0cb3c700 1 -- 172.21.15.146:0/4216990011 >> 172.21.15.146:0/4216990011 conn(0x7efc080cedd0 msgr2=0x7efc080cf1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:08.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.929+0000 7efc0cb3c700 1 -- 172.21.15.146:0/4216990011 shutdown_connections 2023-05-24T03:30:08.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.929+0000 7efc0cb3c700 1 -- 172.21.15.146:0/4216990011 wait complete. 2023-05-24T03:30:08.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.931+0000 7efc0cb3c700 1 Processor -- start 2023-05-24T03:30:08.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.931+0000 7efc0cb3c700 1 -- start start 2023-05-24T03:30:08.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.932+0000 7efc0cb3c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efc0806e140 0x7efc0814fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:08.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.932+0000 7efc0cb3c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efc08071670 0x7efc0815c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:08.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.932+0000 7efc0cb3c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc080cf8e0 0x7efc0815cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:08.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.932+0000 7efc0cb3c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc0814a230 con 0x7efc080cf8e0 2023-05-24T03:30:08.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.932+0000 7efc0cb3c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc08168a10 con 0x7efc0806e140 2023-05-24T03:30:08.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.932+0000 7efc0cb3c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc0814ad00 con 0x7efc08071670 2023-05-24T03:30:08.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.932+0000 7efc06d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc080cf8e0 0x7efc0815cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:08.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.932+0000 7efc06d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc080cf8e0 0x7efc0815cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39276/0 (socket says 172.21.15.146:39276) 2023-05-24T03:30:08.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.932+0000 7efc06d9d700 1 -- 172.21.15.146:0/3480667011 learned_addr learned my addr 172.21.15.146:0/3480667011 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:08.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.932+0000 7efc0659c700 1 --2- 172.21.15.146:0/3480667011 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efc0806e140 0x7efc0814fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:08.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.932+0000 7f1b69e4c700 1 Processor -- start 2023-05-24T03:30:08.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.932+0000 7f1b69e4c700 1 -- start start 2023-05-24T03:30:08.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.933+0000 7efc06d9d700 1 -- 172.21.15.146:0/3480667011 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efc08071670 msgr2=0x7efc0815c870 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-05-24T03:30:08.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.933+0000 7efc06d9d700 1 --2- 172.21.15.146:0/3480667011 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efc08071670 0x7efc0815c870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:08.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.933+0000 7efc06d9d700 1 -- 172.21.15.146:0/3480667011 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efc0806e140 msgr2=0x7efc0814fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:08.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.933+0000 7efc06d9d700 1 --2- 172.21.15.146:0/3480667011 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efc0806e140 0x7efc0814fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:08.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.933+0000 7efc06d9d700 1 -- 172.21.15.146:0/3480667011 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbfc0094a0 con 0x7efc080cf8e0 2023-05-24T03:30:08.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.933+0000 7f38bfabb700 1 Processor -- start 2023-05-24T03:30:08.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.933+0000 7efc06d9d700 1 --2- 172.21.15.146:0/3480667011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc080cf8e0 0x7efc0815cdb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efc0000cbd0 tx=0x7efc0000cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:08.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.933+0000 7efbf6ffd700 1 -- 172.21.15.146:0/3480667011 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc00003c00 con 0x7efc080cf8e0 2023-05-24T03:30:08.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.933+0000 7efc0cb3c700 1 -- 172.21.15.146:0/3480667011 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc080b1630 con 0x7efc080cf8e0 2023-05-24T03:30:08.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.933+0000 7efc0cb3c700 1 -- 172.21.15.146:0/3480667011 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc0815a110 con 0x7efc080cf8e0 2023-05-24T03:30:08.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.933+0000 7efbf6ffd700 1 -- 172.21.15.146:0/3480667011 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc00003d60 con 0x7efc080cf8e0 2023-05-24T03:30:08.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.933+0000 7efbf6ffd700 1 -- 172.21.15.146:0/3480667011 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0000ab00 con 0x7efc080cf8e0 2023-05-24T03:30:08.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.934+0000 7f1b69e4c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1b6415ce30 0x7f1b640c9f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:08.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.934+0000 7f1b69e4c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b640ad0d0 con 0x7f1b640ca460 2023-05-24T03:30:08.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.934+0000 7f1b69e4c700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b6415d200 con 0x7f1b64070ec0 2023-05-24T03:30:08.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.934+0000 7f1b69e4c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b640ac8b0 con 0x7f1b6415ce30 2023-05-24T03:30:08.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.934+0000 7f1b637fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1b6415ce30 0x7f1b640c9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:08.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.934+0000 7f1b63fff700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f1b64070ec0 0x7f1b640ad560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:44766/0 (socket says 172.21.15.146:44766) 2023-05-24T03:30:08.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.934+0000 7f1b63fff700 1 -- 172.21.15.146:0/1593723911 learned_addr learned my addr 172.21.15.146:0/1593723911 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:30:08.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.933+0000 7f38bfabb700 1 -- start start 2023-05-24T03:30:08.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.935+0000 7f1b627fc700 1 -- 172.21.15.146:0/1593723911 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 160921781 0 0) 0x7f1b6415d200 con 0x7f1b64070ec0 2023-05-24T03:30:08.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.935+0000 7f1b627fc700 1 -- 172.21.15.146:0/1593723911 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b4c0035b0 con 0x7f1b64070ec0 2023-05-24T03:30:08.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.935+0000 7f1b637fe700 1 -- 172.21.15.146:0/1593723911 >> v1:172.21.15.151:6789/0 conn(0x7f1b64070ec0 legacy=0x7f1b640ad560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:08.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.935+0000 7f1b637fe700 1 -- 172.21.15.146:0/1593723911 >> v1:172.21.15.146:6789/0 conn(0x7f1b640ca460 legacy=0x7f1b640707b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:08.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.935+0000 7f1b637fe700 1 -- 172.21.15.146:0/1593723911 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b640acac0 con 0x7f1b6415ce30 2023-05-24T03:30:08.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.935+0000 7efc0cb3c700 1 -- 172.21.15.146:0/3480667011 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efbec000fc0 con 0x7efc080cf8e0 2023-05-24T03:30:08.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.935+0000 7f38bfabb700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f38b8159310 0x7f38b806b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:08.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.935+0000 7f38bfabb700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38b806a6f0 con 0x7f38b80caeb0 2023-05-24T03:30:08.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.935+0000 7f38bfabb700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38b806b8c0 con 0x7f38b8071bc0 2023-05-24T03:30:08.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.935+0000 7f38bfabb700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38b8070b20 con 0x7f38b8159310 2023-05-24T03:30:08.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.936+0000 7f38be058700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f38b80caeb0 0x7f38b80afba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45738/0 (socket says 172.21.15.146:45738) 2023-05-24T03:30:08.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.936+0000 7f38be058700 1 -- 172.21.15.146:0/4032017416 learned_addr learned my addr 172.21.15.146:0/4032017416 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:30:08.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.936+0000 7f1b637fe700 1 --2- 172.21.15.146:0/1593723911 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1b6415ce30 0x7f1b640c9f20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1b54009870 tx=0x7f1b54009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=717695057a8aa0b8 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:08.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.936+0000 7efbf6ffd700 1 -- 172.21.15.146:0/3480667011 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efc0000ac60 con 0x7efc080cf8e0 2023-05-24T03:30:08.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.936+0000 7efbf6ffd700 1 --2- 172.21.15.146:0/3480667011 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7efbe806ace0 0x7efbe806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:08.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.936+0000 7efbf6ffd700 1 -- 172.21.15.146:0/3480667011 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7efc00089670 con 0x7efc080cf8e0 2023-05-24T03:30:08.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.936+0000 7efc0659c700 1 --2- 172.21.15.146:0/3480667011 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7efbe806ace0 0x7efbe806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:08.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.936+0000 7efbf6ffd700 1 --2- 172.21.15.146:0/3480667011 >> [v2:172.21.15.146:6818/2537488734,v1:172.21.15.146:6821/2537488734] conn(0x7efbe80748b0 0x7efbe8076ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:08.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.936+0000 7efbf6ffd700 1 -- 172.21.15.146:0/3480667011 --> [v2:172.21.15.146:6818/2537488734,v1:172.21.15.146:6821/2537488734] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efbe80773b0 con 0x7efbe80748b0 2023-05-24T03:30:08.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.937+0000 7f1b627fc700 1 -- 172.21.15.146:0/1593723911 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b54011830 con 0x7f1b6415ce30 2023-05-24T03:30:08.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.937+0000 7f1b627fc700 1 -- 172.21.15.146:0/1593723911 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b54011990 con 0x7f1b6415ce30 2023-05-24T03:30:08.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.937+0000 7f1b627fc700 1 -- 172.21.15.146:0/1593723911 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b54011d00 con 0x7f1b6415ce30 2023-05-24T03:30:08.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.937+0000 7efc05d9b700 1 --2- 172.21.15.146:0/3480667011 >> [v2:172.21.15.146:6818/2537488734,v1:172.21.15.146:6821/2537488734] conn(0x7efbe80748b0 0x7efbe8076ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:08.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.937+0000 7efc0659c700 1 --2- 172.21.15.146:0/3480667011 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7efbe806ace0 0x7efbe806d190 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7efbf8005910 tx=0x7efbf8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:08.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.937+0000 7efbf6ffd700 1 -- 172.21.15.146:0/3480667011 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc00054430 con 0x7efc080cf8e0 2023-05-24T03:30:08.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.937+0000 7f38bd857700 1 --2- 172.21.15.146:0/4032017416 >> v2:172.21.15.146:3300/0 conn(0x7f38b8159310 0x7f38b806b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:08.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.937+0000 7efc05d9b700 1 --2- 172.21.15.146:0/3480667011 >> [v2:172.21.15.146:6818/2537488734,v1:172.21.15.146:6821/2537488734] conn(0x7efbe80748b0 0x7efbe8076ce0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:08.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.938+0000 7f1b69e4c700 1 -- 172.21.15.146:0/1593723911 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1b6415ce30 msgr2=0x7f1b640c9f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:08.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.938+0000 7f1b69e4c700 1 --2- 172.21.15.146:0/1593723911 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1b6415ce30 0x7f1b640c9f20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1b54009870 tx=0x7f1b54009b80 comp rx=0 tx=0).stop 2023-05-24T03:30:08.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.938+0000 7f38bd857700 1 -- 172.21.15.146:0/4032017416 >> v1:172.21.15.151:6789/0 conn(0x7f38b8071bc0 legacy=0x7f38b80ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:08.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.938+0000 7f38bd857700 1 -- 172.21.15.146:0/4032017416 >> v1:172.21.15.146:6789/0 conn(0x7f38b80caeb0 legacy=0x7f38b80afba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:08.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.938+0000 7f38bd857700 1 -- 172.21.15.146:0/4032017416 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b8070e00 con 0x7f38b8159310 2023-05-24T03:30:08.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.938+0000 7f1b69e4c700 1 -- 172.21.15.146:0/1593723911 shutdown_connections 2023-05-24T03:30:08.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.938+0000 7f1b69e4c700 1 --2- 172.21.15.146:0/1593723911 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1b6415ce30 0x7f1b640c9f20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:08.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.938+0000 7f1b69e4c700 1 -- 172.21.15.146:0/1593723911 >> 172.21.15.146:0/1593723911 conn(0x7f1b640cf6c0 msgr2=0x7f1b640cfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:08.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.938+0000 7f1b69e4c700 1 -- 172.21.15.146:0/1593723911 shutdown_connections 2023-05-24T03:30:08.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.939+0000 7efbf6ffd700 1 -- 172.21.15.146:0/3480667011 <== osd.1 v2:172.21.15.146:6818/2537488734 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7efbe80773b0 con 0x7efbe80748b0 2023-05-24T03:30:08.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.938+0000 7fb401f58700 1 Processor -- start 2023-05-24T03:30:08.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.938+0000 7fb401f58700 1 -- start start 2023-05-24T03:30:08.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.940+0000 7fb401f58700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb3fc160f40 0x7fb3fc06fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:08.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.940+0000 7fb401f58700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb3fc0b0a80 0x7fb3fc0b0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:08.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.940+0000 7fb401f58700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3fc161310 con 0x7fb3fc0c1c70 2023-05-24T03:30:08.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.940+0000 7fb401f58700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3fc0cb680 con 0x7fb3fc160f40 2023-05-24T03:30:08.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.940+0000 7fb401f58700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3fc0cab00 con 0x7fb3fc0b0a80 2023-05-24T03:30:08.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.938+0000 7f1c3f593700 1 Processor -- start 2023-05-24T03:30:08.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.939+0000 7f1c3f593700 1 -- start start 2023-05-24T03:30:08.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.940+0000 7f1c3f593700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1c3806da30 0x7f1c380cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:08.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.940+0000 7f1c3f593700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c3806de00 0x7f1c380ce160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:08.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.940+0000 7f1c3f593700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c380ceb20 con 0x7f1c380ce6a0 2023-05-24T03:30:08.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.940+0000 7f1c3f593700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c380cce50 con 0x7f1c3806da30 2023-05-24T03:30:08.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.940+0000 7f1c3f593700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c380ca740 con 0x7f1c3806de00 2023-05-24T03:30:08.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.940+0000 7fb3faffd700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb3fc0b0a80 0x7fb3fc0b0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:08.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.939+0000 7f1b69e4c700 1 -- 172.21.15.146:0/1593723911 wait complete. 2023-05-24T03:30:08.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.940+0000 7f1b69e4c700 1 Processor -- start 2023-05-24T03:30:08.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.940+0000 7fb3faffd700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb3fc0b0a80 0x7fb3fc0b0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:50478/0 (socket says 172.21.15.146:50478) 2023-05-24T03:30:08.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.940+0000 7fb3faffd700 1 -- 172.21.15.146:0/2795824995 learned_addr learned my addr 172.21.15.146:0/2795824995 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:08.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.940+0000 7fb3fb7fe700 1 --2- 172.21.15.146:0/2795824995 >> v2:172.21.15.146:3300/0 conn(0x7fb3fc160f40 0x7fb3fc06fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:08.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.940+0000 7f38bd857700 1 --2- 172.21.15.146:0/4032017416 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38b8159310 0x7f38b806b380 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f38a800bae0 tx=0x7f38a800bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ccd35cb95dab93b server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:08.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.941+0000 7f1b69e4c700 1 -- start start 2023-05-24T03:30:08.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.941+0000 7f1c3db30700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f1c380ce6a0 0x7f1c38164d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45750/0 (socket says 172.21.15.146:45750) 2023-05-24T03:30:08.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.941+0000 7f1c3db30700 1 -- 172.21.15.146:0/1555281437 learned_addr learned my addr 172.21.15.146:0/1555281437 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:30:08.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.941+0000 7fb3faffd700 1 -- 172.21.15.146:0/2795824995 >> v2:172.21.15.146:3300/0 conn(0x7fb3fc160f40 msgr2=0x7fb3fc06fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:08.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.941+0000 7fb3faffd700 1 --2- 172.21.15.146:0/2795824995 >> v2:172.21.15.146:3300/0 conn(0x7fb3fc160f40 0x7fb3fc06fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:08.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.941+0000 7fb3faffd700 1 -- 172.21.15.146:0/2795824995 >> v1:172.21.15.151:6789/0 conn(0x7fb3fc0c1c70 legacy=0x7fb3fc0ccc60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-05-24T03:30:08.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.941+0000 7fb3faffd700 1 -- 172.21.15.146:0/2795824995 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3fc0cade0 con 0x7fb3fc0b0a80 2023-05-24T03:30:08.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.941+0000 7f1c3d32f700 1 --2- 172.21.15.146:0/1555281437 >> v2:172.21.15.146:3300/0 conn(0x7f1c3806da30 0x7f1c380cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:08.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.941+0000 7fb3faffd700 1 --2- 172.21.15.146:0/2795824995 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb3fc0b0a80 0x7fb3fc0b0f20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc06e410 tx=0x7fb3ec009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e94cb787b21db5a server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:08.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.941+0000 7f1c3d32f700 1 -- 172.21.15.146:0/1555281437 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c3806de00 msgr2=0x7f1c380ce160 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-05-24T03:30:08.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.941+0000 7f1c3d32f700 1 --2- 172.21.15.146:0/1555281437 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c3806de00 0x7f1c380ce160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:08.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.941+0000 7f1c3d32f700 1 -- 172.21.15.146:0/1555281437 >> v1:172.21.15.146:6789/0 conn(0x7f1c380ce6a0 legacy=0x7f1c38164d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:08.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.941+0000 7f1c3d32f700 1 -- 172.21.15.146:0/1555281437 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c380ca9e0 con 0x7f1c3806da30 2023-05-24T03:30:08.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.941+0000 7fb3fa7fc700 1 -- 172.21.15.146:0/2795824995 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ec004230 con 0x7fb3fc0b0a80 2023-05-24T03:30:08.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.941+0000 7f1c3d32f700 1 --2- 172.21.15.146:0/1555281437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c3806da30 0x7f1c380cc910 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1c28009840 tx=0x7f1c28009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e345e69ff73c4583 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:08.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.942+0000 7f1b69e4c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b64070ec0 0x7f1b641fc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:08.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.942+0000 7f1b69e4c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b6415ce30 0x7f1b640b4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:08.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.942+0000 7f1b69e4c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1b641ff840 0x7f1b64202a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:08.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.942+0000 7f1b69e4c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b64202590 con 0x7f1b64070ec0 2023-05-24T03:30:08.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.942+0000 7f1b69e4c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b640b0cb0 con 0x7f1b6415ce30 2023-05-24T03:30:08.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.942+0000 7f1b69e4c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b640b0f90 con 0x7f1b641ff840 2023-05-24T03:30:08.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.942+0000 7f1b637fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b64070ec0 0x7f1b641fc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:08.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.942+0000 7f1b637fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b64070ec0 0x7f1b641fc1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39306/0 (socket says 172.21.15.146:39306) 2023-05-24T03:30:08.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.942+0000 7f1b637fe700 1 -- 172.21.15.146:0/4186358134 learned_addr learned my addr 172.21.15.146:0/4186358134 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:08.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.942+0000 7f1b63fff700 1 --2- 172.21.15.146:0/4186358134 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1b641ff840 0x7f1b64202a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:08.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.942+0000 7f1b62ffd700 1 --2- 172.21.15.146:0/4186358134 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b6415ce30 0x7f1b640b4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:08.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.942+0000 7f1b637fe700 1 -- 172.21.15.146:0/4186358134 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1b641ff840 msgr2=0x7f1b64202a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:08.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.942+0000 7f1b637fe700 1 --2- 172.21.15.146:0/4186358134 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1b641ff840 0x7f1b64202a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:08.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.942+0000 7f1b637fe700 1 -- 172.21.15.146:0/4186358134 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b6415ce30 msgr2=0x7f1b640b4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:08.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.942+0000 7f1b637fe700 1 --2- 172.21.15.146:0/4186358134 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b6415ce30 0x7f1b640b4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:08.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.942+0000 7f1b637fe700 1 -- 172.21.15.146:0/4186358134 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b540094a0 con 0x7f1b64070ec0 2023-05-24T03:30:08.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.942+0000 7f1b62ffd700 1 --2- 172.21.15.146:0/4186358134 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b6415ce30 0x7f1b640b4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:30:08.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.941+0000 7fb3fa7fc700 1 -- 172.21.15.146:0/2795824995 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3ec004390 con 0x7fb3fc0b0a80 2023-05-24T03:30:08.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.941+0000 7fb3fa7fc700 1 -- 172.21.15.146:0/2795824995 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ec0036a0 con 0x7fb3fc0b0a80 2023-05-24T03:30:08.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.942+0000 7fb401f58700 1 -- 172.21.15.146:0/2795824995 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb3fc0b0a80 msgr2=0x7fb3fc0b0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:08.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.942+0000 7fb401f58700 1 --2- 172.21.15.146:0/2795824995 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb3fc0b0a80 0x7fb3fc0b0f20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc06e410 tx=0x7fb3ec009bd0 comp rx=0 tx=0).stop 2023-05-24T03:30:08.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.942+0000 7f1b637fe700 1 --2- 172.21.15.146:0/4186358134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b64070ec0 0x7f1b641fc1a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1b54000c00 tx=0x7f1b54004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:08.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.942+0000 7f1c2ffff700 1 -- 172.21.15.146:0/1555281437 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c28004230 con 0x7f1c3806da30 2023-05-24T03:30:08.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.943+0000 7f1c2ffff700 1 -- 172.21.15.146:0/1555281437 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c28004390 con 0x7f1c3806da30 2023-05-24T03:30:08.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.943+0000 7f1c2ffff700 1 -- 172.21.15.146:0/1555281437 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c280036a0 con 0x7f1c3806da30 2023-05-24T03:30:08.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.943+0000 7f1c3f593700 1 -- 172.21.15.146:0/1555281437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c3806da30 msgr2=0x7f1c380cc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:08.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.943+0000 7f1c3f593700 1 --2- 172.21.15.146:0/1555281437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c3806da30 0x7f1c380cc910 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1c28009840 tx=0x7f1c28009b50 comp rx=0 tx=0).stop 2023-05-24T03:30:08.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.943+0000 7f1c3f593700 1 -- 172.21.15.146:0/1555281437 shutdown_connections 2023-05-24T03:30:08.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.943+0000 7f1c3f593700 1 --2- 172.21.15.146:0/1555281437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c3806da30 0x7f1c380cc910 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:08.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.943+0000 7f1c3f593700 1 --2- 172.21.15.146:0/1555281437 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c3806de00 0x7f1c380ce160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:08.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.943+0000 7f1c3f593700 1 -- 172.21.15.146:0/1555281437 >> 172.21.15.146:0/1555281437 conn(0x7f1c380cedd0 msgr2=0x7f1c380cf1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:08.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.943+0000 7f1b4bfff700 1 -- 172.21.15.146:0/4186358134 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b54004510 con 0x7f1b64070ec0 2023-05-24T03:30:08.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.944+0000 7f1b4bfff700 1 -- 172.21.15.146:0/4186358134 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5401f070 con 0x7f1b64070ec0 2023-05-24T03:30:08.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.944+0000 7f1b4bfff700 1 -- 172.21.15.146:0/4186358134 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b540038e0 con 0x7f1b64070ec0 2023-05-24T03:30:08.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.944+0000 7f1b69e4c700 1 -- 172.21.15.146:0/4186358134 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b640acd60 con 0x7f1b64070ec0 2023-05-24T03:30:08.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.944+0000 7f1b69e4c700 1 -- 172.21.15.146:0/4186358134 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b640ca920 con 0x7f1b64070ec0 2023-05-24T03:30:08.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.945+0000 7f1b69e4c700 1 -- 172.21.15.146:0/4186358134 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1b640cabc0 con 0x7f1b64070ec0 2023-05-24T03:30:08.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.945+0000 7f38bc855700 1 -- 172.21.15.146:0/4032017416 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a800dd30 con 0x7f38b8159310 2023-05-24T03:30:08.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.945+0000 7f38bc855700 1 -- 172.21.15.146:0/4032017416 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38a800de90 con 0x7f38b8159310 2023-05-24T03:30:08.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.945+0000 7f38bc855700 1 -- 172.21.15.146:0/4032017416 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a8004270 con 0x7f38b8159310 2023-05-24T03:30:08.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.945+0000 7f38bfabb700 1 -- 172.21.15.146:0/4032017416 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38b8159310 msgr2=0x7f38b806b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:08.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.945+0000 7f38bfabb700 1 --2- 172.21.15.146:0/4032017416 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38b8159310 0x7f38b806b380 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f38a800bae0 tx=0x7f38a800bdf0 comp rx=0 tx=0).stop 2023-05-24T03:30:08.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.945+0000 7fb401f58700 1 -- 172.21.15.146:0/2795824995 shutdown_connections 2023-05-24T03:30:08.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.945+0000 7fb401f58700 1 --2- 172.21.15.146:0/2795824995 >> v2:172.21.15.146:3300/0 conn(0x7fb3fc160f40 0x7fb3fc06fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:08.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.945+0000 7fb401f58700 1 --2- 172.21.15.146:0/2795824995 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb3fc0b0a80 0x7fb3fc0b0f20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:08.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.945+0000 7fb401f58700 1 -- 172.21.15.146:0/2795824995 >> 172.21.15.146:0/2795824995 conn(0x7fb3fc06b0b0 msgr2=0x7fb3fc0cedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:08.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.945+0000 7f38bfabb700 1 -- 172.21.15.146:0/4032017416 shutdown_connections 2023-05-24T03:30:08.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.945+0000 7f38bfabb700 1 --2- 172.21.15.146:0/4032017416 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38b8159310 0x7f38b806b380 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:08.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.945+0000 7f38bfabb700 1 -- 172.21.15.146:0/4032017416 >> 172.21.15.146:0/4032017416 conn(0x7f38b80cf6c0 msgr2=0x7f38b80cfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:08.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.946+0000 7f1b4bfff700 1 -- 172.21.15.146:0/4186358134 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1b54003a40 con 0x7f1b64070ec0 2023-05-24T03:30:08.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.946+0000 7f1b4bfff700 1 --2- 172.21.15.146:0/4186358134 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f1b4c06b1e0 0x7f1b4c06d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:08.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.946+0000 7f1b4bfff700 1 -- 172.21.15.146:0/4186358134 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1b54021070 con 0x7f1b64070ec0 2023-05-24T03:30:08.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.947+0000 7f1b4bfff700 1 --2- 172.21.15.146:0/4186358134 >> [v2:172.21.15.146:6800/3353593100,v1:172.21.15.146:6801/3353593100] conn(0x7f1b4c074eb0 0x7f1b4c0772e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:08.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.947+0000 7f1b4bfff700 1 -- 172.21.15.146:0/4186358134 --> [v2:172.21.15.146:6800/3353593100,v1:172.21.15.146:6801/3353593100] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1b4c0779b0 con 0x7f1b4c074eb0 2023-05-24T03:30:08.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.947+0000 7f1b4bfff700 1 -- 172.21.15.146:0/4186358134 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b5408a5f0 con 0x7f1b64070ec0 2023-05-24T03:30:08.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.946+0000 7fb401f58700 1 -- 172.21.15.146:0/2795824995 shutdown_connections 2023-05-24T03:30:08.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.946+0000 7fb401f58700 1 -- 172.21.15.146:0/2795824995 wait complete. 2023-05-24T03:30:08.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.946+0000 7f1c3f593700 1 -- 172.21.15.146:0/1555281437 shutdown_connections 2023-05-24T03:30:08.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.947+0000 7f38bfabb700 1 -- 172.21.15.146:0/4032017416 shutdown_connections 2023-05-24T03:30:08.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.947+0000 7f1b63fff700 1 --2- 172.21.15.146:0/4186358134 >> [v2:172.21.15.146:6800/3353593100,v1:172.21.15.146:6801/3353593100] conn(0x7f1b4c074eb0 0x7f1b4c0772e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:08.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.947+0000 7f1b62ffd700 1 --2- 172.21.15.146:0/4186358134 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f1b4c06b1e0 0x7f1b4c06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:08.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.946+0000 7f1c3f593700 1 -- 172.21.15.146:0/1555281437 wait complete. 2023-05-24T03:30:08.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.947+0000 7fb401f58700 1 Processor -- start 2023-05-24T03:30:08.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.947+0000 7f38bfabb700 1 -- 172.21.15.146:0/4032017416 wait complete. 2023-05-24T03:30:08.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.948+0000 7f1b63fff700 1 --2- 172.21.15.146:0/4186358134 >> [v2:172.21.15.146:6800/3353593100,v1:172.21.15.146:6801/3353593100] conn(0x7f1b4c074eb0 0x7f1b4c0772e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:08.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.948+0000 7f1c3f593700 1 Processor -- start 2023-05-24T03:30:08.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.948+0000 7f1c3f593700 1 -- start start 2023-05-24T03:30:08.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.949+0000 7f1c3f593700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c3806da30 0x7f1c380c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:08.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.949+0000 7f1c3f593700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c380ce6a0 0x7f1c380c8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:08.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.949+0000 7f1c3f593700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c38070430 0x7f1c380708d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:08.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.949+0000 7f1c3f593700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c38070e10 con 0x7f1c38070430 2023-05-24T03:30:08.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.949+0000 7f1c3f593700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c38153880 con 0x7f1c3806da30 2023-05-24T03:30:08.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.949+0000 7f1c3f593700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c380b1d80 con 0x7f1c380ce6a0 2023-05-24T03:30:08.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.949+0000 7f1b62ffd700 1 --2- 172.21.15.146:0/4186358134 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f1b4c06b1e0 0x7f1b4c06d690 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1b640b5260 tx=0x7f1b5c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:08.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.949+0000 7f1c3cb2e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c380ce6a0 0x7f1c380c8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:08.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.949+0000 7f1c3d32f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c3806da30 0x7f1c380c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:08.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.949+0000 7f1c3cb2e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c380ce6a0 0x7f1c380c8930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:52182/0 (socket says 172.21.15.146:52182) 2023-05-24T03:30:08.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.949+0000 7f1c3cb2e700 1 -- 172.21.15.146:0/2092206228 learned_addr learned my addr 172.21.15.146:0/2092206228 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:08.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.949+0000 7f38bfabb700 1 Processor -- start 2023-05-24T03:30:08.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.948+0000 7fb401f58700 1 -- start start 2023-05-24T03:30:08.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.949+0000 7fb401f58700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb3fc0b0a80 0x7fb3fc0c67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:08.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.949+0000 7fb401f58700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb3fc0c1c70 0x7fb3fc0c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:08.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.949+0000 7fb401f58700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3fc160f40 0x7fb3fc0c7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:08.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.949+0000 7fb401f58700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3fc142350 con 0x7fb3fc160f40 2023-05-24T03:30:08.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.949+0000 7fb401f58700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3fc152520 con 0x7fb3fc0b0a80 2023-05-24T03:30:08.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.949+0000 7fb401f58700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3fc0715f0 con 0x7fb3fc0c1c70 2023-05-24T03:30:08.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.949+0000 7fb3fbfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3fc160f40 0x7fb3fc0c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:08.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.949+0000 7fb3fb7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb3fc0b0a80 0x7fb3fc0c67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:08.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.949+0000 7fb3fbfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3fc160f40 0x7fb3fc0c7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39326/0 (socket says 172.21.15.146:39326) 2023-05-24T03:30:08.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.949+0000 7fb3fbfff700 1 -- 172.21.15.146:0/269468131 learned_addr learned my addr 172.21.15.146:0/269468131 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:08.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.949+0000 7fb3faffd700 1 --2- 172.21.15.146:0/269468131 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb3fc0c1c70 0x7fb3fc0c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:08.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.949+0000 7fdc60d7e700 1 Processor -- start 2023-05-24T03:30:08.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.950+0000 7f1c3d32f700 1 -- 172.21.15.146:0/2092206228 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c380ce6a0 msgr2=0x7f1c380c8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:08.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.950+0000 7f1c3d32f700 1 --2- 172.21.15.146:0/2092206228 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c380ce6a0 0x7f1c380c8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:08.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.950+0000 7f1c3d32f700 1 -- 172.21.15.146:0/2092206228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c38070430 msgr2=0x7f1c380708d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:08.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.950+0000 7f1c3d32f700 1 --2- 172.21.15.146:0/2092206228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c38070430 0x7f1c380708d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:08.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.950+0000 7f1c3d32f700 1 -- 172.21.15.146:0/2092206228 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c280094a0 con 0x7f1c3806da30 2023-05-24T03:30:08.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.950+0000 7fb3faffd700 1 -- 172.21.15.146:0/269468131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb3fc0b0a80 msgr2=0x7fb3fc0c67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:08.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.950+0000 7fb3faffd700 1 --2- 172.21.15.146:0/269468131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb3fc0b0a80 0x7fb3fc0c67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:08.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.950+0000 7fb3faffd700 1 -- 172.21.15.146:0/269468131 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3fc160f40 msgr2=0x7fb3fc0c7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:08.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.950+0000 7fb3faffd700 1 --2- 172.21.15.146:0/269468131 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3fc160f40 0x7fb3fc0c7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:08.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.950+0000 7fb3faffd700 1 -- 172.21.15.146:0/269468131 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3ec009550 con 0x7fb3fc0c1c70 2023-05-24T03:30:08.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.950+0000 7f1c3d32f700 1 --2- 172.21.15.146:0/2092206228 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c3806da30 0x7f1c380c5e10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1c28015000 tx=0x7f1c28004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:08.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.950+0000 7fb3faffd700 1 --2- 172.21.15.146:0/269468131 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb3fc0c1c70 0x7fb3fc0c6d30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec013000 tx=0x7fb3ec004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:08.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.950+0000 7fb3e3fff700 1 -- 172.21.15.146:0/269468131 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ec003c30 con 0x7fb3fc0c1c70 2023-05-24T03:30:08.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.949+0000 7fdc60d7e700 1 -- start start 2023-05-24T03:30:08.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.951+0000 7fdc60d7e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdc5c0cc330 0x7fdc5c0cce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:08.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.951+0000 7fdc60d7e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc5c158e90 con 0x7fdc5c071910 2023-05-24T03:30:08.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.951+0000 7fdc60d7e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc5c0cee60 con 0x7fdc5c15d210 2023-05-24T03:30:08.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.951+0000 7fdc60d7e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc5c15c730 con 0x7fdc5c0cc330 2023-05-24T03:30:08.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.950+0000 7fb3e3fff700 1 -- 172.21.15.146:0/269468131 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3ec003d90 con 0x7fb3fc0c1c70 2023-05-24T03:30:08.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.950+0000 7fb401f58700 1 -- 172.21.15.146:0/269468131 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3fc0cb3a0 con 0x7fb3fc0c1c70 2023-05-24T03:30:08.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.950+0000 7fb3e3fff700 1 -- 172.21.15.146:0/269468131 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ec011870 con 0x7fb3fc0c1c70 2023-05-24T03:30:08.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.950+0000 7fb401f58700 1 -- 172.21.15.146:0/269468131 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3fc0cb0c0 con 0x7fb3fc0c1c70 2023-05-24T03:30:08.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.951+0000 7f8298479700 1 Processor -- start 2023-05-24T03:30:08.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.949+0000 7f38bfabb700 1 -- start start 2023-05-24T03:30:08.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.950+0000 7f38bfabb700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f38b8071bc0 0x7f38b80c3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:08.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.951+0000 7f38bfabb700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38b80caeb0 0x7f38b80c4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:08.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.951+0000 7f38bfabb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38b8159310 0x7f38b81f62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:08.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.951+0000 7f38bfabb700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b81f6bd0 con 0x7f38b8159310 2023-05-24T03:30:08.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.951+0000 7f38bfabb700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b80c5190 con 0x7f38b80caeb0 2023-05-24T03:30:08.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.951+0000 7f38bfabb700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38b80c5470 con 0x7f38b8071bc0 2023-05-24T03:30:08.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.951+0000 7f38bd056700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38b80caeb0 0x7f38b80c4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:08.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.951+0000 7f38be058700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38b8159310 0x7f38b81f62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:08.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.951+0000 7f38be058700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38b8159310 0x7f38b81f62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39332/0 (socket says 172.21.15.146:39332) 2023-05-24T03:30:08.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.951+0000 7f38be058700 1 -- 172.21.15.146:0/2838482382 learned_addr learned my addr 172.21.15.146:0/2838482382 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:08.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.951+0000 7f38bd857700 1 --2- 172.21.15.146:0/2838482382 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f38b8071bc0 0x7f38b80c3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:08.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.951+0000 7f38bd056700 1 -- 172.21.15.146:0/2838482382 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f38b8071bc0 msgr2=0x7f38b80c3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:08.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.951+0000 7f38bd056700 1 --2- 172.21.15.146:0/2838482382 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f38b8071bc0 0x7f38b80c3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:08.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.952+0000 7f38bd056700 1 -- 172.21.15.146:0/2838482382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38b8159310 msgr2=0x7f38b81f62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:08.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.952+0000 7f38bd056700 1 --2- 172.21.15.146:0/2838482382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38b8159310 0x7f38b81f62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:08.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.952+0000 7f38bd056700 1 -- 172.21.15.146:0/2838482382 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a800b740 con 0x7f38b80caeb0 2023-05-24T03:30:08.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.951+0000 7fb401f58700 1 -- 172.21.15.146:0/269468131 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb3fc0ca7b0 con 0x7fb3fc0c1c70 2023-05-24T03:30:08.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.952+0000 7f38bd056700 1 --2- 172.21.15.146:0/2838482382 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38b80caeb0 0x7f38b80c4940 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f38b400c4d0 tx=0x7f38b400c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:08.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.952+0000 7f38ae7fc700 1 -- 172.21.15.146:0/2838482382 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b40052d0 con 0x7f38b80caeb0 2023-05-24T03:30:08.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.952+0000 7f38ae7fc700 1 -- 172.21.15.146:0/2838482382 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b4005430 con 0x7f38b80caeb0 2023-05-24T03:30:08.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.952+0000 7f38ae7fc700 1 -- 172.21.15.146:0/2838482382 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b4003880 con 0x7f38b80caeb0 2023-05-24T03:30:08.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.952+0000 7fb3e3fff700 1 -- 172.21.15.146:0/269468131 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb3ec0119d0 con 0x7fb3fc0c1c70 2023-05-24T03:30:08.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.953+0000 7fb3e3fff700 1 --2- 172.21.15.146:0/269468131 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fb3e406ae60 0x7fb3e406d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:08.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.953+0000 7fb3e3fff700 1 -- 172.21.15.146:0/269468131 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb3ec08a5a0 con 0x7fb3fc0c1c70 2023-05-24T03:30:08.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.953+0000 7fb3e3fff700 1 --2- 172.21.15.146:0/269468131 >> [v2:172.21.15.146:6816/1749783580,v1:172.21.15.146:6817/1749783580] conn(0x7fb3e4074ab0 0x7fb3e4076ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:08.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.951+0000 7f8298479700 1 -- start start 2023-05-24T03:30:08.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.952+0000 7f8298479700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8290071670 0x7f829006da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:08.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.952+0000 7f8298479700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f829006df70 0x7f82900b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:08.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.952+0000 7f8298479700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f82900b0e00 0x7f82901529c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:08.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.952+0000 7f8298479700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f829006e3e0 con 0x7f829006df70 2023-05-24T03:30:08.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.952+0000 7f8298479700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8290159c80 con 0x7f82900b0e00 2023-05-24T03:30:08.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.952+0000 7f8298479700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8290159350 con 0x7f8290071670 2023-05-24T03:30:08.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.953+0000 7f8296a16700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f82900b0e00 0x7f82901529c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:08.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.953+0000 7f8296a16700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f82900b0e00 0x7f82901529c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:50520/0 (socket says 172.21.15.146:50520) 2023-05-24T03:30:08.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.953+0000 7f8296a16700 1 -- 172.21.15.146:0/749621899 learned_addr learned my addr 172.21.15.146:0/749621899 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:08.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.953+0000 7fb3e3fff700 1 -- 172.21.15.146:0/269468131 --> [v2:172.21.15.146:6816/1749783580,v1:172.21.15.146:6817/1749783580] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb3e40775b0 con 0x7fb3e4074ab0 2023-05-24T03:30:08.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.953+0000 7fb3e3fff700 1 -- 172.21.15.146:0/269468131 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb3ec055350 con 0x7fb3fc0c1c70 2023-05-24T03:30:08.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.953+0000 7fb3fbfff700 1 --2- 172.21.15.146:0/269468131 >> [v2:172.21.15.146:6816/1749783580,v1:172.21.15.146:6817/1749783580] conn(0x7fb3e4074ab0 0x7fb3e4076ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:08.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.953+0000 7f8296215700 1 --2- 172.21.15.146:0/749621899 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8290071670 0x7f829006da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:08.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.953+0000 7f8296a16700 1 -- 172.21.15.146:0/749621899 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8290071670 msgr2=0x7f829006da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:08.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.953+0000 7f8296a16700 1 --2- 172.21.15.146:0/749621899 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8290071670 0x7f829006da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:08.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.953+0000 7f8296a16700 1 -- 172.21.15.146:0/749621899 >> v2:172.21.15.146:3300/0 conn(0x7f829006df70 msgr2=0x7f82900b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:08.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.953+0000 7f8296a16700 1 --2- 172.21.15.146:0/749621899 >> v2:172.21.15.146:3300/0 conn(0x7f829006df70 0x7f82900b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:08.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.953+0000 7f8296a16700 1 -- 172.21.15.146:0/749621899 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8290159630 con 0x7f82900b0e00 2023-05-24T03:30:08.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.953+0000 7f8296215700 1 --2- 172.21.15.146:0/749621899 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8290071670 0x7f829006da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:30:08.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.953+0000 7f8296a16700 1 --2- 172.21.15.146:0/749621899 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82900b0e00 0x7f82901529c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f829006f9e0 tx=0x7f8288009eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c755f5f79bba1d00 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:08.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.954+0000 7fb3fbfff700 1 --2- 172.21.15.146:0/269468131 >> [v2:172.21.15.146:6816/1749783580,v1:172.21.15.146:6817/1749783580] conn(0x7fb3e4074ab0 0x7fb3e4076ee0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:08.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.954+0000 7f1c2dffb700 1 -- 172.21.15.146:0/2092206228 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c28011630 con 0x7f1c3806da30 2023-05-24T03:30:08.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.954+0000 7f1c2dffb700 1 -- 172.21.15.146:0/2092206228 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c2801f070 con 0x7f1c3806da30 2023-05-24T03:30:08.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.954+0000 7f1c2dffb700 1 -- 172.21.15.146:0/2092206228 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c280119d0 con 0x7f1c3806da30 2023-05-24T03:30:08.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.954+0000 7f1c3f593700 1 -- 172.21.15.146:0/2092206228 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c380cafa0 con 0x7f1c3806da30 2023-05-24T03:30:08.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.954+0000 7f1c3f593700 1 -- 172.21.15.146:0/2092206228 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c380cacc0 con 0x7f1c3806da30 2023-05-24T03:30:08.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.954+0000 7fdc5ad9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdc5c0cc330 0x7fdc5c0cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:08.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.954+0000 7fdc5ad9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdc5c0cc330 0x7fdc5c0cce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39336/0 (socket says 172.21.15.146:39336) 2023-05-24T03:30:08.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.954+0000 7fdc5ad9d700 1 -- 172.21.15.146:0/3658082771 learned_addr learned my addr 172.21.15.146:0/3658082771 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:08.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.954+0000 7f8295213700 1 -- 172.21.15.146:0/749621899 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828800dd00 con 0x7f82900b0e00 2023-05-24T03:30:08.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.954+0000 7f8295213700 1 -- 172.21.15.146:0/749621899 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82880092e0 con 0x7f82900b0e00 2023-05-24T03:30:08.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.954+0000 7f8295213700 1 -- 172.21.15.146:0/749621899 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828800e670 con 0x7f82900b0e00 2023-05-24T03:30:08.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.955+0000 7f8298479700 1 -- 172.21.15.146:0/749621899 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82900b0e00 msgr2=0x7f82901529c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:08.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.955+0000 7f8298479700 1 --2- 172.21.15.146:0/749621899 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82900b0e00 0x7f82901529c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f829006f9e0 tx=0x7f8288009eb0 comp rx=0 tx=0).stop 2023-05-24T03:30:08.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.955+0000 7fdc5ad9d700 1 -- 172.21.15.146:0/3658082771 >> v1:172.21.15.151:6789/0 conn(0x7fdc5c15d210 legacy=0x7fdc5c0cbc20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-05-24T03:30:08.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.955+0000 7fdc5ad9d700 1 -- 172.21.15.146:0/3658082771 >> v1:172.21.15.146:6789/0 conn(0x7fdc5c071910 legacy=0x7fdc5c06e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:08.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.955+0000 7fdc5ad9d700 1 -- 172.21.15.146:0/3658082771 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc5c15ca10 con 0x7fdc5c0cc330 2023-05-24T03:30:08.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.955+0000 7f1c3f593700 1 -- 172.21.15.146:0/2092206228 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1c380cb280 con 0x7f1c3806da30 2023-05-24T03:30:08.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.955+0000 7fb3e3fff700 1 -- 172.21.15.146:0/269468131 <== osd.3 v2:172.21.15.146:6816/1749783580 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb3e40775b0 con 0x7fb3e4074ab0 2023-05-24T03:30:08.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.955+0000 7f8298479700 1 -- 172.21.15.146:0/749621899 shutdown_connections 2023-05-24T03:30:08.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.955+0000 7f8298479700 1 --2- 172.21.15.146:0/749621899 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82900b0e00 0x7f82901529c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:08.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.955+0000 7f8298479700 1 --2- 172.21.15.146:0/749621899 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8290071670 0x7f829006da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:08.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.955+0000 7f8298479700 1 --2- 172.21.15.146:0/749621899 >> v2:172.21.15.146:3300/0 conn(0x7f829006df70 0x7f82900b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:08.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.955+0000 7f8298479700 1 -- 172.21.15.146:0/749621899 >> 172.21.15.146:0/749621899 conn(0x7f82900cedd0 msgr2=0x7f82900cf1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:08.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.956+0000 7f1c2dffb700 1 -- 172.21.15.146:0/2092206228 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1c28011b30 con 0x7f1c3806da30 2023-05-24T03:30:08.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.956+0000 7f8298479700 1 -- 172.21.15.146:0/749621899 shutdown_connections 2023-05-24T03:30:08.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.956+0000 7fdc5ad9d700 1 --2- 172.21.15.146:0/3658082771 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc5c0cc330 0x7fdc5c0cce10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fdc500088f0 tx=0x7fdc5000d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1efca32fbc891d50 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:08.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.956+0000 7f1c2dffb700 1 --2- 172.21.15.146:0/2092206228 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f1c1c06ad00 0x7f1c1c06d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:08.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.956+0000 7f1c2dffb700 1 -- 172.21.15.146:0/2092206228 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1c28021070 con 0x7f1c3806da30 2023-05-24T03:30:08.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.956+0000 7f1c2dffb700 1 --2- 172.21.15.146:0/2092206228 >> [v2:172.21.15.151:6800/3283474903,v1:172.21.15.151:6801/3283474903] conn(0x7f1c1c0749d0 0x7f1c1c076e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:08.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.956+0000 7f1c2dffb700 1 -- 172.21.15.146:0/2092206228 --> [v2:172.21.15.151:6800/3283474903,v1:172.21.15.151:6801/3283474903] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1c1c0774d0 con 0x7f1c1c0749d0 2023-05-24T03:30:08.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.956+0000 7f1c2dffb700 1 -- 172.21.15.146:0/2092206228 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c2808d5a0 con 0x7f1c3806da30 2023-05-24T03:30:08.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.957+0000 7f1c3db30700 1 --2- 172.21.15.146:0/2092206228 >> [v2:172.21.15.151:6800/3283474903,v1:172.21.15.151:6801/3283474903] conn(0x7f1c1c0749d0 0x7f1c1c076e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:08.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.957+0000 7f1c3db30700 1 --2- 172.21.15.146:0/2092206228 >> [v2:172.21.15.151:6800/3283474903,v1:172.21.15.151:6801/3283474903] conn(0x7f1c1c0749d0 0x7f1c1c076e00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:09.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.956+0000 7f8298479700 1 -- 172.21.15.146:0/749621899 wait complete. 2023-05-24T03:30:09.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.957+0000 7f8298479700 1 Processor -- start 2023-05-24T03:30:09.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.957+0000 7f8298479700 1 -- start start 2023-05-24T03:30:09.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.952+0000 7f1b4bfff700 1 -- 172.21.15.146:0/4186358134 <== osd.0 v2:172.21.15.146:6800/3353593100 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f1b4c0779b0 con 0x7f1b4c074eb0 2023-05-24T03:30:09.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.958+0000 7fdc5959a700 1 -- 172.21.15.146:0/3658082771 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc50010070 con 0x7fdc5c0cc330 2023-05-24T03:30:09.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.958+0000 7fdc5959a700 1 -- 172.21.15.146:0/3658082771 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc5000da00 con 0x7fdc5c0cc330 2023-05-24T03:30:09.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.958+0000 7fdc5959a700 1 -- 172.21.15.146:0/3658082771 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5000dd90 con 0x7fdc5c0cc330 2023-05-24T03:30:09.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.958+0000 7f1c2dffb700 1 -- 172.21.15.146:0/2092206228 <== osd.5 v2:172.21.15.151:6800/3283474903 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f1c1c0774d0 con 0x7f1c1c0749d0 2023-05-24T03:30:09.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.958+0000 7f38bfabb700 1 -- 172.21.15.146:0/2838482382 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38b80713c0 con 0x7f38b80caeb0 2023-05-24T03:30:09.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.958+0000 7f38bfabb700 1 -- 172.21.15.146:0/2838482382 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38b80710e0 con 0x7f38b80caeb0 2023-05-24T03:30:09.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.959+0000 7f8298479700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f829006df70 0x7f82900cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.959+0000 7f8298479700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8290071670 0x7f82900b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.959+0000 7f8298479700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82900b0e00 0x7f82900c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.959+0000 7f8298479700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8290201910 con 0x7f829006df70 2023-05-24T03:30:09.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.959+0000 7f8298479700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8290200a80 con 0x7f8290071670 2023-05-24T03:30:09.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.959+0000 7f8298479700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82900b2140 con 0x7f82900b0e00 2023-05-24T03:30:09.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.959+0000 7f8296215700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f829006df70 0x7f82900cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.959+0000 7fdc60d7e700 1 -- 172.21.15.146:0/3658082771 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc5c0cc330 msgr2=0x7fdc5c0cce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.959+0000 7fdc60d7e700 1 --2- 172.21.15.146:0/3658082771 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc5c0cc330 0x7fdc5c0cce10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fdc500088f0 tx=0x7fdc5000d330 comp rx=0 tx=0).stop 2023-05-24T03:30:09.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.959+0000 7fdc60d7e700 1 -- 172.21.15.146:0/3658082771 shutdown_connections 2023-05-24T03:30:09.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.959+0000 7fdc60d7e700 1 --2- 172.21.15.146:0/3658082771 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc5c0cc330 0x7fdc5c0cce10 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.959+0000 7fdc60d7e700 1 -- 172.21.15.146:0/3658082771 >> 172.21.15.146:0/3658082771 conn(0x7fdc5c0b0d90 msgr2=0x7fdc5c0b1160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:09.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.959+0000 7f8295a14700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8290071670 0x7f82900b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.959+0000 7f8296215700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f829006df70 0x7f82900cbf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39352/0 (socket says 172.21.15.146:39352) 2023-05-24T03:30:09.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.959+0000 7f8296215700 1 -- 172.21.15.146:0/1541677997 learned_addr learned my addr 172.21.15.146:0/1541677997 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:09.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.959+0000 7f8296a16700 1 --2- 172.21.15.146:0/1541677997 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82900b0e00 0x7f82900c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.959+0000 7f8296215700 1 -- 172.21.15.146:0/1541677997 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82900b0e00 msgr2=0x7f82900c6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.959+0000 7f8296215700 1 --2- 172.21.15.146:0/1541677997 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82900b0e00 0x7f82900c6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.959+0000 7f8296215700 1 -- 172.21.15.146:0/1541677997 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8290071670 msgr2=0x7f82900b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.959+0000 7f8296215700 1 --2- 172.21.15.146:0/1541677997 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8290071670 0x7f82900b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.959+0000 7f8296215700 1 -- 172.21.15.146:0/1541677997 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8288009830 con 0x7f829006df70 2023-05-24T03:30:09.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.959+0000 7fdc60d7e700 1 -- 172.21.15.146:0/3658082771 shutdown_connections 2023-05-24T03:30:09.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.959+0000 7f8295a14700 1 --2- 172.21.15.146:0/1541677997 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8290071670 0x7f82900b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T03:30:09.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.959+0000 7fdc60d7e700 1 -- 172.21.15.146:0/3658082771 wait complete. 2023-05-24T03:30:09.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.960+0000 7f38bfabb700 1 -- 172.21.15.146:0/2838482382 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f38b80716a0 con 0x7f38b80caeb0 2023-05-24T03:30:09.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.960+0000 7f8296215700 1 --2- 172.21.15.146:0/1541677997 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f829006df70 0x7f82900cbf40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f828000c7f0 tx=0x7f828000cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:09.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.961+0000 7f1c3cb2e700 1 --2- 172.21.15.146:0/2092206228 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f1c1c06ad00 0x7f1c1c06d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.961+0000 7fdc60d7e700 1 Processor -- start 2023-05-24T03:30:09.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.961+0000 7fdc60d7e700 1 -- start start 2023-05-24T03:30:09.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.961+0000 7f8286ffd700 1 -- 172.21.15.146:0/1541677997 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8280011800 con 0x7f829006df70 2023-05-24T03:30:09.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.961+0000 7f8286ffd700 1 -- 172.21.15.146:0/1541677997 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8280011960 con 0x7f829006df70 2023-05-24T03:30:09.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.961+0000 7f1c3cb2e700 1 --2- 172.21.15.146:0/2092206228 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f1c1c06ad00 0x7f1c1c06d1b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1c380711e0 tx=0x7f1c3000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:09.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.961+0000 7f8286ffd700 1 -- 172.21.15.146:0/1541677997 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8280011cf0 con 0x7f829006df70 2023-05-24T03:30:09.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.962+0000 7fdc60d7e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc5c0cc330 0x7fdc5c0c8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.962+0000 7fdc60d7e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc5c0c8f50 0x7fdc5c0c5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.962+0000 7f8298479700 1 -- 172.21.15.146:0/1541677997 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f829015a110 con 0x7f829006df70 2023-05-24T03:30:09.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.962+0000 7f8298479700 1 -- 172.21.15.146:0/1541677997 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8290159910 con 0x7f829006df70 2023-05-24T03:30:09.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.962+0000 7fdc60d7e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc5c157860 0x7fdc5c157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.962+0000 7fdc60d7e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5c158210 con 0x7fdc5c0c8f50 2023-05-24T03:30:09.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.962+0000 7fdc60d7e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5c0c7360 con 0x7fdc5c157860 2023-05-24T03:30:09.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.962+0000 7fdc60d7e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5c0c7640 con 0x7fdc5c0cc330 2023-05-24T03:30:09.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.963+0000 7fdc5a59c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc5c0cc330 0x7fdc5c0c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.963+0000 7fdc5a59c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc5c0cc330 0x7fdc5c0c8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:52224/0 (socket says 172.21.15.146:52224) 2023-05-24T03:30:09.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.963+0000 7fdc5a59c700 1 -- 172.21.15.146:0/3290849352 learned_addr learned my addr 172.21.15.146:0/3290849352 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:09.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.963+0000 7fdc5ad9d700 1 --2- 172.21.15.146:0/3290849352 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc5c157860 0x7fdc5c157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.963+0000 7fdc5a59c700 1 -- 172.21.15.146:0/3290849352 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc5c157860 msgr2=0x7fdc5c157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.963+0000 7fdc5a59c700 1 --2- 172.21.15.146:0/3290849352 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc5c157860 0x7fdc5c157cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.963+0000 7fdc5a59c700 1 -- 172.21.15.146:0/3290849352 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc5c0c8f50 msgr2=0x7fdc5c0c5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.963+0000 7fdc59d9b700 1 --2- 172.21.15.146:0/3290849352 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc5c0c8f50 0x7fdc5c0c5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.963+0000 7fdc5a59c700 1 --2- 172.21.15.146:0/3290849352 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc5c0c8f50 0x7fdc5c0c5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.963+0000 7fdc5a59c700 1 -- 172.21.15.146:0/3290849352 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc500085d0 con 0x7fdc5c0cc330 2023-05-24T03:30:09.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.964+0000 7fdc59d9b700 1 --2- 172.21.15.146:0/3290849352 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc5c0c8f50 0x7fdc5c0c5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:30:09.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.964+0000 7f8286ffd700 1 -- 172.21.15.146:0/1541677997 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8280018360 con 0x7f829006df70 2023-05-24T03:30:09.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.964+0000 7f38ae7fc700 1 -- 172.21.15.146:0/2838482382 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f38b40039e0 con 0x7f38b80caeb0 2023-05-24T03:30:09.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.965+0000 7f8286ffd700 1 --2- 172.21.15.146:0/1541677997 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f827406ad30 0x7f827406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.965+0000 7f8286ffd700 1 -- 172.21.15.146:0/1541677997 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f82800894a0 con 0x7f829006df70 2023-05-24T03:30:09.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.965+0000 7f38ae7fc700 1 --2- 172.21.15.146:0/2838482382 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f38a406ae60 0x7f38a406d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.965+0000 7f38ae7fc700 1 -- 172.21.15.146:0/2838482382 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f38b4088960 con 0x7f38b80caeb0 2023-05-24T03:30:09.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.965+0000 7f38ae7fc700 1 --2- 172.21.15.146:0/2838482382 >> [v2:172.21.15.146:6808/1800242932,v1:172.21.15.146:6809/1800242932] conn(0x7f38a4074a30 0x7f38a4076e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.965+0000 7f38ae7fc700 1 -- 172.21.15.146:0/2838482382 --> [v2:172.21.15.146:6808/1800242932,v1:172.21.15.146:6809/1800242932] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f38a4077530 con 0x7f38a4074a30 2023-05-24T03:30:09.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.965+0000 7f8295a14700 1 --2- 172.21.15.146:0/1541677997 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f827406ad30 0x7f827406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.966+0000 7fb3fb7fe700 1 --2- 172.21.15.146:0/269468131 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fb3e406ae60 0x7fb3e406d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.966+0000 7f8298479700 1 --2- 172.21.15.146:0/1541677997 >> [v2:172.21.15.151:6809/163453435,v1:172.21.15.151:6811/163453435] conn(0x7f82900c73e0 0x7f8290200f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.966+0000 7f8298479700 1 -- 172.21.15.146:0/1541677997 --> [v2:172.21.15.151:6809/163453435,v1:172.21.15.151:6811/163453435] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8290201b80 con 0x7f82900c73e0 2023-05-24T03:30:09.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.966+0000 7fdc5a59c700 1 --2- 172.21.15.146:0/3290849352 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc5c0cc330 0x7fdc5c0c8680 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c001ab0 tx=0x7fdc4c001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:09.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.966+0000 7f8296a16700 1 --2- 172.21.15.146:0/1541677997 >> [v2:172.21.15.151:6809/163453435,v1:172.21.15.151:6811/163453435] conn(0x7f82900c73e0 0x7f8290200f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.966+0000 7fdc4affd700 1 -- 172.21.15.146:0/3290849352 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c017070 con 0x7fdc5c0cc330 2023-05-24T03:30:09.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.966+0000 7fdc4affd700 1 -- 172.21.15.146:0/3290849352 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc4c0052e0 con 0x7fdc5c0cc330 2023-05-24T03:30:09.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.966+0000 7fdc4affd700 1 -- 172.21.15.146:0/3290849352 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c010850 con 0x7fdc5c0cc330 2023-05-24T03:30:09.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.966+0000 7fdc60d7e700 1 -- 172.21.15.146:0/3290849352 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc5c071ce0 con 0x7fdc5c0cc330 2023-05-24T03:30:09.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.966+0000 7fdc60d7e700 1 -- 172.21.15.146:0/3290849352 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc5c15ccf0 con 0x7fdc5c0cc330 2023-05-24T03:30:09.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.967+0000 7f8295a14700 1 --2- 172.21.15.146:0/1541677997 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f827406ad30 0x7f827406d1e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8290158400 tx=0x7f828c009110 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:09.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.967+0000 7faa2806c700 1 Processor -- start 2023-05-24T03:30:09.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.967+0000 7f8296a16700 1 --2- 172.21.15.146:0/1541677997 >> [v2:172.21.15.151:6809/163453435,v1:172.21.15.151:6811/163453435] conn(0x7f82900c73e0 0x7f8290200f70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:09.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.967+0000 7faa2806c700 1 -- start start 2023-05-24T03:30:09.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.969+0000 7f8286ffd700 1 -- 172.21.15.146:0/1541677997 <== osd.4 v2:172.21.15.151:6809/163453435 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f8290201b80 con 0x7f82900c73e0 2023-05-24T03:30:09.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.968+0000 7faa2806c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7faa200b0ac0 0x7faa200ce490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.968+0000 7faa2806c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa200b0e90 0x7faa20159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.968+0000 7faa2806c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa2015a310 con 0x7faa2015d410 2023-05-24T03:30:09.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.968+0000 7faa2806c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa2006bf00 con 0x7faa200b0ac0 2023-05-24T03:30:09.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.968+0000 7faa2806c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa200c9430 con 0x7faa200b0e90 2023-05-24T03:30:09.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.969+0000 7faa25e08700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7faa200b0ac0 0x7faa200ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.969+0000 7faa25e08700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7faa200b0ac0 0x7faa200ce490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39370/0 (socket says 172.21.15.146:39370) 2023-05-24T03:30:09.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.969+0000 7faa25e08700 1 -- 172.21.15.146:0/1164293262 learned_addr learned my addr 172.21.15.146:0/1164293262 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:09.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.969+0000 7faa25607700 1 --2- 172.21.15.146:0/1164293262 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa200b0e90 0x7faa20159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.969+0000 7faa25e08700 1 -- 172.21.15.146:0/1164293262 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa200b0e90 msgr2=0x7faa20159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:09.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.969+0000 7faa25e08700 1 --2- 172.21.15.146:0/1164293262 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa200b0e90 0x7faa20159dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.969+0000 7faa25e08700 1 -- 172.21.15.146:0/1164293262 >> v1:172.21.15.146:6789/0 conn(0x7faa2015d410 legacy=0x7faa200cca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.969+0000 7faa25e08700 1 -- 172.21.15.146:0/1164293262 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa200c9710 con 0x7faa200b0ac0 2023-05-24T03:30:09.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.970+0000 7faa25e08700 1 --2- 172.21.15.146:0/1164293262 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa200b0ac0 0x7faa200ce490 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7faa1c0098f0 tx=0x7faa1c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=937374f6343c558c server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:09.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.971+0000 7f38ae7fc700 1 -- 172.21.15.146:0/2838482382 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f38b4053860 con 0x7f38b80caeb0 2023-05-24T03:30:09.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.971+0000 7f38be058700 1 --2- 172.21.15.146:0/2838482382 >> [v2:172.21.15.146:6808/1800242932,v1:172.21.15.146:6809/1800242932] conn(0x7f38a4074a30 0x7f38a4076e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.971+0000 7f38be058700 1 --2- 172.21.15.146:0/2838482382 >> [v2:172.21.15.146:6808/1800242932,v1:172.21.15.146:6809/1800242932] conn(0x7f38a4074a30 0x7f38a4076e60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.972+0000 7f38bd857700 1 --2- 172.21.15.146:0/2838482382 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f38a406ae60 0x7f38a406d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.972+0000 7fb3fb7fe700 1 --2- 172.21.15.146:0/269468131 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fb3e406ae60 0x7fb3e406d310 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb3f4011340 tx=0x7fb3f400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.972+0000 7f38bd857700 1 --2- 172.21.15.146:0/2838482382 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f38a406ae60 0x7f38a406d310 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f38a800be30 tx=0x7f38a8013000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.972+0000 7f38ae7fc700 1 -- 172.21.15.146:0/2838482382 <== osd.2 v2:172.21.15.146:6808/1800242932 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f38a4077530 con 0x7f38a4074a30 2023-05-24T03:30:09.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.974+0000 7efc0cb3c700 1 -- 172.21.15.146:0/3480667011 --> [v2:172.21.15.146:6818/2537488734,v1:172.21.15.146:6821/2537488734] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efbec002d40 con 0x7efbe80748b0 2023-05-24T03:30:09.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.968+0000 7fdc4affd700 1 -- 172.21.15.146:0/3290849352 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdc4c0109b0 con 0x7fdc5c0cc330 2023-05-24T03:30:09.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.969+0000 7fdc4affd700 1 --2- 172.21.15.146:0/3290849352 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fdc3c06ad30 0x7fdc3c06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.969+0000 7fdc4affd700 1 -- 172.21.15.146:0/3290849352 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdc4c0910f0 con 0x7fdc5c0cc330 2023-05-24T03:30:09.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.970+0000 7fdc59d9b700 1 --2- 172.21.15.146:0/3290849352 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fdc3c06ad30 0x7fdc3c06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.970+0000 7fdc59d9b700 1 --2- 172.21.15.146:0/3290849352 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fdc3c06ad30 0x7fdc3c06d1e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c0aeb70 tx=0x7fdc540073e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:09.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.974+0000 7fdc60d7e700 1 --2- 172.21.15.146:0/3290849352 >> [v2:172.21.15.151:6824/3889424178,v1:172.21.15.151:6825/3889424178] conn(0x7fdc5c0c7b30 0x7fdc5c0c2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.974+0000 7fdc60d7e700 1 -- 172.21.15.146:0/3290849352 --> [v2:172.21.15.151:6824/3889424178,v1:172.21.15.151:6825/3889424178] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdc5c04e810 con 0x7fdc5c0c7b30 2023-05-24T03:30:09.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.974+0000 7faa24e06700 1 -- 172.21.15.146:0/1164293262 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1c00b8a0 con 0x7faa200b0ac0 2023-05-24T03:30:09.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.974+0000 7faa24e06700 1 -- 172.21.15.146:0/1164293262 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa1c00ba00 con 0x7faa200b0ac0 2023-05-24T03:30:09.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.974+0000 7faa24e06700 1 -- 172.21.15.146:0/1164293262 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1c00bd90 con 0x7faa200b0ac0 2023-05-24T03:30:09.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.974+0000 7efbf6ffd700 1 -- 172.21.15.146:0/3480667011 <== osd.1 v2:172.21.15.146:6818/2537488734 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efbec002d40 con 0x7efbe80748b0 2023-05-24T03:30:09.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.975+0000 7fdc5ad9d700 1 --2- 172.21.15.146:0/3290849352 >> [v2:172.21.15.151:6824/3889424178,v1:172.21.15.151:6825/3889424178] conn(0x7fdc5c0c7b30 0x7fdc5c0c2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.975+0000 7fdc5ad9d700 1 --2- 172.21.15.146:0/3290849352 >> [v2:172.21.15.151:6824/3889424178,v1:172.21.15.151:6825/3889424178] conn(0x7fdc5c0c7b30 0x7fdc5c0c2d40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:09.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.975+0000 7faa2806c700 1 -- 172.21.15.146:0/1164293262 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa200b0ac0 msgr2=0x7faa200ce490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.975+0000 7faa2806c700 1 --2- 172.21.15.146:0/1164293262 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa200b0ac0 0x7faa200ce490 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7faa1c0098f0 tx=0x7faa1c009c00 comp rx=0 tx=0).stop 2023-05-24T03:30:09.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.975+0000 7faa2806c700 1 -- 172.21.15.146:0/1164293262 shutdown_connections 2023-05-24T03:30:09.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.975+0000 7faa2806c700 1 --2- 172.21.15.146:0/1164293262 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa200b0ac0 0x7faa200ce490 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.975+0000 7faa2806c700 1 --2- 172.21.15.146:0/1164293262 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa200b0e90 0x7faa20159dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.975+0000 7faa2806c700 1 -- 172.21.15.146:0/1164293262 >> 172.21.15.146:0/1164293262 conn(0x7faa2006b0b0 msgr2=0x7faa200cedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:09.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.975+0000 7faa2806c700 1 -- 172.21.15.146:0/1164293262 shutdown_connections 2023-05-24T03:30:09.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.976+0000 7faa2806c700 1 -- 172.21.15.146:0/1164293262 wait complete. 2023-05-24T03:30:09.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.976+0000 7fdc4affd700 1 -- 172.21.15.146:0/3290849352 <== osd.6 v2:172.21.15.151:6824/3889424178 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fdc5c04e810 con 0x7fdc5c0c7b30 2023-05-24T03:30:09.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.977+0000 7faa2806c700 1 Processor -- start 2023-05-24T03:30:09.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.978+0000 7faa2806c700 1 -- start start 2023-05-24T03:30:09.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.978+0000 7faa2806c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa200b0ac0 0x7faa200c6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.978+0000 7faa2806c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa200b0e90 0x7faa20148ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.978+0000 7faa2806c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa2015d410 0x7faa20147c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.978+0000 7faa2806c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa200c6d60 con 0x7faa200b0e90 2023-05-24T03:30:09.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.978+0000 7faa2806c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa20151700 con 0x7faa2015d410 2023-05-24T03:30:09.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.978+0000 7faa2806c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa200c8220 con 0x7faa200b0ac0 2023-05-24T03:30:09.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.978+0000 7faa25607700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa200b0e90 0x7faa20148ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.978+0000 7faa25607700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa200b0e90 0x7faa20148ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39386/0 (socket says 172.21.15.146:39386) 2023-05-24T03:30:09.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.978+0000 7faa25607700 1 -- 172.21.15.146:0/836733607 learned_addr learned my addr 172.21.15.146:0/836733607 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:09.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.979+0000 7faa25e08700 1 --2- 172.21.15.146:0/836733607 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa200b0ac0 0x7faa200c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.979+0000 7faa26609700 1 --2- 172.21.15.146:0/836733607 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa2015d410 0x7faa20147c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.979+0000 7faa25607700 1 -- 172.21.15.146:0/836733607 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa200b0ac0 msgr2=0x7faa200c6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.979+0000 7faa25607700 1 --2- 172.21.15.146:0/836733607 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa200b0ac0 0x7faa200c6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.979+0000 7faa25607700 1 -- 172.21.15.146:0/836733607 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa2015d410 msgr2=0x7faa20147c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.979+0000 7faa25607700 1 --2- 172.21.15.146:0/836733607 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa2015d410 0x7faa20147c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.979+0000 7faa25607700 1 -- 172.21.15.146:0/836733607 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa1c009550 con 0x7faa200b0e90 2023-05-24T03:30:09.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.979+0000 7faa25607700 1 --2- 172.21.15.146:0/836733607 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa200b0e90 0x7faa20148ff0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7faa1000e810 tx=0x7faa1000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:09.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.979+0000 7faa167fc700 1 -- 172.21.15.146:0/836733607 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1000c070 con 0x7faa200b0e90 2023-05-24T03:30:09.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.979+0000 7faa167fc700 1 -- 172.21.15.146:0/836733607 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa10013610 con 0x7faa200b0e90 2023-05-24T03:30:09.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.979+0000 7faa167fc700 1 -- 172.21.15.146:0/836733607 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa100139c0 con 0x7faa200b0e90 2023-05-24T03:30:09.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.979+0000 7faa2806c700 1 -- 172.21.15.146:0/836733607 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa2015d870 con 0x7faa200b0e90 2023-05-24T03:30:09.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.979+0000 7faa2806c700 1 -- 172.21.15.146:0/836733607 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa200c99f0 con 0x7faa200b0e90 2023-05-24T03:30:09.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.980+0000 7efc0cb3c700 1 -- 172.21.15.146:0/3480667011 >> [v2:172.21.15.146:6818/2537488734,v1:172.21.15.146:6821/2537488734] conn(0x7efbe80748b0 msgr2=0x7efbe8076ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.980+0000 7efc0cb3c700 1 --2- 172.21.15.146:0/3480667011 >> [v2:172.21.15.146:6818/2537488734,v1:172.21.15.146:6821/2537488734] conn(0x7efbe80748b0 0x7efbe8076ce0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.980+0000 7faa2806c700 1 -- 172.21.15.146:0/836733607 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faa200cea70 con 0x7faa200b0e90 2023-05-24T03:30:09.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.980+0000 7efc0cb3c700 1 -- 172.21.15.146:0/3480667011 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7efbe806ace0 msgr2=0x7efbe806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.980+0000 7efc0cb3c700 1 --2- 172.21.15.146:0/3480667011 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7efbe806ace0 0x7efbe806d190 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7efbf8005910 tx=0x7efbf8009040 comp rx=0 tx=0).stop 2023-05-24T03:30:09.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.980+0000 7efc0cb3c700 1 -- 172.21.15.146:0/3480667011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc080cf8e0 msgr2=0x7efc0815cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.980+0000 7efc0cb3c700 1 --2- 172.21.15.146:0/3480667011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc080cf8e0 0x7efc0815cdb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efc0000cbd0 tx=0x7efc0000cee0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.980+0000 7efc06d9d700 1 -- 172.21.15.146:0/3480667011 reap_dead start 2023-05-24T03:30:09.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.981+0000 7efc0cb3c700 1 -- 172.21.15.146:0/3480667011 shutdown_connections 2023-05-24T03:30:09.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.981+0000 7efc0cb3c700 1 -- 172.21.15.146:0/3480667011 >> 172.21.15.146:0/3480667011 conn(0x7efc080cedd0 msgr2=0x7efc080cf1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:09.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.982+0000 7efc0cb3c700 1 -- 172.21.15.146:0/3480667011 shutdown_connections 2023-05-24T03:30:09.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.982+0000 7faa167fc700 1 -- 172.21.15.146:0/836733607 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7faa10013b20 con 0x7faa200b0e90 2023-05-24T03:30:09.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.982+0000 7efc0cb3c700 1 -- 172.21.15.146:0/3480667011 wait complete. 2023-05-24T03:30:09.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.982+0000 7faa167fc700 1 --2- 172.21.15.146:0/836733607 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7faa0406ace0 0x7faa0406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.982+0000 7faa167fc700 1 -- 172.21.15.146:0/836733607 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7faa10089540 con 0x7faa200b0e90 2023-05-24T03:30:09.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.982+0000 7faa25e08700 1 --2- 172.21.15.146:0/836733607 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7faa0406ace0 0x7faa0406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.982+0000 7faa167fc700 1 --2- 172.21.15.146:0/836733607 >> [v2:172.21.15.151:6808/563291208,v1:172.21.15.151:6810/563291208] conn(0x7faa040748b0 0x7faa04076ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.982+0000 7faa167fc700 1 -- 172.21.15.146:0/836733607 --> [v2:172.21.15.151:6808/563291208,v1:172.21.15.151:6810/563291208] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faa040773b0 con 0x7faa040748b0 2023-05-24T03:30:09.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.982+0000 7faa167fc700 1 -- 172.21.15.146:0/836733607 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa1008bc00 con 0x7faa200b0e90 2023-05-24T03:30:09.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.983+0000 7faa25e08700 1 --2- 172.21.15.146:0/836733607 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7faa0406ace0 0x7faa0406d190 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7faa1c009c40 tx=0x7faa1c01d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:09.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.983+0000 7faa26609700 1 --2- 172.21.15.146:0/836733607 >> [v2:172.21.15.151:6808/563291208,v1:172.21.15.151:6810/563291208] conn(0x7faa040748b0 0x7faa04076ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.983+0000 7faa26609700 1 --2- 172.21.15.146:0/836733607 >> [v2:172.21.15.151:6808/563291208,v1:172.21.15.151:6810/563291208] conn(0x7faa040748b0 0x7faa04076ce0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:09.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.984+0000 7faa167fc700 1 -- 172.21.15.146:0/836733607 <== osd.7 v2:172.21.15.151:6808/563291208 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7faa040773b0 con 0x7faa040748b0 2023-05-24T03:30:09.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.984+0000 7f1b69e4c700 1 -- 172.21.15.146:0/4186358134 --> [v2:172.21.15.146:6800/3353593100,v1:172.21.15.146:6801/3353593100] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1b642026d0 con 0x7f1b4c074eb0 2023-05-24T03:30:09.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.984+0000 7fb401f58700 1 -- 172.21.15.146:0/269468131 --> [v2:172.21.15.146:6816/1749783580,v1:172.21.15.146:6817/1749783580] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb3fc161310 con 0x7fb3e4074ab0 2023-05-24T03:30:09.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.985+0000 7f1b4bfff700 1 -- 172.21.15.146:0/4186358134 <== osd.0 v2:172.21.15.146:6800/3353593100 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1b58001470 con 0x7f1b4c074eb0 2023-05-24T03:30:09.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.985+0000 7f1b69e4c700 1 -- 172.21.15.146:0/4186358134 >> [v2:172.21.15.146:6800/3353593100,v1:172.21.15.146:6801/3353593100] conn(0x7f1b4c074eb0 msgr2=0x7f1b4c0772e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.985+0000 7f1b69e4c700 1 --2- 172.21.15.146:0/4186358134 >> [v2:172.21.15.146:6800/3353593100,v1:172.21.15.146:6801/3353593100] conn(0x7f1b4c074eb0 0x7f1b4c0772e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.987+0000 7f1b69e4c700 1 -- 172.21.15.146:0/4186358134 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f1b4c06b1e0 msgr2=0x7f1b4c06d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.987+0000 7f1b69e4c700 1 --2- 172.21.15.146:0/4186358134 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f1b4c06b1e0 0x7f1b4c06d690 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1b640b5260 tx=0x7f1b5c009040 comp rx=0 tx=0).stop 2023-05-24T03:30:09.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.987+0000 7f1b69e4c700 1 -- 172.21.15.146:0/4186358134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b64070ec0 msgr2=0x7f1b641fc1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.987+0000 7f1b69e4c700 1 --2- 172.21.15.146:0/4186358134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b64070ec0 0x7f1b641fc1a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1b54000c00 tx=0x7f1b54004750 comp rx=0 tx=0).stop 2023-05-24T03:30:09.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.987+0000 7f1b63fff700 1 -- 172.21.15.146:0/4186358134 reap_dead start 2023-05-24T03:30:09.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.987+0000 7f1b69e4c700 1 -- 172.21.15.146:0/4186358134 shutdown_connections 2023-05-24T03:30:09.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.987+0000 7f1b69e4c700 1 -- 172.21.15.146:0/4186358134 >> 172.21.15.146:0/4186358134 conn(0x7f1b640cf6c0 msgr2=0x7f1b640b17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:09.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.987+0000 7f1b69e4c700 1 -- 172.21.15.146:0/4186358134 shutdown_connections 2023-05-24T03:30:09.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.987+0000 7f1b69e4c700 1 -- 172.21.15.146:0/4186358134 wait complete. 2023-05-24T03:30:09.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.990+0000 7f1c3f593700 1 -- 172.21.15.146:0/2092206228 --> [v2:172.21.15.151:6800/3283474903,v1:172.21.15.151:6801/3283474903] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1c3816c610 con 0x7f1c1c0749d0 2023-05-24T03:30:09.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.991+0000 7f1c2dffb700 1 -- 172.21.15.146:0/2092206228 <== osd.5 v2:172.21.15.151:6800/3283474903 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1c3816c610 con 0x7f1c1c0749d0 2023-05-24T03:30:09.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.994+0000 7f1c3f593700 1 -- 172.21.15.146:0/2092206228 >> [v2:172.21.15.151:6800/3283474903,v1:172.21.15.151:6801/3283474903] conn(0x7f1c1c0749d0 msgr2=0x7f1c1c076e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.994+0000 7f1c3f593700 1 --2- 172.21.15.146:0/2092206228 >> [v2:172.21.15.151:6800/3283474903,v1:172.21.15.151:6801/3283474903] conn(0x7f1c1c0749d0 0x7f1c1c076e00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.994+0000 7f1c3f593700 1 -- 172.21.15.146:0/2092206228 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f1c1c06ad00 msgr2=0x7f1c1c06d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.994+0000 7f1c3f593700 1 --2- 172.21.15.146:0/2092206228 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f1c1c06ad00 0x7f1c1c06d1b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1c380711e0 tx=0x7f1c3000b040 comp rx=0 tx=0).stop 2023-05-24T03:30:09.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.994+0000 7f1c3f593700 1 -- 172.21.15.146:0/2092206228 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c3806da30 msgr2=0x7f1c380c5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.994+0000 7f1c3f593700 1 --2- 172.21.15.146:0/2092206228 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c3806da30 0x7f1c380c5e10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1c28015000 tx=0x7f1c28004750 comp rx=0 tx=0).stop 2023-05-24T03:30:09.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.994+0000 7f1c3db30700 1 -- 172.21.15.146:0/2092206228 reap_dead start 2023-05-24T03:30:09.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.995+0000 7fb3e3fff700 1 -- 172.21.15.146:0/269468131 <== osd.3 v2:172.21.15.146:6816/1749783580 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb3fc161310 con 0x7fb3e4074ab0 2023-05-24T03:30:09.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.996+0000 7fb401f58700 1 -- 172.21.15.146:0/269468131 >> [v2:172.21.15.146:6816/1749783580,v1:172.21.15.146:6817/1749783580] conn(0x7fb3e4074ab0 msgr2=0x7fb3e4076ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.996+0000 7fb401f58700 1 --2- 172.21.15.146:0/269468131 >> [v2:172.21.15.146:6816/1749783580,v1:172.21.15.146:6817/1749783580] conn(0x7fb3e4074ab0 0x7fb3e4076ee0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.996+0000 7fb401f58700 1 -- 172.21.15.146:0/269468131 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fb3e406ae60 msgr2=0x7fb3e406d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.996+0000 7fb401f58700 1 --2- 172.21.15.146:0/269468131 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fb3e406ae60 0x7fb3e406d310 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb3f4011340 tx=0x7fb3f400b040 comp rx=0 tx=0).stop 2023-05-24T03:30:09.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.996+0000 7fb401f58700 1 -- 172.21.15.146:0/269468131 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb3fc0c1c70 msgr2=0x7fb3fc0c6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.996+0000 7fb401f58700 1 --2- 172.21.15.146:0/269468131 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb3fc0c1c70 0x7fb3fc0c6d30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec013000 tx=0x7fb3ec004750 comp rx=0 tx=0).stop 2023-05-24T03:30:09.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.996+0000 7fb3fbfff700 1 -- 172.21.15.146:0/269468131 reap_dead start 2023-05-24T03:30:09.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.996+0000 7fb401f58700 1 -- 172.21.15.146:0/269468131 shutdown_connections 2023-05-24T03:30:09.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.996+0000 7fb401f58700 1 -- 172.21.15.146:0/269468131 >> 172.21.15.146:0/269468131 conn(0x7fb3fc06b0b0 msgr2=0x7fb3fc0b0210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:09.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.997+0000 7fb401f58700 1 -- 172.21.15.146:0/269468131 shutdown_connections 2023-05-24T03:30:09.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.997+0000 7fb401f58700 1 -- 172.21.15.146:0/269468131 wait complete. 2023-05-24T03:30:09.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.998+0000 7f1c3f593700 1 -- 172.21.15.146:0/2092206228 shutdown_connections 2023-05-24T03:30:09.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.998+0000 7f1c3f593700 1 -- 172.21.15.146:0/2092206228 >> 172.21.15.146:0/2092206228 conn(0x7f1c380cedd0 msgr2=0x7f1c3816bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:09.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.998+0000 7f38bfabb700 1 -- 172.21.15.146:0/2838482382 --> [v2:172.21.15.146:6808/1800242932,v1:172.21.15.146:6809/1800242932] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f38b81f6d10 con 0x7f38a4074a30 2023-05-24T03:30:09.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.998+0000 7f8298479700 1 -- 172.21.15.146:0/1541677997 --> [v2:172.21.15.151:6809/163453435,v1:172.21.15.151:6811/163453435] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f829004e810 con 0x7f82900c73e0 2023-05-24T03:30:09.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.999+0000 7f38ae7fc700 1 -- 172.21.15.146:0/2838482382 <== osd.2 v2:172.21.15.146:6808/1800242932 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f38b81f6d10 con 0x7f38a4074a30 2023-05-24T03:30:09.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:08.999+0000 7f8286ffd700 1 -- 172.21.15.146:0/1541677997 <== osd.4 v2:172.21.15.151:6809/163453435 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f829004e810 con 0x7f82900c73e0 2023-05-24T03:30:09.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.000+0000 7f38bfabb700 1 -- 172.21.15.146:0/2838482382 >> [v2:172.21.15.146:6808/1800242932,v1:172.21.15.146:6809/1800242932] conn(0x7f38a4074a30 msgr2=0x7f38a4076e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.000+0000 7f38bfabb700 1 --2- 172.21.15.146:0/2838482382 >> [v2:172.21.15.146:6808/1800242932,v1:172.21.15.146:6809/1800242932] conn(0x7f38a4074a30 0x7f38a4076e60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.001+0000 7f8298479700 1 -- 172.21.15.146:0/1541677997 >> [v2:172.21.15.151:6809/163453435,v1:172.21.15.151:6811/163453435] conn(0x7f82900c73e0 msgr2=0x7f8290200f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.001+0000 7f8298479700 1 --2- 172.21.15.146:0/1541677997 >> [v2:172.21.15.151:6809/163453435,v1:172.21.15.151:6811/163453435] conn(0x7f82900c73e0 0x7f8290200f70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.003+0000 7f38bfabb700 1 -- 172.21.15.146:0/2838482382 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f38a406ae60 msgr2=0x7f38a406d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.003+0000 7f38bfabb700 1 --2- 172.21.15.146:0/2838482382 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f38a406ae60 0x7f38a406d310 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f38a800be30 tx=0x7f38a8013000 comp rx=0 tx=0).stop 2023-05-24T03:30:09.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.003+0000 7f38bfabb700 1 -- 172.21.15.146:0/2838482382 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38b80caeb0 msgr2=0x7f38b80c4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.003+0000 7f38bfabb700 1 --2- 172.21.15.146:0/2838482382 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38b80caeb0 0x7f38b80c4940 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f38b400c4d0 tx=0x7f38b400c7e0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.003+0000 7f38be058700 1 -- 172.21.15.146:0/2838482382 reap_dead start 2023-05-24T03:30:09.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.003+0000 7f8298479700 1 -- 172.21.15.146:0/1541677997 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f827406ad30 msgr2=0x7f827406d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.003+0000 7f8298479700 1 --2- 172.21.15.146:0/1541677997 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f827406ad30 0x7f827406d1e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8290158400 tx=0x7f828c009110 comp rx=0 tx=0).stop 2023-05-24T03:30:09.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.003+0000 7f8298479700 1 -- 172.21.15.146:0/1541677997 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f829006df70 msgr2=0x7f82900cbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.003+0000 7f8298479700 1 --2- 172.21.15.146:0/1541677997 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f829006df70 0x7f82900cbf40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f828000c7f0 tx=0x7f828000cb00 comp rx=0 tx=0).stop 2023-05-24T03:30:09.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.003+0000 7f8296a16700 1 -- 172.21.15.146:0/1541677997 reap_dead start 2023-05-24T03:30:09.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.003+0000 7fdc60d7e700 1 -- 172.21.15.146:0/3290849352 --> [v2:172.21.15.151:6824/3889424178,v1:172.21.15.151:6825/3889424178] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdc5c0b51c0 con 0x7fdc5c0c7b30 2023-05-24T03:30:09.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.003+0000 7f8298479700 1 -- 172.21.15.146:0/1541677997 shutdown_connections 2023-05-24T03:30:09.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.003+0000 7f8298479700 1 -- 172.21.15.146:0/1541677997 >> 172.21.15.146:0/1541677997 conn(0x7f82900cedd0 msgr2=0x7f82900cf1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:09.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.003+0000 7f8298479700 1 -- 172.21.15.146:0/1541677997 shutdown_connections 2023-05-24T03:30:09.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.003+0000 7f8298479700 1 -- 172.21.15.146:0/1541677997 wait complete. 2023-05-24T03:30:09.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.004+0000 7f1c3f593700 1 -- 172.21.15.146:0/2092206228 shutdown_connections 2023-05-24T03:30:09.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.004+0000 7f1c3f593700 1 -- 172.21.15.146:0/2092206228 wait complete. 2023-05-24T03:30:09.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.004+0000 7fdc4affd700 1 -- 172.21.15.146:0/3290849352 <== osd.6 v2:172.21.15.151:6824/3889424178 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdc5c0b51c0 con 0x7fdc5c0c7b30 2023-05-24T03:30:09.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.004+0000 7f38bfabb700 1 -- 172.21.15.146:0/2838482382 shutdown_connections 2023-05-24T03:30:09.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.004+0000 7f38bfabb700 1 -- 172.21.15.146:0/2838482382 >> 172.21.15.146:0/2838482382 conn(0x7f38b80cf6c0 msgr2=0x7f38b8158a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:09.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.004+0000 7f38bfabb700 1 -- 172.21.15.146:0/2838482382 shutdown_connections 2023-05-24T03:30:09.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.004+0000 7f38bfabb700 1 -- 172.21.15.146:0/2838482382 wait complete. 2023-05-24T03:30:09.054 INFO:teuthology.orchestra.run.smithi146.stdout:55834574859 2023-05-24T03:30:09.055 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-05-24T03:30:09.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.006+0000 7fdc60d7e700 1 -- 172.21.15.146:0/3290849352 >> [v2:172.21.15.151:6824/3889424178,v1:172.21.15.151:6825/3889424178] conn(0x7fdc5c0c7b30 msgr2=0x7fdc5c0c2d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.006+0000 7fdc60d7e700 1 --2- 172.21.15.146:0/3290849352 >> [v2:172.21.15.151:6824/3889424178,v1:172.21.15.151:6825/3889424178] conn(0x7fdc5c0c7b30 0x7fdc5c0c2d40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.006+0000 7fdc60d7e700 1 -- 172.21.15.146:0/3290849352 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fdc3c06ad30 msgr2=0x7fdc3c06d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.006+0000 7fdc60d7e700 1 --2- 172.21.15.146:0/3290849352 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fdc3c06ad30 0x7fdc3c06d1e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c0aeb70 tx=0x7fdc540073e0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.006+0000 7fdc60d7e700 1 -- 172.21.15.146:0/3290849352 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc5c0cc330 msgr2=0x7fdc5c0c8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.006+0000 7fdc60d7e700 1 --2- 172.21.15.146:0/3290849352 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc5c0cc330 0x7fdc5c0c8680 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c001ab0 tx=0x7fdc4c001e70 comp rx=0 tx=0).stop 2023-05-24T03:30:09.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.006+0000 7fdc5ad9d700 1 -- 172.21.15.146:0/3290849352 reap_dead start 2023-05-24T03:30:09.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.006+0000 7fdc60d7e700 1 -- 172.21.15.146:0/3290849352 shutdown_connections 2023-05-24T03:30:09.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.006+0000 7fdc60d7e700 1 -- 172.21.15.146:0/3290849352 >> 172.21.15.146:0/3290849352 conn(0x7fdc5c0b0d90 msgr2=0x7fdc5c0ccdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:09.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.006+0000 7fdc60d7e700 1 -- 172.21.15.146:0/3290849352 shutdown_connections 2023-05-24T03:30:09.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.007+0000 7fdc60d7e700 1 -- 172.21.15.146:0/3290849352 wait complete. 2023-05-24T03:30:09.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.013+0000 7faa2806c700 1 -- 172.21.15.146:0/836733607 --> [v2:172.21.15.151:6808/563291208,v1:172.21.15.151:6810/563291208] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7faa200c8390 con 0x7faa040748b0 2023-05-24T03:30:09.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.014+0000 7faa167fc700 1 -- 172.21.15.146:0/836733607 <== osd.7 v2:172.21.15.151:6808/563291208 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7faa200c8390 con 0x7faa040748b0 2023-05-24T03:30:09.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.015+0000 7faa2806c700 1 -- 172.21.15.146:0/836733607 >> [v2:172.21.15.151:6808/563291208,v1:172.21.15.151:6810/563291208] conn(0x7faa040748b0 msgr2=0x7faa04076ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.015+0000 7faa2806c700 1 --2- 172.21.15.146:0/836733607 >> [v2:172.21.15.151:6808/563291208,v1:172.21.15.151:6810/563291208] conn(0x7faa040748b0 0x7faa04076ce0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.015+0000 7faa2806c700 1 -- 172.21.15.146:0/836733607 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7faa0406ace0 msgr2=0x7faa0406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.015+0000 7faa2806c700 1 --2- 172.21.15.146:0/836733607 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7faa0406ace0 0x7faa0406d190 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7faa1c009c40 tx=0x7faa1c01d040 comp rx=0 tx=0).stop 2023-05-24T03:30:09.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.015+0000 7faa2806c700 1 -- 172.21.15.146:0/836733607 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa200b0e90 msgr2=0x7faa20148ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.015+0000 7faa2806c700 1 --2- 172.21.15.146:0/836733607 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa200b0e90 0x7faa20148ff0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7faa1000e810 tx=0x7faa1000eb20 comp rx=0 tx=0).stop 2023-05-24T03:30:09.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.015+0000 7faa26609700 1 -- 172.21.15.146:0/836733607 reap_dead start 2023-05-24T03:30:09.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.015+0000 7faa2806c700 1 -- 172.21.15.146:0/836733607 shutdown_connections 2023-05-24T03:30:09.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.015+0000 7faa2806c700 1 -- 172.21.15.146:0/836733607 >> 172.21.15.146:0/836733607 conn(0x7faa2006b0b0 msgr2=0x7faa20151e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:09.060 INFO:teuthology.orchestra.run.smithi146.stdout:55834574859 2023-05-24T03:30:09.061 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-05-24T03:30:09.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.016+0000 7faa2806c700 1 -- 172.21.15.146:0/836733607 shutdown_connections 2023-05-24T03:30:09.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.016+0000 7faa2806c700 1 -- 172.21.15.146:0/836733607 wait complete. 2023-05-24T03:30:09.062 INFO:teuthology.orchestra.run.smithi146.stdout:55834574858 2023-05-24T03:30:09.062 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-05-24T03:30:09.063 INFO:teuthology.orchestra.run.smithi146.stdout:55834574859 2023-05-24T03:30:09.063 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-05-24T03:30:09.064 INFO:teuthology.orchestra.run.smithi146.stdout:55834574859 2023-05-24T03:30:09.064 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-05-24T03:30:09.065 INFO:teuthology.orchestra.run.smithi146.stdout:55834574858 2023-05-24T03:30:09.065 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-05-24T03:30:09.066 INFO:teuthology.orchestra.run.smithi146.stdout:55834574859 2023-05-24T03:30:09.066 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-05-24T03:30:09.067 INFO:teuthology.orchestra.run.smithi146.stdout:55834574859 2023-05-24T03:30:09.068 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-05-24T03:30:09.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.281+0000 7f6fa2a9f700 1 Processor -- start 2023-05-24T03:30:09.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.281+0000 7f6fa2a9f700 1 -- start start 2023-05-24T03:30:09.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.282+0000 7f6fa2a9f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6f9c071670 0x7f6f9c06da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.282+0000 7f6fa2a9f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f9c0b0fd0 0x7f6f9c1529c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.282+0000 7f6fa2a9f700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f9c06e3c0 con 0x7f6f9c06df70 2023-05-24T03:30:09.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.282+0000 7f6fa2a9f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f9c15d840 con 0x7f6f9c071670 2023-05-24T03:30:09.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.282+0000 7f6fa2a9f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9c0b1410 con 0x7f6f9c0b0fd0 2023-05-24T03:30:09.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.283+0000 7f6f9bfff700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f6f9c06df70 0x7f6f9c0b08c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:44878/0 (socket says 172.21.15.146:44878) 2023-05-24T03:30:09.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.283+0000 7f6f9bfff700 1 -- 172.21.15.146:0/1649593756 learned_addr learned my addr 172.21.15.146:0/1649593756 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:30:09.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.283+0000 7f6fa083b700 1 --2- 172.21.15.146:0/1649593756 >> v2:172.21.15.146:3300/0 conn(0x7f6f9c071670 0x7f6f9c06da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.284+0000 7f6fa083b700 1 -- 172.21.15.146:0/1649593756 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f9c0b0fd0 msgr2=0x7f6f9c1529c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:09.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.284+0000 7f6fa083b700 1 --2- 172.21.15.146:0/1649593756 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f9c0b0fd0 0x7f6f9c1529c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.284+0000 7f6fa083b700 1 -- 172.21.15.146:0/1649593756 >> v1:172.21.15.151:6789/0 conn(0x7f6f9c06df70 legacy=0x7f6f9c0b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.284+0000 7f6fa083b700 1 -- 172.21.15.146:0/1649593756 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f9c159c80 con 0x7f6f9c071670 2023-05-24T03:30:09.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.284+0000 7f6fa083b700 1 --2- 172.21.15.146:0/1649593756 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f9c071670 0x7f6f9c06da30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c009870 tx=0x7f6f8c009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=573438096dc66f4b server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:09.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.285+0000 7f6f9b7fe700 1 -- 172.21.15.146:0/1649593756 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c004230 con 0x7f6f9c071670 2023-05-24T03:30:09.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.285+0000 7f6f9b7fe700 1 -- 172.21.15.146:0/1649593756 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f8c004390 con 0x7f6f9c071670 2023-05-24T03:30:09.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.285+0000 7f6f9b7fe700 1 -- 172.21.15.146:0/1649593756 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c0036a0 con 0x7f6f9c071670 2023-05-24T03:30:09.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.286+0000 7f6fa2a9f700 1 -- 172.21.15.146:0/1649593756 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f9c071670 msgr2=0x7f6f9c06da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.286+0000 7f6fa2a9f700 1 --2- 172.21.15.146:0/1649593756 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f9c071670 0x7f6f9c06da30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c009870 tx=0x7f6f8c009b80 comp rx=0 tx=0).stop 2023-05-24T03:30:09.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.286+0000 7f6fa2a9f700 1 -- 172.21.15.146:0/1649593756 shutdown_connections 2023-05-24T03:30:09.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.286+0000 7f6fa2a9f700 1 --2- 172.21.15.146:0/1649593756 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f9c0b0fd0 0x7f6f9c1529c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.286+0000 7f6fa2a9f700 1 --2- 172.21.15.146:0/1649593756 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f9c071670 0x7f6f9c06da30 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.286+0000 7f6fa2a9f700 1 -- 172.21.15.146:0/1649593756 >> 172.21.15.146:0/1649593756 conn(0x7f6f9c0cedd0 msgr2=0x7f6f9c0cf1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:09.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.287+0000 7f6fa2a9f700 1 -- 172.21.15.146:0/1649593756 shutdown_connections 2023-05-24T03:30:09.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.287+0000 7f6fa2a9f700 1 -- 172.21.15.146:0/1649593756 wait complete. 2023-05-24T03:30:09.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.289+0000 7f6fa2a9f700 1 Processor -- start 2023-05-24T03:30:09.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.289+0000 7f6fa2a9f700 1 -- start start 2023-05-24T03:30:09.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.290+0000 7f6fa2a9f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f9c06df70 0x7f6f9c1fed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.290+0000 7f6fa2a9f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f9c071670 0x7f6f9c0c4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.290+0000 7f6fa2a9f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f9c0b0fd0 0x7f6f9c200420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.291+0000 7f6fa2a9f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9c0b1c00 con 0x7f6f9c06df70 2023-05-24T03:30:09.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.291+0000 7f6fa2a9f700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9c0c54c0 con 0x7f6f9c0b0fd0 2023-05-24T03:30:09.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.291+0000 7f6fa2a9f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9c0b1e50 con 0x7f6f9c071670 2023-05-24T03:30:09.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.291+0000 7f6fa103c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f9c0b0fd0 0x7f6f9c200420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.291+0000 7f6f9bfff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f9c071670 0x7f6f9c0c4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.291+0000 7f6fa103c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f9c0b0fd0 0x7f6f9c200420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:50584/0 (socket says 172.21.15.146:50584) 2023-05-24T03:30:09.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.291+0000 7f6fa103c700 1 -- 172.21.15.146:0/2012711458 learned_addr learned my addr 172.21.15.146:0/2012711458 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:09.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.291+0000 7f6fa103c700 1 -- 172.21.15.146:0/2012711458 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f9c071670 msgr2=0x7f6f9c0c4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.291+0000 7f6fa103c700 1 --2- 172.21.15.146:0/2012711458 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f9c071670 0x7f6f9c0c4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.291+0000 7f6fa103c700 1 -- 172.21.15.146:0/2012711458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f9c06df70 msgr2=0x7f6f9c1fed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.291+0000 7f6fa103c700 1 --2- 172.21.15.146:0/2012711458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f9c06df70 0x7f6f9c1fed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.291+0000 7f6fa103c700 1 -- 172.21.15.146:0/2012711458 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f8c0094a0 con 0x7f6f9c0b0fd0 2023-05-24T03:30:09.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.291+0000 7f6f9bfff700 1 --2- 172.21.15.146:0/2012711458 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f9c071670 0x7f6f9c0c4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T03:30:09.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.292+0000 7f6fa103c700 1 --2- 172.21.15.146:0/2012711458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f9c0b0fd0 0x7f6f9c200420 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6f9000b550 tx=0x7f6f9000b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:09.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.296+0000 7f6f997fa700 1 -- 172.21.15.146:0/2012711458 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f90011830 con 0x7f6f9c0b0fd0 2023-05-24T03:30:09.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.296+0000 7f6f997fa700 1 -- 172.21.15.146:0/2012711458 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f90011990 con 0x7f6f9c0b0fd0 2023-05-24T03:30:09.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.296+0000 7f6f997fa700 1 -- 172.21.15.146:0/2012711458 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f90011d40 con 0x7f6f9c0b0fd0 2023-05-24T03:30:09.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.296+0000 7f6fa2a9f700 1 -- 172.21.15.146:0/2012711458 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f9c159630 con 0x7f6f9c0b0fd0 2023-05-24T03:30:09.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.296+0000 7f6fa2a9f700 1 -- 172.21.15.146:0/2012711458 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f9c159350 con 0x7f6f9c0b0fd0 2023-05-24T03:30:09.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.300+0000 7f2dd8361700 1 Processor -- start 2023-05-24T03:30:09.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.301+0000 7f2dd8361700 1 -- start start 2023-05-24T03:30:09.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.299+0000 7f6fa2a9f700 1 -- 172.21.15.146:0/2012711458 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f9c159910 con 0x7f6f9c0b0fd0 2023-05-24T03:30:09.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.301+0000 7f6f997fa700 1 -- 172.21.15.146:0/2012711458 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6f9001a400 con 0x7f6f9c0b0fd0 2023-05-24T03:30:09.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.302+0000 7f6f997fa700 1 --2- 172.21.15.146:0/2012711458 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f6f8006ad00 0x7f6f8006d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.302+0000 7f6f997fa700 1 -- 172.21.15.146:0/2012711458 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6f90089640 con 0x7f6f9c0b0fd0 2023-05-24T03:30:09.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.303+0000 7f9279435700 1 Processor -- start 2023-05-24T03:30:09.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.302+0000 7f2dd8361700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2dd00cc500 0x7f2dd0071720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.302+0000 7f2dd8361700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2dd0071c60 0x7f2dd006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.302+0000 7f2dd8361700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dd00cb740 con 0x7f2dd015a9c0 2023-05-24T03:30:09.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.302+0000 7f2dd8361700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dd0072100 con 0x7f2dd00cc500 2023-05-24T03:30:09.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.302+0000 7f2dd8361700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd00cba20 con 0x7f2dd0071c60 2023-05-24T03:30:09.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.303+0000 7f2dd60fd700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f2dd015a9c0 0x7f2dd00b52e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:44890/0 (socket says 172.21.15.146:44890) 2023-05-24T03:30:09.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.303+0000 7f2dd60fd700 1 -- 172.21.15.146:0/2561666244 learned_addr learned my addr 172.21.15.146:0/2561666244 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:30:09.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.303+0000 7f2dd58fc700 1 --2- 172.21.15.146:0/2561666244 >> v2:172.21.15.146:3300/0 conn(0x7f2dd00cc500 0x7f2dd0071720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.305+0000 7f2dd68fe700 1 --2- 172.21.15.146:0/2561666244 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2dd0071c60 0x7f2dd006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.305+0000 7f6fa083b700 1 --2- 172.21.15.146:0/2012711458 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f6f8006ad00 0x7f6f8006d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.304+0000 7f9279435700 1 -- start start 2023-05-24T03:30:09.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.305+0000 7f9279435700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9274071670 0x7f927406da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.305+0000 7f9279435700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f92740b0fd0 0x7f92741529c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.305+0000 7f9279435700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9274159c80 con 0x7f927406df70 2023-05-24T03:30:09.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.305+0000 7f9279435700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f927415d840 con 0x7f92740b0fd0 2023-05-24T03:30:09.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.305+0000 7f9279435700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92740b1430 con 0x7f9274071670 2023-05-24T03:30:09.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.305+0000 7f92727fc700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f927406df70 0x7f92740b08c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:44898/0 (socket says 172.21.15.146:44898) 2023-05-24T03:30:09.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.305+0000 7f92727fc700 1 -- 172.21.15.146:0/2537044314 learned_addr learned my addr 172.21.15.146:0/2537044314 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:30:09.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.305+0000 7f9272ffd700 1 --2- 172.21.15.146:0/2537044314 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9274071670 0x7f927406da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.305+0000 7f9272ffd700 1 -- 172.21.15.146:0/2537044314 >> v2:172.21.15.146:3300/0 conn(0x7f92740b0fd0 msgr2=0x7f92741529c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:09.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.305+0000 7f9272ffd700 1 --2- 172.21.15.146:0/2537044314 >> v2:172.21.15.146:3300/0 conn(0x7f92740b0fd0 0x7f92741529c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.305+0000 7f9272ffd700 1 -- 172.21.15.146:0/2537044314 >> v1:172.21.15.151:6789/0 conn(0x7f927406df70 legacy=0x7f92740b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.305+0000 7f9272ffd700 1 -- 172.21.15.146:0/2537044314 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9274159350 con 0x7f9274071670 2023-05-24T03:30:09.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.306+0000 7f6fa083b700 1 --2- 172.21.15.146:0/2012711458 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f6f8006ad00 0x7f6f8006d1b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c0acc20 tx=0x7f6f8c011000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:09.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.306+0000 7f2dd68fe700 1 -- 172.21.15.146:0/2561666244 >> v2:172.21.15.146:3300/0 conn(0x7f2dd00cc500 msgr2=0x7f2dd0071720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:09.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.306+0000 7f2dd68fe700 1 --2- 172.21.15.146:0/2561666244 >> v2:172.21.15.146:3300/0 conn(0x7f2dd00cc500 0x7f2dd0071720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.306+0000 7f2dd68fe700 1 -- 172.21.15.146:0/2561666244 >> v1:172.21.15.151:6789/0 conn(0x7f2dd015a9c0 legacy=0x7f2dd00b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.306+0000 7f2dd68fe700 1 -- 172.21.15.146:0/2561666244 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd00cbd00 con 0x7f2dd0071c60 2023-05-24T03:30:09.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.306+0000 7f9272ffd700 1 --2- 172.21.15.146:0/2537044314 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9274071670 0x7f927406da30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f926400ca00 tx=0x7f926400cd10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d70cb1d2a8adcd12 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:09.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.306+0000 7f9271ffb700 1 -- 172.21.15.146:0/2537044314 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9264011070 con 0x7f9274071670 2023-05-24T03:30:09.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.307+0000 7f2dd68fe700 1 --2- 172.21.15.146:0/2561666244 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2dd0071c60 0x7f2dd006d0f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2dc8009840 tx=0x7f2dc8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b57bf7b6e5a3bf5 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:09.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.307+0000 7fc3d000c700 1 Processor -- start 2023-05-24T03:30:09.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.306+0000 7f9271ffb700 1 -- 172.21.15.146:0/2537044314 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f926400ce30 con 0x7f9274071670 2023-05-24T03:30:09.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.306+0000 7f9271ffb700 1 -- 172.21.15.146:0/2537044314 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9264007c80 con 0x7f9274071670 2023-05-24T03:30:09.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.307+0000 7f9279435700 1 -- 172.21.15.146:0/2537044314 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9274071670 msgr2=0x7f927406da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.307+0000 7f9279435700 1 --2- 172.21.15.146:0/2537044314 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9274071670 0x7f927406da30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f926400ca00 tx=0x7f926400cd10 comp rx=0 tx=0).stop 2023-05-24T03:30:09.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.307+0000 7f6f997fa700 1 -- 172.21.15.146:0/2012711458 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f6f900544f0 con 0x7f6f9c0b0fd0 2023-05-24T03:30:09.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.307+0000 7f9279435700 1 -- 172.21.15.146:0/2537044314 shutdown_connections 2023-05-24T03:30:09.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.307+0000 7f9279435700 1 --2- 172.21.15.146:0/2537044314 >> v2:172.21.15.146:3300/0 conn(0x7f92740b0fd0 0x7f92741529c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.307+0000 7f9279435700 1 --2- 172.21.15.146:0/2537044314 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9274071670 0x7f927406da30 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.307+0000 7f9279435700 1 -- 172.21.15.146:0/2537044314 >> 172.21.15.146:0/2537044314 conn(0x7f92740cedd0 msgr2=0x7f92740cf1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:09.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.307+0000 7f2dd50fb700 1 -- 172.21.15.146:0/2561666244 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc8011830 con 0x7f2dd0071c60 2023-05-24T03:30:09.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.307+0000 7f2dd50fb700 1 -- 172.21.15.146:0/2561666244 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dc8011990 con 0x7f2dd0071c60 2023-05-24T03:30:09.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.307+0000 7f2dd50fb700 1 -- 172.21.15.146:0/2561666244 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc8011d20 con 0x7f2dd0071c60 2023-05-24T03:30:09.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.307+0000 7f9279435700 1 -- 172.21.15.146:0/2537044314 shutdown_connections 2023-05-24T03:30:09.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.307+0000 7f9279435700 1 -- 172.21.15.146:0/2537044314 wait complete. 2023-05-24T03:30:09.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.308+0000 7f2dd8361700 1 -- 172.21.15.146:0/2561666244 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2dd0071c60 msgr2=0x7f2dd006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.308+0000 7f2dd8361700 1 --2- 172.21.15.146:0/2561666244 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2dd0071c60 0x7f2dd006d0f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2dc8009840 tx=0x7f2dc8009b50 comp rx=0 tx=0).stop 2023-05-24T03:30:09.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.309+0000 7f2dd8361700 1 -- 172.21.15.146:0/2561666244 shutdown_connections 2023-05-24T03:30:09.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.309+0000 7f2dd8361700 1 --2- 172.21.15.146:0/2561666244 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2dd0071c60 0x7f2dd006d0f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.309+0000 7f2dd8361700 1 --2- 172.21.15.146:0/2561666244 >> v2:172.21.15.146:3300/0 conn(0x7f2dd00cc500 0x7f2dd0071720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.309+0000 7f2dd8361700 1 -- 172.21.15.146:0/2561666244 >> 172.21.15.146:0/2561666244 conn(0x7f2dd00cfea0 msgr2=0x7f2dd00d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:09.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.307+0000 7fc3d000c700 1 -- start start 2023-05-24T03:30:09.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.309+0000 7fc3d000c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc3c80b67d0 0x7fc3c80b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.309+0000 7fc3d000c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3c80b5b90 con 0x7fc3c815cb50 2023-05-24T03:30:09.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.309+0000 7fc3d000c700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3c815cf20 con 0x7fc3c80d2da0 2023-05-24T03:30:09.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.309+0000 7fc3d000c700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3c80cd960 con 0x7fc3c80b67d0 2023-05-24T03:30:09.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.309+0000 7fc3cdda8700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc3c815cb50 0x7fc3c80d1e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45870/0 (socket says 172.21.15.146:45870) 2023-05-24T03:30:09.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.309+0000 7fc3cdda8700 1 -- 172.21.15.146:0/1445064331 learned_addr learned my addr 172.21.15.146:0/1445064331 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:30:09.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.309+0000 7f2dd8361700 1 -- 172.21.15.146:0/2561666244 shutdown_connections 2023-05-24T03:30:09.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.309+0000 7f2dd8361700 1 -- 172.21.15.146:0/2561666244 wait complete. 2023-05-24T03:30:09.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.309+0000 7fc3ce5a9700 1 --2- 172.21.15.146:0/1445064331 >> v2:172.21.15.151:3300/0 conn(0x7fc3c80b67d0 0x7fc3c80b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.309+0000 7fc3ccda6700 1 -- 172.21.15.146:0/1445064331 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1003849108 0 0) 0x7fc3c80b5b90 con 0x7fc3c815cb50 2023-05-24T03:30:09.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.309+0000 7f9279435700 1 Processor -- start 2023-05-24T03:30:09.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.309+0000 7fc3ccda6700 1 -- 172.21.15.146:0/1445064331 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3b40035b0 con 0x7fc3c815cb50 2023-05-24T03:30:09.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.310+0000 7fc3ccda6700 1 -- 172.21.15.146:0/1445064331 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1119434965 0 0) 0x7fc3c815cf20 con 0x7fc3c80d2da0 2023-05-24T03:30:09.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.310+0000 7fc3ccda6700 1 -- 172.21.15.146:0/1445064331 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3c80b5b90 con 0x7fc3c80d2da0 2023-05-24T03:30:09.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.310+0000 7fc3ce5a9700 1 -- 172.21.15.146:0/1445064331 >> v1:172.21.15.151:6789/0 conn(0x7fc3c80d2da0 legacy=0x7fc3c80b60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.310+0000 7fc3ce5a9700 1 -- 172.21.15.146:0/1445064331 >> v1:172.21.15.146:6789/0 conn(0x7fc3c815cb50 legacy=0x7fc3c80d1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.310+0000 7fc3ce5a9700 1 -- 172.21.15.146:0/1445064331 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c80cdc40 con 0x7fc3c80b67d0 2023-05-24T03:30:09.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.310+0000 7fc3ce5a9700 1 --2- 172.21.15.146:0/1445064331 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3c80b67d0 0x7fc3c80b4cf0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0009d90 tx=0x7fc3c000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93be56ed1b82ca99 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:09.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.310+0000 7efd6c872700 1 Processor -- start 2023-05-24T03:30:09.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.311+0000 7f2dd8361700 1 Processor -- start 2023-05-24T03:30:09.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.309+0000 7f9279435700 1 -- start start 2023-05-24T03:30:09.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.311+0000 7f9279435700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f927406df70 0x7f9274146c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.311+0000 7f9279435700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9274071670 0x7f92740af760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.311+0000 7f9279435700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92740b0fd0 0x7f92740afca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.311+0000 7f9279435700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9274145020 con 0x7f927406df70 2023-05-24T03:30:09.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.311+0000 7f9279435700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9274147580 con 0x7f92740b0fd0 2023-05-24T03:30:09.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.311+0000 7f9279435700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9274147860 con 0x7f9274071670 2023-05-24T03:30:09.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.311+0000 7f9272ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f927406df70 0x7f9274146c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.311+0000 7f92727fc700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9274071670 0x7f92740af760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.311+0000 7f9272ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f927406df70 0x7f9274146c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39424/0 (socket says 172.21.15.146:39424) 2023-05-24T03:30:09.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.311+0000 7f9272ffd700 1 -- 172.21.15.146:0/77805668 learned_addr learned my addr 172.21.15.146:0/77805668 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:09.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.311+0000 7f92737fe700 1 --2- 172.21.15.146:0/77805668 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92740b0fd0 0x7f92740afca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.311+0000 7f92727fc700 1 -- 172.21.15.146:0/77805668 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92740b0fd0 msgr2=0x7f92740afca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.311+0000 7f92727fc700 1 --2- 172.21.15.146:0/77805668 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92740b0fd0 0x7f92740afca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.311+0000 7f92727fc700 1 -- 172.21.15.146:0/77805668 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f927406df70 msgr2=0x7f9274146c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.311+0000 7f92727fc700 1 --2- 172.21.15.146:0/77805668 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f927406df70 0x7f9274146c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.311+0000 7f92727fc700 1 -- 172.21.15.146:0/77805668 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f926400c6e0 con 0x7f9274071670 2023-05-24T03:30:09.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.312+0000 7f92727fc700 1 --2- 172.21.15.146:0/77805668 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9274071670 0x7f92740af760 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f926800c3c0 tx=0x7f926800c6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:09.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.310+0000 7efd6c872700 1 -- start start 2023-05-24T03:30:09.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.312+0000 7efd6c872700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7efd68160f40 0x7efd6806fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.312+0000 7efd6c872700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd68161310 con 0x7efd680b0a80 2023-05-24T03:30:09.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.312+0000 7efd6c872700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd680cb680 con 0x7efd680c2380 2023-05-24T03:30:09.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.312+0000 7efd6c872700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd680cab00 con 0x7efd68160f40 2023-05-24T03:30:09.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.312+0000 7efd65d9b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7efd680b0a80 0x7efd680c1c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45884/0 (socket says 172.21.15.146:45884) 2023-05-24T03:30:09.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.312+0000 7efd65d9b700 1 -- 172.21.15.146:0/1910855463 learned_addr learned my addr 172.21.15.146:0/1910855463 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:30:09.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.313+0000 7efd6559a700 1 -- 172.21.15.146:0/1910855463 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2170927701 0 0) 0x7efd680cb680 con 0x7efd680c2380 2023-05-24T03:30:09.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.313+0000 7efd6559a700 1 -- 172.21.15.146:0/1910855463 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd500035b0 con 0x7efd680c2380 2023-05-24T03:30:09.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.313+0000 7efd6559a700 1 -- 172.21.15.146:0/1910855463 <== mon.1 v1:172.21.15.151:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4083769914 0 0) 0x7efd500035b0 con 0x7efd680c2380 2023-05-24T03:30:09.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.313+0000 7efd6559a700 1 -- 172.21.15.146:0/1910855463 >> v2:172.21.15.151:3300/0 conn(0x7efd68160f40 msgr2=0x7efd6806fe00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-05-24T03:30:09.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.313+0000 7efd6559a700 1 --2- 172.21.15.146:0/1910855463 >> v2:172.21.15.151:3300/0 conn(0x7efd68160f40 0x7efd6806fe00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.313+0000 7efd6559a700 1 -- 172.21.15.146:0/1910855463 >> v1:172.21.15.146:6789/0 conn(0x7efd680b0a80 legacy=0x7efd680c1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.313+0000 7efd6559a700 1 -- 172.21.15.146:0/1910855463 --> v1:172.21.15.151:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd680cade0 con 0x7efd680c2380 2023-05-24T03:30:09.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.313+0000 7efd6559a700 1 -- 172.21.15.146:0/1910855463 <== mon.1 v1:172.21.15.151:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1301887351 0 0) 0x7efd58001670 con 0x7efd680c2380 2023-05-24T03:30:09.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.313+0000 7efd6559a700 1 -- 172.21.15.146:0/1910855463 >> v1:172.21.15.151:6789/0 conn(0x7efd680c2380 legacy=0x7efd680ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.313+0000 7efd6559a700 1 --2- 172.21.15.146:0/1910855463 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd50003a00 0x7efd50003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.313+0000 7efd6559a700 1 --2- 172.21.15.146:0/1910855463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd50004850 0x7efd50004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.313+0000 7efd6559a700 1 --2- 172.21.15.146:0/1910855463 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd500052d0 0x7efd5000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.313+0000 7efd6559a700 1 -- 172.21.15.146:0/1910855463 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd680cab00 con 0x7efd50004850 2023-05-24T03:30:09.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.313+0000 7efd6559a700 1 -- 172.21.15.146:0/1910855463 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5000c200 con 0x7efd50003a00 2023-05-24T03:30:09.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.313+0000 7efd6559a700 1 -- 172.21.15.146:0/1910855463 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd5000c3c0 con 0x7efd500052d0 2023-05-24T03:30:09.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.313+0000 7efd66d9d700 1 --2- 172.21.15.146:0/1910855463 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd500052d0 0x7efd5000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.314+0000 7efd66d9d700 1 -- 172.21.15.146:0/1910855463 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd50003a00 msgr2=0x7efd50003e10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-05-24T03:30:09.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.314+0000 7efd66d9d700 1 --2- 172.21.15.146:0/1910855463 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd50003a00 0x7efd50003e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.314+0000 7efd66d9d700 1 -- 172.21.15.146:0/1910855463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd50004850 msgr2=0x7efd50004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:09.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.314+0000 7efd66d9d700 1 --2- 172.21.15.146:0/1910855463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd50004850 0x7efd50004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.314+0000 7efd66d9d700 1 -- 172.21.15.146:0/1910855463 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd500035b0 con 0x7efd500052d0 2023-05-24T03:30:09.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.314+0000 7efd66d9d700 1 -- 172.21.15.146:0/1910855463 reap_dead start 2023-05-24T03:30:09.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.314+0000 7efd66d9d700 1 --2- 172.21.15.146:0/1910855463 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd500052d0 0x7efd5000ba10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efd5800c190 tx=0x7efd50005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d52719cc9f9a51e server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:09.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.312+0000 7f925b7fe700 1 -- 172.21.15.146:0/77805668 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9268005b40 con 0x7f9274071670 2023-05-24T03:30:09.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.312+0000 7f925b7fe700 1 -- 172.21.15.146:0/77805668 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9268005ca0 con 0x7f9274071670 2023-05-24T03:30:09.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.312+0000 7f925b7fe700 1 -- 172.21.15.146:0/77805668 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92680072d0 con 0x7f9274071670 2023-05-24T03:30:09.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.312+0000 7f9279435700 1 -- 172.21.15.146:0/77805668 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9274159910 con 0x7f9274071670 2023-05-24T03:30:09.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.312+0000 7f9279435700 1 -- 172.21.15.146:0/77805668 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9274159630 con 0x7f9274071670 2023-05-24T03:30:09.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.314+0000 7f9279435700 1 -- 172.21.15.146:0/77805668 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92540052f0 con 0x7f9274071670 2023-05-24T03:30:09.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.314+0000 7f925b7fe700 1 -- 172.21.15.146:0/77805668 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9268007430 con 0x7f9274071670 2023-05-24T03:30:09.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.314+0000 7f2dd8361700 1 -- start start 2023-05-24T03:30:09.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.315+0000 7f925b7fe700 1 --2- 172.21.15.146:0/77805668 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f926006ace0 0x7f926006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.315+0000 7f925b7fe700 1 -- 172.21.15.146:0/77805668 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9268088840 con 0x7f9274071670 2023-05-24T03:30:09.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.315+0000 7f9272ffd700 1 --2- 172.21.15.146:0/77805668 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f926006ace0 0x7f926006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.315+0000 7f9272ffd700 1 --2- 172.21.15.146:0/77805668 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f926006ace0 0x7f926006d190 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f926400dfd0 tx=0x7f9264014000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:09.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.315+0000 7f2dd8361700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2dd0071c60 0x7f2dd015af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.315+0000 7f2dd8361700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2dd00cc500 0x7f2dd00b3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.315+0000 7f2dd8361700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dd015a9c0 0x7f2dd00b3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.315+0000 7f2dd8361700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd00b4ae0 con 0x7f2dd015a9c0 2023-05-24T03:30:09.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.315+0000 7f2dd8361700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd00b4800 con 0x7f2dd00cc500 2023-05-24T03:30:09.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.315+0000 7f2dd8361700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd015b9c0 con 0x7f2dd0071c60 2023-05-24T03:30:09.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.316+0000 7f2dd68fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dd015a9c0 0x7f2dd00b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.316+0000 7f2dd68fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dd015a9c0 0x7f2dd00b3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39446/0 (socket says 172.21.15.146:39446) 2023-05-24T03:30:09.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.316+0000 7f2dd68fe700 1 -- 172.21.15.146:0/1417801855 learned_addr learned my addr 172.21.15.146:0/1417801855 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:09.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.316+0000 7f2dd60fd700 1 --2- 172.21.15.146:0/1417801855 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2dd0071c60 0x7f2dd015af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.316+0000 7f2dd60fd700 1 -- 172.21.15.146:0/1417801855 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2dd00cc500 msgr2=0x7f2dd00b3340 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-05-24T03:30:09.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.316+0000 7f2dd60fd700 1 --2- 172.21.15.146:0/1417801855 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2dd00cc500 0x7f2dd00b3340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.316+0000 7f2dd60fd700 1 -- 172.21.15.146:0/1417801855 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dd015a9c0 msgr2=0x7f2dd00b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.316+0000 7f2dd60fd700 1 --2- 172.21.15.146:0/1417801855 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dd015a9c0 0x7f2dd00b3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.316+0000 7f2dd60fd700 1 -- 172.21.15.146:0/1417801855 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc80094a0 con 0x7f2dd0071c60 2023-05-24T03:30:09.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.316+0000 7f2dd68fe700 1 --2- 172.21.15.146:0/1417801855 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dd015a9c0 0x7f2dd00b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T03:30:09.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.316+0000 7f2dd60fd700 1 --2- 172.21.15.146:0/1417801855 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2dd0071c60 0x7f2dd015af20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0010e80 tx=0x7f2dc00153c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:09.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.318+0000 7fc3ccda6700 1 -- 172.21.15.146:0/1445064331 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c000e070 con 0x7fc3c80b67d0 2023-05-24T03:30:09.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.318+0000 7fc3ccda6700 1 -- 172.21.15.146:0/1445064331 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c000bae0 con 0x7fc3c80b67d0 2023-05-24T03:30:09.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.318+0000 7fc3ccda6700 1 -- 172.21.15.146:0/1445064331 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c000be90 con 0x7fc3c80b67d0 2023-05-24T03:30:09.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.318+0000 7fc3d000c700 1 -- 172.21.15.146:0/1445064331 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3c80b67d0 msgr2=0x7fc3c80b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.318+0000 7fc3d000c700 1 --2- 172.21.15.146:0/1445064331 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3c80b67d0 0x7fc3c80b4cf0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0009d90 tx=0x7fc3c000b330 comp rx=0 tx=0).stop 2023-05-24T03:30:09.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.318+0000 7efd6559a700 1 -- 172.21.15.146:0/1910855463 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd58016070 con 0x7efd500052d0 2023-05-24T03:30:09.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.318+0000 7f5e5e119700 1 Processor -- start 2023-05-24T03:30:09.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.319+0000 7f5e5e119700 1 -- start start 2023-05-24T03:30:09.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.318+0000 7efd6559a700 1 -- 172.21.15.146:0/1910855463 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd5800cb30 con 0x7efd500052d0 2023-05-24T03:30:09.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.318+0000 7efd6559a700 1 -- 172.21.15.146:0/1910855463 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5800cea0 con 0x7efd500052d0 2023-05-24T03:30:09.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.319+0000 7efd6c872700 1 -- 172.21.15.146:0/1910855463 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd500052d0 msgr2=0x7efd5000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.319+0000 7efd6c872700 1 --2- 172.21.15.146:0/1910855463 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd500052d0 0x7efd5000ba10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efd5800c190 tx=0x7efd50005880 comp rx=0 tx=0).stop 2023-05-24T03:30:09.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.318+0000 7fc3d000c700 1 -- 172.21.15.146:0/1445064331 shutdown_connections 2023-05-24T03:30:09.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.318+0000 7fc3d000c700 1 --2- 172.21.15.146:0/1445064331 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3c80b67d0 0x7fc3c80b4cf0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.318+0000 7fc3d000c700 1 -- 172.21.15.146:0/1445064331 >> 172.21.15.146:0/1445064331 conn(0x7fc3c806af50 msgr2=0x7fc3c806b350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:09.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.319+0000 7efd6c872700 1 -- 172.21.15.146:0/1910855463 shutdown_connections 2023-05-24T03:30:09.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.319+0000 7efd6c872700 1 --2- 172.21.15.146:0/1910855463 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd500052d0 0x7efd5000ba10 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.319+0000 7efd6c872700 1 -- 172.21.15.146:0/1910855463 >> 172.21.15.146:0/1910855463 conn(0x7efd6806b0b0 msgr2=0x7efd680cedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:09.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.320+0000 7f6c902ff700 1 Processor -- start 2023-05-24T03:30:09.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.320+0000 7efd6c872700 1 -- 172.21.15.146:0/1910855463 shutdown_connections 2023-05-24T03:30:09.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.320+0000 7f6c902ff700 1 -- start start 2023-05-24T03:30:09.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.320+0000 7f5e5e119700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5e58159310 0x7f5e58073760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.320+0000 7f5e5e119700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5e580ca7a0 0x7f5e580cac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.320+0000 7f5e5e119700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e580cb140 con 0x7f5e58071bc0 2023-05-24T03:30:09.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.320+0000 7f5e5e119700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e5806a6f0 con 0x7f5e58159310 2023-05-24T03:30:09.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.320+0000 7f5e5e119700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e58070b20 con 0x7f5e580ca7a0 2023-05-24T03:30:09.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.320+0000 7f5e57fff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5e580ca7a0 0x7f5e580cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.320+0000 7f5e57fff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5e580ca7a0 0x7f5e580cac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:50634/0 (socket says 172.21.15.146:50634) 2023-05-24T03:30:09.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.320+0000 7f5e57fff700 1 -- 172.21.15.146:0/2201872566 learned_addr learned my addr 172.21.15.146:0/2201872566 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:09.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.320+0000 7f5e577fe700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f5e58071bc0 0x7f5e5806b380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:44934/0 (socket says 172.21.15.146:44934) 2023-05-24T03:30:09.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.320+0000 7f5e56ffd700 1 --2- 172.21.15.146:0/2201872566 >> v2:172.21.15.146:3300/0 conn(0x7f5e58159310 0x7f5e58073760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.321+0000 7f6c902ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6c880cf8e0 0x7f6c88071670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.321+0000 7f6c902ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6c880b0fd0 0x7f6c8806de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.321+0000 7f6c902ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c8806e3c0 con 0x7f6c8806da30 2023-05-24T03:30:09.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.321+0000 7f6c902ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c880b1430 con 0x7f6c880cf8e0 2023-05-24T03:30:09.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.321+0000 7f6c902ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c88159c80 con 0x7f6c880b0fd0 2023-05-24T03:30:09.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.320+0000 7f925b7fe700 1 -- 172.21.15.146:0/77805668 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f92680536b0 con 0x7f9274071670 2023-05-24T03:30:09.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.321+0000 7f6c8d89a700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f6c8806da30 0x7f6c880b08c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45910/0 (socket says 172.21.15.146:45910) 2023-05-24T03:30:09.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.321+0000 7f6c8e89c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6c880b0fd0 0x7f6c8806de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.321+0000 7f6c8d89a700 1 -- 172.21.15.146:0/99131824 learned_addr learned my addr 172.21.15.146:0/99131824 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:30:09.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.322+0000 7f6c8e09b700 1 --2- 172.21.15.146:0/99131824 >> v2:172.21.15.151:3300/0 conn(0x7f6c880cf8e0 0x7f6c88071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.320+0000 7efd6c872700 1 -- 172.21.15.146:0/1910855463 wait complete. 2023-05-24T03:30:09.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.322+0000 7efd6c872700 1 Processor -- start 2023-05-24T03:30:09.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.322+0000 7f6c8d099700 1 -- 172.21.15.146:0/99131824 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3036658051 0 0) 0x7f6c78001110 con 0x7f6c8806da30 2023-05-24T03:30:09.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.322+0000 7f6c8d099700 1 -- 172.21.15.146:0/99131824 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c740035b0 con 0x7f6c8806da30 2023-05-24T03:30:09.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.322+0000 7f6c8e89c700 1 -- 172.21.15.146:0/99131824 >> v2:172.21.15.151:3300/0 conn(0x7f6c880cf8e0 msgr2=0x7f6c88071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:09.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.322+0000 7f6c8e89c700 1 --2- 172.21.15.146:0/99131824 >> v2:172.21.15.151:3300/0 conn(0x7f6c880cf8e0 0x7f6c88071670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.322+0000 7f6c8e89c700 1 -- 172.21.15.146:0/99131824 >> v1:172.21.15.146:6789/0 conn(0x7f6c8806da30 legacy=0x7f6c880b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.322+0000 7f6c8d099700 1 -- 172.21.15.146:0/99131824 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 96885202 0 0) 0x7f6c740035b0 con 0x7f6c8806da30 2023-05-24T03:30:09.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.322+0000 7f6c8e89c700 1 -- 172.21.15.146:0/99131824 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c88071bb0 con 0x7f6c880b0fd0 2023-05-24T03:30:09.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.323+0000 7f6c8e89c700 1 --2- 172.21.15.146:0/99131824 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6c880b0fd0 0x7f6c8806de80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6c8000bfa0 tx=0x7f6c8000d330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=896c5f4bae1986d4 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:09.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.320+0000 7f2dceffd700 1 -- 172.21.15.146:0/1417801855 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc0015a50 con 0x7f2dd0071c60 2023-05-24T03:30:09.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.320+0000 7f2dceffd700 1 -- 172.21.15.146:0/1417801855 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dc0015bb0 con 0x7f2dd0071c60 2023-05-24T03:30:09.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.320+0000 7f2dceffd700 1 -- 172.21.15.146:0/1417801855 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc000e4d0 con 0x7f2dd0071c60 2023-05-24T03:30:09.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.320+0000 7f2dd8361700 1 -- 172.21.15.146:0/1417801855 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dd015ad90 con 0x7f2dd0071c60 2023-05-24T03:30:09.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.320+0000 7f2dd8361700 1 -- 172.21.15.146:0/1417801855 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dd00cbfe0 con 0x7f2dd0071c60 2023-05-24T03:30:09.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.322+0000 7f2dd8361700 1 -- 172.21.15.146:0/1417801855 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2db00052f0 con 0x7f2dd0071c60 2023-05-24T03:30:09.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.322+0000 7efd6c872700 1 -- start start 2023-05-24T03:30:09.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.321+0000 7f5e567fc700 1 -- 172.21.15.146:0/2201872566 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 77689429 0 0) 0x7f5e580cb140 con 0x7f5e58071bc0 2023-05-24T03:30:09.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.321+0000 7f5e567fc700 1 -- 172.21.15.146:0/2201872566 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e400035b0 con 0x7f5e58071bc0 2023-05-24T03:30:09.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.321+0000 7f5e56ffd700 1 -- 172.21.15.146:0/2201872566 >> v2:172.21.15.151:3300/0 conn(0x7f5e580ca7a0 msgr2=0x7f5e580cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:09.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.321+0000 7f5e56ffd700 1 --2- 172.21.15.146:0/2201872566 >> v2:172.21.15.151:3300/0 conn(0x7f5e580ca7a0 0x7f5e580cac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.321+0000 7f5e56ffd700 1 -- 172.21.15.146:0/2201872566 >> v1:172.21.15.151:6789/0 conn(0x7f5e58071bc0 legacy=0x7f5e5806b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.321+0000 7f5e56ffd700 1 -- 172.21.15.146:0/2201872566 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e58070e00 con 0x7f5e58159310 2023-05-24T03:30:09.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.322+0000 7f5e56ffd700 1 --2- 172.21.15.146:0/2201872566 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e58159310 0x7f5e58073760 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5e58070600 tx=0x7f5e48009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52762d6dcf69c6fb server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:09.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.322+0000 7f5e567fc700 1 -- 172.21.15.146:0/2201872566 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e48014e90 con 0x7f5e58159310 2023-05-24T03:30:09.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.322+0000 7f5e567fc700 1 -- 172.21.15.146:0/2201872566 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e48004030 con 0x7f5e58159310 2023-05-24T03:30:09.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.322+0000 7f5e567fc700 1 -- 172.21.15.146:0/2201872566 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e480043a0 con 0x7f5e58159310 2023-05-24T03:30:09.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.323+0000 7efd6c872700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd500052d0 0x7efd680c6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.323+0000 7efd6c872700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd680afe10 0x7efd6815e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.323+0000 7efd6c872700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd680b0280 0x7efd6815e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.323+0000 7efd6c872700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd681f97f0 con 0x7efd680afe10 2023-05-24T03:30:09.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.323+0000 7efd6c872700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd681f9ad0 con 0x7efd500052d0 2023-05-24T03:30:09.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.323+0000 7efd6c872700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd681f9db0 con 0x7efd680b0280 2023-05-24T03:30:09.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.323+0000 7efd65d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd680afe10 0x7efd6815e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.323+0000 7efd65d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd680afe10 0x7efd6815e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39460/0 (socket says 172.21.15.146:39460) 2023-05-24T03:30:09.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.323+0000 7efd65d9b700 1 -- 172.21.15.146:0/2694281220 learned_addr learned my addr 172.21.15.146:0/2694281220 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:09.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.324+0000 7efd66d9d700 1 --2- 172.21.15.146:0/2694281220 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd680b0280 0x7efd6815e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.324+0000 7efd6659c700 1 --2- 172.21.15.146:0/2694281220 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd500052d0 0x7efd680c6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.324+0000 7efd65d9b700 1 -- 172.21.15.146:0/2694281220 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd680b0280 msgr2=0x7efd6815e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.324+0000 7efd65d9b700 1 --2- 172.21.15.146:0/2694281220 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd680b0280 0x7efd6815e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.324+0000 7efd65d9b700 1 -- 172.21.15.146:0/2694281220 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd500052d0 msgr2=0x7efd680c6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.324+0000 7efd65d9b700 1 --2- 172.21.15.146:0/2694281220 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd500052d0 0x7efd680c6890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.324+0000 7efd65d9b700 1 -- 172.21.15.146:0/2694281220 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd680cb3a0 con 0x7efd680afe10 2023-05-24T03:30:09.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.324+0000 7efd65d9b700 1 --2- 172.21.15.146:0/2694281220 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd680afe10 0x7efd6815e160 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7efd6000caa0 tx=0x7efd6000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:09.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.324+0000 7f5e5e119700 1 -- 172.21.15.146:0/2201872566 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e58159310 msgr2=0x7f5e58073760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.324+0000 7f5e5e119700 1 --2- 172.21.15.146:0/2201872566 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e58159310 0x7f5e58073760 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5e58070600 tx=0x7f5e48009b20 comp rx=0 tx=0).stop 2023-05-24T03:30:09.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.324+0000 7f2dceffd700 1 -- 172.21.15.146:0/1417801855 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2dc000e630 con 0x7f2dd0071c60 2023-05-24T03:30:09.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.324+0000 7f2dceffd700 1 --2- 172.21.15.146:0/1417801855 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f2dbc06ad60 0x7f2dbc06d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.324+0000 7f2dceffd700 1 -- 172.21.15.146:0/1417801855 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2dc0091900 con 0x7f2dd0071c60 2023-05-24T03:30:09.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.324+0000 7f2dd58fc700 1 --2- 172.21.15.146:0/1417801855 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f2dbc06ad60 0x7f2dbc06d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.325+0000 7f2dd58fc700 1 --2- 172.21.15.146:0/1417801855 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f2dbc06ad60 0x7f2dbc06d210 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2dd00b42f0 tx=0x7f2dc4009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:09.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.324+0000 7efd56ffd700 1 -- 172.21.15.146:0/2694281220 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6000aaa0 con 0x7efd680afe10 2023-05-24T03:30:09.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.324+0000 7efd56ffd700 1 -- 172.21.15.146:0/2694281220 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd6000ac00 con 0x7efd680afe10 2023-05-24T03:30:09.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.324+0000 7efd56ffd700 1 -- 172.21.15.146:0/2694281220 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd60012400 con 0x7efd680afe10 2023-05-24T03:30:09.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.324+0000 7efd6c872700 1 -- 172.21.15.146:0/2694281220 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd680cb0c0 con 0x7efd680afe10 2023-05-24T03:30:09.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.324+0000 7efd6c872700 1 -- 172.21.15.146:0/2694281220 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd680ca7b0 con 0x7efd680afe10 2023-05-24T03:30:09.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.325+0000 7efd6c872700 1 -- 172.21.15.146:0/2694281220 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd6804e810 con 0x7efd680afe10 2023-05-24T03:30:09.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.326+0000 7f5e57fff700 1 --2- 172.21.15.146:0/2201872566 >> v2:172.21.15.151:3300/0 conn(0x7f5e580ca7a0 0x7f5e580cac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:30:09.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.326+0000 7f5e5e119700 1 -- 172.21.15.146:0/2201872566 shutdown_connections 2023-05-24T03:30:09.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.326+0000 7f5e5e119700 1 --2- 172.21.15.146:0/2201872566 >> v2:172.21.15.151:3300/0 conn(0x7f5e580ca7a0 0x7f5e580cac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.326+0000 7f5e5e119700 1 --2- 172.21.15.146:0/2201872566 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e58159310 0x7f5e58073760 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.326+0000 7f5e5e119700 1 -- 172.21.15.146:0/2201872566 >> 172.21.15.146:0/2201872566 conn(0x7f5e580cf6c0 msgr2=0x7f5e580cfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:09.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.326+0000 7f5e5e119700 1 -- 172.21.15.146:0/2201872566 shutdown_connections 2023-05-24T03:30:09.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.326+0000 7f5e5e119700 1 -- 172.21.15.146:0/2201872566 wait complete. 2023-05-24T03:30:09.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.327+0000 7efd56ffd700 1 -- 172.21.15.146:0/2694281220 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efd60012560 con 0x7efd680afe10 2023-05-24T03:30:09.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.327+0000 7efd56ffd700 1 --2- 172.21.15.146:0/2694281220 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7efd4806ad30 0x7efd4806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.327+0000 7efd56ffd700 1 -- 172.21.15.146:0/2694281220 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7efd6008a380 con 0x7efd680afe10 2023-05-24T03:30:09.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.328+0000 7f2dceffd700 1 -- 172.21.15.146:0/1417801855 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f2dc005c850 con 0x7f2dd0071c60 2023-05-24T03:30:09.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.328+0000 7efd6659c700 1 --2- 172.21.15.146:0/2694281220 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7efd4806ad30 0x7efd4806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.328+0000 7f5e5e119700 1 Processor -- start 2023-05-24T03:30:09.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.328+0000 7f5e5e119700 1 -- start start 2023-05-24T03:30:09.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.328+0000 7efd6659c700 1 --2- 172.21.15.146:0/2694281220 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7efd4806ad30 0x7efd4806d1e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7efd6804fa50 tx=0x7efd5c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:09.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.329+0000 7f6c8d099700 1 -- 172.21.15.146:0/99131824 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c80010070 con 0x7f6c880b0fd0 2023-05-24T03:30:09.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.329+0000 7f6c8d099700 1 -- 172.21.15.146:0/99131824 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c8000b2e0 con 0x7f6c880b0fd0 2023-05-24T03:30:09.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.329+0000 7f6c8d099700 1 -- 172.21.15.146:0/99131824 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c78001800 con 0x7f6c880b0fd0 2023-05-24T03:30:09.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.329+0000 7f5e5e119700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e58071bc0 0x7f5e580c6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.329+0000 7f5e5e119700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e580ca7a0 0x7f5e580c9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.329+0000 7f5e5e119700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e58159310 0x7f5e580b1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.329+0000 7f5e5e119700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e580c9a90 con 0x7f5e58159310 2023-05-24T03:30:09.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.329+0000 7f5e5e119700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e580b32f0 con 0x7f5e580ca7a0 2023-05-24T03:30:09.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.329+0000 7f5e5e119700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e580b3780 con 0x7f5e58071bc0 2023-05-24T03:30:09.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.329+0000 7f5e57fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e58159310 0x7f5e580b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.329+0000 7f5e57fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e58159310 0x7f5e580b1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39472/0 (socket says 172.21.15.146:39472) 2023-05-24T03:30:09.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.329+0000 7f5e57fff700 1 -- 172.21.15.146:0/281755511 learned_addr learned my addr 172.21.15.146:0/281755511 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:09.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.330+0000 7f6c902ff700 1 -- 172.21.15.146:0/99131824 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6c880b0fd0 msgr2=0x7f6c8806de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.330+0000 7f6c902ff700 1 --2- 172.21.15.146:0/99131824 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6c880b0fd0 0x7f6c8806de80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6c8000bfa0 tx=0x7f6c8000d330 comp rx=0 tx=0).stop 2023-05-24T03:30:09.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.330+0000 7f6c902ff700 1 -- 172.21.15.146:0/99131824 shutdown_connections 2023-05-24T03:30:09.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.330+0000 7f6c902ff700 1 --2- 172.21.15.146:0/99131824 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6c880b0fd0 0x7f6c8806de80 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.330+0000 7f6c902ff700 1 --2- 172.21.15.146:0/99131824 >> v2:172.21.15.151:3300/0 conn(0x7f6c880cf8e0 0x7f6c88071670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.330+0000 7f6c902ff700 1 -- 172.21.15.146:0/99131824 >> 172.21.15.146:0/99131824 conn(0x7f6c880cedd0 msgr2=0x7f6c880cf1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:09.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.330+0000 7f5e57fff700 1 -- 172.21.15.146:0/281755511 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e58071bc0 msgr2=0x7f5e580c6790 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-05-24T03:30:09.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.330+0000 7f5e57fff700 1 --2- 172.21.15.146:0/281755511 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e58071bc0 0x7f5e580c6790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.330+0000 7f5e57fff700 1 -- 172.21.15.146:0/281755511 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e580ca7a0 msgr2=0x7f5e580c9550 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-05-24T03:30:09.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.330+0000 7f5e57fff700 1 --2- 172.21.15.146:0/281755511 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e580ca7a0 0x7f5e580c9550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.330+0000 7f5e57fff700 1 -- 172.21.15.146:0/281755511 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e480094a0 con 0x7f5e58159310 2023-05-24T03:30:09.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.330+0000 7f6c902ff700 1 -- 172.21.15.146:0/99131824 shutdown_connections 2023-05-24T03:30:09.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.330+0000 7f6c902ff700 1 -- 172.21.15.146:0/99131824 wait complete. 2023-05-24T03:30:09.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.330+0000 7f5e57fff700 1 --2- 172.21.15.146:0/281755511 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e58159310 0x7f5e580b1460 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5e50007bd0 tx=0x7f5e50007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:09.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.331+0000 7f6c902ff700 1 Processor -- start 2023-05-24T03:30:09.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.333+0000 7fc3d000c700 1 -- 172.21.15.146:0/1445064331 shutdown_connections 2023-05-24T03:30:09.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.331+0000 7f6c902ff700 1 -- start start 2023-05-24T03:30:09.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.333+0000 7f6c902ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6c8806da30 0x7f6c88150380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.333+0000 7f6c902ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c880b0fd0 0x7f6c88156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.333+0000 7f6c902ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c880cf8e0 0x7f6c881572a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.333+0000 7f6c902ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c880c6cc0 con 0x7f6c880cf8e0 2023-05-24T03:30:09.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.333+0000 7f6c902ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c881580a0 con 0x7f6c880b0fd0 2023-05-24T03:30:09.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.333+0000 7f6c902ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c88157ae0 con 0x7f6c8806da30 2023-05-24T03:30:09.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.333+0000 7fc3d000c700 1 -- 172.21.15.146:0/1445064331 wait complete. 2023-05-24T03:30:09.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.333+0000 7f6c8e09b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6c8806da30 0x7f6c88150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.333+0000 7f6c8d89a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c880b0fd0 0x7f6c88156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.333+0000 7f6c8d89a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c880b0fd0 0x7f6c88156d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:50660/0 (socket says 172.21.15.146:50660) 2023-05-24T03:30:09.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.333+0000 7f6c8d89a700 1 -- 172.21.15.146:0/44239924 learned_addr learned my addr 172.21.15.146:0/44239924 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:09.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.333+0000 7f5e3ffff700 1 -- 172.21.15.146:0/281755511 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e50003c20 con 0x7f5e58159310 2023-05-24T03:30:09.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.333+0000 7f5e3ffff700 1 -- 172.21.15.146:0/281755511 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e5000f040 con 0x7f5e58159310 2023-05-24T03:30:09.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.333+0000 7f5e3ffff700 1 -- 172.21.15.146:0/281755511 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5000da00 con 0x7f5e58159310 2023-05-24T03:30:09.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.333+0000 7efd56ffd700 1 -- 172.21.15.146:0/2694281220 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7efd60055190 con 0x7efd680afe10 2023-05-24T03:30:09.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.334+0000 7f6c8d89a700 1 -- 172.21.15.146:0/44239924 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6c8806da30 msgr2=0x7f6c88150380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.334+0000 7f6c8d89a700 1 --2- 172.21.15.146:0/44239924 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6c8806da30 0x7f6c88150380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.334+0000 7f6c8d89a700 1 -- 172.21.15.146:0/44239924 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c880cf8e0 msgr2=0x7f6c881572a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.334+0000 7f6c8e89c700 1 --2- 172.21.15.146:0/44239924 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c880cf8e0 0x7f6c881572a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.334+0000 7f6c8d89a700 1 --2- 172.21.15.146:0/44239924 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c880cf8e0 0x7f6c881572a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.334+0000 7f6c8d89a700 1 -- 172.21.15.146:0/44239924 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c8000bc80 con 0x7f6c880b0fd0 2023-05-24T03:30:09.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.334+0000 7f6c8e89c700 1 --2- 172.21.15.146:0/44239924 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c880cf8e0 0x7f6c881572a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:30:09.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.334+0000 7f6c8d89a700 1 --2- 172.21.15.146:0/44239924 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c880b0fd0 0x7f6c88156d60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6c7800c4d0 tx=0x7f6c7800c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:09.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.335+0000 7fc3d000c700 1 Processor -- start 2023-05-24T03:30:09.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.333+0000 7f5e5e119700 1 -- 172.21.15.146:0/281755511 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e580713c0 con 0x7f5e58159310 2023-05-24T03:30:09.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.333+0000 7f5e5e119700 1 -- 172.21.15.146:0/281755511 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e580710e0 con 0x7f5e58159310 2023-05-24T03:30:09.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.334+0000 7f6c7effd700 1 -- 172.21.15.146:0/44239924 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c78004c80 con 0x7f6c880b0fd0 2023-05-24T03:30:09.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.334+0000 7f6c7effd700 1 -- 172.21.15.146:0/44239924 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c78004e00 con 0x7f6c880b0fd0 2023-05-24T03:30:09.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.334+0000 7f6c902ff700 1 -- 172.21.15.146:0/44239924 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c88159630 con 0x7f6c880b0fd0 2023-05-24T03:30:09.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.334+0000 7f6c902ff700 1 -- 172.21.15.146:0/44239924 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c88159350 con 0x7f6c880b0fd0 2023-05-24T03:30:09.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.336+0000 7f6c7effd700 1 -- 172.21.15.146:0/44239924 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c78007310 con 0x7f6c880b0fd0 2023-05-24T03:30:09.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.336+0000 7f5e5e119700 1 -- 172.21.15.146:0/281755511 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e380052f0 con 0x7f5e58159310 2023-05-24T03:30:09.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.336+0000 7f6c902ff700 1 -- 172.21.15.146:0/44239924 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c88159910 con 0x7f6c880b0fd0 2023-05-24T03:30:09.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.339+0000 7f6c7effd700 1 -- 172.21.15.146:0/44239924 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6c78007470 con 0x7f6c880b0fd0 2023-05-24T03:30:09.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.339+0000 7f6c7effd700 1 --2- 172.21.15.146:0/44239924 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f6c6c06ad30 0x7f6c6c06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.339+0000 7f6c7effd700 1 -- 172.21.15.146:0/44239924 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6c78089800 con 0x7f6c880b0fd0 2023-05-24T03:30:09.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.338+0000 7f5e3ffff700 1 -- 172.21.15.146:0/281755511 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5e5000db60 con 0x7f5e58159310 2023-05-24T03:30:09.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.338+0000 7f5e3ffff700 1 --2- 172.21.15.146:0/281755511 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f5e4006b160 0x7f5e4006d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.338+0000 7f5e3ffff700 1 -- 172.21.15.146:0/281755511 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5e50089bb0 con 0x7f5e58159310 2023-05-24T03:30:09.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.341+0000 7f6c7effd700 1 -- 172.21.15.146:0/44239924 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f6c78054730 con 0x7f6c880b0fd0 2023-05-24T03:30:09.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.342+0000 7f5e577fe700 1 --2- 172.21.15.146:0/281755511 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f5e4006b160 0x7f5e4006d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.342+0000 7f6c8e09b700 1 --2- 172.21.15.146:0/44239924 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f6c6c06ad30 0x7f6c6c06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.344+0000 7f6c8e09b700 1 --2- 172.21.15.146:0/44239924 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f6c6c06ad30 0x7f6c6c06d1e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6c84006b20 tx=0x7f6c84008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:09.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.345+0000 7fc3d000c700 1 -- start start 2023-05-24T03:30:09.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.346+0000 7fc3d000c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3c80b67d0 0x7fc3c814cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.346+0000 7fc3d000c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3c80d2da0 0x7fc3c80cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.346+0000 7fc3d000c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3c815cb50 0x7fc3c80a9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.346+0000 7fc3d000c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c814d2a0 con 0x7fc3c815cb50 2023-05-24T03:30:09.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.346+0000 7fc3d000c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c814d860 con 0x7fc3c80b67d0 2023-05-24T03:30:09.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.346+0000 7fc3d000c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c80cc820 con 0x7fc3c80d2da0 2023-05-24T03:30:09.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.346+0000 7fc3cdda8700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3c80b67d0 0x7fc3c814cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.346+0000 7fc3cdda8700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3c80b67d0 0x7fc3c814cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:50668/0 (socket says 172.21.15.146:50668) 2023-05-24T03:30:09.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.346+0000 7fc3cdda8700 1 -- 172.21.15.146:0/1675818562 learned_addr learned my addr 172.21.15.146:0/1675818562 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:09.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.346+0000 7fc3cd5a7700 1 --2- 172.21.15.146:0/1675818562 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3c80d2da0 0x7fc3c80cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.346+0000 7fc3ce5a9700 1 --2- 172.21.15.146:0/1675818562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3c815cb50 0x7fc3c80a9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.347+0000 7fc3cdda8700 1 -- 172.21.15.146:0/1675818562 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3c80d2da0 msgr2=0x7fc3c80cbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.347+0000 7fc3cdda8700 1 --2- 172.21.15.146:0/1675818562 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3c80d2da0 0x7fc3c80cbd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.347+0000 7fc3cdda8700 1 -- 172.21.15.146:0/1675818562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3c815cb50 msgr2=0x7fc3c80a9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.347+0000 7fc3cdda8700 1 --2- 172.21.15.146:0/1675818562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3c815cb50 0x7fc3c80a9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.347+0000 7fc3cdda8700 1 -- 172.21.15.146:0/1675818562 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c0009a70 con 0x7fc3c80b67d0 2023-05-24T03:30:09.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.348+0000 7f5e3ffff700 1 -- 172.21.15.146:0/281755511 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f5e50054ae0 con 0x7f5e58159310 2023-05-24T03:30:09.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.350+0000 7fc3cdda8700 1 --2- 172.21.15.146:0/1675818562 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3c80b67d0 0x7fc3c814cb80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc3c400c550 tx=0x7fc3c400c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:09.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.350+0000 7fc3be7fc700 1 -- 172.21.15.146:0/1675818562 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c4004c80 con 0x7fc3c80b67d0 2023-05-24T03:30:09.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.350+0000 7fc3be7fc700 1 -- 172.21.15.146:0/1675818562 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c4004e20 con 0x7fc3c80b67d0 2023-05-24T03:30:09.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.350+0000 7fc3be7fc700 1 -- 172.21.15.146:0/1675818562 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c4007310 con 0x7fc3c80b67d0 2023-05-24T03:30:09.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.350+0000 7fc3d000c700 1 -- 172.21.15.146:0/1675818562 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3c80d2520 con 0x7fc3c80b67d0 2023-05-24T03:30:09.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.350+0000 7fc3d000c700 1 -- 172.21.15.146:0/1675818562 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3c80d18f0 con 0x7fc3c80b67d0 2023-05-24T03:30:09.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.352+0000 7fc3be7fc700 1 -- 172.21.15.146:0/1675818562 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc3c4007470 con 0x7fc3c80b67d0 2023-05-24T03:30:09.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.352+0000 7fc3be7fc700 1 --2- 172.21.15.146:0/1675818562 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fc3ac06ace0 0x7fc3ac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.352+0000 7fc3be7fc700 1 -- 172.21.15.146:0/1675818562 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc3c4089380 con 0x7fc3c80b67d0 2023-05-24T03:30:09.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.353+0000 7fc3cd5a7700 1 --2- 172.21.15.146:0/1675818562 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fc3ac06ace0 0x7fc3ac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.354+0000 7fc3cd5a7700 1 --2- 172.21.15.146:0/1675818562 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fc3ac06ace0 0x7fc3ac06d190 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc3c80b67a0 tx=0x7fc3b8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:09.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.355+0000 7fc3d000c700 1 -- 172.21.15.146:0/1675818562 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3b00052f0 con 0x7fc3c80b67d0 2023-05-24T03:30:09.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.353+0000 7f5e577fe700 1 --2- 172.21.15.146:0/281755511 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f5e4006b160 0x7f5e4006d610 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c007fd0 tx=0x7f5e4c007920 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:09.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.361+0000 7fc3be7fc700 1 -- 172.21.15.146:0/1675818562 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc3c4054140 con 0x7fc3c80b67d0 2023-05-24T03:30:09.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.390+0000 7f48e1397700 1 Processor -- start 2023-05-24T03:30:09.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.390+0000 7f48e1397700 1 -- start start 2023-05-24T03:30:09.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.392+0000 7f48e1397700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f48dc06de00 0x7f48dc0ce160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.392+0000 7f48e1397700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f48dc0ce6a0 0x7f48dc164d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.392+0000 7f48e1397700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48dc0ceb20 con 0x7f48dc06da30 2023-05-24T03:30:09.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.392+0000 7f48e1397700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48dc0ca740 con 0x7f48dc06de00 2023-05-24T03:30:09.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.392+0000 7f48e1397700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48dc0ca9e0 con 0x7f48dc0ce6a0 2023-05-24T03:30:09.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.392+0000 7f48db7fe700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f48dc0ce6a0 0x7f48dc164d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.393+0000 7f48db7fe700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f48dc0ce6a0 0x7f48dc164d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:50676/0 (socket says 172.21.15.146:50676) 2023-05-24T03:30:09.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.393+0000 7f48db7fe700 1 -- 172.21.15.146:0/363359112 learned_addr learned my addr 172.21.15.146:0/363359112 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:09.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.393+0000 7f48da7fc700 1 --2- 172.21.15.146:0/363359112 >> v2:172.21.15.146:3300/0 conn(0x7f48dc06de00 0x7f48dc0ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.393+0000 7f48da7fc700 1 -- 172.21.15.146:0/363359112 >> v2:172.21.15.151:3300/0 conn(0x7f48dc0ce6a0 msgr2=0x7f48dc164d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:09.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.393+0000 7f48da7fc700 1 --2- 172.21.15.146:0/363359112 >> v2:172.21.15.151:3300/0 conn(0x7f48dc0ce6a0 0x7f48dc164d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.393+0000 7f48da7fc700 1 -- 172.21.15.146:0/363359112 >> v1:172.21.15.151:6789/0 conn(0x7f48dc06da30 legacy=0x7f48dc0cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.393+0000 7f48da7fc700 1 -- 172.21.15.146:0/363359112 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48dc0cacc0 con 0x7f48dc06de00 2023-05-24T03:30:09.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.394+0000 7f48da7fc700 1 --2- 172.21.15.146:0/363359112 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48dc06de00 0x7f48dc0ce160 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f48dc0c1b10 tx=0x7f48cc009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ea8e097a7c0d02b server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:09.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.394+0000 7f48d9ffb700 1 -- 172.21.15.146:0/363359112 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48cc011830 con 0x7f48dc06de00 2023-05-24T03:30:09.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.394+0000 7f48d9ffb700 1 -- 172.21.15.146:0/363359112 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48cc011990 con 0x7f48dc06de00 2023-05-24T03:30:09.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.394+0000 7f48d9ffb700 1 -- 172.21.15.146:0/363359112 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48cc011d20 con 0x7f48dc06de00 2023-05-24T03:30:09.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.395+0000 7f48e1397700 1 -- 172.21.15.146:0/363359112 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48dc06de00 msgr2=0x7f48dc0ce160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.395+0000 7f48e1397700 1 --2- 172.21.15.146:0/363359112 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48dc06de00 0x7f48dc0ce160 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f48dc0c1b10 tx=0x7f48cc009b20 comp rx=0 tx=0).stop 2023-05-24T03:30:09.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.396+0000 7f48e1397700 1 -- 172.21.15.146:0/363359112 shutdown_connections 2023-05-24T03:30:09.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.396+0000 7f48e1397700 1 --2- 172.21.15.146:0/363359112 >> v2:172.21.15.151:3300/0 conn(0x7f48dc0ce6a0 0x7f48dc164d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.396+0000 7f48e1397700 1 --2- 172.21.15.146:0/363359112 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48dc06de00 0x7f48dc0ce160 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.396+0000 7f48e1397700 1 -- 172.21.15.146:0/363359112 >> 172.21.15.146:0/363359112 conn(0x7f48dc0cedd0 msgr2=0x7f48dc0cf1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:09.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.396+0000 7f48e1397700 1 -- 172.21.15.146:0/363359112 shutdown_connections 2023-05-24T03:30:09.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.397+0000 7f48e1397700 1 -- 172.21.15.146:0/363359112 wait complete. 2023-05-24T03:30:09.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.399+0000 7f48e1397700 1 Processor -- start 2023-05-24T03:30:09.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.399+0000 7f48e1397700 1 -- start start 2023-05-24T03:30:09.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.400+0000 7f48e1397700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48dc06da30 0x7f48dc163a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.400+0000 7f48e1397700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48dc06de00 0x7f48dc160310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.400+0000 7f48e1397700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f48dc0ce6a0 0x7f48dc160850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.400+0000 7f48e1397700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48dc1611d0 con 0x7f48dc06da30 2023-05-24T03:30:09.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.400+0000 7f48e1397700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48dc163f40 con 0x7f48dc06de00 2023-05-24T03:30:09.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.400+0000 7f48e1397700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48dc0c25a0 con 0x7f48dc0ce6a0 2023-05-24T03:30:09.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.401+0000 7f48daffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48dc06da30 0x7f48dc163a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.401+0000 7f48daffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48dc06da30 0x7f48dc163a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39504/0 (socket says 172.21.15.146:39504) 2023-05-24T03:30:09.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.401+0000 7f48daffd700 1 -- 172.21.15.146:0/680294167 learned_addr learned my addr 172.21.15.146:0/680294167 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:09.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.401+0000 7f48daffd700 1 -- 172.21.15.146:0/680294167 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f48dc0ce6a0 msgr2=0x7f48dc160850 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-05-24T03:30:09.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.401+0000 7f48daffd700 1 --2- 172.21.15.146:0/680294167 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f48dc0ce6a0 0x7f48dc160850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.402+0000 7f48daffd700 1 -- 172.21.15.146:0/680294167 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48dc06de00 msgr2=0x7f48dc160310 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-05-24T03:30:09.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.402+0000 7f48daffd700 1 --2- 172.21.15.146:0/680294167 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48dc06de00 0x7f48dc160310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.402+0000 7f48daffd700 1 -- 172.21.15.146:0/680294167 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48cc0094a0 con 0x7f48dc06da30 2023-05-24T03:30:09.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.402+0000 7f48daffd700 1 --2- 172.21.15.146:0/680294167 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48dc06da30 0x7f48dc163a00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f48d000c450 tx=0x7f48d000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:09.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.404+0000 7f48c37fe700 1 -- 172.21.15.146:0/680294167 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d00052d0 con 0x7f48dc06da30 2023-05-24T03:30:09.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.404+0000 7f48c37fe700 1 -- 172.21.15.146:0/680294167 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d0005430 con 0x7f48dc06da30 2023-05-24T03:30:09.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.404+0000 7f48c37fe700 1 -- 172.21.15.146:0/680294167 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d00038c0 con 0x7f48dc06da30 2023-05-24T03:30:09.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.404+0000 7f48e1397700 1 -- 172.21.15.146:0/680294167 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48dc0cb280 con 0x7f48dc06da30 2023-05-24T03:30:09.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.404+0000 7f48e1397700 1 -- 172.21.15.146:0/680294167 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48dc0cafa0 con 0x7f48dc06da30 2023-05-24T03:30:09.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.409+0000 7f48c37fe700 1 -- 172.21.15.146:0/680294167 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f48d0003a20 con 0x7f48dc06da30 2023-05-24T03:30:09.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.409+0000 7f48c37fe700 1 --2- 172.21.15.146:0/680294167 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f48c406af10 0x7f48c406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:09.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.409+0000 7f48c37fe700 1 -- 172.21.15.146:0/680294167 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f48d0088be0 con 0x7f48dc06da30 2023-05-24T03:30:09.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.410+0000 7f48da7fc700 1 --2- 172.21.15.146:0/680294167 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f48c406af10 0x7f48c406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:09.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.411+0000 7f48da7fc700 1 --2- 172.21.15.146:0/680294167 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f48c406af10 0x7f48c406d3c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f48dc0c8c80 tx=0x7f48cc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:09.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.412+0000 7f48e1397700 1 -- 172.21.15.146:0/680294167 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48bc0052f0 con 0x7f48dc06da30 2023-05-24T03:30:09.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.421+0000 7f48c37fe700 1 -- 172.21.15.146:0/680294167 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f48d0053980 con 0x7f48dc06da30 2023-05-24T03:30:09.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.709+0000 7f6fa2a9f700 1 -- 172.21.15.146:0/2012711458 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f6f9c04e810 con 0x7f6f9c0b0fd0 2023-05-24T03:30:09.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.709+0000 7f6f997fa700 1 -- 172.21.15.146:0/2012711458 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6f90057b10 con 0x7f6f9c0b0fd0 2023-05-24T03:30:09.714 INFO:teuthology.orchestra.run.smithi146.stdout:55834574858 2023-05-24T03:30:09.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.717+0000 7f9279435700 1 -- 172.21.15.146:0/77805668 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9254005870 con 0x7f9274071670 2023-05-24T03:30:09.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.717+0000 7f6fa2a9f700 1 -- 172.21.15.146:0/2012711458 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f6f8006ad00 msgr2=0x7f6f8006d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.717+0000 7f6fa2a9f700 1 --2- 172.21.15.146:0/2012711458 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f6f8006ad00 0x7f6f8006d1b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c0acc20 tx=0x7f6f8c011000 comp rx=0 tx=0).stop 2023-05-24T03:30:09.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.717+0000 7f6fa2a9f700 1 -- 172.21.15.146:0/2012711458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f9c0b0fd0 msgr2=0x7f6f9c200420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.717+0000 7f6fa2a9f700 1 --2- 172.21.15.146:0/2012711458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f9c0b0fd0 0x7f6f9c200420 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6f9000b550 tx=0x7f6f9000b860 comp rx=0 tx=0).stop 2023-05-24T03:30:09.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.717+0000 7f6fa2a9f700 1 -- 172.21.15.146:0/2012711458 shutdown_connections 2023-05-24T03:30:09.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.717+0000 7f6fa2a9f700 1 --2- 172.21.15.146:0/2012711458 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f6f8006ad00 0x7f6f8006d1b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.717+0000 7f6fa2a9f700 1 --2- 172.21.15.146:0/2012711458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f9c0b0fd0 0x7f6f9c200420 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.717+0000 7f6fa2a9f700 1 --2- 172.21.15.146:0/2012711458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f9c06df70 0x7f6f9c1fed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.717+0000 7f6fa2a9f700 1 --2- 172.21.15.146:0/2012711458 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f9c071670 0x7f6f9c0c4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.717+0000 7f6fa2a9f700 1 -- 172.21.15.146:0/2012711458 >> 172.21.15.146:0/2012711458 conn(0x7f6f9c0cedd0 msgr2=0x7f6f9c0b0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:09.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.718+0000 7f925b7fe700 1 -- 172.21.15.146:0/77805668 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9268001100 con 0x7f9274071670 2023-05-24T03:30:09.724 INFO:teuthology.orchestra.run.smithi146.stdout:55834574857 2023-05-24T03:30:09.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.718+0000 7f6c902ff700 1 -- 172.21.15.146:0/44239924 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f6c8806e3c0 con 0x7f6c880b0fd0 2023-05-24T03:30:09.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.719+0000 7f6c7effd700 1 -- 172.21.15.146:0/44239924 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6c8806e3c0 con 0x7f6c880b0fd0 2023-05-24T03:30:09.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.721+0000 7f9279435700 1 -- 172.21.15.146:0/77805668 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f926006ace0 msgr2=0x7f926006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.721+0000 7f9279435700 1 --2- 172.21.15.146:0/77805668 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f926006ace0 0x7f926006d190 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f926400dfd0 tx=0x7f9264014000 comp rx=0 tx=0).stop 2023-05-24T03:30:09.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.721+0000 7f9279435700 1 -- 172.21.15.146:0/77805668 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9274071670 msgr2=0x7f92740af760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.721+0000 7f9279435700 1 --2- 172.21.15.146:0/77805668 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9274071670 0x7f92740af760 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f926800c3c0 tx=0x7f926800c6d0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.722+0000 7f9279435700 1 -- 172.21.15.146:0/77805668 shutdown_connections 2023-05-24T03:30:09.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.722+0000 7f9279435700 1 --2- 172.21.15.146:0/77805668 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f926006ace0 0x7f926006d190 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.722+0000 7f9279435700 1 --2- 172.21.15.146:0/77805668 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92740b0fd0 0x7f92740afca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.722+0000 7f9279435700 1 --2- 172.21.15.146:0/77805668 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f927406df70 0x7f9274146c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.722+0000 7f9279435700 1 --2- 172.21.15.146:0/77805668 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9274071670 0x7f92740af760 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.722+0000 7f9279435700 1 -- 172.21.15.146:0/77805668 >> 172.21.15.146:0/77805668 conn(0x7f92740cedd0 msgr2=0x7f92740702e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:09.728 INFO:teuthology.orchestra.run.smithi146.stdout:55834574858 2023-05-24T03:30:09.729 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.722+0000 7f6fa2a9f700 1 -- 172.21.15.146:0/2012711458 shutdown_connections 2023-05-24T03:30:09.729 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.722+0000 7f9279435700 1 -- 172.21.15.146:0/77805668 shutdown_connections 2023-05-24T03:30:09.729 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.722+0000 7f9279435700 1 -- 172.21.15.146:0/77805668 wait complete. 2023-05-24T03:30:09.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.723+0000 7f2dd8361700 1 -- 172.21.15.146:0/1417801855 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2db0005870 con 0x7f2dd0071c60 2023-05-24T03:30:09.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.723+0000 7f6fa2a9f700 1 -- 172.21.15.146:0/2012711458 wait complete. 2023-05-24T03:30:09.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.723+0000 7f2dceffd700 1 -- 172.21.15.146:0/1417801855 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2dc005fe70 con 0x7f2dd0071c60 2023-05-24T03:30:09.730 INFO:teuthology.orchestra.run.smithi146.stdout:55834574858 2023-05-24T03:30:09.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.729+0000 7f6c902ff700 1 -- 172.21.15.146:0/44239924 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f6c6c06ad30 msgr2=0x7f6c6c06d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.729+0000 7f6c902ff700 1 --2- 172.21.15.146:0/44239924 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f6c6c06ad30 0x7f6c6c06d1e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6c84006b20 tx=0x7f6c84008040 comp rx=0 tx=0).stop 2023-05-24T03:30:09.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.729+0000 7f6c902ff700 1 -- 172.21.15.146:0/44239924 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c880b0fd0 msgr2=0x7f6c88156d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.729+0000 7f6c902ff700 1 --2- 172.21.15.146:0/44239924 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c880b0fd0 0x7f6c88156d60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6c7800c4d0 tx=0x7f6c7800c7e0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.729+0000 7efd6c872700 1 -- 172.21.15.146:0/2694281220 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7efd68161310 con 0x7efd680afe10 2023-05-24T03:30:09.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.730+0000 7f2dd8361700 1 -- 172.21.15.146:0/1417801855 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f2dbc06ad60 msgr2=0x7f2dbc06d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.730+0000 7f2dd8361700 1 --2- 172.21.15.146:0/1417801855 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f2dbc06ad60 0x7f2dbc06d210 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2dd00b42f0 tx=0x7f2dc4009210 comp rx=0 tx=0).stop 2023-05-24T03:30:09.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.730+0000 7f2dd8361700 1 -- 172.21.15.146:0/1417801855 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2dd0071c60 msgr2=0x7f2dd015af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.730+0000 7f2dd8361700 1 --2- 172.21.15.146:0/1417801855 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2dd0071c60 0x7f2dd015af20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0010e80 tx=0x7f2dc00153c0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.730+0000 7f2dd8361700 1 -- 172.21.15.146:0/1417801855 shutdown_connections 2023-05-24T03:30:09.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.730+0000 7f2dd8361700 1 --2- 172.21.15.146:0/1417801855 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f2dbc06ad60 0x7f2dbc06d210 secure :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2dd00b42f0 tx=0x7f2dc4009210 comp rx=0 tx=0).stop 2023-05-24T03:30:09.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.730+0000 7f2dd8361700 1 --2- 172.21.15.146:0/1417801855 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dd015a9c0 0x7f2dd00b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.730+0000 7f2dd8361700 1 --2- 172.21.15.146:0/1417801855 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2dd0071c60 0x7f2dd015af20 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.730+0000 7f2dd8361700 1 --2- 172.21.15.146:0/1417801855 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2dd00cc500 0x7f2dd00b3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.730+0000 7f2dd8361700 1 -- 172.21.15.146:0/1417801855 >> 172.21.15.146:0/1417801855 conn(0x7f2dd00cfea0 msgr2=0x7f2dd01553b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:09.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.731+0000 7f6c902ff700 1 -- 172.21.15.146:0/44239924 shutdown_connections 2023-05-24T03:30:09.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.731+0000 7f6c902ff700 1 --2- 172.21.15.146:0/44239924 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f6c6c06ad30 0x7f6c6c06d1e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.731+0000 7f6c902ff700 1 --2- 172.21.15.146:0/44239924 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c880cf8e0 0x7f6c881572a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.731+0000 7f6c902ff700 1 --2- 172.21.15.146:0/44239924 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6c8806da30 0x7f6c88150380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.731+0000 7f6c902ff700 1 --2- 172.21.15.146:0/44239924 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c880b0fd0 0x7f6c88156d60 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.731+0000 7f6c902ff700 1 -- 172.21.15.146:0/44239924 >> 172.21.15.146:0/44239924 conn(0x7f6c880cedd0 msgr2=0x7f6c880cd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:09.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.731+0000 7f6c902ff700 1 -- 172.21.15.146:0/44239924 shutdown_connections 2023-05-24T03:30:09.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.731+0000 7f6c902ff700 1 -- 172.21.15.146:0/44239924 wait complete. 2023-05-24T03:30:09.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.732+0000 7efd56ffd700 1 -- 172.21.15.146:0/2694281220 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efd68161310 con 0x7efd680afe10 2023-05-24T03:30:09.738 INFO:teuthology.orchestra.run.smithi146.stdout:55834574857 2023-05-24T03:30:09.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.735+0000 7efd6c872700 1 -- 172.21.15.146:0/2694281220 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7efd4806ad30 msgr2=0x7efd4806d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.736+0000 7efd6c872700 1 --2- 172.21.15.146:0/2694281220 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7efd4806ad30 0x7efd4806d1e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7efd6804fa50 tx=0x7efd5c008040 comp rx=0 tx=0).stop 2023-05-24T03:30:09.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.736+0000 7efd6c872700 1 -- 172.21.15.146:0/2694281220 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd680afe10 msgr2=0x7efd6815e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.736+0000 7efd6c872700 1 --2- 172.21.15.146:0/2694281220 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd680afe10 0x7efd6815e160 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7efd6000caa0 tx=0x7efd6000cdb0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.739+0000 7efd6c872700 1 -- 172.21.15.146:0/2694281220 shutdown_connections 2023-05-24T03:30:09.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.739+0000 7efd6c872700 1 --2- 172.21.15.146:0/2694281220 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7efd4806ad30 0x7efd4806d1e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.739+0000 7efd6c872700 1 --2- 172.21.15.146:0/2694281220 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd680b0280 0x7efd6815e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.739+0000 7efd6c872700 1 --2- 172.21.15.146:0/2694281220 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd500052d0 0x7efd680c6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.739+0000 7efd6c872700 1 --2- 172.21.15.146:0/2694281220 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd680afe10 0x7efd6815e160 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.739+0000 7efd6c872700 1 -- 172.21.15.146:0/2694281220 >> 172.21.15.146:0/2694281220 conn(0x7efd6806b0b0 msgr2=0x7efd681634c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:09.747 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.3 2023-05-24T03:30:09.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.744+0000 7f2dd8361700 1 -- 172.21.15.146:0/1417801855 shutdown_connections 2023-05-24T03:30:09.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.744+0000 7f2dd8361700 1 -- 172.21.15.146:0/1417801855 wait complete. 2023-05-24T03:30:09.749 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.4 2023-05-24T03:30:09.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.745+0000 7f5e5e119700 1 -- 172.21.15.146:0/281755511 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5e38005870 con 0x7f5e58159310 2023-05-24T03:30:09.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.746+0000 7f5e3ffff700 1 -- 172.21.15.146:0/281755511 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5e50023020 con 0x7f5e58159310 2023-05-24T03:30:09.750 INFO:teuthology.orchestra.run.smithi146.stdout:55834574858 2023-05-24T03:30:09.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.747+0000 7efd6c872700 1 -- 172.21.15.146:0/2694281220 shutdown_connections 2023-05-24T03:30:09.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.747+0000 7efd6c872700 1 -- 172.21.15.146:0/2694281220 wait complete. 2023-05-24T03:30:09.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.748+0000 7f5e5e119700 1 -- 172.21.15.146:0/281755511 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f5e4006b160 msgr2=0x7f5e4006d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.748+0000 7f5e5e119700 1 --2- 172.21.15.146:0/281755511 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f5e4006b160 0x7f5e4006d610 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c007fd0 tx=0x7f5e4c007920 comp rx=0 tx=0).stop 2023-05-24T03:30:09.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.748+0000 7f5e5e119700 1 -- 172.21.15.146:0/281755511 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e58159310 msgr2=0x7f5e580b1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.748+0000 7f5e5e119700 1 --2- 172.21.15.146:0/281755511 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e58159310 0x7f5e580b1460 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5e50007bd0 tx=0x7f5e50007f90 comp rx=0 tx=0).stop 2023-05-24T03:30:09.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.748+0000 7f5e5e119700 1 -- 172.21.15.146:0/281755511 shutdown_connections 2023-05-24T03:30:09.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.748+0000 7f5e5e119700 1 --2- 172.21.15.146:0/281755511 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f5e4006b160 0x7f5e4006d610 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.748+0000 7f5e5e119700 1 --2- 172.21.15.146:0/281755511 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e58159310 0x7f5e580b1460 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.748+0000 7f5e5e119700 1 --2- 172.21.15.146:0/281755511 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e58071bc0 0x7f5e580c6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.748+0000 7f5e5e119700 1 --2- 172.21.15.146:0/281755511 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e580ca7a0 0x7f5e580c9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.748+0000 7f5e5e119700 1 -- 172.21.15.146:0/281755511 >> 172.21.15.146:0/281755511 conn(0x7f5e580cf6c0 msgr2=0x7f5e580cb4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:09.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.750+0000 7f5e5e119700 1 -- 172.21.15.146:0/281755511 shutdown_connections 2023-05-24T03:30:09.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.750+0000 7f5e5e119700 1 -- 172.21.15.146:0/281755511 wait complete. 2023-05-24T03:30:09.758 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.6 2023-05-24T03:30:09.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.757+0000 7fc3d000c700 1 -- 172.21.15.146:0/1675818562 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc3b0005870 con 0x7fc3c80b67d0 2023-05-24T03:30:09.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.757+0000 7fc3be7fc700 1 -- 172.21.15.146:0/1675818562 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc3c4007720 con 0x7fc3c80b67d0 2023-05-24T03:30:09.762 INFO:teuthology.orchestra.run.smithi146.stdout:55834574858 2023-05-24T03:30:09.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.759+0000 7fc3d000c700 1 -- 172.21.15.146:0/1675818562 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fc3ac06ace0 msgr2=0x7fc3ac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.759+0000 7fc3d000c700 1 --2- 172.21.15.146:0/1675818562 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fc3ac06ace0 0x7fc3ac06d190 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc3c80b67a0 tx=0x7fc3b8009040 comp rx=0 tx=0).stop 2023-05-24T03:30:09.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.759+0000 7fc3d000c700 1 -- 172.21.15.146:0/1675818562 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3c80b67d0 msgr2=0x7fc3c814cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.759+0000 7fc3d000c700 1 --2- 172.21.15.146:0/1675818562 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3c80b67d0 0x7fc3c814cb80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc3c400c550 tx=0x7fc3c400c860 comp rx=0 tx=0).stop 2023-05-24T03:30:09.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.760+0000 7fc3d000c700 1 -- 172.21.15.146:0/1675818562 shutdown_connections 2023-05-24T03:30:09.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.760+0000 7fc3d000c700 1 --2- 172.21.15.146:0/1675818562 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fc3ac06ace0 0x7fc3ac06d190 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.760+0000 7fc3d000c700 1 --2- 172.21.15.146:0/1675818562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3c815cb50 0x7fc3c80a9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.760+0000 7fc3d000c700 1 --2- 172.21.15.146:0/1675818562 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3c80b67d0 0x7fc3c814cb80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.760+0000 7fc3d000c700 1 --2- 172.21.15.146:0/1675818562 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3c80d2da0 0x7fc3c80cbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.760+0000 7fc3d000c700 1 -- 172.21.15.146:0/1675818562 >> 172.21.15.146:0/1675818562 conn(0x7fc3c806af50 msgr2=0x7fc3c8066100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:09.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.760+0000 7fc3d000c700 1 -- 172.21.15.146:0/1675818562 shutdown_connections 2023-05-24T03:30:09.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.760+0000 7fc3d000c700 1 -- 172.21.15.146:0/1675818562 wait complete. 2023-05-24T03:30:09.767 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.0 2023-05-24T03:30:09.773 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.5 2023-05-24T03:30:09.776 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.2 2023-05-24T03:30:09.779 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.1 2023-05-24T03:30:09.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.776+0000 7f48e1397700 1 -- 172.21.15.146:0/680294167 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f48bc0055a0 con 0x7f48dc06da30 2023-05-24T03:30:09.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.776+0000 7f48c37fe700 1 -- 172.21.15.146:0/680294167 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f48d0017020 con 0x7f48dc06da30 2023-05-24T03:30:09.781 INFO:teuthology.orchestra.run.smithi146.stdout:55834574858 2023-05-24T03:30:09.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.778+0000 7f48e1397700 1 -- 172.21.15.146:0/680294167 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f48c406af10 msgr2=0x7f48c406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.778+0000 7f48e1397700 1 --2- 172.21.15.146:0/680294167 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f48c406af10 0x7f48c406d3c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f48dc0c8c80 tx=0x7f48cc008030 comp rx=0 tx=0).stop 2023-05-24T03:30:09.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.778+0000 7f48e1397700 1 -- 172.21.15.146:0/680294167 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48dc06da30 msgr2=0x7f48dc163a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:09.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.778+0000 7f48e1397700 1 --2- 172.21.15.146:0/680294167 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48dc06da30 0x7f48dc163a00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f48d000c450 tx=0x7f48d000c810 comp rx=0 tx=0).stop 2023-05-24T03:30:09.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.778+0000 7f48e1397700 1 -- 172.21.15.146:0/680294167 shutdown_connections 2023-05-24T03:30:09.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.778+0000 7f48e1397700 1 --2- 172.21.15.146:0/680294167 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f48c406af10 0x7f48c406d3c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.778+0000 7f48e1397700 1 --2- 172.21.15.146:0/680294167 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f48dc0ce6a0 0x7f48dc160850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.778+0000 7f48e1397700 1 --2- 172.21.15.146:0/680294167 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48dc06da30 0x7f48dc163a00 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.778+0000 7f48e1397700 1 --2- 172.21.15.146:0/680294167 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48dc06de00 0x7f48dc160310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:09.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.778+0000 7f48e1397700 1 -- 172.21.15.146:0/680294167 >> 172.21.15.146:0/680294167 conn(0x7f48dc0cedd0 msgr2=0x7f48dc0af000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:09.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.778+0000 7f48e1397700 1 -- 172.21.15.146:0/680294167 shutdown_connections 2023-05-24T03:30:09.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:09.778+0000 7f48e1397700 1 -- 172.21.15.146:0/680294167 wait complete. 2023-05-24T03:30:09.795 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.7 2023-05-24T03:30:10.749 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-05-24T03:30:10.750 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-05-24T03:30:10.759 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-05-24T03:30:10.768 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-05-24T03:30:10.773 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-05-24T03:30:10.777 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-05-24T03:30:10.780 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-05-24T03:30:10.796 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-05-24T03:30:10.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.946+0000 7f37861e2700 1 Processor -- start 2023-05-24T03:30:10.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.946+0000 7f37861e2700 1 -- start start 2023-05-24T03:30:10.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.947+0000 7f5748d48700 1 Processor -- start 2023-05-24T03:30:10.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.948+0000 7f37861e2700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f378006de00 0x7f37800ce160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:10.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.948+0000 7f37861e2700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f37800ce6a0 0x7f3780164d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:10.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.948+0000 7f37861e2700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37800ceb20 con 0x7f378006da30 2023-05-24T03:30:10.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.948+0000 7f37861e2700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37800ca740 con 0x7f378006de00 2023-05-24T03:30:10.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.948+0000 7f37861e2700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37800ca9e0 con 0x7f37800ce6a0 2023-05-24T03:30:10.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.949+0000 7f377effd700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f378006de00 0x7f37800ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:10.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.949+0000 7f377f7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f378006da30 0x7f37800cc910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45960/0 (socket says 172.21.15.146:45960) 2023-05-24T03:30:10.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.949+0000 7f377f7fe700 1 -- 172.21.15.146:0/682969789 learned_addr learned my addr 172.21.15.146:0/682969789 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:30:10.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.949+0000 7f377ffff700 1 --2- 172.21.15.146:0/682969789 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f37800ce6a0 0x7f3780164d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:10.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.948+0000 7f5748d48700 1 -- start start 2023-05-24T03:30:10.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.949+0000 7f5748d48700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f57440d00d0 0x7f57440b67d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:10.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.949+0000 7f5748d48700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57440d2fe0 con 0x7f5744161150 2023-05-24T03:30:10.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.949+0000 7f5748d48700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57440b4d90 con 0x7f57440cfc80 2023-05-24T03:30:10.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.949+0000 7f5748d48700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57440b5070 con 0x7f57440d00d0 2023-05-24T03:30:10.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.950+0000 7f5742d9d700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f57440d00d0 0x7f57440b67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:10.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.950+0000 7f5742d9d700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f57440d00d0 0x7f57440b67d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:50698/0 (socket says 172.21.15.146:50698) 2023-05-24T03:30:10.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.950+0000 7f5742d9d700 1 -- 172.21.15.146:0/3340263949 learned_addr learned my addr 172.21.15.146:0/3340263949 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:10.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.950+0000 7f377effd700 1 -- 172.21.15.146:0/682969789 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f37800ce6a0 msgr2=0x7f3780164d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:10.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.950+0000 7f377effd700 1 --2- 172.21.15.146:0/682969789 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f37800ce6a0 0x7f3780164d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:10.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.950+0000 7f377effd700 1 -- 172.21.15.146:0/682969789 >> v1:172.21.15.146:6789/0 conn(0x7f378006da30 legacy=0x7f37800cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:10.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.950+0000 7f377effd700 1 -- 172.21.15.146:0/682969789 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37800cacc0 con 0x7f378006de00 2023-05-24T03:30:10.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.950+0000 7f5742d9d700 1 -- 172.21.15.146:0/3340263949 >> v1:172.21.15.151:6789/0 conn(0x7f57440cfc80 legacy=0x7f57440b60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:10.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.950+0000 7f5742d9d700 1 -- 172.21.15.146:0/3340263949 >> v1:172.21.15.146:6789/0 conn(0x7f5744161150 legacy=0x7f57440d2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:10.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.950+0000 7f5742d9d700 1 -- 172.21.15.146:0/3340263949 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57440b5350 con 0x7f57440d00d0 2023-05-24T03:30:10.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.950+0000 7f377effd700 1 --2- 172.21.15.146:0/682969789 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f378006de00 0x7f37800ce160 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3770009840 tx=0x7f3770009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a43f618de965802 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:10.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.951+0000 7f377e7fc700 1 -- 172.21.15.146:0/682969789 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3770011830 con 0x7f378006de00 2023-05-24T03:30:10.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.951+0000 7f377e7fc700 1 -- 172.21.15.146:0/682969789 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3770011990 con 0x7f378006de00 2023-05-24T03:30:10.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.951+0000 7f377e7fc700 1 -- 172.21.15.146:0/682969789 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3770011d00 con 0x7f378006de00 2023-05-24T03:30:10.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.952+0000 7f37861e2700 1 -- 172.21.15.146:0/682969789 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f378006de00 msgr2=0x7f37800ce160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:10.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.952+0000 7f37861e2700 1 --2- 172.21.15.146:0/682969789 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f378006de00 0x7f37800ce160 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3770009840 tx=0x7f3770009b50 comp rx=0 tx=0).stop 2023-05-24T03:30:10.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.952+0000 7f5742d9d700 1 --2- 172.21.15.146:0/3340263949 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57440d00d0 0x7f57440b67d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f57340098f0 tx=0x7f5734009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97af1ad3f35aa46a server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:10.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.952+0000 7f574159a700 1 -- 172.21.15.146:0/3340263949 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5734004230 con 0x7f57440d00d0 2023-05-24T03:30:10.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.952+0000 7f574159a700 1 -- 172.21.15.146:0/3340263949 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5734004390 con 0x7f57440d00d0 2023-05-24T03:30:10.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.952+0000 7f574159a700 1 -- 172.21.15.146:0/3340263949 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57340036a0 con 0x7f57440d00d0 2023-05-24T03:30:10.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.953+0000 7f5748d48700 1 -- 172.21.15.146:0/3340263949 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57440d00d0 msgr2=0x7f57440b67d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:10.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.953+0000 7f5748d48700 1 --2- 172.21.15.146:0/3340263949 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57440d00d0 0x7f57440b67d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f57340098f0 tx=0x7f5734009c00 comp rx=0 tx=0).stop 2023-05-24T03:30:10.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.953+0000 7f5748d48700 1 -- 172.21.15.146:0/3340263949 shutdown_connections 2023-05-24T03:30:10.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.953+0000 7f5748d48700 1 --2- 172.21.15.146:0/3340263949 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57440d00d0 0x7f57440b67d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:10.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.953+0000 7f5748d48700 1 -- 172.21.15.146:0/3340263949 >> 172.21.15.146:0/3340263949 conn(0x7f574406af50 msgr2=0x7f574406b350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:10.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.953+0000 7f5748d48700 1 -- 172.21.15.146:0/3340263949 shutdown_connections 2023-05-24T03:30:10.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.953+0000 7f5748d48700 1 -- 172.21.15.146:0/3340263949 wait complete. 2023-05-24T03:30:10.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.955+0000 7f5748d48700 1 Processor -- start 2023-05-24T03:30:10.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.956+0000 7f5748d48700 1 -- start start 2023-05-24T03:30:10.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.957+0000 7f5748d48700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57440cfc80 0x7f57441fbd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:10.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.957+0000 7f5748d48700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57440d00d0 0x7f57440b3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:10.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.957+0000 7f5748d48700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5744161150 0x7f57440b43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:10.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.957+0000 7f5748d48700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5744155e40 con 0x7f57440d00d0 2023-05-24T03:30:10.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.957+0000 7f5748d48700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57441fc2c0 con 0x7f5744161150 2023-05-24T03:30:10.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.957+0000 7f5748d48700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57441ff7e0 con 0x7f57440cfc80 2023-05-24T03:30:10.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.957+0000 7f5741d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57440d00d0 0x7f57440b3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:10.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.957+0000 7f5741d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57440d00d0 0x7f57440b3ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39524/0 (socket says 172.21.15.146:39524) 2023-05-24T03:30:10.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.957+0000 7f5741d9b700 1 -- 172.21.15.146:0/2290332553 learned_addr learned my addr 172.21.15.146:0/2290332553 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:10.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.958+0000 7f5741d9b700 1 -- 172.21.15.146:0/2290332553 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57440cfc80 msgr2=0x7f57441fbd80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-05-24T03:30:10.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.958+0000 7f5741d9b700 1 --2- 172.21.15.146:0/2290332553 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57440cfc80 0x7f57441fbd80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:10.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.958+0000 7f5741d9b700 1 -- 172.21.15.146:0/2290332553 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5744161150 msgr2=0x7f57440b43e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-05-24T03:30:10.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.958+0000 7f5741d9b700 1 --2- 172.21.15.146:0/2290332553 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5744161150 0x7f57440b43e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:10.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.958+0000 7f5741d9b700 1 -- 172.21.15.146:0/2290332553 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5734009550 con 0x7f57440d00d0 2023-05-24T03:30:10.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.958+0000 7f5741d9b700 1 --2- 172.21.15.146:0/2290332553 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57440d00d0 0x7f57440b3ea0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f573800c450 tx=0x7f573800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:10.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.959+0000 7f37861e2700 1 -- 172.21.15.146:0/682969789 shutdown_connections 2023-05-24T03:30:10.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.959+0000 7f37861e2700 1 --2- 172.21.15.146:0/682969789 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f37800ce6a0 0x7f3780164d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:10.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.959+0000 7f37861e2700 1 --2- 172.21.15.146:0/682969789 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f378006de00 0x7f37800ce160 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:10.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.959+0000 7f37861e2700 1 -- 172.21.15.146:0/682969789 >> 172.21.15.146:0/682969789 conn(0x7f37800cedd0 msgr2=0x7f37800cf1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:10.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.959+0000 7f37861e2700 1 -- 172.21.15.146:0/682969789 shutdown_connections 2023-05-24T03:30:10.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.961+0000 7f5732ffd700 1 -- 172.21.15.146:0/2290332553 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57380052d0 con 0x7f57440d00d0 2023-05-24T03:30:10.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.961+0000 7f5732ffd700 1 -- 172.21.15.146:0/2290332553 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5738005430 con 0x7f57440d00d0 2023-05-24T03:30:10.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.961+0000 7f5732ffd700 1 -- 172.21.15.146:0/2290332553 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57380038a0 con 0x7f57440d00d0 2023-05-24T03:30:10.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.961+0000 7f5748d48700 1 -- 172.21.15.146:0/2290332553 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57440d0550 con 0x7f57440d00d0 2023-05-24T03:30:10.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.959+0000 7f37861e2700 1 -- 172.21.15.146:0/682969789 wait complete. 2023-05-24T03:30:10.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.961+0000 7f37861e2700 1 Processor -- start 2023-05-24T03:30:10.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.961+0000 7f5748d48700 1 -- 172.21.15.146:0/2290332553 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57440b5630 con 0x7f57440d00d0 2023-05-24T03:30:10.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.962+0000 7f37861e2700 1 -- start start 2023-05-24T03:30:10.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.963+0000 7f37861e2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f378006da30 0x7f37800c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:10.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.963+0000 7f37861e2700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f378006de00 0x7f3780154350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:10.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.963+0000 7f37861e2700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f37800ce6a0 0x7f37800af820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:10.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.963+0000 7f37861e2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3780154890 con 0x7f378006da30 2023-05-24T03:30:10.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.963+0000 7f37861e2700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3780154ca0 con 0x7f378006de00 2023-05-24T03:30:10.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.963+0000 7f37861e2700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37800c84b0 con 0x7f37800ce6a0 2023-05-24T03:30:10.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.965+0000 7f5732ffd700 1 -- 172.21.15.146:0/2290332553 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5738003a00 con 0x7f57440d00d0 2023-05-24T03:30:10.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.965+0000 7f5732ffd700 1 --2- 172.21.15.146:0/2290332553 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f572406adb0 0x7f572406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:10.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.965+0000 7f5732ffd700 1 -- 172.21.15.146:0/2290332553 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f57380889f0 con 0x7f57440d00d0 2023-05-24T03:30:10.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.966+0000 7f574259c700 1 --2- 172.21.15.146:0/2290332553 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f572406adb0 0x7f572406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:10.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.966+0000 7f574259c700 1 --2- 172.21.15.146:0/2290332553 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f572406adb0 0x7f572406d260 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f573c007fd0 tx=0x7f573c007da0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:10.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.964+0000 7f377ffff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f37800ce6a0 0x7f37800af820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:10.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.964+0000 7f377ffff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f37800ce6a0 0x7f37800af820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:52390/0 (socket says 172.21.15.146:52390) 2023-05-24T03:30:10.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.964+0000 7f377ffff700 1 -- 172.21.15.146:0/3556163439 learned_addr learned my addr 172.21.15.146:0/3556163439 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:10.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.964+0000 7f377ffff700 1 -- 172.21.15.146:0/3556163439 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f378006de00 msgr2=0x7f3780154350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-24T03:30:10.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.964+0000 7f377ffff700 1 --2- 172.21.15.146:0/3556163439 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f378006de00 0x7f3780154350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:10.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.964+0000 7f377ffff700 1 -- 172.21.15.146:0/3556163439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f378006da30 msgr2=0x7f37800c6d70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-24T03:30:10.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.964+0000 7f377ffff700 1 --2- 172.21.15.146:0/3556163439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f378006da30 0x7f37800c6d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:10.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.964+0000 7f377ffff700 1 -- 172.21.15.146:0/3556163439 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37700094a0 con 0x7f37800ce6a0 2023-05-24T03:30:10.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.964+0000 7f377ffff700 1 --2- 172.21.15.146:0/3556163439 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f37800ce6a0 0x7f37800af820 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f377400d5d0 tx=0x7f377400d990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:10.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.966+0000 7f3767fff700 1 -- 172.21.15.146:0/3556163439 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37740125f0 con 0x7f37800ce6a0 2023-05-24T03:30:10.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.966+0000 7f3767fff700 1 -- 172.21.15.146:0/3556163439 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3774012750 con 0x7f37800ce6a0 2023-05-24T03:30:10.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.966+0000 7f37861e2700 1 -- 172.21.15.146:0/3556163439 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37800cb280 con 0x7f37800ce6a0 2023-05-24T03:30:10.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.966+0000 7f37861e2700 1 -- 172.21.15.146:0/3556163439 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37800cafa0 con 0x7f37800ce6a0 2023-05-24T03:30:10.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.966+0000 7f3767fff700 1 -- 172.21.15.146:0/3556163439 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3774012b00 con 0x7f37800ce6a0 2023-05-24T03:30:10.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.968+0000 7f37861e2700 1 -- 172.21.15.146:0/3556163439 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37600052f0 con 0x7f37800ce6a0 2023-05-24T03:30:10.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.970+0000 7f3767fff700 1 -- 172.21.15.146:0/3556163439 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3774012c60 con 0x7f37800ce6a0 2023-05-24T03:30:10.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.970+0000 7f3767fff700 1 --2- 172.21.15.146:0/3556163439 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f376806af40 0x7f376806d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:10.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.970+0000 7f3767fff700 1 -- 172.21.15.146:0/3556163439 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f37740897d0 con 0x7f37800ce6a0 2023-05-24T03:30:10.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.971+0000 7f377f7fe700 1 --2- 172.21.15.146:0/3556163439 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f376806af40 0x7f376806d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:10.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.972+0000 7f377f7fe700 1 --2- 172.21.15.146:0/3556163439 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f376806af40 0x7f376806d3f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f37780012e0 tx=0x7f37780015b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:10.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.975+0000 7f3767fff700 1 -- 172.21.15.146:0/3556163439 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3774054600 con 0x7f37800ce6a0 2023-05-24T03:30:10.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.970+0000 7f5748d48700 1 -- 172.21.15.146:0/2290332553 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57440b5b50 con 0x7f57440d00d0 2023-05-24T03:30:10.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:10.979+0000 7f5732ffd700 1 -- 172.21.15.146:0/2290332553 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f57380538d0 con 0x7f57440d00d0 2023-05-24T03:30:11.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.003+0000 7f122689a700 1 Processor -- start 2023-05-24T03:30:11.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.005+0000 7f8a279d6700 1 Processor -- start 2023-05-24T03:30:11.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.004+0000 7f122689a700 1 -- start start 2023-05-24T03:30:11.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.005+0000 7f122689a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1220160f40 0x7f122006fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:11.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.005+0000 7f122689a700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f12200b0a80 0x7f12200b0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:11.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.005+0000 7f122689a700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1220161310 con 0x7f12200c1c70 2023-05-24T03:30:11.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.005+0000 7f122689a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12200cb680 con 0x7f1220160f40 2023-05-24T03:30:11.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.005+0000 7f122689a700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12200cab00 con 0x7f12200b0a80 2023-05-24T03:30:11.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.006+0000 7fde55685700 1 Processor -- start 2023-05-24T03:30:11.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.006+0000 7f121f7fe700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f12200b0a80 0x7f12200b0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:11.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.006+0000 7f121f7fe700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f12200b0a80 0x7f12200b0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:50716/0 (socket says 172.21.15.146:50716) 2023-05-24T03:30:11.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.006+0000 7f121f7fe700 1 -- 172.21.15.146:0/978858200 learned_addr learned my addr 172.21.15.146:0/978858200 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:11.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.005+0000 7f8a279d6700 1 -- start start 2023-05-24T03:30:11.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.006+0000 7f8a279d6700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a20160f40 0x7f8a2006fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:11.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.006+0000 7f8a279d6700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8a200c2380 0x7f8a200b0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:11.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.006+0000 7f8a279d6700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a20161310 con 0x7f8a200b0a80 2023-05-24T03:30:11.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.006+0000 7f8a279d6700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a200cb680 con 0x7f8a200c2380 2023-05-24T03:30:11.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.006+0000 7f8a279d6700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a200cab00 con 0x7f8a20160f40 2023-05-24T03:30:11.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.006+0000 7f121f7fe700 1 -- 172.21.15.146:0/978858200 >> v2:172.21.15.146:3300/0 conn(0x7f1220160f40 msgr2=0x7f122006fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:11.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.006+0000 7f121f7fe700 1 --2- 172.21.15.146:0/978858200 >> v2:172.21.15.146:3300/0 conn(0x7f1220160f40 0x7f122006fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.006+0000 7f121f7fe700 1 -- 172.21.15.146:0/978858200 >> v1:172.21.15.151:6789/0 conn(0x7f12200c1c70 legacy=0x7f12200ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:11.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.006+0000 7f121f7fe700 1 -- 172.21.15.146:0/978858200 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12200cade0 con 0x7f12200b0a80 2023-05-24T03:30:11.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.007+0000 7f8a25772700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a20160f40 0x7f8a2006fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:11.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.007+0000 7f8a25772700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a20160f40 0x7f8a2006fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:52402/0 (socket says 172.21.15.146:52402) 2023-05-24T03:30:11.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.007+0000 7f8a25772700 1 -- 172.21.15.146:0/3832433857 learned_addr learned my addr 172.21.15.146:0/3832433857 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:11.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.006+0000 7fde55685700 1 -- start start 2023-05-24T03:30:11.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.007+0000 7f121f7fe700 1 --2- 172.21.15.146:0/978858200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12200b0a80 0x7f12200b0f20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f122006e410 tx=0x7f121800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b611eca9cd5256b server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:11.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.007+0000 7f8a25f73700 1 --2- 172.21.15.146:0/3832433857 >> v2:172.21.15.151:3300/0 conn(0x7f8a200c2380 0x7f8a200b0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:11.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.007+0000 7f8a25772700 1 -- 172.21.15.146:0/3832433857 >> v2:172.21.15.151:3300/0 conn(0x7f8a200c2380 msgr2=0x7f8a200b0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:11.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.007+0000 7f8a25772700 1 --2- 172.21.15.146:0/3832433857 >> v2:172.21.15.151:3300/0 conn(0x7f8a200c2380 0x7f8a200b0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.007+0000 7f8a25772700 1 -- 172.21.15.146:0/3832433857 >> v1:172.21.15.151:6789/0 conn(0x7f8a200b0a80 legacy=0x7f8a200c1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:11.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.007+0000 7f8a25772700 1 -- 172.21.15.146:0/3832433857 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a200cade0 con 0x7f8a20160f40 2023-05-24T03:30:11.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.007+0000 7f8a25772700 1 --2- 172.21.15.146:0/3832433857 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a20160f40 0x7f8a2006fe00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8a100098f0 tx=0x7f8a10009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf66234b9798e97d server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:11.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.007+0000 7fde55685700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde50160db0 0x7fde5006a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:11.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.007+0000 7fde55685700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fde50161180 0x7fde5006a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:11.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.007+0000 7fde55685700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde5006b3c0 con 0x7fde500c2d40 2023-05-24T03:30:11.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.007+0000 7fde55685700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde500b19c0 con 0x7fde50161180 2023-05-24T03:30:11.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.007+0000 7fde55685700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde500b1ca0 con 0x7fde50160db0 2023-05-24T03:30:11.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.008+0000 7fde4effd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde50160db0 0x7fde5006a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:11.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.008+0000 7fde4effd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde50160db0 0x7fde5006a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:52408/0 (socket says 172.21.15.146:52408) 2023-05-24T03:30:11.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.008+0000 7fde4effd700 1 -- 172.21.15.146:0/3928051597 learned_addr learned my addr 172.21.15.146:0/3928051597 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:11.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.008+0000 7fde4e7fc700 1 --2- 172.21.15.146:0/3928051597 >> v2:172.21.15.146:3300/0 conn(0x7fde50161180 0x7fde5006a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:11.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.008+0000 7fde4effd700 1 -- 172.21.15.146:0/3928051597 >> v2:172.21.15.146:3300/0 conn(0x7fde50161180 msgr2=0x7fde5006a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:11.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.008+0000 7fde4effd700 1 --2- 172.21.15.146:0/3928051597 >> v2:172.21.15.146:3300/0 conn(0x7fde50161180 0x7fde5006a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.008+0000 7fde4effd700 1 -- 172.21.15.146:0/3928051597 >> v1:172.21.15.151:6789/0 conn(0x7fde500c2d40 legacy=0x7fde50164a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:11.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.008+0000 7fde4effd700 1 -- 172.21.15.146:0/3928051597 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde500b1f80 con 0x7fde50160db0 2023-05-24T03:30:11.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.008+0000 7fde4effd700 1 --2- 172.21.15.146:0/3928051597 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde50160db0 0x7fde5006a460 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fde440098f0 tx=0x7fde44009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69f18d223b0ce6be server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:11.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.008+0000 7fde4dffb700 1 -- 172.21.15.146:0/3928051597 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde44011830 con 0x7fde50160db0 2023-05-24T03:30:11.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.008+0000 7fde4dffb700 1 -- 172.21.15.146:0/3928051597 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde44011990 con 0x7fde50160db0 2023-05-24T03:30:11.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.008+0000 7fde4dffb700 1 -- 172.21.15.146:0/3928051597 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde44011d20 con 0x7fde50160db0 2023-05-24T03:30:11.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.009+0000 7fde55685700 1 -- 172.21.15.146:0/3928051597 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde50160db0 msgr2=0x7fde5006a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:11.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.009+0000 7fde55685700 1 --2- 172.21.15.146:0/3928051597 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde50160db0 0x7fde5006a460 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fde440098f0 tx=0x7fde44009c00 comp rx=0 tx=0).stop 2023-05-24T03:30:11.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.009+0000 7fde55685700 1 -- 172.21.15.146:0/3928051597 shutdown_connections 2023-05-24T03:30:11.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.009+0000 7fde55685700 1 --2- 172.21.15.146:0/3928051597 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde50160db0 0x7fde5006a460 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.009+0000 7fde55685700 1 --2- 172.21.15.146:0/3928051597 >> v2:172.21.15.146:3300/0 conn(0x7fde50161180 0x7fde5006a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.009+0000 7fde55685700 1 -- 172.21.15.146:0/3928051597 >> 172.21.15.146:0/3928051597 conn(0x7fde500cfea0 msgr2=0x7fde500d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:11.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.011+0000 7fde55685700 1 -- 172.21.15.146:0/3928051597 shutdown_connections 2023-05-24T03:30:11.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.011+0000 7fde55685700 1 -- 172.21.15.146:0/3928051597 wait complete. 2023-05-24T03:30:11.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.011+0000 7f121effd700 1 -- 172.21.15.146:0/978858200 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121800e070 con 0x7f12200b0a80 2023-05-24T03:30:11.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.011+0000 7f121effd700 1 -- 172.21.15.146:0/978858200 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f121800b9c0 con 0x7f12200b0a80 2023-05-24T03:30:11.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.011+0000 7f121effd700 1 -- 172.21.15.146:0/978858200 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121800bd70 con 0x7f12200b0a80 2023-05-24T03:30:11.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.012+0000 7f122689a700 1 -- 172.21.15.146:0/978858200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12200b0a80 msgr2=0x7f12200b0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:11.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.012+0000 7f122689a700 1 --2- 172.21.15.146:0/978858200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12200b0a80 0x7f12200b0f20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f122006e410 tx=0x7f121800b330 comp rx=0 tx=0).stop 2023-05-24T03:30:11.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.011+0000 7f8a17fff700 1 -- 172.21.15.146:0/3832433857 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1000b8a0 con 0x7f8a20160f40 2023-05-24T03:30:11.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.011+0000 7f8a17fff700 1 -- 172.21.15.146:0/3832433857 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1000ba00 con 0x7f8a20160f40 2023-05-24T03:30:11.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.011+0000 7f8a17fff700 1 -- 172.21.15.146:0/3832433857 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1000bd90 con 0x7f8a20160f40 2023-05-24T03:30:11.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.012+0000 7f8a279d6700 1 -- 172.21.15.146:0/3832433857 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a20160f40 msgr2=0x7f8a2006fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:11.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.012+0000 7f8a279d6700 1 --2- 172.21.15.146:0/3832433857 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a20160f40 0x7f8a2006fe00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8a100098f0 tx=0x7f8a10009c00 comp rx=0 tx=0).stop 2023-05-24T03:30:11.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.012+0000 7f122689a700 1 -- 172.21.15.146:0/978858200 shutdown_connections 2023-05-24T03:30:11.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.012+0000 7f122689a700 1 --2- 172.21.15.146:0/978858200 >> v2:172.21.15.146:3300/0 conn(0x7f1220160f40 0x7f122006fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.012+0000 7f122689a700 1 --2- 172.21.15.146:0/978858200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12200b0a80 0x7f12200b0f20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.012+0000 7f122689a700 1 -- 172.21.15.146:0/978858200 >> 172.21.15.146:0/978858200 conn(0x7f122006b0b0 msgr2=0x7f12200cedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:11.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.012+0000 7f122689a700 1 -- 172.21.15.146:0/978858200 shutdown_connections 2023-05-24T03:30:11.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.012+0000 7f122689a700 1 -- 172.21.15.146:0/978858200 wait complete. 2023-05-24T03:30:11.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.013+0000 7fde55685700 1 Processor -- start 2023-05-24T03:30:11.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.014+0000 7f122689a700 1 Processor -- start 2023-05-24T03:30:11.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.013+0000 7fde55685700 1 -- start start 2023-05-24T03:30:11.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.014+0000 7fde55685700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde500c2d40 0x7fde500b5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:11.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.014+0000 7fde55685700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde50160db0 0x7fde50162ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:11.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.014+0000 7fde55685700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde50161180 0x7fde500c5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:11.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.014+0000 7fde55685700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde500c8c80 con 0x7fde50160db0 2023-05-24T03:30:11.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.014+0000 7fde55685700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde500b56d0 con 0x7fde50161180 2023-05-24T03:30:11.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.014+0000 7fde55685700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde50163d10 con 0x7fde500c2d40 2023-05-24T03:30:11.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.014+0000 7f122689a700 1 -- start start 2023-05-24T03:30:11.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.014+0000 7fde4e7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde50160db0 0x7fde50162ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:11.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.014+0000 7fde4e7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde50160db0 0x7fde50162ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39552/0 (socket says 172.21.15.146:39552) 2023-05-24T03:30:11.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.014+0000 7fde4e7fc700 1 -- 172.21.15.146:0/1084602170 learned_addr learned my addr 172.21.15.146:0/1084602170 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:11.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.014+0000 7fde4effd700 1 --2- 172.21.15.146:0/1084602170 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde500c2d40 0x7fde500b5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:11.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.015+0000 7fde4f7fe700 1 --2- 172.21.15.146:0/1084602170 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde50161180 0x7fde500c5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:11.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.015+0000 7fde4e7fc700 1 -- 172.21.15.146:0/1084602170 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde500c2d40 msgr2=0x7fde500b5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:11.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.015+0000 7fde4e7fc700 1 --2- 172.21.15.146:0/1084602170 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde500c2d40 0x7fde500b5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.015+0000 7fde4e7fc700 1 -- 172.21.15.146:0/1084602170 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde50161180 msgr2=0x7fde500c5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:11.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.015+0000 7fde4e7fc700 1 --2- 172.21.15.146:0/1084602170 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde50161180 0x7fde500c5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.015+0000 7fde4e7fc700 1 -- 172.21.15.146:0/1084602170 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde44009550 con 0x7fde50160db0 2023-05-24T03:30:11.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.015+0000 7fde4e7fc700 1 --2- 172.21.15.146:0/1084602170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde50160db0 0x7fde50162ed0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fde4000ea00 tx=0x7fde4000ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:11.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.015+0000 7fde377fe700 1 -- 172.21.15.146:0/1084602170 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde40009730 con 0x7fde50160db0 2023-05-24T03:30:11.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.015+0000 7f122689a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12200b0a80 0x7f12200c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:11.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.015+0000 7f122689a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12200c1c70 0x7f1220163730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:11.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.015+0000 7f122689a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1220160f40 0x7f122014f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:11.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.015+0000 7f122689a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12200c8290 con 0x7f1220160f40 2023-05-24T03:30:11.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.015+0000 7f122689a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12200c8560 con 0x7f12200b0a80 2023-05-24T03:30:11.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.015+0000 7f122689a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12200c8840 con 0x7f12200c1c70 2023-05-24T03:30:11.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.015+0000 7fde55685700 1 -- 172.21.15.146:0/1084602170 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde500b2540 con 0x7fde50160db0 2023-05-24T03:30:11.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.015+0000 7fde55685700 1 -- 172.21.15.146:0/1084602170 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde500b2260 con 0x7fde50160db0 2023-05-24T03:30:11.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.016+0000 7f1224e37700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1220160f40 0x7f122014f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:11.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.016+0000 7f1224e37700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1220160f40 0x7f122014f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39558/0 (socket says 172.21.15.146:39558) 2023-05-24T03:30:11.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.016+0000 7f1224e37700 1 -- 172.21.15.146:0/3852161268 learned_addr learned my addr 172.21.15.146:0/3852161268 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:11.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.016+0000 7fde377fe700 1 -- 172.21.15.146:0/1084602170 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4000eea0 con 0x7fde50160db0 2023-05-24T03:30:11.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.016+0000 7fde377fe700 1 -- 172.21.15.146:0/1084602170 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4000ca10 con 0x7fde50160db0 2023-05-24T03:30:11.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.016+0000 7f121f7fe700 1 --2- 172.21.15.146:0/3852161268 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12200c1c70 0x7f1220163730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:11.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.016+0000 7f1224e37700 1 -- 172.21.15.146:0/3852161268 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12200c1c70 msgr2=0x7f1220163730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:11.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.016+0000 7f1224e37700 1 --2- 172.21.15.146:0/3852161268 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12200c1c70 0x7f1220163730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.016+0000 7f1224e37700 1 -- 172.21.15.146:0/3852161268 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12200b0a80 msgr2=0x7f12200c7d50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-05-24T03:30:11.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.016+0000 7f1224e37700 1 --2- 172.21.15.146:0/3852161268 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12200b0a80 0x7f12200c7d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.016+0000 7f1224e37700 1 -- 172.21.15.146:0/3852161268 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1218009b30 con 0x7f1220160f40 2023-05-24T03:30:11.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.017+0000 7f1224e37700 1 --2- 172.21.15.146:0/3852161268 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1220160f40 0x7f122014f070 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f121000c420 tx=0x7f121000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:11.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.017+0000 7f121cff9700 1 -- 172.21.15.146:0/3852161268 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12100052d0 con 0x7f1220160f40 2023-05-24T03:30:11.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.017+0000 7f121cff9700 1 -- 172.21.15.146:0/3852161268 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1210005430 con 0x7f1220160f40 2023-05-24T03:30:11.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.017+0000 7f122689a700 1 -- 172.21.15.146:0/3852161268 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12200cb3a0 con 0x7f1220160f40 2023-05-24T03:30:11.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.017+0000 7f121cff9700 1 -- 172.21.15.146:0/3852161268 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1210006aa0 con 0x7f1220160f40 2023-05-24T03:30:11.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.017+0000 7f122689a700 1 -- 172.21.15.146:0/3852161268 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12200cb0c0 con 0x7f1220160f40 2023-05-24T03:30:11.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.018+0000 7fde377fe700 1 -- 172.21.15.146:0/1084602170 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fde4000cc50 con 0x7fde50160db0 2023-05-24T03:30:11.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.018+0000 7f122689a700 1 -- 172.21.15.146:0/3852161268 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12200ca7b0 con 0x7f1220160f40 2023-05-24T03:30:11.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.018+0000 7f121cff9700 1 -- 172.21.15.146:0/3852161268 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1210003680 con 0x7f1220160f40 2023-05-24T03:30:11.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.018+0000 7fde377fe700 1 --2- 172.21.15.146:0/1084602170 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fde3c06ad10 0x7fde3c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:11.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.019+0000 7fde377fe700 1 -- 172.21.15.146:0/1084602170 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fde400896f0 con 0x7fde50160db0 2023-05-24T03:30:11.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.019+0000 7fde4effd700 1 --2- 172.21.15.146:0/1084602170 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fde3c06ad10 0x7fde3c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:11.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.019+0000 7f121cff9700 1 --2- 172.21.15.146:0/3852161268 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f120c06ace0 0x7f120c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:11.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.019+0000 7f121cff9700 1 -- 172.21.15.146:0/3852161268 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1210088890 con 0x7f1220160f40 2023-05-24T03:30:11.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.019+0000 7fde4effd700 1 --2- 172.21.15.146:0/1084602170 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fde3c06ad10 0x7fde3c06d1c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fde44009c40 tx=0x7fde44008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:11.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.019+0000 7f121ffff700 1 --2- 172.21.15.146:0/3852161268 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f120c06ace0 0x7f120c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:11.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.019+0000 7f121ffff700 1 --2- 172.21.15.146:0/3852161268 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f120c06ace0 0x7f120c06d190 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f12200aef20 tx=0x7f1214006c10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:11.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.021+0000 7f8a279d6700 1 -- 172.21.15.146:0/3832433857 shutdown_connections 2023-05-24T03:30:11.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.021+0000 7f8a279d6700 1 --2- 172.21.15.146:0/3832433857 >> v2:172.21.15.151:3300/0 conn(0x7f8a200c2380 0x7f8a200b0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.021+0000 7f8a279d6700 1 --2- 172.21.15.146:0/3832433857 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a20160f40 0x7f8a2006fe00 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.021+0000 7f8a279d6700 1 -- 172.21.15.146:0/3832433857 >> 172.21.15.146:0/3832433857 conn(0x7f8a2006b0b0 msgr2=0x7f8a200cedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:11.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.021+0000 7f8a279d6700 1 -- 172.21.15.146:0/3832433857 shutdown_connections 2023-05-24T03:30:11.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.021+0000 7f8a279d6700 1 -- 172.21.15.146:0/3832433857 wait complete. 2023-05-24T03:30:11.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.022+0000 7f8a279d6700 1 Processor -- start 2023-05-24T03:30:11.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.022+0000 7f8a279d6700 1 -- start start 2023-05-24T03:30:11.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.023+0000 7f8a279d6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a200b0a80 0x7f8a200c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:11.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.023+0000 7f8a279d6700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a200c2380 0x7f8a201504c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:11.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.023+0000 7f8a279d6700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a20160f40 0x7f8a20150a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:11.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.023+0000 7f8a279d6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a20151cb0 con 0x7f8a200b0a80 2023-05-24T03:30:11.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.023+0000 7f8a279d6700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a201524e0 con 0x7f8a20160f40 2023-05-24T03:30:11.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.023+0000 7f8a279d6700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a201510a0 con 0x7f8a200c2380 2023-05-24T03:30:11.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.023+0000 7f8a25772700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a200b0a80 0x7f8a200c42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:11.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.023+0000 7f8a25772700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a200b0a80 0x7f8a200c42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39566/0 (socket says 172.21.15.146:39566) 2023-05-24T03:30:11.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.023+0000 7f8a25772700 1 -- 172.21.15.146:0/2143146495 learned_addr learned my addr 172.21.15.146:0/2143146495 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:11.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.023+0000 7f8a25f73700 1 --2- 172.21.15.146:0/2143146495 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a20160f40 0x7f8a20150a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:11.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.023+0000 7f8a24f71700 1 --2- 172.21.15.146:0/2143146495 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a200c2380 0x7f8a201504c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:11.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.024+0000 7f8a25772700 1 -- 172.21.15.146:0/2143146495 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a200c2380 msgr2=0x7f8a201504c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:11.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.024+0000 7f8a25772700 1 --2- 172.21.15.146:0/2143146495 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a200c2380 0x7f8a201504c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.024+0000 7f8a25772700 1 -- 172.21.15.146:0/2143146495 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a20160f40 msgr2=0x7f8a20150a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:11.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.024+0000 7f8a25772700 1 --2- 172.21.15.146:0/2143146495 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a20160f40 0x7f8a20150a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.024+0000 7f8a25772700 1 -- 172.21.15.146:0/2143146495 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a10009550 con 0x7f8a200b0a80 2023-05-24T03:30:11.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.024+0000 7f8a24f71700 1 --2- 172.21.15.146:0/2143146495 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a200c2380 0x7f8a201504c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T03:30:11.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.024+0000 7f8a25f73700 1 --2- 172.21.15.146:0/2143146495 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a20160f40 0x7f8a20150a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T03:30:11.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.024+0000 7f8a25772700 1 --2- 172.21.15.146:0/2143146495 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a200b0a80 0x7f8a200c42a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8a10000c00 tx=0x7f8a10004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:11.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.025+0000 7f38ecdef700 1 Processor -- start 2023-05-24T03:30:11.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.025+0000 7f38ecdef700 1 -- start start 2023-05-24T03:30:11.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.026+0000 7f38ecdef700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f38e80c9390 0x7f38e806c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:11.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.026+0000 7f38ecdef700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38e815abd0 con 0x7f38e80b4630 2023-05-24T03:30:11.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.026+0000 7f38ecdef700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38e815e2f0 con 0x7f38e806da30 2023-05-24T03:30:11.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.026+0000 7f38ecdef700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38e815e5d0 con 0x7f38e80c9390 2023-05-24T03:30:11.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.026+0000 7f38e5d9b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f38e80b4630 0x7f38e80714b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46026/0 (socket says 172.21.15.146:46026) 2023-05-24T03:30:11.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.026+0000 7f38e5d9b700 1 -- 172.21.15.146:0/1566284257 learned_addr learned my addr 172.21.15.146:0/1566284257 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:30:11.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.026+0000 7f38e659c700 1 --1- 172.21.15.146:0/1566284257 >> v1:172.21.15.151:6789/0 conn(0x7f38e806da30 0x7f38e806de00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:45058/0 (socket says 172.21.15.146:45058) 2023-05-24T03:30:11.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.026+0000 7f38e6d9d700 1 --2- 172.21.15.146:0/1566284257 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f38e80c9390 0x7f38e806c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:11.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.026+0000 7f38e559a700 1 -- 172.21.15.146:0/1566284257 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1115321279 0 0) 0x7f38e815e2f0 con 0x7f38e806da30 2023-05-24T03:30:11.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.026+0000 7f38e559a700 1 -- 172.21.15.146:0/1566284257 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38d00035b0 con 0x7f38e806da30 2023-05-24T03:30:11.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.026+0000 7f38e6d9d700 1 -- 172.21.15.146:0/1566284257 >> v1:172.21.15.151:6789/0 conn(0x7f38e806da30 legacy=0x7f38e806de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:11.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.026+0000 7f38e6d9d700 1 -- 172.21.15.146:0/1566284257 >> v1:172.21.15.146:6789/0 conn(0x7f38e80b4630 legacy=0x7f38e80714b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:11.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.026+0000 7f38e6d9d700 1 -- 172.21.15.146:0/1566284257 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e815e8b0 con 0x7f38e80c9390 2023-05-24T03:30:11.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.026+0000 7f38e6d9d700 1 --2- 172.21.15.146:0/1566284257 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f38e80c9390 0x7f38e806c020 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f38d8009870 tx=0x7f38d8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ea6249b60c495ba server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:11.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.027+0000 7f38e559a700 1 -- 172.21.15.146:0/1566284257 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d8011830 con 0x7f38e80c9390 2023-05-24T03:30:11.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.027+0000 7f38e559a700 1 -- 172.21.15.146:0/1566284257 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38d8011990 con 0x7f38e80c9390 2023-05-24T03:30:11.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.027+0000 7f38e559a700 1 -- 172.21.15.146:0/1566284257 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d8011d20 con 0x7f38e80c9390 2023-05-24T03:30:11.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.027+0000 7f8a15ffb700 1 -- 172.21.15.146:0/2143146495 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a10004450 con 0x7f8a200b0a80 2023-05-24T03:30:11.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.027+0000 7f8a279d6700 1 -- 172.21.15.146:0/2143146495 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a200cb3a0 con 0x7f8a200b0a80 2023-05-24T03:30:11.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.027+0000 7f8a15ffb700 1 -- 172.21.15.146:0/2143146495 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a100045b0 con 0x7f8a200b0a80 2023-05-24T03:30:11.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.027+0000 7f121cff9700 1 -- 172.21.15.146:0/3852161268 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f1210053650 con 0x7f1220160f40 2023-05-24T03:30:11.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.028+0000 7f38ecdef700 1 -- 172.21.15.146:0/1566284257 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f38e80c9390 msgr2=0x7f38e806c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:11.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.028+0000 7f38ecdef700 1 --2- 172.21.15.146:0/1566284257 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f38e80c9390 0x7f38e806c020 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f38d8009870 tx=0x7f38d8009b80 comp rx=0 tx=0).stop 2023-05-24T03:30:11.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.028+0000 7f38ecdef700 1 -- 172.21.15.146:0/1566284257 shutdown_connections 2023-05-24T03:30:11.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.028+0000 7f38ecdef700 1 --2- 172.21.15.146:0/1566284257 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f38e80c9390 0x7f38e806c020 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.028+0000 7f38ecdef700 1 -- 172.21.15.146:0/1566284257 >> 172.21.15.146:0/1566284257 conn(0x7f38e80cedd0 msgr2=0x7f38e80cf1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:11.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.028+0000 7f38ecdef700 1 -- 172.21.15.146:0/1566284257 shutdown_connections 2023-05-24T03:30:11.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.027+0000 7f8a15ffb700 1 -- 172.21.15.146:0/2143146495 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a100038e0 con 0x7f8a200b0a80 2023-05-24T03:30:11.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.027+0000 7f8a279d6700 1 -- 172.21.15.146:0/2143146495 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a200cb0c0 con 0x7f8a200b0a80 2023-05-24T03:30:11.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.028+0000 7f38ecdef700 1 -- 172.21.15.146:0/1566284257 wait complete. 2023-05-24T03:30:11.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.030+0000 7f38ecdef700 1 Processor -- start 2023-05-24T03:30:11.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.031+0000 7f3b665ad700 1 Processor -- start 2023-05-24T03:30:11.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.030+0000 7f38ecdef700 1 -- start start 2023-05-24T03:30:11.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.031+0000 7f38ecdef700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38e806da30 0x7f38e80b3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:11.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.031+0000 7f38ecdef700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38e80b4630 0x7f38e81f9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:11.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.031+0000 7f38ecdef700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f38e80c9390 0x7f38e8159300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:11.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.031+0000 7f38ecdef700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38e80b20c0 con 0x7f38e80b4630 2023-05-24T03:30:11.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.031+0000 7f38ecdef700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38e80b1db0 con 0x7f38e806da30 2023-05-24T03:30:11.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.031+0000 7f38ecdef700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38e81f9cc0 con 0x7f38e80c9390 2023-05-24T03:30:11.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.031+0000 7f38e5d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38e80b4630 0x7f38e81f9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:11.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.031+0000 7f38e5d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38e80b4630 0x7f38e81f9780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39580/0 (socket says 172.21.15.146:39580) 2023-05-24T03:30:11.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.031+0000 7f38e5d9b700 1 -- 172.21.15.146:0/2369619382 learned_addr learned my addr 172.21.15.146:0/2369619382 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:11.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.031+0000 7f38e6d9d700 1 --2- 172.21.15.146:0/2369619382 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f38e80c9390 0x7f38e8159300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:11.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.031+0000 7f38e659c700 1 --2- 172.21.15.146:0/2369619382 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38e806da30 0x7f38e80b3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:11.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.031+0000 7f8a15ffb700 1 -- 172.21.15.146:0/2143146495 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8a10003a40 con 0x7f8a200b0a80 2023-05-24T03:30:11.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.031+0000 7f38e6d9d700 1 -- 172.21.15.146:0/2369619382 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38e806da30 msgr2=0x7f38e80b3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:11.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.031+0000 7f38e6d9d700 1 --2- 172.21.15.146:0/2369619382 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38e806da30 0x7f38e80b3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.031+0000 7f38e6d9d700 1 -- 172.21.15.146:0/2369619382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38e80b4630 msgr2=0x7f38e81f9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:11.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.031+0000 7f38e6d9d700 1 --2- 172.21.15.146:0/2369619382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38e80b4630 0x7f38e81f9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.031+0000 7f38e6d9d700 1 -- 172.21.15.146:0/2369619382 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d80094a0 con 0x7f38e80c9390 2023-05-24T03:30:11.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.031+0000 7f38e5d9b700 1 --2- 172.21.15.146:0/2369619382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38e80b4630 0x7f38e81f9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:30:11.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.031+0000 7f8a15ffb700 1 --2- 172.21.15.146:0/2143146495 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f8a0406acb0 0x7f8a0406d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:11.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.031+0000 7f8a15ffb700 1 -- 172.21.15.146:0/2143146495 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8a1008a5b0 con 0x7f8a200b0a80 2023-05-24T03:30:11.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.032+0000 7f8a24f71700 1 --2- 172.21.15.146:0/2143146495 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f8a0406acb0 0x7f8a0406d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:11.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.032+0000 7f38e6d9d700 1 --2- 172.21.15.146:0/2369619382 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f38e80c9390 0x7f38e8159300 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f38d8016000 tx=0x7f38d8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:11.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.032+0000 7f38d6ffd700 1 -- 172.21.15.146:0/2369619382 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d80036a0 con 0x7f38e80c9390 2023-05-24T03:30:11.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.032+0000 7f38d6ffd700 1 -- 172.21.15.146:0/2369619382 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38d801f070 con 0x7f38e80c9390 2023-05-24T03:30:11.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.032+0000 7f38d6ffd700 1 -- 172.21.15.146:0/2369619382 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d8003a60 con 0x7f38e80c9390 2023-05-24T03:30:11.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.032+0000 7f38ecdef700 1 -- 172.21.15.146:0/2369619382 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38e815ee70 con 0x7f38e80c9390 2023-05-24T03:30:11.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.032+0000 7f38ecdef700 1 -- 172.21.15.146:0/2369619382 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38e815eb90 con 0x7f38e80c9390 2023-05-24T03:30:11.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.031+0000 7f3b665ad700 1 -- start start 2023-05-24T03:30:11.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.032+0000 7f3b665ad700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3b6006e140 0x7f3b600b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:11.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.032+0000 7f3b665ad700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3b600b0e00 0x7f3b601529c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:11.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.032+0000 7f3b665ad700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b60159c80 con 0x7f3b60071670 2023-05-24T03:30:11.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.032+0000 7f3b665ad700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b6015d840 con 0x7f3b600b0e00 2023-05-24T03:30:11.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.032+0000 7f3b665ad700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b60159350 con 0x7f3b6006e140 2023-05-24T03:30:11.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.032+0000 7f3b64b4a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3b600b0e00 0x7f3b601529c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:11.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.032+0000 7f3b5ffff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3b60071670 0x7f3b6006da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46038/0 (socket says 172.21.15.146:46038) 2023-05-24T03:30:11.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.032+0000 7f3b5ffff700 1 -- 172.21.15.146:0/3691863371 learned_addr learned my addr 172.21.15.146:0/3691863371 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:30:11.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.033+0000 7f3b5f7fe700 1 --2- 172.21.15.146:0/3691863371 >> v2:172.21.15.151:3300/0 conn(0x7f3b6006e140 0x7f3b600b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:11.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.033+0000 7f3b64b4a700 1 -- 172.21.15.146:0/3691863371 >> v2:172.21.15.151:3300/0 conn(0x7f3b6006e140 msgr2=0x7f3b600b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:11.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.033+0000 7f3b64b4a700 1 --2- 172.21.15.146:0/3691863371 >> v2:172.21.15.151:3300/0 conn(0x7f3b6006e140 0x7f3b600b08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.033+0000 7f3b64b4a700 1 -- 172.21.15.146:0/3691863371 >> v1:172.21.15.146:6789/0 conn(0x7f3b60071670 legacy=0x7f3b6006da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:11.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.033+0000 7f3b64b4a700 1 -- 172.21.15.146:0/3691863371 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b60159630 con 0x7f3b600b0e00 2023-05-24T03:30:11.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.033+0000 7fde55685700 1 -- 172.21.15.146:0/1084602170 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde300052f0 con 0x7fde50160db0 2023-05-24T03:30:11.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.033+0000 7f3b64b4a700 1 --2- 172.21.15.146:0/3691863371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b600b0e00 0x7f3b601529c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3b6006ca90 tx=0x7f3b5800d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=318923987edc09b1 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:11.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.034+0000 7f38d6ffd700 1 -- 172.21.15.146:0/2369619382 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f38d8003bc0 con 0x7f38e80c9390 2023-05-24T03:30:11.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.034+0000 7f38ecdef700 1 -- 172.21.15.146:0/2369619382 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38c8005320 con 0x7f38e80c9390 2023-05-24T03:30:11.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.035+0000 7f38d6ffd700 1 --2- 172.21.15.146:0/2369619382 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f38d006b0c0 0x7f38d006d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:11.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.035+0000 7f38d6ffd700 1 -- 172.21.15.146:0/2369619382 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f38d8021070 con 0x7f38e80c9390 2023-05-24T03:30:11.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.036+0000 7f38e659c700 1 --2- 172.21.15.146:0/2369619382 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f38d006b0c0 0x7f38d006d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:11.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.036+0000 7f38e659c700 1 --2- 172.21.15.146:0/2369619382 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f38d006b0c0 0x7f38d006d570 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f38e00015a0 tx=0x7f38e0001b50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:11.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.036+0000 7f8a24f71700 1 --2- 172.21.15.146:0/2143146495 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f8a0406acb0 0x7f8a0406d160 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8a18002230 tx=0x7f8a18009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:11.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.039+0000 7f38d6ffd700 1 -- 172.21.15.146:0/2369619382 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f38d8055cb0 con 0x7f38e80c9390 2023-05-24T03:30:11.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.041+0000 7f8a279d6700 1 -- 172.21.15.146:0/2143146495 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a200ca7b0 con 0x7f8a200b0a80 2023-05-24T03:30:11.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.043+0000 7f3b5effd700 1 -- 172.21.15.146:0/3691863371 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b58010070 con 0x7f3b600b0e00 2023-05-24T03:30:11.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.043+0000 7f3b5effd700 1 -- 172.21.15.146:0/3691863371 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b5800b2e0 con 0x7f3b600b0e00 2023-05-24T03:30:11.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.043+0000 7f3b5effd700 1 -- 172.21.15.146:0/3691863371 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5800dcc0 con 0x7f3b600b0e00 2023-05-24T03:30:11.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.041+0000 7fde377fe700 1 -- 172.21.15.146:0/1084602170 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fde400544b0 con 0x7fde50160db0 2023-05-24T03:30:11.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.044+0000 7f3b665ad700 1 -- 172.21.15.146:0/3691863371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b600b0e00 msgr2=0x7f3b601529c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:11.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.044+0000 7f3b665ad700 1 --2- 172.21.15.146:0/3691863371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b600b0e00 0x7f3b601529c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3b6006ca90 tx=0x7f3b5800d330 comp rx=0 tx=0).stop 2023-05-24T03:30:11.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.045+0000 7f3b665ad700 1 -- 172.21.15.146:0/3691863371 shutdown_connections 2023-05-24T03:30:11.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.045+0000 7f3b665ad700 1 --2- 172.21.15.146:0/3691863371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b600b0e00 0x7f3b601529c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.045+0000 7f3b665ad700 1 --2- 172.21.15.146:0/3691863371 >> v2:172.21.15.151:3300/0 conn(0x7f3b6006e140 0x7f3b600b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.045+0000 7f3b665ad700 1 -- 172.21.15.146:0/3691863371 >> 172.21.15.146:0/3691863371 conn(0x7f3b600cedd0 msgr2=0x7f3b600cf1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:11.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.053+0000 7f8a15ffb700 1 -- 172.21.15.146:0/2143146495 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f8a10055400 con 0x7f8a200b0a80 2023-05-24T03:30:11.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.053+0000 7f3b665ad700 1 -- 172.21.15.146:0/3691863371 shutdown_connections 2023-05-24T03:30:11.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.056+0000 7f3b665ad700 1 -- 172.21.15.146:0/3691863371 wait complete. 2023-05-24T03:30:11.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.058+0000 7f3b665ad700 1 Processor -- start 2023-05-24T03:30:11.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.061+0000 7f3b665ad700 1 -- start start 2023-05-24T03:30:11.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.062+0000 7f3b665ad700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b6006e140 0x7f3b60202fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:11.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.062+0000 7f3b665ad700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b60071670 0x7f3b600b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:11.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.062+0000 7f3b665ad700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3b600b0e00 0x7f3b600b42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:11.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.062+0000 7f3b665ad700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b600b4830 con 0x7f3b60071670 2023-05-24T03:30:11.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.062+0000 7f3b665ad700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b600c6820 con 0x7f3b6006e140 2023-05-24T03:30:11.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.062+0000 7f3b665ad700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b600b1c00 con 0x7f3b600b0e00 2023-05-24T03:30:11.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.062+0000 7f3b5f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b60071670 0x7f3b600b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:11.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.062+0000 7f3b5f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b60071670 0x7f3b600b3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39596/0 (socket says 172.21.15.146:39596) 2023-05-24T03:30:11.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.062+0000 7f3b5f7fe700 1 -- 172.21.15.146:0/3983177013 learned_addr learned my addr 172.21.15.146:0/3983177013 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:11.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.062+0000 7f3b5ffff700 1 --2- 172.21.15.146:0/3983177013 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b6006e140 0x7f3b60202fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:11.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.063+0000 7f3b5f7fe700 1 -- 172.21.15.146:0/3983177013 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3b600b0e00 msgr2=0x7f3b600b42f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-05-24T03:30:11.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.063+0000 7f3b5f7fe700 1 --2- 172.21.15.146:0/3983177013 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3b600b0e00 0x7f3b600b42f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.063+0000 7f3b5f7fe700 1 -- 172.21.15.146:0/3983177013 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b6006e140 msgr2=0x7f3b60202fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:11.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.063+0000 7f3b5f7fe700 1 --2- 172.21.15.146:0/3983177013 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b6006e140 0x7f3b60202fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.063+0000 7f3b5f7fe700 1 -- 172.21.15.146:0/3983177013 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b5800bc80 con 0x7f3b60071670 2023-05-24T03:30:11.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.063+0000 7f3b5ffff700 1 --2- 172.21.15.146:0/3983177013 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b6006e140 0x7f3b60202fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:30:11.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.063+0000 7f3b5f7fe700 1 --2- 172.21.15.146:0/3983177013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b60071670 0x7f3b600b3db0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3b5400d750 tx=0x7f3b5400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:11.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.064+0000 7f3b5cff9700 1 -- 172.21.15.146:0/3983177013 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b540125f0 con 0x7f3b60071670 2023-05-24T03:30:11.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.064+0000 7f3b5cff9700 1 -- 172.21.15.146:0/3983177013 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b54012750 con 0x7f3b60071670 2023-05-24T03:30:11.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.064+0000 7f3b5cff9700 1 -- 172.21.15.146:0/3983177013 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b54012ae0 con 0x7f3b60071670 2023-05-24T03:30:11.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.064+0000 7f3b665ad700 1 -- 172.21.15.146:0/3983177013 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b6015a110 con 0x7f3b60071670 2023-05-24T03:30:11.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.064+0000 7f3b665ad700 1 -- 172.21.15.146:0/3983177013 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b60159910 con 0x7f3b60071670 2023-05-24T03:30:11.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.067+0000 7f3b5cff9700 1 -- 172.21.15.146:0/3983177013 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3b54012c40 con 0x7f3b60071670 2023-05-24T03:30:11.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.068+0000 7f3b5cff9700 1 --2- 172.21.15.146:0/3983177013 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f3b4c06adb0 0x7f3b4c06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:11.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.068+0000 7f3b5cff9700 1 -- 172.21.15.146:0/3983177013 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3b540897f0 con 0x7f3b60071670 2023-05-24T03:30:11.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.072+0000 7f3b5ffff700 1 --2- 172.21.15.146:0/3983177013 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f3b4c06adb0 0x7f3b4c06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:11.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.072+0000 7f3b5ffff700 1 --2- 172.21.15.146:0/3983177013 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f3b4c06adb0 0x7f3b4c06d260 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3b500050b0 tx=0x7f3b50004ea0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:11.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.073+0000 7f3b665ad700 1 -- 172.21.15.146:0/3983177013 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b400052f0 con 0x7f3b60071670 2023-05-24T03:30:11.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.064+0000 7f87381cc700 1 Processor -- start 2023-05-24T03:30:11.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.064+0000 7f87381cc700 1 -- start start 2023-05-24T03:30:11.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.065+0000 7f87381cc700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8730158be0 0x7f87300b0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:11.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.065+0000 7f87381cc700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f873006d0f0 con 0x7f873006c910 2023-05-24T03:30:11.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.065+0000 7f87381cc700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f873006d3d0 con 0x7f87300cb2f0 2023-05-24T03:30:11.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.065+0000 7f87381cc700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f873006d6b0 con 0x7f8730158be0 2023-05-24T03:30:11.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.067+0000 7f8735f68700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8730158be0 0x7f87300b0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:11.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.067+0000 7f8735f68700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8730158be0 0x7f87300b0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:50782/0 (socket says 172.21.15.146:50782) 2023-05-24T03:30:11.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.067+0000 7f8735f68700 1 -- 172.21.15.146:0/3319950057 learned_addr learned my addr 172.21.15.146:0/3319950057 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:11.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.067+0000 7f8735f68700 1 -- 172.21.15.146:0/3319950057 >> v1:172.21.15.151:6789/0 conn(0x7f87300cb2f0 legacy=0x7f87300707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:11.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.067+0000 7f8735f68700 1 -- 172.21.15.146:0/3319950057 >> v1:172.21.15.146:6789/0 conn(0x7f873006c910 legacy=0x7f87300cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:11.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.067+0000 7f8735f68700 1 -- 172.21.15.146:0/3319950057 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f873006ffa0 con 0x7f8730158be0 2023-05-24T03:30:11.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.067+0000 7f8735f68700 1 --2- 172.21.15.146:0/3319950057 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8730158be0 0x7f87300b0e10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f872c00a990 tx=0x7f872c009520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebb7946914066546 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:11.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.075+0000 7f8734f66700 1 -- 172.21.15.146:0/3319950057 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872c004030 con 0x7f8730158be0 2023-05-24T03:30:11.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.075+0000 7f8734f66700 1 -- 172.21.15.146:0/3319950057 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f872c004190 con 0x7f8730158be0 2023-05-24T03:30:11.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.075+0000 7f8734f66700 1 -- 172.21.15.146:0/3319950057 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872c004520 con 0x7f8730158be0 2023-05-24T03:30:11.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.076+0000 7f87381cc700 1 -- 172.21.15.146:0/3319950057 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8730158be0 msgr2=0x7f87300b0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:11.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.076+0000 7f87381cc700 1 --2- 172.21.15.146:0/3319950057 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8730158be0 0x7f87300b0e10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f872c00a990 tx=0x7f872c009520 comp rx=0 tx=0).stop 2023-05-24T03:30:11.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.077+0000 7f87381cc700 1 -- 172.21.15.146:0/3319950057 shutdown_connections 2023-05-24T03:30:11.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.077+0000 7f87381cc700 1 --2- 172.21.15.146:0/3319950057 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8730158be0 0x7f87300b0e10 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.077+0000 7f87381cc700 1 -- 172.21.15.146:0/3319950057 >> 172.21.15.146:0/3319950057 conn(0x7f873006b0b0 msgr2=0x7f87300cedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:11.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.081+0000 7f87381cc700 1 -- 172.21.15.146:0/3319950057 shutdown_connections 2023-05-24T03:30:11.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.082+0000 7f87381cc700 1 -- 172.21.15.146:0/3319950057 wait complete. 2023-05-24T03:30:11.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.084+0000 7f87381cc700 1 Processor -- start 2023-05-24T03:30:11.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.084+0000 7f87381cc700 1 -- start start 2023-05-24T03:30:11.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.084+0000 7f3b5cff9700 1 -- 172.21.15.146:0/3983177013 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3b54054640 con 0x7f3b60071670 2023-05-24T03:30:11.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.085+0000 7f87381cc700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87300cb2f0 0x7f87300c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:11.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.085+0000 7f87381cc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8730158be0 0x7f873014b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:11.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.085+0000 7f87381cc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87300b0210 0x7f8730144b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:11.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.085+0000 7f87381cc700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f873008ae50 con 0x7f87300b0210 2023-05-24T03:30:11.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.085+0000 7f87381cc700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87300c7000 con 0x7f8730158be0 2023-05-24T03:30:11.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.085+0000 7f87381cc700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87300c63f0 con 0x7f87300cb2f0 2023-05-24T03:30:11.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.085+0000 7f8736769700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87300b0210 0x7f8730144b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:11.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.085+0000 7f8736769700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87300b0210 0x7f8730144b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39610/0 (socket says 172.21.15.146:39610) 2023-05-24T03:30:11.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.085+0000 7f8736769700 1 -- 172.21.15.146:0/759831527 learned_addr learned my addr 172.21.15.146:0/759831527 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:11.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.086+0000 7f8735f68700 1 --2- 172.21.15.146:0/759831527 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87300cb2f0 0x7f87300c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:11.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.086+0000 7f8736769700 1 -- 172.21.15.146:0/759831527 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87300cb2f0 msgr2=0x7f87300c5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:11.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.086+0000 7f8736769700 1 --2- 172.21.15.146:0/759831527 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87300cb2f0 0x7f87300c5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.086+0000 7f8736769700 1 -- 172.21.15.146:0/759831527 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8730158be0 msgr2=0x7f873014b0d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-24T03:30:11.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.086+0000 7f8736769700 1 --2- 172.21.15.146:0/759831527 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8730158be0 0x7f873014b0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.086+0000 7f8736769700 1 -- 172.21.15.146:0/759831527 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f872c00a5f0 con 0x7f87300b0210 2023-05-24T03:30:11.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.086+0000 7f8736769700 1 --2- 172.21.15.146:0/759831527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87300b0210 0x7f8730144b10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f872800b990 tx=0x7f872800bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:11.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.093+0000 7f87267fc700 1 -- 172.21.15.146:0/759831527 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872800c930 con 0x7f87300b0210 2023-05-24T03:30:11.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.093+0000 7f87267fc700 1 -- 172.21.15.146:0/759831527 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f872800ca90 con 0x7f87300b0210 2023-05-24T03:30:11.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.093+0000 7f87267fc700 1 -- 172.21.15.146:0/759831527 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872800ce40 con 0x7f87300b0210 2023-05-24T03:30:11.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.094+0000 7f87381cc700 1 -- 172.21.15.146:0/759831527 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f873006cdb0 con 0x7f87300b0210 2023-05-24T03:30:11.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.094+0000 7f87381cc700 1 -- 172.21.15.146:0/759831527 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8730070280 con 0x7f87300b0210 2023-05-24T03:30:11.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.098+0000 7f87267fc700 1 -- 172.21.15.146:0/759831527 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8728006d50 con 0x7f87300b0210 2023-05-24T03:30:11.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.099+0000 7f87267fc700 1 --2- 172.21.15.146:0/759831527 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f871406adb0 0x7f871406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:11.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.099+0000 7f87267fc700 1 -- 172.21.15.146:0/759831527 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8728089250 con 0x7f87300b0210 2023-05-24T03:30:11.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.100+0000 7f8735f68700 1 --2- 172.21.15.146:0/759831527 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f871406adb0 0x7f871406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:11.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.100+0000 7f8735f68700 1 --2- 172.21.15.146:0/759831527 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f871406adb0 0x7f871406d260 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f872c000c00 tx=0x7f872c01a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:11.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.101+0000 7f87381cc700 1 -- 172.21.15.146:0/759831527 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87300cc910 con 0x7f87300b0210 2023-05-24T03:30:11.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.110+0000 7f87267fc700 1 -- 172.21.15.146:0/759831527 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f8728054000 con 0x7f87300b0210 2023-05-24T03:30:11.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.393+0000 7f5748d48700 1 -- 172.21.15.146:0/2290332553 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f5744072ae0 con 0x7f57440d00d0 2023-05-24T03:30:11.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.394+0000 7f37861e2700 1 -- 172.21.15.146:0/3556163439 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f37600055a0 con 0x7f37800ce6a0 2023-05-24T03:30:11.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.394+0000 7f5732ffd700 1 -- 172.21.15.146:0/2290332553 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5738017070 con 0x7f57440d00d0 2023-05-24T03:30:11.399 INFO:teuthology.orchestra.run.smithi146.stdout:55834574859 2023-05-24T03:30:11.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.396+0000 7f3767fff700 1 -- 172.21.15.146:0/3556163439 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3774057c20 con 0x7f37800ce6a0 2023-05-24T03:30:11.401 INFO:teuthology.orchestra.run.smithi146.stdout:55834574858 2023-05-24T03:30:11.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.397+0000 7f5748d48700 1 -- 172.21.15.146:0/2290332553 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f572406adb0 msgr2=0x7f572406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:11.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.397+0000 7f5748d48700 1 --2- 172.21.15.146:0/2290332553 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f572406adb0 0x7f572406d260 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f573c007fd0 tx=0x7f573c007da0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.397+0000 7f5748d48700 1 -- 172.21.15.146:0/2290332553 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57440d00d0 msgr2=0x7f57440b3ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:11.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.397+0000 7f5748d48700 1 --2- 172.21.15.146:0/2290332553 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57440d00d0 0x7f57440b3ea0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f573800c450 tx=0x7f573800c810 comp rx=0 tx=0).stop 2023-05-24T03:30:11.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.397+0000 7f5748d48700 1 -- 172.21.15.146:0/2290332553 shutdown_connections 2023-05-24T03:30:11.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.397+0000 7f5748d48700 1 --2- 172.21.15.146:0/2290332553 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f572406adb0 0x7f572406d260 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.397+0000 7f5748d48700 1 --2- 172.21.15.146:0/2290332553 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5744161150 0x7f57440b43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.397+0000 7f5748d48700 1 --2- 172.21.15.146:0/2290332553 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57440cfc80 0x7f57441fbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.397+0000 7f5748d48700 1 --2- 172.21.15.146:0/2290332553 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57440d00d0 0x7f57440b3ea0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.397+0000 7f5748d48700 1 -- 172.21.15.146:0/2290332553 >> 172.21.15.146:0/2290332553 conn(0x7f574406af50 msgr2=0x7f574415fbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:11.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.398+0000 7f5748d48700 1 -- 172.21.15.146:0/2290332553 shutdown_connections 2023-05-24T03:30:11.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.398+0000 7f5748d48700 1 -- 172.21.15.146:0/2290332553 wait complete. 2023-05-24T03:30:11.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.403+0000 7f37861e2700 1 -- 172.21.15.146:0/3556163439 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f376806af40 msgr2=0x7f376806d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:11.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.403+0000 7f37861e2700 1 --2- 172.21.15.146:0/3556163439 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f376806af40 0x7f376806d3f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f37780012e0 tx=0x7f37780015b0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.403+0000 7f37861e2700 1 -- 172.21.15.146:0/3556163439 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f37800ce6a0 msgr2=0x7f37800af820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:11.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.403+0000 7f37861e2700 1 --2- 172.21.15.146:0/3556163439 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f37800ce6a0 0x7f37800af820 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f377400d5d0 tx=0x7f377400d990 comp rx=0 tx=0).stop 2023-05-24T03:30:11.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.403+0000 7f37861e2700 1 -- 172.21.15.146:0/3556163439 shutdown_connections 2023-05-24T03:30:11.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.403+0000 7f37861e2700 1 --2- 172.21.15.146:0/3556163439 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f376806af40 0x7f376806d3f0 secure :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f37780012e0 tx=0x7f37780015b0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.403+0000 7f37861e2700 1 --2- 172.21.15.146:0/3556163439 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f37800ce6a0 0x7f37800af820 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.403+0000 7f37861e2700 1 --2- 172.21.15.146:0/3556163439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f378006da30 0x7f37800c6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.403+0000 7f37861e2700 1 --2- 172.21.15.146:0/3556163439 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f378006de00 0x7f3780154350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.403+0000 7f37861e2700 1 -- 172.21.15.146:0/3556163439 >> 172.21.15.146:0/3556163439 conn(0x7f37800cedd0 msgr2=0x7f37800cd860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:11.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.404+0000 7f37861e2700 1 -- 172.21.15.146:0/3556163439 shutdown_connections 2023-05-24T03:30:11.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.404+0000 7f37861e2700 1 -- 172.21.15.146:0/3556163439 wait complete. 2023-05-24T03:30:11.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.405+0000 7f38ecdef700 1 -- 172.21.15.146:0/2369619382 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f38cc0051a0 con 0x7f38e80c9390 2023-05-24T03:30:11.417 INFO:teuthology.orchestra.run.smithi146.stdout:55834574859 2023-05-24T03:30:11.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.409+0000 7f38d6ffd700 1 -- 172.21.15.146:0/2369619382 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f38d8015090 con 0x7f38e80c9390 2023-05-24T03:30:11.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.413+0000 7f38ecdef700 1 -- 172.21.15.146:0/2369619382 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f38d006b0c0 msgr2=0x7f38d006d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:11.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.413+0000 7f38ecdef700 1 --2- 172.21.15.146:0/2369619382 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f38d006b0c0 0x7f38d006d570 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f38e00015a0 tx=0x7f38e0001b50 comp rx=0 tx=0).stop 2023-05-24T03:30:11.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.413+0000 7f38ecdef700 1 -- 172.21.15.146:0/2369619382 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f38e80c9390 msgr2=0x7f38e8159300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:11.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.413+0000 7f38ecdef700 1 --2- 172.21.15.146:0/2369619382 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f38e80c9390 0x7f38e8159300 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f38d8016000 tx=0x7f38d8004750 comp rx=0 tx=0).stop 2023-05-24T03:30:11.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.413+0000 7f38ecdef700 1 -- 172.21.15.146:0/2369619382 shutdown_connections 2023-05-24T03:30:11.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.413+0000 7f38ecdef700 1 --2- 172.21.15.146:0/2369619382 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f38d006b0c0 0x7f38d006d570 secure :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f38e00015a0 tx=0x7f38e0001b50 comp rx=0 tx=0).stop 2023-05-24T03:30:11.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.413+0000 7f38ecdef700 1 --2- 172.21.15.146:0/2369619382 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f38e80c9390 0x7f38e8159300 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.413+0000 7f38ecdef700 1 --2- 172.21.15.146:0/2369619382 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38e806da30 0x7f38e80b3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.413+0000 7f38ecdef700 1 --2- 172.21.15.146:0/2369619382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38e80b4630 0x7f38e81f9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.413+0000 7f38ecdef700 1 -- 172.21.15.146:0/2369619382 >> 172.21.15.146:0/2369619382 conn(0x7f38e80cedd0 msgr2=0x7f38e815a100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:11.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.414+0000 7f38ecdef700 1 -- 172.21.15.146:0/2369619382 shutdown_connections 2023-05-24T03:30:11.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.414+0000 7f38ecdef700 1 -- 172.21.15.146:0/2369619382 wait complete. 2023-05-24T03:30:11.420 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.4 2023-05-24T03:30:11.421 DEBUG:teuthology.parallel:result is None 2023-05-24T03:30:11.421 INFO:teuthology.orchestra.run.smithi146.stdout:55834574859 2023-05-24T03:30:11.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.416+0000 7f122689a700 1 -- 172.21.15.146:0/3852161268 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1220161310 con 0x7f1220160f40 2023-05-24T03:30:11.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.416+0000 7f121cff9700 1 -- 172.21.15.146:0/3852161268 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1220161310 con 0x7f1220160f40 2023-05-24T03:30:11.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.420+0000 7f122689a700 1 -- 172.21.15.146:0/3852161268 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f120c06ace0 msgr2=0x7f120c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:11.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.420+0000 7f122689a700 1 --2- 172.21.15.146:0/3852161268 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f120c06ace0 0x7f120c06d190 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f12200aef20 tx=0x7f1214006c10 comp rx=0 tx=0).stop 2023-05-24T03:30:11.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.420+0000 7f122689a700 1 -- 172.21.15.146:0/3852161268 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1220160f40 msgr2=0x7f122014f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:11.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.420+0000 7f122689a700 1 --2- 172.21.15.146:0/3852161268 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1220160f40 0x7f122014f070 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f121000c420 tx=0x7f121000c7e0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.421+0000 7f122689a700 1 -- 172.21.15.146:0/3852161268 shutdown_connections 2023-05-24T03:30:11.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.421+0000 7f122689a700 1 --2- 172.21.15.146:0/3852161268 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f120c06ace0 0x7f120c06d190 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.421+0000 7f122689a700 1 --2- 172.21.15.146:0/3852161268 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1220160f40 0x7f122014f070 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.421+0000 7f122689a700 1 --2- 172.21.15.146:0/3852161268 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12200b0a80 0x7f12200c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.421+0000 7f122689a700 1 --2- 172.21.15.146:0/3852161268 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12200c1c70 0x7f1220163730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.421+0000 7f122689a700 1 -- 172.21.15.146:0/3852161268 >> 172.21.15.146:0/3852161268 conn(0x7f122006b0b0 msgr2=0x7f1220160310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:11.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.421+0000 7f122689a700 1 -- 172.21.15.146:0/3852161268 shutdown_connections 2023-05-24T03:30:11.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.421+0000 7f122689a700 1 -- 172.21.15.146:0/3852161268 wait complete. 2023-05-24T03:30:11.428 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.3 2023-05-24T03:30:11.428 DEBUG:teuthology.parallel:result is None 2023-05-24T03:30:11.439 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.6 2023-05-24T03:30:11.439 DEBUG:teuthology.parallel:result is None 2023-05-24T03:30:11.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.438+0000 7fde55685700 1 -- 172.21.15.146:0/1084602170 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fde30005870 con 0x7fde50160db0 2023-05-24T03:30:11.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.438+0000 7fde377fe700 1 -- 172.21.15.146:0/1084602170 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fde40021020 con 0x7fde50160db0 2023-05-24T03:30:11.443 INFO:teuthology.orchestra.run.smithi146.stdout:55834574858 2023-05-24T03:30:11.445 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.1 2023-05-24T03:30:11.446 DEBUG:teuthology.parallel:result is None 2023-05-24T03:30:11.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.442+0000 7fde55685700 1 -- 172.21.15.146:0/1084602170 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fde3c06ad10 msgr2=0x7fde3c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:11.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.442+0000 7fde55685700 1 --2- 172.21.15.146:0/1084602170 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fde3c06ad10 0x7fde3c06d1c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fde44009c40 tx=0x7fde44008030 comp rx=0 tx=0).stop 2023-05-24T03:30:11.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.442+0000 7fde55685700 1 -- 172.21.15.146:0/1084602170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde50160db0 msgr2=0x7fde50162ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:11.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.442+0000 7fde55685700 1 --2- 172.21.15.146:0/1084602170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde50160db0 0x7fde50162ed0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fde4000ea00 tx=0x7fde4000ed10 comp rx=0 tx=0).stop 2023-05-24T03:30:11.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.442+0000 7fde55685700 1 -- 172.21.15.146:0/1084602170 shutdown_connections 2023-05-24T03:30:11.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.442+0000 7fde55685700 1 --2- 172.21.15.146:0/1084602170 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fde3c06ad10 0x7fde3c06d1c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.442+0000 7fde55685700 1 --2- 172.21.15.146:0/1084602170 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde50161180 0x7fde500c5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.442+0000 7fde55685700 1 --2- 172.21.15.146:0/1084602170 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde500c2d40 0x7fde500b5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.442+0000 7fde55685700 1 --2- 172.21.15.146:0/1084602170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde50160db0 0x7fde50162ed0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.442+0000 7fde55685700 1 -- 172.21.15.146:0/1084602170 >> 172.21.15.146:0/1084602170 conn(0x7fde500cfea0 msgr2=0x7fde500ca420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:11.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.442+0000 7fde55685700 1 -- 172.21.15.146:0/1084602170 shutdown_connections 2023-05-24T03:30:11.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.442+0000 7fde55685700 1 -- 172.21.15.146:0/1084602170 wait complete. 2023-05-24T03:30:11.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.452+0000 7f8a279d6700 1 -- 172.21.15.146:0/2143146495 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8a20151f90 con 0x7f8a200b0a80 2023-05-24T03:30:11.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.452+0000 7f8a15ffb700 1 -- 172.21.15.146:0/2143146495 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8a10015090 con 0x7f8a200b0a80 2023-05-24T03:30:11.457 INFO:teuthology.orchestra.run.smithi146.stdout:55834574859 2023-05-24T03:30:11.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.454+0000 7f8a279d6700 1 -- 172.21.15.146:0/2143146495 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f8a0406acb0 msgr2=0x7f8a0406d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:11.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.454+0000 7f8a279d6700 1 --2- 172.21.15.146:0/2143146495 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f8a0406acb0 0x7f8a0406d160 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8a18002230 tx=0x7f8a18009040 comp rx=0 tx=0).stop 2023-05-24T03:30:11.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.454+0000 7f8a279d6700 1 -- 172.21.15.146:0/2143146495 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a200b0a80 msgr2=0x7f8a200c42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:11.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.454+0000 7f8a279d6700 1 --2- 172.21.15.146:0/2143146495 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a200b0a80 0x7f8a200c42a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8a10000c00 tx=0x7f8a10004750 comp rx=0 tx=0).stop 2023-05-24T03:30:11.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.454+0000 7f8a279d6700 1 -- 172.21.15.146:0/2143146495 shutdown_connections 2023-05-24T03:30:11.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.454+0000 7f8a279d6700 1 --2- 172.21.15.146:0/2143146495 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f8a0406acb0 0x7f8a0406d160 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.454+0000 7f8a279d6700 1 --2- 172.21.15.146:0/2143146495 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a20160f40 0x7f8a20150a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.454+0000 7f8a279d6700 1 --2- 172.21.15.146:0/2143146495 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a200b0a80 0x7f8a200c42a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.454+0000 7f8a279d6700 1 --2- 172.21.15.146:0/2143146495 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a200c2380 0x7f8a201504c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.455+0000 7f8a279d6700 1 -- 172.21.15.146:0/2143146495 >> 172.21.15.146:0/2143146495 conn(0x7f8a2006b0b0 msgr2=0x7f8a201602f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:11.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.455+0000 7f8a279d6700 1 -- 172.21.15.146:0/2143146495 shutdown_connections 2023-05-24T03:30:11.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.455+0000 7f8a279d6700 1 -- 172.21.15.146:0/2143146495 wait complete. 2023-05-24T03:30:11.462 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.5 2023-05-24T03:30:11.462 DEBUG:teuthology.parallel:result is None 2023-05-24T03:30:11.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.464+0000 7f3b665ad700 1 -- 172.21.15.146:0/3983177013 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3b400055a0 con 0x7f3b60071670 2023-05-24T03:30:11.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.464+0000 7f3b5cff9700 1 -- 172.21.15.146:0/3983177013 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3b54057c60 con 0x7f3b60071670 2023-05-24T03:30:11.469 INFO:teuthology.orchestra.run.smithi146.stdout:55834574859 2023-05-24T03:30:11.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.466+0000 7f3b665ad700 1 -- 172.21.15.146:0/3983177013 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f3b4c06adb0 msgr2=0x7f3b4c06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:11.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.466+0000 7f3b665ad700 1 --2- 172.21.15.146:0/3983177013 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f3b4c06adb0 0x7f3b4c06d260 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3b500050b0 tx=0x7f3b50004ea0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.466+0000 7f3b665ad700 1 -- 172.21.15.146:0/3983177013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b60071670 msgr2=0x7f3b600b3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:11.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.466+0000 7f3b665ad700 1 --2- 172.21.15.146:0/3983177013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b60071670 0x7f3b600b3db0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3b5400d750 tx=0x7f3b5400db10 comp rx=0 tx=0).stop 2023-05-24T03:30:11.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.466+0000 7f3b665ad700 1 -- 172.21.15.146:0/3983177013 shutdown_connections 2023-05-24T03:30:11.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.466+0000 7f3b665ad700 1 --2- 172.21.15.146:0/3983177013 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f3b4c06adb0 0x7f3b4c06d260 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.466+0000 7f3b665ad700 1 --2- 172.21.15.146:0/3983177013 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3b600b0e00 0x7f3b600b42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.466+0000 7f3b665ad700 1 --2- 172.21.15.146:0/3983177013 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b6006e140 0x7f3b60202fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.466+0000 7f3b665ad700 1 --2- 172.21.15.146:0/3983177013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b60071670 0x7f3b600b3db0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.467+0000 7f3b665ad700 1 -- 172.21.15.146:0/3983177013 >> 172.21.15.146:0/3983177013 conn(0x7f3b600cedd0 msgr2=0x7f3b600ce4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:11.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.467+0000 7f3b665ad700 1 -- 172.21.15.146:0/3983177013 shutdown_connections 2023-05-24T03:30:11.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.467+0000 7f3b665ad700 1 -- 172.21.15.146:0/3983177013 wait complete. 2023-05-24T03:30:11.473 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.0 2023-05-24T03:30:11.473 DEBUG:teuthology.parallel:result is None 2023-05-24T03:30:11.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.474+0000 7f87381cc700 1 -- 172.21.15.146:0/759831527 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f873004e810 con 0x7f87300b0210 2023-05-24T03:30:11.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.474+0000 7f87267fc700 1 -- 172.21.15.146:0/759831527 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8728019070 con 0x7f87300b0210 2023-05-24T03:30:11.479 INFO:teuthology.orchestra.run.smithi146.stdout:55834574859 2023-05-24T03:30:11.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.476+0000 7f87381cc700 1 -- 172.21.15.146:0/759831527 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f871406adb0 msgr2=0x7f871406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:11.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.476+0000 7f87381cc700 1 --2- 172.21.15.146:0/759831527 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f871406adb0 0x7f871406d260 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f872c000c00 tx=0x7f872c01a000 comp rx=0 tx=0).stop 2023-05-24T03:30:11.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.476+0000 7f87381cc700 1 -- 172.21.15.146:0/759831527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87300b0210 msgr2=0x7f8730144b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:11.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.476+0000 7f87381cc700 1 --2- 172.21.15.146:0/759831527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87300b0210 0x7f8730144b10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f872800b990 tx=0x7f872800bca0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.476+0000 7f87381cc700 1 -- 172.21.15.146:0/759831527 shutdown_connections 2023-05-24T03:30:11.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.476+0000 7f87381cc700 1 --2- 172.21.15.146:0/759831527 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f871406adb0 0x7f871406d260 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.476+0000 7f87381cc700 1 --2- 172.21.15.146:0/759831527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87300b0210 0x7f8730144b10 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.476+0000 7f87381cc700 1 --2- 172.21.15.146:0/759831527 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87300cb2f0 0x7f87300c5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.476+0000 7f87381cc700 1 --2- 172.21.15.146:0/759831527 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8730158be0 0x7f873014b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.476+0000 7f87381cc700 1 -- 172.21.15.146:0/759831527 >> 172.21.15.146:0/759831527 conn(0x7f873006b0b0 msgr2=0x7f87300cabe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:11.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.476+0000 7f87381cc700 1 -- 172.21.15.146:0/759831527 shutdown_connections 2023-05-24T03:30:11.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.476+0000 7f87381cc700 1 -- 172.21.15.146:0/759831527 wait complete. 2023-05-24T03:30:11.486 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.2 2023-05-24T03:30:11.486 DEBUG:teuthology.parallel:result is None 2023-05-24T03:30:11.494 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.7 2023-05-24T03:30:11.494 DEBUG:teuthology.parallel:result is None 2023-05-24T03:30:11.494 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-05-24T03:30:11.494 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-24T03:30:11.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.650+0000 7f24555b1700 1 Processor -- start 2023-05-24T03:30:11.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.650+0000 7f24555b1700 1 -- start start 2023-05-24T03:30:11.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.651+0000 7f24555b1700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f245015e100 0x7f24500afbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:11.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.651+0000 7f24555b1700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2450073760 0x7f2450070e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:11.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.651+0000 7f24555b1700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f245006bce0 con 0x7f2450071340 2023-05-24T03:30:11.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.651+0000 7f24555b1700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2450070970 con 0x7f2450073760 2023-05-24T03:30:11.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.651+0000 7f24555b1700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24500b0130 con 0x7f245015e100 2023-05-24T03:30:11.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.651+0000 7f244e7fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2450073760 0x7f2450070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:11.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.651+0000 7f244f7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f2450071340 0x7f24500b25b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46066/0 (socket says 172.21.15.146:46066) 2023-05-24T03:30:11.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.651+0000 7f244f7fe700 1 -- 172.21.15.146:0/1298339450 learned_addr learned my addr 172.21.15.146:0/1298339450 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:30:11.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.652+0000 7f244effd700 1 --2- 172.21.15.146:0/1298339450 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f245015e100 0x7f24500afbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:11.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.652+0000 7f244dffb700 1 -- 172.21.15.146:0/1298339450 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2324945370 0 0) 0x7f245006bce0 con 0x7f2450071340 2023-05-24T03:30:11.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.652+0000 7f244dffb700 1 -- 172.21.15.146:0/1298339450 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24380035b0 con 0x7f2450071340 2023-05-24T03:30:11.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.652+0000 7f244e7fc700 1 -- 172.21.15.146:0/1298339450 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f245015e100 msgr2=0x7f24500afbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:11.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.652+0000 7f244e7fc700 1 --2- 172.21.15.146:0/1298339450 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f245015e100 0x7f24500afbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.652+0000 7f244e7fc700 1 -- 172.21.15.146:0/1298339450 >> v1:172.21.15.146:6789/0 conn(0x7f2450071340 legacy=0x7f24500b25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:11.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.652+0000 7f244e7fc700 1 -- 172.21.15.146:0/1298339450 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2450071ac0 con 0x7f2450073760 2023-05-24T03:30:11.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.652+0000 7f244e7fc700 1 --2- 172.21.15.146:0/1298339450 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2450073760 0x7f2450070e00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2440009840 tx=0x7f2440009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1777d8c51cca7e0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:11.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.652+0000 7f244dffb700 1 -- 172.21.15.146:0/1298339450 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2440011830 con 0x7f2450073760 2023-05-24T03:30:11.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.652+0000 7f244dffb700 1 -- 172.21.15.146:0/1298339450 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2440011990 con 0x7f2450073760 2023-05-24T03:30:11.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.652+0000 7f244dffb700 1 -- 172.21.15.146:0/1298339450 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2440011d20 con 0x7f2450073760 2023-05-24T03:30:11.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.653+0000 7f24555b1700 1 -- 172.21.15.146:0/1298339450 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2450073760 msgr2=0x7f2450070e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:11.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.653+0000 7f24555b1700 1 --2- 172.21.15.146:0/1298339450 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2450073760 0x7f2450070e00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2440009840 tx=0x7f2440009b50 comp rx=0 tx=0).stop 2023-05-24T03:30:11.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.653+0000 7f24555b1700 1 -- 172.21.15.146:0/1298339450 shutdown_connections 2023-05-24T03:30:11.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.653+0000 7f24555b1700 1 --2- 172.21.15.146:0/1298339450 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f245015e100 0x7f24500afbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.653+0000 7f24555b1700 1 --2- 172.21.15.146:0/1298339450 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2450073760 0x7f2450070e00 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.653+0000 7f24555b1700 1 -- 172.21.15.146:0/1298339450 >> 172.21.15.146:0/1298339450 conn(0x7f24500cf6c0 msgr2=0x7f24500cfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:11.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.653+0000 7f24555b1700 1 -- 172.21.15.146:0/1298339450 shutdown_connections 2023-05-24T03:30:11.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.653+0000 7f24555b1700 1 -- 172.21.15.146:0/1298339450 wait complete. 2023-05-24T03:30:11.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.654+0000 7f24555b1700 1 Processor -- start 2023-05-24T03:30:11.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.654+0000 7f24555b1700 1 -- start start 2023-05-24T03:30:11.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.655+0000 7f24555b1700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2450071340 0x7f2450147e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:11.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.655+0000 7f24555b1700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2450073760 0x7f24500b3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:11.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.655+0000 7f24555b1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f245015e100 0x7f24500b3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:11.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.655+0000 7f24555b1700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24501483b0 con 0x7f245015e100 2023-05-24T03:30:11.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.655+0000 7f24555b1700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245014aa40 con 0x7f2450071340 2023-05-24T03:30:11.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.655+0000 7f24555b1700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f245014ad20 con 0x7f2450073760 2023-05-24T03:30:11.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.655+0000 7f244f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f245015e100 0x7f24500b3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:11.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.655+0000 7f244f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f245015e100 0x7f24500b3ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39624/0 (socket says 172.21.15.146:39624) 2023-05-24T03:30:11.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.655+0000 7f244f7fe700 1 -- 172.21.15.146:0/1937331555 learned_addr learned my addr 172.21.15.146:0/1937331555 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:11.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.655+0000 7f244e7fc700 1 --2- 172.21.15.146:0/1937331555 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2450073760 0x7f24500b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:11.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.655+0000 7f244effd700 1 --2- 172.21.15.146:0/1937331555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2450071340 0x7f2450147e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:11.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.655+0000 7f244f7fe700 1 -- 172.21.15.146:0/1937331555 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2450073760 msgr2=0x7f24500b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:11.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.655+0000 7f244f7fe700 1 --2- 172.21.15.146:0/1937331555 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2450073760 0x7f24500b3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.655+0000 7f244f7fe700 1 -- 172.21.15.146:0/1937331555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2450071340 msgr2=0x7f2450147e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:11.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.655+0000 7f244f7fe700 1 --2- 172.21.15.146:0/1937331555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2450071340 0x7f2450147e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.655+0000 7f244f7fe700 1 -- 172.21.15.146:0/1937331555 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24400094a0 con 0x7f245015e100 2023-05-24T03:30:11.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.655+0000 7f244f7fe700 1 --2- 172.21.15.146:0/1937331555 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f245015e100 0x7f24500b3ea0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f244800cbb0 tx=0x7f244800cec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:11.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.656+0000 7f24377fe700 1 -- 172.21.15.146:0/1937331555 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244800a9e0 con 0x7f245015e100 2023-05-24T03:30:11.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.656+0000 7f24377fe700 1 -- 172.21.15.146:0/1937331555 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f244800ab40 con 0x7f245015e100 2023-05-24T03:30:11.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.656+0000 7f24555b1700 1 -- 172.21.15.146:0/1937331555 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f245006b720 con 0x7f245015e100 2023-05-24T03:30:11.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.656+0000 7f24377fe700 1 -- 172.21.15.146:0/1937331555 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2448012400 con 0x7f245015e100 2023-05-24T03:30:11.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.656+0000 7f24555b1700 1 -- 172.21.15.146:0/1937331555 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2450073bd0 con 0x7f245015e100 2023-05-24T03:30:11.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.657+0000 7f24555b1700 1 -- 172.21.15.146:0/1937331555 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f245006ba00 con 0x7f245015e100 2023-05-24T03:30:11.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.657+0000 7f24377fe700 1 -- 172.21.15.146:0/1937331555 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f244801b3b0 con 0x7f245015e100 2023-05-24T03:30:11.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.657+0000 7f24377fe700 1 --2- 172.21.15.146:0/1937331555 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f243c06ace0 0x7f243c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:11.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.658+0000 7f244effd700 1 --2- 172.21.15.146:0/1937331555 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f243c06ace0 0x7f243c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:11.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.658+0000 7f24377fe700 1 -- 172.21.15.146:0/1937331555 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2448089320 con 0x7f245015e100 2023-05-24T03:30:11.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.658+0000 7f244effd700 1 --2- 172.21.15.146:0/1937331555 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f243c06ace0 0x7f243c06d190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2444009b40 tx=0x7f2444009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:11.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.663+0000 7f24377fe700 1 -- 172.21.15.146:0/1937331555 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f2448054220 con 0x7f245015e100 2023-05-24T03:30:11.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.844+0000 7f24555b1700 1 -- 172.21.15.146:0/1937331555 --> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2450071fb0 con 0x7f243c06ace0 2023-05-24T03:30:11.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.853+0000 7f24377fe700 1 -- 172.21.15.146:0/1937331555 <== mgr.4104 v2:172.21.15.146:6832/1985394169 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367318 (secure 0 0 0) 0x7f2450071fb0 con 0x7f243c06ace0 2023-05-24T03:30:11.861 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:30:11.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.857+0000 7f24555b1700 1 -- 172.21.15.146:0/1937331555 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f243c06ace0 msgr2=0x7f243c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:11.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.857+0000 7f24555b1700 1 --2- 172.21.15.146:0/1937331555 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f243c06ace0 0x7f243c06d190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2444009b40 tx=0x7f2444009210 comp rx=0 tx=0).stop 2023-05-24T03:30:11.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.857+0000 7f24555b1700 1 -- 172.21.15.146:0/1937331555 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f245015e100 msgr2=0x7f24500b3ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:11.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.857+0000 7f24555b1700 1 --2- 172.21.15.146:0/1937331555 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f245015e100 0x7f24500b3ea0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f244800cbb0 tx=0x7f244800cec0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.857+0000 7f24555b1700 1 -- 172.21.15.146:0/1937331555 shutdown_connections 2023-05-24T03:30:11.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.857+0000 7f24555b1700 1 --2- 172.21.15.146:0/1937331555 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f243c06ace0 0x7f243c06d190 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.857+0000 7f24555b1700 1 --2- 172.21.15.146:0/1937331555 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f245015e100 0x7f24500b3ea0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.857+0000 7f24555b1700 1 --2- 172.21.15.146:0/1937331555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2450071340 0x7f2450147e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.857+0000 7f24555b1700 1 --2- 172.21.15.146:0/1937331555 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2450073760 0x7f24500b3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:11.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.857+0000 7f24555b1700 1 -- 172.21.15.146:0/1937331555 >> 172.21.15.146:0/1937331555 conn(0x7f24500cf6c0 msgr2=0x7f24500c8950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:11.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.857+0000 7f24555b1700 1 -- 172.21.15.146:0/1937331555 shutdown_connections 2023-05-24T03:30:11.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:11.857+0000 7f24555b1700 1 -- 172.21.15.146:0/1937331555 wait complete. 2023-05-24T03:30:11.865 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-05-24T03:30:11.874 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2023-05-24T03:30:10.713485+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":147016,"kb_used_data":3592,"kb_used_omap":0,"kb_used_meta":143360,"kb_avail":754827704,"statfs":{"total":773094113280,"available":772943568896,"internally_reserved":0,"allocated":3678208,"data_stored":2186592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":146800640},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003538"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.232284+0000","last_change":"2023-05-24T03:29:44.490120+0000","last_active":"2023-05-24T03:29:49.232284+0000","last_peered":"2023-05-24T03:29:49.232284+0000","last_clean":"2023-05-24T03:29:49.232284+0000","last_became_active":"2023-05-24T03:29:44.489854+0000","last_became_peered":"2023-05-24T03:29:44.489854+0000","last_unstale":"2023-05-24T03:29:49.232284+0000","last_undegraded":"2023-05-24T03:29:49.232284+0000","last_fullsized":"2023-05-24T03:29:49.232284+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:33:03.914585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.923811+0000","last_change":"2023-05-24T03:29:44.495973+0000","last_active":"2023-05-24T03:29:48.923811+0000","last_peered":"2023-05-24T03:29:48.923811+0000","last_clean":"2023-05-24T03:29:48.923811+0000","last_became_active":"2023-05-24T03:29:44.495700+0000","last_became_peered":"2023-05-24T03:29:44.495700+0000","last_unstale":"2023-05-24T03:29:48.923811+0000","last_undegraded":"2023-05-24T03:29:48.923811+0000","last_fullsized":"2023-05-24T03:29:48.923811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:27:09.189901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925500+0000","last_change":"2023-05-24T03:29:44.499947+0000","last_active":"2023-05-24T03:29:48.925500+0000","last_peered":"2023-05-24T03:29:48.925500+0000","last_clean":"2023-05-24T03:29:48.925500+0000","last_became_active":"2023-05-24T03:29:44.499663+0000","last_became_peered":"2023-05-24T03:29:44.499663+0000","last_unstale":"2023-05-24T03:29:48.925500+0000","last_undegraded":"2023-05-24T03:29:48.925500+0000","last_fullsized":"2023-05-24T03:29:48.925500+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:14:55.806370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798091+0000","last_change":"2023-05-24T03:29:44.498790+0000","last_active":"2023-05-24T03:29:49.798091+0000","last_peered":"2023-05-24T03:29:49.798091+0000","last_clean":"2023-05-24T03:29:49.798091+0000","last_became_active":"2023-05-24T03:29:44.498528+0000","last_became_peered":"2023-05-24T03:29:44.498528+0000","last_unstale":"2023-05-24T03:29:49.798091+0000","last_undegraded":"2023-05-24T03:29:49.798091+0000","last_fullsized":"2023-05-24T03:29:49.798091+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:37:55.804539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156224+0000","last_change":"2023-05-24T03:29:44.504225+0000","last_active":"2023-05-24T03:29:49.156224+0000","last_peered":"2023-05-24T03:29:49.156224+0000","last_clean":"2023-05-24T03:29:49.156224+0000","last_became_active":"2023-05-24T03:29:44.503998+0000","last_became_peered":"2023-05-24T03:29:44.503998+0000","last_unstale":"2023-05-24T03:29:49.156224+0000","last_undegraded":"2023-05-24T03:29:49.156224+0000","last_fullsized":"2023-05-24T03:29:49.156224+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:12:39.912312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925136+0000","last_change":"2023-05-24T03:29:44.500355+0000","last_active":"2023-05-24T03:29:48.925136+0000","last_peered":"2023-05-24T03:29:48.925136+0000","last_clean":"2023-05-24T03:29:48.925136+0000","last_became_active":"2023-05-24T03:29:44.500065+0000","last_became_peered":"2023-05-24T03:29:44.500065+0000","last_unstale":"2023-05-24T03:29:48.925136+0000","last_undegraded":"2023-05-24T03:29:48.925136+0000","last_fullsized":"2023-05-24T03:29:48.925136+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:43:04.720238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.711626+0000","last_change":"2023-05-24T03:29:44.499607+0000","last_active":"2023-05-24T03:29:49.711626+0000","last_peered":"2023-05-24T03:29:49.711626+0000","last_clean":"2023-05-24T03:29:49.711626+0000","last_became_active":"2023-05-24T03:29:44.499324+0000","last_became_peered":"2023-05-24T03:29:44.499324+0000","last_unstale":"2023-05-24T03:29:49.711626+0000","last_undegraded":"2023-05-24T03:29:49.711626+0000","last_fullsized":"2023-05-24T03:29:49.711626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:54:54.025911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.923288+0000","last_change":"2023-05-24T03:29:44.500576+0000","last_active":"2023-05-24T03:29:48.923288+0000","last_peered":"2023-05-24T03:29:48.923288+0000","last_clean":"2023-05-24T03:29:48.923288+0000","last_became_active":"2023-05-24T03:29:44.500260+0000","last_became_peered":"2023-05-24T03:29:44.500260+0000","last_unstale":"2023-05-24T03:29:48.923288+0000","last_undegraded":"2023-05-24T03:29:48.923288+0000","last_fullsized":"2023-05-24T03:29:48.923288+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:16:38.784464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156365+0000","last_change":"2023-05-24T03:29:44.502655+0000","last_active":"2023-05-24T03:29:49.156365+0000","last_peered":"2023-05-24T03:29:49.156365+0000","last_clean":"2023-05-24T03:29:49.156365+0000","last_became_active":"2023-05-24T03:29:44.502341+0000","last_became_peered":"2023-05-24T03:29:44.502341+0000","last_unstale":"2023-05-24T03:29:49.156365+0000","last_undegraded":"2023-05-24T03:29:49.156365+0000","last_fullsized":"2023-05-24T03:29:49.156365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:17:26.378756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924197+0000","last_change":"2023-05-24T03:29:44.500505+0000","last_active":"2023-05-24T03:29:48.924197+0000","last_peered":"2023-05-24T03:29:48.924197+0000","last_clean":"2023-05-24T03:29:48.924197+0000","last_became_active":"2023-05-24T03:29:44.500156+0000","last_became_peered":"2023-05-24T03:29:44.500156+0000","last_unstale":"2023-05-24T03:29:48.924197+0000","last_undegraded":"2023-05-24T03:29:48.924197+0000","last_fullsized":"2023-05-24T03:29:48.924197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:52:13.818279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925752+0000","last_change":"2023-05-24T03:29:44.492850+0000","last_active":"2023-05-24T03:29:48.925752+0000","last_peered":"2023-05-24T03:29:48.925752+0000","last_clean":"2023-05-24T03:29:48.925752+0000","last_became_active":"2023-05-24T03:29:44.492573+0000","last_became_peered":"2023-05-24T03:29:44.492573+0000","last_unstale":"2023-05-24T03:29:48.925752+0000","last_undegraded":"2023-05-24T03:29:48.925752+0000","last_fullsized":"2023-05-24T03:29:48.925752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:27:24.810532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.232125+0000","last_change":"2023-05-24T03:29:44.501565+0000","last_active":"2023-05-24T03:29:49.232125+0000","last_peered":"2023-05-24T03:29:49.232125+0000","last_clean":"2023-05-24T03:29:49.232125+0000","last_became_active":"2023-05-24T03:29:44.501371+0000","last_became_peered":"2023-05-24T03:29:44.501371+0000","last_unstale":"2023-05-24T03:29:49.232125+0000","last_undegraded":"2023-05-24T03:29:49.232125+0000","last_fullsized":"2023-05-24T03:29:49.232125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:51:11.755899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.232142+0000","last_change":"2023-05-24T03:29:44.490972+0000","last_active":"2023-05-24T03:29:49.232142+0000","last_peered":"2023-05-24T03:29:49.232142+0000","last_clean":"2023-05-24T03:29:49.232142+0000","last_became_active":"2023-05-24T03:29:44.490411+0000","last_became_peered":"2023-05-24T03:29:44.490411+0000","last_unstale":"2023-05-24T03:29:49.232142+0000","last_undegraded":"2023-05-24T03:29:49.232142+0000","last_fullsized":"2023-05-24T03:29:49.232142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:43:24.929689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.923436+0000","last_change":"2023-05-24T03:29:44.495213+0000","last_active":"2023-05-24T03:29:48.923436+0000","last_peered":"2023-05-24T03:29:48.923436+0000","last_clean":"2023-05-24T03:29:48.923436+0000","last_became_active":"2023-05-24T03:29:44.494879+0000","last_became_peered":"2023-05-24T03:29:44.494879+0000","last_unstale":"2023-05-24T03:29:48.923436+0000","last_undegraded":"2023-05-24T03:29:48.923436+0000","last_fullsized":"2023-05-24T03:29:48.923436+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:12:39.912312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.711461+0000","last_change":"2023-05-24T03:29:44.499673+0000","last_active":"2023-05-24T03:29:49.711461+0000","last_peered":"2023-05-24T03:29:49.711461+0000","last_clean":"2023-05-24T03:29:49.711461+0000","last_became_active":"2023-05-24T03:29:44.499393+0000","last_became_peered":"2023-05-24T03:29:44.499393+0000","last_unstale":"2023-05-24T03:29:49.711461+0000","last_undegraded":"2023-05-24T03:29:49.711461+0000","last_fullsized":"2023-05-24T03:29:49.711461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:55:32.189744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925151+0000","last_change":"2023-05-24T03:29:44.501101+0000","last_active":"2023-05-24T03:29:48.925151+0000","last_peered":"2023-05-24T03:29:48.925151+0000","last_clean":"2023-05-24T03:29:48.925151+0000","last_became_active":"2023-05-24T03:29:44.500818+0000","last_became_peered":"2023-05-24T03:29:44.500818+0000","last_unstale":"2023-05-24T03:29:48.925151+0000","last_undegraded":"2023-05-24T03:29:48.925151+0000","last_fullsized":"2023-05-24T03:29:48.925151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:44:17.635928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156394+0000","last_change":"2023-05-24T03:29:44.500209+0000","last_active":"2023-05-24T03:29:49.156394+0000","last_peered":"2023-05-24T03:29:49.156394+0000","last_clean":"2023-05-24T03:29:49.156394+0000","last_became_active":"2023-05-24T03:29:44.499543+0000","last_became_peered":"2023-05-24T03:29:44.499543+0000","last_unstale":"2023-05-24T03:29:49.156394+0000","last_undegraded":"2023-05-24T03:29:49.156394+0000","last_fullsized":"2023-05-24T03:29:49.156394+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:54:54.025911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925839+0000","last_change":"2023-05-24T03:29:44.492545+0000","last_active":"2023-05-24T03:29:48.925839+0000","last_peered":"2023-05-24T03:29:48.925839+0000","last_clean":"2023-05-24T03:29:48.925839+0000","last_became_active":"2023-05-24T03:29:44.492109+0000","last_became_peered":"2023-05-24T03:29:44.492109+0000","last_unstale":"2023-05-24T03:29:48.925839+0000","last_undegraded":"2023-05-24T03:29:48.925839+0000","last_fullsized":"2023-05-24T03:29:48.925839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:14:30.274935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.232313+0000","last_change":"2023-05-24T03:29:44.480834+0000","last_active":"2023-05-24T03:29:49.232313+0000","last_peered":"2023-05-24T03:29:49.232313+0000","last_clean":"2023-05-24T03:29:49.232313+0000","last_became_active":"2023-05-24T03:29:44.480597+0000","last_became_peered":"2023-05-24T03:29:44.480597+0000","last_unstale":"2023-05-24T03:29:49.232313+0000","last_undegraded":"2023-05-24T03:29:49.232313+0000","last_fullsized":"2023-05-24T03:29:49.232313+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:10:15.509028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925476+0000","last_change":"2023-05-24T03:29:44.501003+0000","last_active":"2023-05-24T03:29:48.925476+0000","last_peered":"2023-05-24T03:29:48.925476+0000","last_clean":"2023-05-24T03:29:48.925476+0000","last_became_active":"2023-05-24T03:29:44.499405+0000","last_became_peered":"2023-05-24T03:29:44.499405+0000","last_unstale":"2023-05-24T03:29:48.925476+0000","last_undegraded":"2023-05-24T03:29:48.925476+0000","last_fullsized":"2023-05-24T03:29:48.925476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:26:26.500917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.711735+0000","last_change":"2023-05-24T03:29:44.499151+0000","last_active":"2023-05-24T03:29:49.711735+0000","last_peered":"2023-05-24T03:29:49.711735+0000","last_clean":"2023-05-24T03:29:49.711735+0000","last_became_active":"2023-05-24T03:29:44.498782+0000","last_became_peered":"2023-05-24T03:29:44.498782+0000","last_unstale":"2023-05-24T03:29:49.711735+0000","last_undegraded":"2023-05-24T03:29:49.711735+0000","last_fullsized":"2023-05-24T03:29:49.711735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:48:28.516583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.155935+0000","last_change":"2023-05-24T03:29:44.498675+0000","last_active":"2023-05-24T03:29:49.155935+0000","last_peered":"2023-05-24T03:29:49.155935+0000","last_clean":"2023-05-24T03:29:49.155935+0000","last_became_active":"2023-05-24T03:29:44.498463+0000","last_became_peered":"2023-05-24T03:29:44.498463+0000","last_unstale":"2023-05-24T03:29:49.155935+0000","last_undegraded":"2023-05-24T03:29:49.155935+0000","last_fullsized":"2023-05-24T03:29:49.155935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:51:21.843236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.797699+0000","last_change":"2023-05-24T03:29:44.500169+0000","last_active":"2023-05-24T03:29:49.797699+0000","last_peered":"2023-05-24T03:29:49.797699+0000","last_clean":"2023-05-24T03:29:49.797699+0000","last_became_active":"2023-05-24T03:29:44.499960+0000","last_became_peered":"2023-05-24T03:29:44.499960+0000","last_unstale":"2023-05-24T03:29:49.797699+0000","last_undegraded":"2023-05-24T03:29:49.797699+0000","last_fullsized":"2023-05-24T03:29:49.797699+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:55:32.189744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.711518+0000","last_change":"2023-05-24T03:29:44.499015+0000","last_active":"2023-05-24T03:29:49.711518+0000","last_peered":"2023-05-24T03:29:49.711518+0000","last_clean":"2023-05-24T03:29:49.711518+0000","last_became_active":"2023-05-24T03:29:44.498437+0000","last_became_peered":"2023-05-24T03:29:44.498437+0000","last_unstale":"2023-05-24T03:29:49.711518+0000","last_undegraded":"2023-05-24T03:29:49.711518+0000","last_fullsized":"2023-05-24T03:29:49.711518+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:27:09.189901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920628+0000","last_change":"2023-05-24T03:29:44.481162+0000","last_active":"2023-05-24T03:29:48.920628+0000","last_peered":"2023-05-24T03:29:48.920628+0000","last_clean":"2023-05-24T03:29:48.920628+0000","last_became_active":"2023-05-24T03:29:44.481004+0000","last_became_peered":"2023-05-24T03:29:44.481004+0000","last_unstale":"2023-05-24T03:29:48.920628+0000","last_undegraded":"2023-05-24T03:29:48.920628+0000","last_fullsized":"2023-05-24T03:29:48.920628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:55:32.189744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920849+0000","last_change":"2023-05-24T03:29:44.481942+0000","last_active":"2023-05-24T03:29:48.920849+0000","last_peered":"2023-05-24T03:29:48.920849+0000","last_clean":"2023-05-24T03:29:48.920849+0000","last_became_active":"2023-05-24T03:29:44.481686+0000","last_became_peered":"2023-05-24T03:29:44.481686+0000","last_unstale":"2023-05-24T03:29:48.920849+0000","last_undegraded":"2023-05-24T03:29:48.920849+0000","last_fullsized":"2023-05-24T03:29:48.920849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:13:02.352900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924263+0000","last_change":"2023-05-24T03:29:44.502948+0000","last_active":"2023-05-24T03:29:48.924263+0000","last_peered":"2023-05-24T03:29:48.924263+0000","last_clean":"2023-05-24T03:29:48.924263+0000","last_became_active":"2023-05-24T03:29:44.502669+0000","last_became_peered":"2023-05-24T03:29:44.502669+0000","last_unstale":"2023-05-24T03:29:48.924263+0000","last_undegraded":"2023-05-24T03:29:48.924263+0000","last_fullsized":"2023-05-24T03:29:48.924263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:04:07.700748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925372+0000","last_change":"2023-05-24T03:29:48.523138+0000","last_active":"2023-05-24T03:29:48.925372+0000","last_peered":"2023-05-24T03:29:48.925372+0000","last_clean":"2023-05-24T03:29:48.925372+0000","last_became_active":"2023-05-24T03:29:48.522749+0000","last_became_peered":"2023-05-24T03:29:48.522749+0000","last_unstale":"2023-05-24T03:29:48.925372+0000","last_undegraded":"2023-05-24T03:29:48.925372+0000","last_fullsized":"2023-05-24T03:29:48.925372+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:20:12.731273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925118+0000","last_change":"2023-05-24T03:29:44.086543+0000","last_active":"2023-05-24T03:29:48.925118+0000","last_peered":"2023-05-24T03:29:48.925118+0000","last_clean":"2023-05-24T03:29:48.925118+0000","last_became_active":"2023-05-24T03:29:44.086143+0000","last_became_peered":"2023-05-24T03:29:44.086143+0000","last_unstale":"2023-05-24T03:29:48.925118+0000","last_undegraded":"2023-05-24T03:29:48.925118+0000","last_fullsized":"2023-05-24T03:29:48.925118+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:22:00.186684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798333+0000","last_change":"2023-05-24T03:29:44.491005+0000","last_active":"2023-05-24T03:29:49.798333+0000","last_peered":"2023-05-24T03:29:49.798333+0000","last_clean":"2023-05-24T03:29:49.798333+0000","last_became_active":"2023-05-24T03:29:44.490772+0000","last_became_peered":"2023-05-24T03:29:44.490772+0000","last_unstale":"2023-05-24T03:29:49.798333+0000","last_undegraded":"2023-05-24T03:29:49.798333+0000","last_fullsized":"2023-05-24T03:29:49.798333+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:04:07.700748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798539+0000","last_change":"2023-05-24T03:29:48.523521+0000","last_active":"2023-05-24T03:29:49.798539+0000","last_peered":"2023-05-24T03:29:49.798539+0000","last_clean":"2023-05-24T03:29:49.798539+0000","last_became_active":"2023-05-24T03:29:48.523125+0000","last_became_peered":"2023-05-24T03:29:48.523125+0000","last_unstale":"2023-05-24T03:29:49.798539+0000","last_undegraded":"2023-05-24T03:29:49.798539+0000","last_fullsized":"2023-05-24T03:29:49.798539+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:44:02.617382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920004+0000","last_change":"2023-05-24T03:29:44.084408+0000","last_active":"2023-05-24T03:29:48.920004+0000","last_peered":"2023-05-24T03:29:48.920004+0000","last_clean":"2023-05-24T03:29:48.920004+0000","last_became_active":"2023-05-24T03:29:44.084099+0000","last_became_peered":"2023-05-24T03:29:44.084099+0000","last_unstale":"2023-05-24T03:29:48.920004+0000","last_undegraded":"2023-05-24T03:29:48.920004+0000","last_fullsized":"2023-05-24T03:29:48.920004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:14:05.716019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156351+0000","last_change":"2023-05-24T03:29:44.503346+0000","last_active":"2023-05-24T03:29:49.156351+0000","last_peered":"2023-05-24T03:29:49.156351+0000","last_clean":"2023-05-24T03:29:49.156351+0000","last_became_active":"2023-05-24T03:29:44.503039+0000","last_became_peered":"2023-05-24T03:29:44.503039+0000","last_unstale":"2023-05-24T03:29:49.156351+0000","last_undegraded":"2023-05-24T03:29:49.156351+0000","last_fullsized":"2023-05-24T03:29:49.156351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:55:32.189744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156521+0000","last_change":"2023-05-24T03:29:48.529615+0000","last_active":"2023-05-24T03:29:49.156521+0000","last_peered":"2023-05-24T03:29:49.156521+0000","last_clean":"2023-05-24T03:29:49.156521+0000","last_became_active":"2023-05-24T03:29:48.529142+0000","last_became_peered":"2023-05-24T03:29:48.529142+0000","last_unstale":"2023-05-24T03:29:49.156521+0000","last_undegraded":"2023-05-24T03:29:49.156521+0000","last_fullsized":"2023-05-24T03:29:49.156521+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:48:31.938863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798028+0000","last_change":"2023-05-24T03:29:44.085410+0000","last_active":"2023-05-24T03:29:49.798028+0000","last_peered":"2023-05-24T03:29:49.798028+0000","last_clean":"2023-05-24T03:29:49.798028+0000","last_became_active":"2023-05-24T03:29:44.084907+0000","last_became_peered":"2023-05-24T03:29:44.084907+0000","last_unstale":"2023-05-24T03:29:49.798028+0000","last_undegraded":"2023-05-24T03:29:49.798028+0000","last_fullsized":"2023-05-24T03:29:49.798028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:06:44.879201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798596+0000","last_change":"2023-05-24T03:29:44.497128+0000","last_active":"2023-05-24T03:29:49.798596+0000","last_peered":"2023-05-24T03:29:49.798596+0000","last_clean":"2023-05-24T03:29:49.798596+0000","last_became_active":"2023-05-24T03:29:44.496746+0000","last_became_peered":"2023-05-24T03:29:44.496746+0000","last_unstale":"2023-05-24T03:29:49.798596+0000","last_undegraded":"2023-05-24T03:29:49.798596+0000","last_fullsized":"2023-05-24T03:29:49.798596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:50:28.601742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798309+0000","last_change":"2023-05-24T03:29:48.520693+0000","last_active":"2023-05-24T03:29:49.798309+0000","last_peered":"2023-05-24T03:29:49.798309+0000","last_clean":"2023-05-24T03:29:49.798309+0000","last_became_active":"2023-05-24T03:29:48.520319+0000","last_became_peered":"2023-05-24T03:29:48.520319+0000","last_unstale":"2023-05-24T03:29:49.798309+0000","last_undegraded":"2023-05-24T03:29:49.798309+0000","last_fullsized":"2023-05-24T03:29:49.798309+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:55:04.423811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156490+0000","last_change":"2023-05-24T03:29:44.088769+0000","last_active":"2023-05-24T03:29:49.156490+0000","last_peered":"2023-05-24T03:29:49.156490+0000","last_clean":"2023-05-24T03:29:49.156490+0000","last_became_active":"2023-05-24T03:29:44.088267+0000","last_became_peered":"2023-05-24T03:29:44.088267+0000","last_unstale":"2023-05-24T03:29:49.156490+0000","last_undegraded":"2023-05-24T03:29:49.156490+0000","last_fullsized":"2023-05-24T03:29:49.156490+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:06:44.879201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.797921+0000","last_change":"2023-05-24T03:29:44.489309+0000","last_active":"2023-05-24T03:29:49.797921+0000","last_peered":"2023-05-24T03:29:49.797921+0000","last_clean":"2023-05-24T03:29:49.797921+0000","last_became_active":"2023-05-24T03:29:44.488666+0000","last_became_peered":"2023-05-24T03:29:44.488666+0000","last_unstale":"2023-05-24T03:29:49.797921+0000","last_undegraded":"2023-05-24T03:29:49.797921+0000","last_fullsized":"2023-05-24T03:29:49.797921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:27:09.189901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.711386+0000","last_change":"2023-05-24T03:29:48.518108+0000","last_active":"2023-05-24T03:29:49.711386+0000","last_peered":"2023-05-24T03:29:49.711386+0000","last_clean":"2023-05-24T03:29:49.711386+0000","last_became_active":"2023-05-24T03:29:48.517771+0000","last_became_peered":"2023-05-24T03:29:48.517771+0000","last_unstale":"2023-05-24T03:29:49.711386+0000","last_undegraded":"2023-05-24T03:29:49.711386+0000","last_fullsized":"2023-05-24T03:29:49.711386+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:37:26.748143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.923964+0000","last_change":"2023-05-24T03:29:44.087910+0000","last_active":"2023-05-24T03:29:48.923964+0000","last_peered":"2023-05-24T03:29:48.923964+0000","last_clean":"2023-05-24T03:29:48.923964+0000","last_became_active":"2023-05-24T03:29:44.087601+0000","last_became_peered":"2023-05-24T03:29:44.087601+0000","last_unstale":"2023-05-24T03:29:48.923964+0000","last_undegraded":"2023-05-24T03:29:48.923964+0000","last_fullsized":"2023-05-24T03:29:48.923964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:59:05.268973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.797675+0000","last_change":"2023-05-24T03:29:44.496020+0000","last_active":"2023-05-24T03:29:49.797675+0000","last_peered":"2023-05-24T03:29:49.797675+0000","last_clean":"2023-05-24T03:29:49.797675+0000","last_became_active":"2023-05-24T03:29:44.495752+0000","last_became_peered":"2023-05-24T03:29:44.495752+0000","last_unstale":"2023-05-24T03:29:49.797675+0000","last_undegraded":"2023-05-24T03:29:49.797675+0000","last_fullsized":"2023-05-24T03:29:49.797675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:42:07.310986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798229+0000","last_change":"2023-05-24T03:29:48.529893+0000","last_active":"2023-05-24T03:29:49.798229+0000","last_peered":"2023-05-24T03:29:49.798229+0000","last_clean":"2023-05-24T03:29:49.798229+0000","last_became_active":"2023-05-24T03:29:48.529514+0000","last_became_peered":"2023-05-24T03:29:48.529514+0000","last_unstale":"2023-05-24T03:29:49.798229+0000","last_undegraded":"2023-05-24T03:29:49.798229+0000","last_fullsized":"2023-05-24T03:29:49.798229+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:19:31.096262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.711996+0000","last_change":"2023-05-24T03:29:44.091648+0000","last_active":"2023-05-24T03:29:49.711996+0000","last_peered":"2023-05-24T03:29:49.711996+0000","last_clean":"2023-05-24T03:29:49.711996+0000","last_became_active":"2023-05-24T03:29:44.091390+0000","last_became_peered":"2023-05-24T03:29:44.091390+0000","last_unstale":"2023-05-24T03:29:49.711996+0000","last_undegraded":"2023-05-24T03:29:49.711996+0000","last_fullsized":"2023-05-24T03:29:49.711996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:37:43.011120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920406+0000","last_change":"2023-05-24T03:29:44.481629+0000","last_active":"2023-05-24T03:29:48.920406+0000","last_peered":"2023-05-24T03:29:48.920406+0000","last_clean":"2023-05-24T03:29:48.920406+0000","last_became_active":"2023-05-24T03:29:44.481385+0000","last_became_peered":"2023-05-24T03:29:44.481385+0000","last_unstale":"2023-05-24T03:29:48.920406+0000","last_undegraded":"2023-05-24T03:29:48.920406+0000","last_fullsized":"2023-05-24T03:29:48.920406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:27:52.176207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920327+0000","last_change":"2023-05-24T03:29:48.524712+0000","last_active":"2023-05-24T03:29:48.920327+0000","last_peered":"2023-05-24T03:29:48.920327+0000","last_clean":"2023-05-24T03:29:48.920327+0000","last_became_active":"2023-05-24T03:29:48.524312+0000","last_became_peered":"2023-05-24T03:29:48.524312+0000","last_unstale":"2023-05-24T03:29:48.920327+0000","last_undegraded":"2023-05-24T03:29:48.920327+0000","last_fullsized":"2023-05-24T03:29:48.920327+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:13:47.041051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'9","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:53.574777+0000","last_change":"2023-05-24T03:29:44.079067+0000","last_active":"2023-05-24T03:29:53.574777+0000","last_peered":"2023-05-24T03:29:53.574777+0000","last_clean":"2023-05-24T03:29:53.574777+0000","last_became_active":"2023-05-24T03:29:44.078785+0000","last_became_peered":"2023-05-24T03:29:44.078785+0000","last_unstale":"2023-05-24T03:29:53.574777+0000","last_undegraded":"2023-05-24T03:29:53.574777+0000","last_fullsized":"2023-05-24T03:29:53.574777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:32:31.553230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925391+0000","last_change":"2023-05-24T03:29:44.497603+0000","last_active":"2023-05-24T03:29:48.925391+0000","last_peered":"2023-05-24T03:29:48.925391+0000","last_clean":"2023-05-24T03:29:48.925391+0000","last_became_active":"2023-05-24T03:29:44.497120+0000","last_became_peered":"2023-05-24T03:29:44.497120+0000","last_unstale":"2023-05-24T03:29:48.925391+0000","last_undegraded":"2023-05-24T03:29:48.925391+0000","last_fullsized":"2023-05-24T03:29:48.925391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:18:47.235377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924432+0000","last_change":"2023-05-24T03:29:48.531846+0000","last_active":"2023-05-24T03:29:48.924432+0000","last_peered":"2023-05-24T03:29:48.924432+0000","last_clean":"2023-05-24T03:29:48.924432+0000","last_became_active":"2023-05-24T03:29:48.531538+0000","last_became_peered":"2023-05-24T03:29:48.531538+0000","last_unstale":"2023-05-24T03:29:48.924432+0000","last_undegraded":"2023-05-24T03:29:48.924432+0000","last_fullsized":"2023-05-24T03:29:48.924432+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:59:12.868748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.711788+0000","last_change":"2023-05-24T03:29:44.087315+0000","last_active":"2023-05-24T03:29:49.711788+0000","last_peered":"2023-05-24T03:29:49.711788+0000","last_clean":"2023-05-24T03:29:49.711788+0000","last_became_active":"2023-05-24T03:29:44.086997+0000","last_became_peered":"2023-05-24T03:29:44.086997+0000","last_unstale":"2023-05-24T03:29:49.711788+0000","last_undegraded":"2023-05-24T03:29:49.711788+0000","last_fullsized":"2023-05-24T03:29:49.711788+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:06:44.879201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798223+0000","last_change":"2023-05-24T03:29:44.487497+0000","last_active":"2023-05-24T03:29:49.798223+0000","last_peered":"2023-05-24T03:29:49.798223+0000","last_clean":"2023-05-24T03:29:49.798223+0000","last_became_active":"2023-05-24T03:29:44.487257+0000","last_became_peered":"2023-05-24T03:29:44.487257+0000","last_unstale":"2023-05-24T03:29:49.798223+0000","last_undegraded":"2023-05-24T03:29:49.798223+0000","last_fullsized":"2023-05-24T03:29:49.798223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:37:44.017565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798223+0000","last_change":"2023-05-24T03:29:48.526115+0000","last_active":"2023-05-24T03:29:49.798223+0000","last_peered":"2023-05-24T03:29:49.798223+0000","last_clean":"2023-05-24T03:29:49.798223+0000","last_became_active":"2023-05-24T03:29:48.525726+0000","last_became_peered":"2023-05-24T03:29:48.525726+0000","last_unstale":"2023-05-24T03:29:49.798223+0000","last_undegraded":"2023-05-24T03:29:49.798223+0000","last_fullsized":"2023-05-24T03:29:49.798223+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:59:09.697698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.155791+0000","last_change":"2023-05-24T03:29:44.084599+0000","last_active":"2023-05-24T03:29:49.155791+0000","last_peered":"2023-05-24T03:29:49.155791+0000","last_clean":"2023-05-24T03:29:49.155791+0000","last_became_active":"2023-05-24T03:29:44.084278+0000","last_became_peered":"2023-05-24T03:29:44.084278+0000","last_unstale":"2023-05-24T03:29:49.155791+0000","last_undegraded":"2023-05-24T03:29:49.155791+0000","last_fullsized":"2023-05-24T03:29:49.155791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:13:42.612325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924229+0000","last_change":"2023-05-24T03:29:44.498378+0000","last_active":"2023-05-24T03:29:48.924229+0000","last_peered":"2023-05-24T03:29:48.924229+0000","last_clean":"2023-05-24T03:29:48.924229+0000","last_became_active":"2023-05-24T03:29:44.498097+0000","last_became_peered":"2023-05-24T03:29:44.498097+0000","last_unstale":"2023-05-24T03:29:48.924229+0000","last_undegraded":"2023-05-24T03:29:48.924229+0000","last_fullsized":"2023-05-24T03:29:48.924229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:37:44.017565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798670+0000","last_change":"2023-05-24T03:29:48.525018+0000","last_active":"2023-05-24T03:29:49.798670+0000","last_peered":"2023-05-24T03:29:49.798670+0000","last_clean":"2023-05-24T03:29:49.798670+0000","last_became_active":"2023-05-24T03:29:48.524602+0000","last_became_peered":"2023-05-24T03:29:48.524602+0000","last_unstale":"2023-05-24T03:29:49.798670+0000","last_undegraded":"2023-05-24T03:29:49.798670+0000","last_fullsized":"2023-05-24T03:29:49.798670+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:25:43.600049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.711568+0000","last_change":"2023-05-24T03:29:44.085212+0000","last_active":"2023-05-24T03:29:49.711568+0000","last_peered":"2023-05-24T03:29:49.711568+0000","last_clean":"2023-05-24T03:29:49.711568+0000","last_became_active":"2023-05-24T03:29:44.085001+0000","last_became_peered":"2023-05-24T03:29:44.085001+0000","last_unstale":"2023-05-24T03:29:49.711568+0000","last_undegraded":"2023-05-24T03:29:49.711568+0000","last_fullsized":"2023-05-24T03:29:49.711568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:13:01.346454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156439+0000","last_change":"2023-05-24T03:29:44.500883+0000","last_active":"2023-05-24T03:29:49.156439+0000","last_peered":"2023-05-24T03:29:49.156439+0000","last_clean":"2023-05-24T03:29:49.156439+0000","last_became_active":"2023-05-24T03:29:44.500631+0000","last_became_peered":"2023-05-24T03:29:44.500631+0000","last_unstale":"2023-05-24T03:29:49.156439+0000","last_undegraded":"2023-05-24T03:29:49.156439+0000","last_fullsized":"2023-05-24T03:29:49.156439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:47:24.077381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.923764+0000","last_change":"2023-05-24T03:29:48.523523+0000","last_active":"2023-05-24T03:29:48.923764+0000","last_peered":"2023-05-24T03:29:48.923764+0000","last_clean":"2023-05-24T03:29:48.923764+0000","last_became_active":"2023-05-24T03:29:48.523138+0000","last_became_peered":"2023-05-24T03:29:48.523138+0000","last_unstale":"2023-05-24T03:29:48.923764+0000","last_undegraded":"2023-05-24T03:29:48.923764+0000","last_fullsized":"2023-05-24T03:29:48.923764+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:17:29.801036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.797983+0000","last_change":"2023-05-24T03:29:44.085229+0000","last_active":"2023-05-24T03:29:49.797983+0000","last_peered":"2023-05-24T03:29:49.797983+0000","last_clean":"2023-05-24T03:29:49.797983+0000","last_became_active":"2023-05-24T03:29:44.084914+0000","last_became_peered":"2023-05-24T03:29:44.084914+0000","last_unstale":"2023-05-24T03:29:49.797983+0000","last_undegraded":"2023-05-24T03:29:49.797983+0000","last_fullsized":"2023-05-24T03:29:49.797983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:13:33.993784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798728+0000","last_change":"2023-05-24T03:29:44.496038+0000","last_active":"2023-05-24T03:29:49.798728+0000","last_peered":"2023-05-24T03:29:49.798728+0000","last_clean":"2023-05-24T03:29:49.798728+0000","last_became_active":"2023-05-24T03:29:44.495795+0000","last_became_peered":"2023-05-24T03:29:44.495795+0000","last_unstale":"2023-05-24T03:29:49.798728+0000","last_undegraded":"2023-05-24T03:29:49.798728+0000","last_fullsized":"2023-05-24T03:29:49.798728+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:09:24.928940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.712227+0000","last_change":"2023-05-24T03:29:48.518930+0000","last_active":"2023-05-24T03:29:49.712227+0000","last_peered":"2023-05-24T03:29:49.712227+0000","last_clean":"2023-05-24T03:29:49.712227+0000","last_became_active":"2023-05-24T03:29:48.518531+0000","last_became_peered":"2023-05-24T03:29:48.518531+0000","last_unstale":"2023-05-24T03:29:49.712227+0000","last_undegraded":"2023-05-24T03:29:49.712227+0000","last_fullsized":"2023-05-24T03:29:49.712227+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:04:11.123028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.712271+0000","last_change":"2023-05-24T03:29:44.089650+0000","last_active":"2023-05-24T03:29:49.712271+0000","last_peered":"2023-05-24T03:29:49.712271+0000","last_clean":"2023-05-24T03:29:49.712271+0000","last_became_active":"2023-05-24T03:29:44.089340+0000","last_became_peered":"2023-05-24T03:29:44.089340+0000","last_unstale":"2023-05-24T03:29:49.712271+0000","last_undegraded":"2023-05-24T03:29:49.712271+0000","last_fullsized":"2023-05-24T03:29:49.712271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:25:39.171324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.923182+0000","last_change":"2023-05-24T03:29:44.498089+0000","last_active":"2023-05-24T03:29:48.923182+0000","last_peered":"2023-05-24T03:29:48.923182+0000","last_clean":"2023-05-24T03:29:48.923182+0000","last_became_active":"2023-05-24T03:29:44.497795+0000","last_became_peered":"2023-05-24T03:29:44.497795+0000","last_unstale":"2023-05-24T03:29:48.923182+0000","last_undegraded":"2023-05-24T03:29:48.923182+0000","last_fullsized":"2023-05-24T03:29:48.923182+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:30:56.976033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.231935+0000","last_change":"2023-05-24T03:29:48.521349+0000","last_active":"2023-05-24T03:29:49.231935+0000","last_peered":"2023-05-24T03:29:49.231935+0000","last_clean":"2023-05-24T03:29:49.231935+0000","last_became_active":"2023-05-24T03:29:48.520899+0000","last_became_peered":"2023-05-24T03:29:48.520899+0000","last_unstale":"2023-05-24T03:29:49.231935+0000","last_undegraded":"2023-05-24T03:29:49.231935+0000","last_fullsized":"2023-05-24T03:29:49.231935+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:39:27.313301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.712201+0000","last_change":"2023-05-24T03:29:44.086355+0000","last_active":"2023-05-24T03:29:49.712201+0000","last_peered":"2023-05-24T03:29:49.712201+0000","last_clean":"2023-05-24T03:29:49.712201+0000","last_became_active":"2023-05-24T03:29:44.086054+0000","last_became_peered":"2023-05-24T03:29:44.086054+0000","last_unstale":"2023-05-24T03:29:49.712201+0000","last_undegraded":"2023-05-24T03:29:49.712201+0000","last_fullsized":"2023-05-24T03:29:49.712201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:59:08.440023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924885+0000","last_change":"2023-05-24T03:29:44.492413+0000","last_active":"2023-05-24T03:29:48.924885+0000","last_peered":"2023-05-24T03:29:48.924885+0000","last_clean":"2023-05-24T03:29:48.924885+0000","last_became_active":"2023-05-24T03:29:44.492099+0000","last_became_peered":"2023-05-24T03:29:44.492099+0000","last_unstale":"2023-05-24T03:29:48.924885+0000","last_undegraded":"2023-05-24T03:29:48.924885+0000","last_fullsized":"2023-05-24T03:29:48.924885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:10:14.728343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.232089+0000","last_change":"2023-05-24T03:29:48.522128+0000","last_active":"2023-05-24T03:29:49.232089+0000","last_peered":"2023-05-24T03:29:49.232089+0000","last_clean":"2023-05-24T03:29:49.232089+0000","last_became_active":"2023-05-24T03:29:48.521729+0000","last_became_peered":"2023-05-24T03:29:48.521729+0000","last_unstale":"2023-05-24T03:29:49.232089+0000","last_undegraded":"2023-05-24T03:29:49.232089+0000","last_fullsized":"2023-05-24T03:29:49.232089+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:56:43.026692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.712235+0000","last_change":"2023-05-24T03:29:44.088761+0000","last_active":"2023-05-24T03:29:49.712235+0000","last_peered":"2023-05-24T03:29:49.712235+0000","last_clean":"2023-05-24T03:29:49.712235+0000","last_became_active":"2023-05-24T03:29:44.088459+0000","last_became_peered":"2023-05-24T03:29:44.088459+0000","last_unstale":"2023-05-24T03:29:49.712235+0000","last_undegraded":"2023-05-24T03:29:49.712235+0000","last_fullsized":"2023-05-24T03:29:49.712235+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:59:51.303175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.797882+0000","last_change":"2023-05-24T03:29:44.490252+0000","last_active":"2023-05-24T03:29:49.797882+0000","last_peered":"2023-05-24T03:29:49.797882+0000","last_clean":"2023-05-24T03:29:49.797882+0000","last_became_active":"2023-05-24T03:29:44.489975+0000","last_became_peered":"2023-05-24T03:29:44.489975+0000","last_unstale":"2023-05-24T03:29:49.797882+0000","last_undegraded":"2023-05-24T03:29:49.797882+0000","last_fullsized":"2023-05-24T03:29:49.797882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:23:37.430993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.232052+0000","last_change":"2023-05-24T03:29:48.523911+0000","last_active":"2023-05-24T03:29:49.232052+0000","last_peered":"2023-05-24T03:29:49.232052+0000","last_clean":"2023-05-24T03:29:49.232052+0000","last_became_active":"2023-05-24T03:29:48.523545+0000","last_became_peered":"2023-05-24T03:29:48.523545+0000","last_unstale":"2023-05-24T03:29:49.232052+0000","last_undegraded":"2023-05-24T03:29:49.232052+0000","last_fullsized":"2023-05-24T03:29:49.232052+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:03:23.555501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.923539+0000","last_change":"2023-05-24T03:29:44.091185+0000","last_active":"2023-05-24T03:29:48.923539+0000","last_peered":"2023-05-24T03:29:48.923539+0000","last_clean":"2023-05-24T03:29:48.923539+0000","last_became_active":"2023-05-24T03:29:44.090887+0000","last_became_peered":"2023-05-24T03:29:44.090887+0000","last_unstale":"2023-05-24T03:29:48.923539+0000","last_undegraded":"2023-05-24T03:29:48.923539+0000","last_fullsized":"2023-05-24T03:29:48.923539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:37:22.319418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156514+0000","last_change":"2023-05-24T03:29:44.502570+0000","last_active":"2023-05-24T03:29:49.156514+0000","last_peered":"2023-05-24T03:29:49.156514+0000","last_clean":"2023-05-24T03:29:49.156514+0000","last_became_active":"2023-05-24T03:29:44.502286+0000","last_became_peered":"2023-05-24T03:29:44.502286+0000","last_unstale":"2023-05-24T03:29:49.156514+0000","last_undegraded":"2023-05-24T03:29:49.156514+0000","last_fullsized":"2023-05-24T03:29:49.156514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:59:06.275418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.232426+0000","last_change":"2023-05-24T03:29:48.521750+0000","last_active":"2023-05-24T03:29:49.232426+0000","last_peered":"2023-05-24T03:29:49.232426+0000","last_clean":"2023-05-24T03:29:49.232426+0000","last_became_active":"2023-05-24T03:29:48.520960+0000","last_became_peered":"2023-05-24T03:29:48.520960+0000","last_unstale":"2023-05-24T03:29:49.232426+0000","last_undegraded":"2023-05-24T03:29:49.232426+0000","last_fullsized":"2023-05-24T03:29:49.232426+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T03:39:23.517439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.797919+0000","last_change":"2023-05-24T03:29:44.088157+0000","last_active":"2023-05-24T03:29:49.797919+0000","last_peered":"2023-05-24T03:29:49.797919+0000","last_clean":"2023-05-24T03:29:49.797919+0000","last_became_active":"2023-05-24T03:29:44.087869+0000","last_became_peered":"2023-05-24T03:29:44.087869+0000","last_unstale":"2023-05-24T03:29:49.797919+0000","last_undegraded":"2023-05-24T03:29:49.797919+0000","last_fullsized":"2023-05-24T03:29:49.797919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:47:23.070936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925265+0000","last_change":"2023-05-24T03:29:44.501176+0000","last_active":"2023-05-24T03:29:48.925265+0000","last_peered":"2023-05-24T03:29:48.925265+0000","last_clean":"2023-05-24T03:29:48.925265+0000","last_became_active":"2023-05-24T03:29:44.499700+0000","last_became_peered":"2023-05-24T03:29:44.499700+0000","last_unstale":"2023-05-24T03:29:48.925265+0000","last_undegraded":"2023-05-24T03:29:48.925265+0000","last_fullsized":"2023-05-24T03:29:48.925265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:31:52.511256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920217+0000","last_change":"2023-05-24T03:29:48.522778+0000","last_active":"2023-05-24T03:29:48.920217+0000","last_peered":"2023-05-24T03:29:48.920217+0000","last_clean":"2023-05-24T03:29:48.920217+0000","last_became_active":"2023-05-24T03:29:48.522104+0000","last_became_peered":"2023-05-24T03:29:48.522104+0000","last_unstale":"2023-05-24T03:29:48.920217+0000","last_undegraded":"2023-05-24T03:29:48.920217+0000","last_fullsized":"2023-05-24T03:29:48.920217+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:43:13.521320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.797884+0000","last_change":"2023-05-24T03:29:44.085211+0000","last_active":"2023-05-24T03:29:49.797884+0000","last_peered":"2023-05-24T03:29:49.797884+0000","last_clean":"2023-05-24T03:29:49.797884+0000","last_became_active":"2023-05-24T03:29:44.084894+0000","last_became_peered":"2023-05-24T03:29:44.084894+0000","last_unstale":"2023-05-24T03:29:49.797884+0000","last_undegraded":"2023-05-24T03:29:49.797884+0000","last_fullsized":"2023-05-24T03:29:49.797884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:12:00.580737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925495+0000","last_change":"2023-05-24T03:29:44.492807+0000","last_active":"2023-05-24T03:29:48.925495+0000","last_peered":"2023-05-24T03:29:48.925495+0000","last_clean":"2023-05-24T03:29:48.925495+0000","last_became_active":"2023-05-24T03:29:44.492462+0000","last_became_peered":"2023-05-24T03:29:44.492462+0000","last_unstale":"2023-05-24T03:29:48.925495+0000","last_undegraded":"2023-05-24T03:29:48.925495+0000","last_fullsized":"2023-05-24T03:29:48.925495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:58:20.689097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924069+0000","last_change":"2023-05-24T03:29:48.524960+0000","last_active":"2023-05-24T03:29:48.924069+0000","last_peered":"2023-05-24T03:29:48.924069+0000","last_clean":"2023-05-24T03:29:48.924069+0000","last_became_active":"2023-05-24T03:29:48.524023+0000","last_became_peered":"2023-05-24T03:29:48.524023+0000","last_unstale":"2023-05-24T03:29:48.924069+0000","last_undegraded":"2023-05-24T03:29:48.924069+0000","last_fullsized":"2023-05-24T03:29:48.924069+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:06:49.307926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924625+0000","last_change":"2023-05-24T03:29:44.082700+0000","last_active":"2023-05-24T03:29:48.924625+0000","last_peered":"2023-05-24T03:29:48.924625+0000","last_clean":"2023-05-24T03:29:48.924625+0000","last_became_active":"2023-05-24T03:29:44.082382+0000","last_became_peered":"2023-05-24T03:29:44.082382+0000","last_unstale":"2023-05-24T03:29:48.924625+0000","last_undegraded":"2023-05-24T03:29:48.924625+0000","last_fullsized":"2023-05-24T03:29:48.924625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:25:39.171324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925735+0000","last_change":"2023-05-24T03:29:44.501409+0000","last_active":"2023-05-24T03:29:48.925735+0000","last_peered":"2023-05-24T03:29:48.925735+0000","last_clean":"2023-05-24T03:29:48.925735+0000","last_became_active":"2023-05-24T03:29:44.501080+0000","last_became_peered":"2023-05-24T03:29:44.501080+0000","last_unstale":"2023-05-24T03:29:48.925735+0000","last_undegraded":"2023-05-24T03:29:48.925735+0000","last_fullsized":"2023-05-24T03:29:48.925735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T03:40:05.771938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925745+0000","last_change":"2023-05-24T03:29:48.519383+0000","last_active":"2023-05-24T03:29:48.925745+0000","last_peered":"2023-05-24T03:29:48.925745+0000","last_clean":"2023-05-24T03:29:48.925745+0000","last_became_active":"2023-05-24T03:29:48.519046+0000","last_became_peered":"2023-05-24T03:29:48.519046+0000","last_unstale":"2023-05-24T03:29:48.925745+0000","last_undegraded":"2023-05-24T03:29:48.925745+0000","last_fullsized":"2023-05-24T03:29:48.925745+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:55:49.240935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.797812+0000","last_change":"2023-05-24T03:29:44.085771+0000","last_active":"2023-05-24T03:29:49.797812+0000","last_peered":"2023-05-24T03:29:49.797812+0000","last_clean":"2023-05-24T03:29:49.797812+0000","last_became_active":"2023-05-24T03:29:44.085420+0000","last_became_peered":"2023-05-24T03:29:44.085420+0000","last_unstale":"2023-05-24T03:29:49.797812+0000","last_undegraded":"2023-05-24T03:29:49.797812+0000","last_fullsized":"2023-05-24T03:29:49.797812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:17:25.372310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920855+0000","last_change":"2023-05-24T03:29:44.491345+0000","last_active":"2023-05-24T03:29:48.920855+0000","last_peered":"2023-05-24T03:29:48.920855+0000","last_clean":"2023-05-24T03:29:48.920855+0000","last_became_active":"2023-05-24T03:29:44.491089+0000","last_became_peered":"2023-05-24T03:29:44.491089+0000","last_unstale":"2023-05-24T03:29:48.920855+0000","last_undegraded":"2023-05-24T03:29:48.920855+0000","last_fullsized":"2023-05-24T03:29:48.920855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:27:09.189901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156263+0000","last_change":"2023-05-24T03:29:48.530105+0000","last_active":"2023-05-24T03:29:49.156263+0000","last_peered":"2023-05-24T03:29:49.156263+0000","last_clean":"2023-05-24T03:29:49.156263+0000","last_became_active":"2023-05-24T03:29:48.529157+0000","last_became_peered":"2023-05-24T03:29:48.529157+0000","last_unstale":"2023-05-24T03:29:49.156263+0000","last_undegraded":"2023-05-24T03:29:49.156263+0000","last_fullsized":"2023-05-24T03:29:49.156263+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:16:42.206744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920406+0000","last_change":"2023-05-24T03:29:39.143199+0000","last_active":"2023-05-24T03:29:48.920406+0000","last_peered":"2023-05-24T03:29:48.920406+0000","last_clean":"2023-05-24T03:29:48.920406+0000","last_became_active":"2023-05-24T03:29:39.142867+0000","last_became_peered":"2023-05-24T03:29:39.142867+0000","last_unstale":"2023-05-24T03:29:48.920406+0000","last_undegraded":"2023-05-24T03:29:48.920406+0000","last_fullsized":"2023-05-24T03:29:48.920406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:30:50.951434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924073+0000","last_change":"2023-05-24T03:29:44.087790+0000","last_active":"2023-05-24T03:29:48.924073+0000","last_peered":"2023-05-24T03:29:48.924073+0000","last_clean":"2023-05-24T03:29:48.924073+0000","last_became_active":"2023-05-24T03:29:44.087475+0000","last_became_peered":"2023-05-24T03:29:44.087475+0000","last_unstale":"2023-05-24T03:29:48.924073+0000","last_undegraded":"2023-05-24T03:29:48.924073+0000","last_fullsized":"2023-05-24T03:29:48.924073+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:19:26.667537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920215+0000","last_change":"2023-05-24T03:29:44.497235+0000","last_active":"2023-05-24T03:29:48.920215+0000","last_peered":"2023-05-24T03:29:48.920215+0000","last_clean":"2023-05-24T03:29:48.920215+0000","last_became_active":"2023-05-24T03:29:44.497015+0000","last_became_peered":"2023-05-24T03:29:44.497015+0000","last_unstale":"2023-05-24T03:29:48.920215+0000","last_undegraded":"2023-05-24T03:29:48.920215+0000","last_fullsized":"2023-05-24T03:29:48.920215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:57:57.662351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156092+0000","last_change":"2023-05-24T03:29:48.527805+0000","last_active":"2023-05-24T03:29:49.156092+0000","last_peered":"2023-05-24T03:29:49.156092+0000","last_clean":"2023-05-24T03:29:49.156092+0000","last_became_active":"2023-05-24T03:29:48.527010+0000","last_became_peered":"2023-05-24T03:29:48.527010+0000","last_unstale":"2023-05-24T03:29:49.156092+0000","last_undegraded":"2023-05-24T03:29:49.156092+0000","last_fullsized":"2023-05-24T03:29:49.156092+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:27:55.598487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.923462+0000","last_change":"2023-05-24T03:29:39.048516+0000","last_active":"2023-05-24T03:29:48.923462+0000","last_peered":"2023-05-24T03:29:48.923462+0000","last_clean":"2023-05-24T03:29:48.923462+0000","last_became_active":"2023-05-24T03:29:39.048141+0000","last_became_peered":"2023-05-24T03:29:39.048141+0000","last_unstale":"2023-05-24T03:29:48.923462+0000","last_undegraded":"2023-05-24T03:29:48.923462+0000","last_fullsized":"2023-05-24T03:29:48.923462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:42:01.286387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925527+0000","last_change":"2023-05-24T03:29:44.085282+0000","last_active":"2023-05-24T03:29:48.925527+0000","last_peered":"2023-05-24T03:29:48.925527+0000","last_clean":"2023-05-24T03:29:48.925527+0000","last_became_active":"2023-05-24T03:29:44.084944+0000","last_became_peered":"2023-05-24T03:29:44.084944+0000","last_unstale":"2023-05-24T03:29:48.925527+0000","last_undegraded":"2023-05-24T03:29:48.925527+0000","last_fullsized":"2023-05-24T03:29:48.925527+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:09:43.787048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920293+0000","last_change":"2023-05-24T03:29:44.483553+0000","last_active":"2023-05-24T03:29:48.920293+0000","last_peered":"2023-05-24T03:29:48.920293+0000","last_clean":"2023-05-24T03:29:48.920293+0000","last_became_active":"2023-05-24T03:29:44.483134+0000","last_became_peered":"2023-05-24T03:29:44.483134+0000","last_unstale":"2023-05-24T03:29:48.920293+0000","last_undegraded":"2023-05-24T03:29:48.920293+0000","last_fullsized":"2023-05-24T03:29:48.920293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:51:21.843236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.232485+0000","last_change":"2023-05-24T03:29:48.519249+0000","last_active":"2023-05-24T03:29:49.232485+0000","last_peered":"2023-05-24T03:29:49.232485+0000","last_clean":"2023-05-24T03:29:49.232485+0000","last_became_active":"2023-05-24T03:29:48.518546+0000","last_became_peered":"2023-05-24T03:29:48.518546+0000","last_unstale":"2023-05-24T03:29:49.232485+0000","last_undegraded":"2023-05-24T03:29:49.232485+0000","last_fullsized":"2023-05-24T03:29:49.232485+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:03:54.662293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.232195+0000","last_change":"2023-05-24T03:29:39.310351+0000","last_active":"2023-05-24T03:29:49.232195+0000","last_peered":"2023-05-24T03:29:49.232195+0000","last_clean":"2023-05-24T03:29:49.232195+0000","last_became_active":"2023-05-24T03:29:39.310070+0000","last_became_peered":"2023-05-24T03:29:39.310070+0000","last_unstale":"2023-05-24T03:29:49.232195+0000","last_undegraded":"2023-05-24T03:29:49.232195+0000","last_fullsized":"2023-05-24T03:29:49.232195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:13:08.585653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.919973+0000","last_change":"2023-05-24T03:29:44.075504+0000","last_active":"2023-05-24T03:29:48.919973+0000","last_peered":"2023-05-24T03:29:48.919973+0000","last_clean":"2023-05-24T03:29:48.919973+0000","last_became_active":"2023-05-24T03:29:44.074551+0000","last_became_peered":"2023-05-24T03:29:44.074551+0000","last_unstale":"2023-05-24T03:29:48.919973+0000","last_undegraded":"2023-05-24T03:29:48.919973+0000","last_fullsized":"2023-05-24T03:29:48.919973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:00:51.565754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920676+0000","last_change":"2023-05-24T03:29:44.496225+0000","last_active":"2023-05-24T03:29:48.920676+0000","last_peered":"2023-05-24T03:29:48.920676+0000","last_clean":"2023-05-24T03:29:48.920676+0000","last_became_active":"2023-05-24T03:29:44.496030+0000","last_became_peered":"2023-05-24T03:29:44.496030+0000","last_unstale":"2023-05-24T03:29:48.920676+0000","last_undegraded":"2023-05-24T03:29:48.920676+0000","last_fullsized":"2023-05-24T03:29:48.920676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:37:23.325863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.711961+0000","last_change":"2023-05-24T03:29:48.523816+0000","last_active":"2023-05-24T03:29:49.711961+0000","last_peered":"2023-05-24T03:29:49.711961+0000","last_clean":"2023-05-24T03:29:49.711961+0000","last_became_active":"2023-05-24T03:29:48.523380+0000","last_became_peered":"2023-05-24T03:29:48.523380+0000","last_unstale":"2023-05-24T03:29:49.711961+0000","last_undegraded":"2023-05-24T03:29:49.711961+0000","last_fullsized":"2023-05-24T03:29:49.711961+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:59:09.697698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.923885+0000","last_change":"2023-05-24T03:29:39.051113+0000","last_active":"2023-05-24T03:29:48.923885+0000","last_peered":"2023-05-24T03:29:48.923885+0000","last_clean":"2023-05-24T03:29:48.923885+0000","last_became_active":"2023-05-24T03:29:39.050751+0000","last_became_peered":"2023-05-24T03:29:39.050751+0000","last_unstale":"2023-05-24T03:29:48.923885+0000","last_undegraded":"2023-05-24T03:29:48.923885+0000","last_fullsized":"2023-05-24T03:29:48.923885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:54:48.001313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":183,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.711482+0000","last_change":"2023-05-24T03:29:34.025679+0000","last_active":"2023-05-24T03:29:49.711482+0000","last_peered":"2023-05-24T03:29:49.711482+0000","last_clean":"2023-05-24T03:29:49.711482+0000","last_became_active":"2023-05-24T03:29:34.024728+0000","last_became_peered":"2023-05-24T03:29:34.024728+0000","last_unstale":"2023-05-24T03:29:49.711482+0000","last_undegraded":"2023-05-24T03:29:49.711482+0000","last_fullsized":"2023-05-24T03:29:49.711482+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:32.968348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:32.968348+0000","last_clean_scrub_stamp":"2023-05-24T03:29:32.968348+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:17:15.286781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.797849+0000","last_change":"2023-05-24T03:29:44.086373+0000","last_active":"2023-05-24T03:29:49.797849+0000","last_peered":"2023-05-24T03:29:49.797849+0000","last_clean":"2023-05-24T03:29:49.797849+0000","last_became_active":"2023-05-24T03:29:44.086125+0000","last_became_peered":"2023-05-24T03:29:44.086125+0000","last_unstale":"2023-05-24T03:29:49.797849+0000","last_undegraded":"2023-05-24T03:29:49.797849+0000","last_fullsized":"2023-05-24T03:29:49.797849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:13:01.346454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798145+0000","last_change":"2023-05-24T03:29:44.492654+0000","last_active":"2023-05-24T03:29:49.798145+0000","last_peered":"2023-05-24T03:29:49.798145+0000","last_clean":"2023-05-24T03:29:49.798145+0000","last_became_active":"2023-05-24T03:29:44.492375+0000","last_became_peered":"2023-05-24T03:29:44.492375+0000","last_unstale":"2023-05-24T03:29:49.798145+0000","last_undegraded":"2023-05-24T03:29:49.798145+0000","last_fullsized":"2023-05-24T03:29:49.798145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:59:38.574199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.923773+0000","last_change":"2023-05-24T03:29:48.525206+0000","last_active":"2023-05-24T03:29:48.923773+0000","last_peered":"2023-05-24T03:29:48.923773+0000","last_clean":"2023-05-24T03:29:48.923773+0000","last_became_active":"2023-05-24T03:29:48.524615+0000","last_became_peered":"2023-05-24T03:29:48.524615+0000","last_unstale":"2023-05-24T03:29:48.923773+0000","last_undegraded":"2023-05-24T03:29:48.923773+0000","last_fullsized":"2023-05-24T03:29:48.923773+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:13:05.775179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.711704+0000","last_change":"2023-05-24T03:29:39.054117+0000","last_active":"2023-05-24T03:29:49.711704+0000","last_peered":"2023-05-24T03:29:49.711704+0000","last_clean":"2023-05-24T03:29:49.711704+0000","last_became_active":"2023-05-24T03:29:39.053813+0000","last_became_peered":"2023-05-24T03:29:39.053813+0000","last_unstale":"2023-05-24T03:29:49.711704+0000","last_undegraded":"2023-05-24T03:29:49.711704+0000","last_fullsized":"2023-05-24T03:29:49.711704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:47:18.052783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156076+0000","last_change":"2023-05-24T03:29:44.090147+0000","last_active":"2023-05-24T03:29:49.156076+0000","last_peered":"2023-05-24T03:29:49.156076+0000","last_clean":"2023-05-24T03:29:49.156076+0000","last_became_active":"2023-05-24T03:29:44.089943+0000","last_became_peered":"2023-05-24T03:29:44.089943+0000","last_unstale":"2023-05-24T03:29:49.156076+0000","last_undegraded":"2023-05-24T03:29:49.156076+0000","last_fullsized":"2023-05-24T03:29:49.156076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:30:55.969587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156224+0000","last_change":"2023-05-24T03:29:44.498467+0000","last_active":"2023-05-24T03:29:49.156224+0000","last_peered":"2023-05-24T03:29:49.156224+0000","last_clean":"2023-05-24T03:29:49.156224+0000","last_became_active":"2023-05-24T03:29:44.498130+0000","last_became_peered":"2023-05-24T03:29:44.498130+0000","last_unstale":"2023-05-24T03:29:49.156224+0000","last_undegraded":"2023-05-24T03:29:49.156224+0000","last_fullsized":"2023-05-24T03:29:49.156224+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:42:07.310986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798266+0000","last_change":"2023-05-24T03:29:48.520034+0000","last_active":"2023-05-24T03:29:49.798266+0000","last_peered":"2023-05-24T03:29:49.798266+0000","last_clean":"2023-05-24T03:29:49.798266+0000","last_became_active":"2023-05-24T03:29:48.519673+0000","last_became_peered":"2023-05-24T03:29:48.519673+0000","last_unstale":"2023-05-24T03:29:49.798266+0000","last_undegraded":"2023-05-24T03:29:49.798266+0000","last_fullsized":"2023-05-24T03:29:49.798266+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:47:00.839865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.711979+0000","last_change":"2023-05-24T03:29:39.143215+0000","last_active":"2023-05-24T03:29:49.711979+0000","last_peered":"2023-05-24T03:29:49.711979+0000","last_clean":"2023-05-24T03:29:49.711979+0000","last_became_active":"2023-05-24T03:29:39.142949+0000","last_became_peered":"2023-05-24T03:29:39.142949+0000","last_unstale":"2023-05-24T03:29:49.711979+0000","last_undegraded":"2023-05-24T03:29:49.711979+0000","last_fullsized":"2023-05-24T03:29:49.711979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:52:07.793681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920538+0000","last_change":"2023-05-24T03:29:44.074869+0000","last_active":"2023-05-24T03:29:48.920538+0000","last_peered":"2023-05-24T03:29:48.920538+0000","last_clean":"2023-05-24T03:29:48.920538+0000","last_became_active":"2023-05-24T03:29:44.074374+0000","last_became_peered":"2023-05-24T03:29:44.074374+0000","last_unstale":"2023-05-24T03:29:48.920538+0000","last_undegraded":"2023-05-24T03:29:48.920538+0000","last_fullsized":"2023-05-24T03:29:48.920538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:16:37.778018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156370+0000","last_change":"2023-05-24T03:29:44.499979+0000","last_active":"2023-05-24T03:29:49.156370+0000","last_peered":"2023-05-24T03:29:49.156370+0000","last_clean":"2023-05-24T03:29:49.156370+0000","last_became_active":"2023-05-24T03:29:44.499768+0000","last_became_peered":"2023-05-24T03:29:44.499768+0000","last_unstale":"2023-05-24T03:29:49.156370+0000","last_undegraded":"2023-05-24T03:29:49.156370+0000","last_fullsized":"2023-05-24T03:29:49.156370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:13:02.352900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924990+0000","last_change":"2023-05-24T03:29:48.530781+0000","last_active":"2023-05-24T03:29:48.924990+0000","last_peered":"2023-05-24T03:29:48.924990+0000","last_clean":"2023-05-24T03:29:48.924990+0000","last_became_active":"2023-05-24T03:29:48.530401+0000","last_became_peered":"2023-05-24T03:29:48.530401+0000","last_unstale":"2023-05-24T03:29:48.924990+0000","last_undegraded":"2023-05-24T03:29:48.924990+0000","last_fullsized":"2023-05-24T03:29:48.924990+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:56:52.111906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798616+0000","last_change":"2023-05-24T03:29:44.084278+0000","last_active":"2023-05-24T03:29:49.798616+0000","last_peered":"2023-05-24T03:29:49.798616+0000","last_clean":"2023-05-24T03:29:49.798616+0000","last_became_active":"2023-05-24T03:29:44.083929+0000","last_became_peered":"2023-05-24T03:29:44.083929+0000","last_unstale":"2023-05-24T03:29:49.798616+0000","last_undegraded":"2023-05-24T03:29:49.798616+0000","last_fullsized":"2023-05-24T03:29:49.798616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:59:51.303175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920595+0000","last_change":"2023-05-24T03:29:39.045821+0000","last_active":"2023-05-24T03:29:48.920595+0000","last_peered":"2023-05-24T03:29:48.920595+0000","last_clean":"2023-05-24T03:29:48.920595+0000","last_became_active":"2023-05-24T03:29:39.045543+0000","last_became_peered":"2023-05-24T03:29:39.045543+0000","last_unstale":"2023-05-24T03:29:48.920595+0000","last_undegraded":"2023-05-24T03:29:48.920595+0000","last_fullsized":"2023-05-24T03:29:48.920595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:12:33.887713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.797728+0000","last_change":"2023-05-24T03:29:44.496106+0000","last_active":"2023-05-24T03:29:49.797728+0000","last_peered":"2023-05-24T03:29:49.797728+0000","last_clean":"2023-05-24T03:29:49.797728+0000","last_became_active":"2023-05-24T03:29:44.495816+0000","last_became_peered":"2023-05-24T03:29:44.495816+0000","last_unstale":"2023-05-24T03:29:49.797728+0000","last_undegraded":"2023-05-24T03:29:49.797728+0000","last_fullsized":"2023-05-24T03:29:49.797728+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:37:23.325863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.797716+0000","last_change":"2023-05-24T03:29:48.527602+0000","last_active":"2023-05-24T03:29:49.797716+0000","last_peered":"2023-05-24T03:29:49.797716+0000","last_clean":"2023-05-24T03:29:49.797716+0000","last_became_active":"2023-05-24T03:29:48.527196+0000","last_became_peered":"2023-05-24T03:29:48.527196+0000","last_unstale":"2023-05-24T03:29:49.797716+0000","last_undegraded":"2023-05-24T03:29:49.797716+0000","last_fullsized":"2023-05-24T03:29:49.797716+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:12:43.334592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798516+0000","last_change":"2023-05-24T03:29:39.046445+0000","last_active":"2023-05-24T03:29:49.798516+0000","last_peered":"2023-05-24T03:29:49.798516+0000","last_clean":"2023-05-24T03:29:49.798516+0000","last_became_active":"2023-05-24T03:29:39.046149+0000","last_became_peered":"2023-05-24T03:29:39.046149+0000","last_unstale":"2023-05-24T03:29:49.798516+0000","last_undegraded":"2023-05-24T03:29:49.798516+0000","last_fullsized":"2023-05-24T03:29:49.798516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:11:20.972024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"28'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156361+0000","last_change":"2023-05-24T03:29:44.088780+0000","last_active":"2023-05-24T03:29:49.156361+0000","last_peered":"2023-05-24T03:29:49.156361+0000","last_clean":"2023-05-24T03:29:49.156361+0000","last_became_active":"2023-05-24T03:29:44.088495+0000","last_became_peered":"2023-05-24T03:29:44.088495+0000","last_unstale":"2023-05-24T03:29:49.156361+0000","last_undegraded":"2023-05-24T03:29:49.156361+0000","last_fullsized":"2023-05-24T03:29:49.156361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:37:22.319418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924732+0000","last_change":"2023-05-24T03:29:44.496966+0000","last_active":"2023-05-24T03:29:48.924732+0000","last_peered":"2023-05-24T03:29:48.924732+0000","last_clean":"2023-05-24T03:29:48.924732+0000","last_became_active":"2023-05-24T03:29:44.496597+0000","last_became_peered":"2023-05-24T03:29:44.496597+0000","last_unstale":"2023-05-24T03:29:48.924732+0000","last_undegraded":"2023-05-24T03:29:48.924732+0000","last_fullsized":"2023-05-24T03:29:48.924732+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:09:24.928940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920813+0000","last_change":"2023-05-24T03:29:48.524541+0000","last_active":"2023-05-24T03:29:48.920813+0000","last_peered":"2023-05-24T03:29:48.920813+0000","last_clean":"2023-05-24T03:29:48.920813+0000","last_became_active":"2023-05-24T03:29:48.524170+0000","last_became_peered":"2023-05-24T03:29:48.524170+0000","last_unstale":"2023-05-24T03:29:48.920813+0000","last_undegraded":"2023-05-24T03:29:48.920813+0000","last_fullsized":"2023-05-24T03:29:48.920813+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:17:29.801036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156385+0000","last_change":"2023-05-24T03:29:44.090259+0000","last_active":"2023-05-24T03:29:49.156385+0000","last_peered":"2023-05-24T03:29:49.156385+0000","last_clean":"2023-05-24T03:29:49.156385+0000","last_became_active":"2023-05-24T03:29:44.089993+0000","last_became_peered":"2023-05-24T03:29:44.089993+0000","last_unstale":"2023-05-24T03:29:49.156385+0000","last_undegraded":"2023-05-24T03:29:49.156385+0000","last_fullsized":"2023-05-24T03:29:49.156385+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:27:08.183456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.232199+0000","last_change":"2023-05-24T03:29:44.481933+0000","last_active":"2023-05-24T03:29:49.232199+0000","last_peered":"2023-05-24T03:29:49.232199+0000","last_clean":"2023-05-24T03:29:49.232199+0000","last_became_active":"2023-05-24T03:29:44.481655+0000","last_became_peered":"2023-05-24T03:29:44.481655+0000","last_unstale":"2023-05-24T03:29:49.232199+0000","last_undegraded":"2023-05-24T03:29:49.232199+0000","last_fullsized":"2023-05-24T03:29:49.232199+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:06:36.510598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.712009+0000","last_change":"2023-05-24T03:29:48.516800+0000","last_active":"2023-05-24T03:29:49.712009+0000","last_peered":"2023-05-24T03:29:49.712009+0000","last_clean":"2023-05-24T03:29:49.712009+0000","last_became_active":"2023-05-24T03:29:48.516366+0000","last_became_peered":"2023-05-24T03:29:48.516366+0000","last_unstale":"2023-05-24T03:29:49.712009+0000","last_undegraded":"2023-05-24T03:29:49.712009+0000","last_fullsized":"2023-05-24T03:29:49.712009+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:19:31.096262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.923650+0000","last_change":"2023-05-24T03:29:44.094179+0000","last_active":"2023-05-24T03:29:48.923650+0000","last_peered":"2023-05-24T03:29:48.923650+0000","last_clean":"2023-05-24T03:29:48.923650+0000","last_became_active":"2023-05-24T03:29:44.093909+0000","last_became_peered":"2023-05-24T03:29:44.093909+0000","last_unstale":"2023-05-24T03:29:48.923650+0000","last_undegraded":"2023-05-24T03:29:48.923650+0000","last_fullsized":"2023-05-24T03:29:48.923650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:55:31.183299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924979+0000","last_change":"2023-05-24T03:29:44.497379+0000","last_active":"2023-05-24T03:29:48.924979+0000","last_peered":"2023-05-24T03:29:48.924979+0000","last_clean":"2023-05-24T03:29:48.924979+0000","last_became_active":"2023-05-24T03:29:44.496679+0000","last_became_peered":"2023-05-24T03:29:44.496679+0000","last_unstale":"2023-05-24T03:29:48.924979+0000","last_undegraded":"2023-05-24T03:29:48.924979+0000","last_fullsized":"2023-05-24T03:29:48.924979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:53:47.591081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924043+0000","last_change":"2023-05-24T03:29:48.529231+0000","last_active":"2023-05-24T03:29:48.924043+0000","last_peered":"2023-05-24T03:29:48.924043+0000","last_clean":"2023-05-24T03:29:48.924043+0000","last_became_active":"2023-05-24T03:29:48.528862+0000","last_became_peered":"2023-05-24T03:29:48.528862+0000","last_unstale":"2023-05-24T03:29:48.924043+0000","last_undegraded":"2023-05-24T03:29:48.924043+0000","last_fullsized":"2023-05-24T03:29:48.924043+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:48:31.938863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.923932+0000","last_change":"2023-05-24T03:29:44.090289+0000","last_active":"2023-05-24T03:29:48.923932+0000","last_peered":"2023-05-24T03:29:48.923932+0000","last_clean":"2023-05-24T03:29:48.923932+0000","last_became_active":"2023-05-24T03:29:44.089949+0000","last_became_peered":"2023-05-24T03:29:44.089949+0000","last_unstale":"2023-05-24T03:29:48.923932+0000","last_undegraded":"2023-05-24T03:29:48.923932+0000","last_fullsized":"2023-05-24T03:29:48.923932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:47:23.070936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924880+0000","last_change":"2023-05-24T03:29:44.498632+0000","last_active":"2023-05-24T03:29:48.924880+0000","last_peered":"2023-05-24T03:29:48.924880+0000","last_clean":"2023-05-24T03:29:48.924880+0000","last_became_active":"2023-05-24T03:29:44.498350+0000","last_became_peered":"2023-05-24T03:29:44.498350+0000","last_unstale":"2023-05-24T03:29:48.924880+0000","last_undegraded":"2023-05-24T03:29:48.924880+0000","last_fullsized":"2023-05-24T03:29:48.924880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:02:32.050380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924648+0000","last_change":"2023-05-24T03:29:48.523434+0000","last_active":"2023-05-24T03:29:48.924648+0000","last_peered":"2023-05-24T03:29:48.924648+0000","last_clean":"2023-05-24T03:29:48.924648+0000","last_became_active":"2023-05-24T03:29:48.522228+0000","last_became_peered":"2023-05-24T03:29:48.522228+0000","last_unstale":"2023-05-24T03:29:48.924648+0000","last_undegraded":"2023-05-24T03:29:48.924648+0000","last_fullsized":"2023-05-24T03:29:48.924648+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:59:55.731900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798448+0000","last_change":"2023-05-24T03:29:44.083178+0000","last_active":"2023-05-24T03:29:49.798448+0000","last_peered":"2023-05-24T03:29:49.798448+0000","last_clean":"2023-05-24T03:29:49.798448+0000","last_became_active":"2023-05-24T03:29:44.082903+0000","last_became_peered":"2023-05-24T03:29:44.082903+0000","last_unstale":"2023-05-24T03:29:49.798448+0000","last_undegraded":"2023-05-24T03:29:49.798448+0000","last_fullsized":"2023-05-24T03:29:49.798448+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:59:08.440023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798028+0000","last_change":"2023-05-24T03:29:44.488206+0000","last_active":"2023-05-24T03:29:49.798028+0000","last_peered":"2023-05-24T03:29:49.798028+0000","last_clean":"2023-05-24T03:29:49.798028+0000","last_became_active":"2023-05-24T03:29:44.487925+0000","last_became_peered":"2023-05-24T03:29:44.487925+0000","last_unstale":"2023-05-24T03:29:49.798028+0000","last_undegraded":"2023-05-24T03:29:49.798028+0000","last_fullsized":"2023-05-24T03:29:49.798028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:48:28.516583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920063+0000","last_change":"2023-05-24T03:29:48.519899+0000","last_active":"2023-05-24T03:29:48.920063+0000","last_peered":"2023-05-24T03:29:48.920063+0000","last_clean":"2023-05-24T03:29:48.920063+0000","last_became_active":"2023-05-24T03:29:48.519517+0000","last_became_peered":"2023-05-24T03:29:48.519517+0000","last_unstale":"2023-05-24T03:29:48.920063+0000","last_undegraded":"2023-05-24T03:29:48.920063+0000","last_fullsized":"2023-05-24T03:29:48.920063+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:26:20.594013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156596+0000","last_change":"2023-05-24T03:29:44.088545+0000","last_active":"2023-05-24T03:29:49.156596+0000","last_peered":"2023-05-24T03:29:49.156596+0000","last_clean":"2023-05-24T03:29:49.156596+0000","last_became_active":"2023-05-24T03:29:44.087891+0000","last_became_peered":"2023-05-24T03:29:44.087891+0000","last_unstale":"2023-05-24T03:29:49.156596+0000","last_undegraded":"2023-05-24T03:29:49.156596+0000","last_fullsized":"2023-05-24T03:29:49.156596+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:19:26.667537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925035+0000","last_change":"2023-05-24T03:29:44.493246+0000","last_active":"2023-05-24T03:29:48.925035+0000","last_peered":"2023-05-24T03:29:48.925035+0000","last_clean":"2023-05-24T03:29:48.925035+0000","last_became_active":"2023-05-24T03:29:44.492923+0000","last_became_peered":"2023-05-24T03:29:44.492923+0000","last_unstale":"2023-05-24T03:29:48.925035+0000","last_undegraded":"2023-05-24T03:29:48.925035+0000","last_fullsized":"2023-05-24T03:29:48.925035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:59:05.161810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798054+0000","last_change":"2023-05-24T03:29:44.486961+0000","last_active":"2023-05-24T03:29:49.798054+0000","last_peered":"2023-05-24T03:29:49.798054+0000","last_clean":"2023-05-24T03:29:49.798054+0000","last_became_active":"2023-05-24T03:29:44.483898+0000","last_became_peered":"2023-05-24T03:29:44.483898+0000","last_unstale":"2023-05-24T03:29:49.798054+0000","last_undegraded":"2023-05-24T03:29:49.798054+0000","last_fullsized":"2023-05-24T03:29:49.798054+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:17:10.507341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798199+0000","last_change":"2023-05-24T03:29:44.494451+0000","last_active":"2023-05-24T03:29:49.798199+0000","last_peered":"2023-05-24T03:29:49.798199+0000","last_clean":"2023-05-24T03:29:49.798199+0000","last_became_active":"2023-05-24T03:29:44.494073+0000","last_became_peered":"2023-05-24T03:29:44.494073+0000","last_unstale":"2023-05-24T03:29:49.798199+0000","last_undegraded":"2023-05-24T03:29:49.798199+0000","last_fullsized":"2023-05-24T03:29:49.798199+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:52:13.818279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925451+0000","last_change":"2023-05-24T03:29:44.498119+0000","last_active":"2023-05-24T03:29:48.925451+0000","last_peered":"2023-05-24T03:29:48.925451+0000","last_clean":"2023-05-24T03:29:48.925451+0000","last_became_active":"2023-05-24T03:29:44.497832+0000","last_became_peered":"2023-05-24T03:29:44.497832+0000","last_unstale":"2023-05-24T03:29:48.925451+0000","last_undegraded":"2023-05-24T03:29:48.925451+0000","last_fullsized":"2023-05-24T03:29:48.925451+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:27:13.487917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.797913+0000","last_change":"2023-05-24T03:29:44.496468+0000","last_active":"2023-05-24T03:29:49.797913+0000","last_peered":"2023-05-24T03:29:49.797913+0000","last_clean":"2023-05-24T03:29:49.797913+0000","last_became_active":"2023-05-24T03:29:44.496197+0000","last_became_peered":"2023-05-24T03:29:44.496197+0000","last_unstale":"2023-05-24T03:29:49.797913+0000","last_undegraded":"2023-05-24T03:29:49.797913+0000","last_fullsized":"2023-05-24T03:29:49.797913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:54:54.025911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920554+0000","last_change":"2023-05-24T03:29:44.495194+0000","last_active":"2023-05-24T03:29:48.920554+0000","last_peered":"2023-05-24T03:29:48.920554+0000","last_clean":"2023-05-24T03:29:48.920554+0000","last_became_active":"2023-05-24T03:29:44.494928+0000","last_became_peered":"2023-05-24T03:29:44.494928+0000","last_unstale":"2023-05-24T03:29:48.920554+0000","last_undegraded":"2023-05-24T03:29:48.920554+0000","last_fullsized":"2023-05-24T03:29:48.920554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:42:07.310986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18832,"kb_used_data":904,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353008,"statfs":{"total":96636764160,"available":96617480192,"internally_reserved":0,"allocated":925696,"data_stored":718998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18224,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353616,"statfs":{"total":96636764160,"available":96618102784,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18224,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353616,"statfs":{"total":96636764160,"available":96618102784,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18808,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353032,"statfs":{"total":96636764160,"available":96617504768,"internally_reserved":0,"allocated":901120,"data_stored":715522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18224,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353616,"statfs":{"total":96636764160,"available":96618102784,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18228,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353612,"statfs":{"total":96636764160,"available":96618098688,"internally_reserved":0,"allocated":307200,"data_stored":124662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18244,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353596,"statfs":{"total":96636764160,"available":96618082304,"internally_reserved":0,"allocated":323584,"data_stored":128470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18232,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353608,"statfs":{"total":96636764160,"available":96618094592,"internally_reserved":0,"allocated":311296,"data_stored":125224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-24T03:30:11.883 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-24T03:30:12.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.032+0000 7fd1fe390700 1 Processor -- start 2023-05-24T03:30:12.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.032+0000 7fd1fe390700 1 -- start start 2023-05-24T03:30:12.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.032+0000 7fd1fe390700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1f815dcf0 0x7fd1f806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:12.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.032+0000 7fd1fe390700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1f815a120 con 0x7fd1f8159c80 2023-05-24T03:30:12.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.032+0000 7fd1fe390700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1f815a3c0 con 0x7fd1f80cdf10 2023-05-24T03:30:12.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.032+0000 7fd1fe390700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f815a6a0 con 0x7fd1f815dcf0 2023-05-24T03:30:12.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.032+0000 7fd1effff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd1f8159c80 0x7fd1f8070f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46080/0 (socket says 172.21.15.146:46080) 2023-05-24T03:30:12.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.032+0000 7fd1effff700 1 -- 172.21.15.146:0/597239831 learned_addr learned my addr 172.21.15.146:0/597239831 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:30:12.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.032+0000 7fd1fc92d700 1 --2- 172.21.15.146:0/597239831 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1f815dcf0 0x7fd1f806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:12.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.032+0000 7fd1f77fe700 1 -- 172.21.15.146:0/597239831 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 112180641 0 0) 0x7fd1f815a120 con 0x7fd1f8159c80 2023-05-24T03:30:12.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.032+0000 7fd1f77fe700 1 -- 172.21.15.146:0/597239831 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1e40035b0 con 0x7fd1f8159c80 2023-05-24T03:30:12.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.032+0000 7fd1f77fe700 1 -- 172.21.15.146:0/597239831 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1760194169 0 0) 0x7fd1f815a3c0 con 0x7fd1f80cdf10 2023-05-24T03:30:12.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.032+0000 7fd1f77fe700 1 -- 172.21.15.146:0/597239831 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1f815a120 con 0x7fd1f80cdf10 2023-05-24T03:30:12.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.033+0000 7fd1f77fe700 1 -- 172.21.15.146:0/597239831 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3262984878 0 0) 0x7fd1e40035b0 con 0x7fd1f8159c80 2023-05-24T03:30:12.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.033+0000 7fd1f77fe700 1 -- 172.21.15.146:0/597239831 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1f815dcf0 msgr2=0x7fd1f806d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:12.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.033+0000 7fd1f77fe700 1 --2- 172.21.15.146:0/597239831 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1f815dcf0 0x7fd1f806d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:12.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.033+0000 7fd1f77fe700 1 -- 172.21.15.146:0/597239831 >> v1:172.21.15.151:6789/0 conn(0x7fd1f80cdf10 legacy=0x7fd1f80ce2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:12.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.033+0000 7fd1f77fe700 1 -- 172.21.15.146:0/597239831 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f815a980 con 0x7fd1f8159c80 2023-05-24T03:30:12.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.033+0000 7fd1f77fe700 1 -- 172.21.15.146:0/597239831 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1301887351 0 0) 0x7fd1e0001670 con 0x7fd1f8159c80 2023-05-24T03:30:12.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.033+0000 7fd1f77fe700 1 -- 172.21.15.146:0/597239831 >> v1:172.21.15.146:6789/0 conn(0x7fd1f8159c80 legacy=0x7fd1f8070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:12.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.033+0000 7fd1f77fe700 1 --2- 172.21.15.146:0/597239831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1e4003bc0 0x7fd1e4003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:12.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.033+0000 7fd1f77fe700 1 --2- 172.21.15.146:0/597239831 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1f815dcf0 0x7fd1e4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:12.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.033+0000 7fd1f77fe700 1 --2- 172.21.15.146:0/597239831 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1e4004d90 0x7fd1e4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:12.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.033+0000 7fd1f77fe700 1 -- 172.21.15.146:0/597239831 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f815a6a0 con 0x7fd1e4003bc0 2023-05-24T03:30:12.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.033+0000 7fd1f77fe700 1 -- 172.21.15.146:0/597239831 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e400bac0 con 0x7fd1e4004d90 2023-05-24T03:30:12.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.033+0000 7fd1f77fe700 1 -- 172.21.15.146:0/597239831 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e400bc30 con 0x7fd1f815dcf0 2023-05-24T03:30:12.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.033+0000 7fd1f7fff700 1 --2- 172.21.15.146:0/597239831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1e4003bc0 0x7fd1e4003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:12.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.033+0000 7fd1effff700 1 --2- 172.21.15.146:0/597239831 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1f815dcf0 0x7fd1e4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:12.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.033+0000 7fd1fc92d700 1 --2- 172.21.15.146:0/597239831 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1e4004d90 0x7fd1e4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:12.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.033+0000 7fd1f7fff700 1 -- 172.21.15.146:0/597239831 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1f815dcf0 msgr2=0x7fd1e4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:12.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.033+0000 7fd1f7fff700 1 --2- 172.21.15.146:0/597239831 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1f815dcf0 0x7fd1e4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:12.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.033+0000 7fd1f7fff700 1 -- 172.21.15.146:0/597239831 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1e4004d90 msgr2=0x7fd1e4005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:12.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.033+0000 7fd1f7fff700 1 --2- 172.21.15.146:0/597239831 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1e4004d90 0x7fd1e4005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:12.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.033+0000 7fd1f7fff700 1 -- 172.21.15.146:0/597239831 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e40035b0 con 0x7fd1e4003bc0 2023-05-24T03:30:12.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.033+0000 7fd1f7fff700 1 --2- 172.21.15.146:0/597239831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1e4003bc0 0x7fd1e4003fb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd1e8001980 tx=0x7fd1e4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=494776b540684115 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:12.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.033+0000 7fd1f77fe700 1 -- 172.21.15.146:0/597239831 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e8001470 con 0x7fd1e4003bc0 2023-05-24T03:30:12.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.033+0000 7fd1f77fe700 1 -- 172.21.15.146:0/597239831 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e80052d0 con 0x7fd1e4003bc0 2023-05-24T03:30:12.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.033+0000 7fd1f77fe700 1 -- 172.21.15.146:0/597239831 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e8003680 con 0x7fd1e4003bc0 2023-05-24T03:30:12.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.034+0000 7fd1fe390700 1 -- 172.21.15.146:0/597239831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1e4003bc0 msgr2=0x7fd1e4003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:12.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.034+0000 7fd1fe390700 1 --2- 172.21.15.146:0/597239831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1e4003bc0 0x7fd1e4003fb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd1e8001980 tx=0x7fd1e4005880 comp rx=0 tx=0).stop 2023-05-24T03:30:12.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.034+0000 7fd1fc92d700 1 -- 172.21.15.146:0/597239831 reap_dead start 2023-05-24T03:30:12.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.034+0000 7fd1fe390700 1 -- 172.21.15.146:0/597239831 shutdown_connections 2023-05-24T03:30:12.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.034+0000 7fd1fe390700 1 -- 172.21.15.146:0/597239831 >> 172.21.15.146:0/597239831 conn(0x7fd1f80cfea0 msgr2=0x7fd1f80d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:12.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.034+0000 7fd1fe390700 1 -- 172.21.15.146:0/597239831 shutdown_connections 2023-05-24T03:30:12.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.034+0000 7fd1fe390700 1 -- 172.21.15.146:0/597239831 wait complete. 2023-05-24T03:30:12.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.035+0000 7fd1fe390700 1 Processor -- start 2023-05-24T03:30:12.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.035+0000 7fd1fe390700 1 -- start start 2023-05-24T03:30:12.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.036+0000 7fd1fe390700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1e4003bc0 0x7fd1f81561e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:12.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.036+0000 7fd1fe390700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1f80aee90 0x7fd1f815c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:12.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.036+0000 7fd1fe390700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1f815ae80 0x7fd1f80ca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:12.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.036+0000 7fd1fe390700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f8156720 con 0x7fd1f80aee90 2023-05-24T03:30:12.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.036+0000 7fd1fe390700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f815b7f0 con 0x7fd1e4003bc0 2023-05-24T03:30:12.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.036+0000 7fd1fe390700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f815bad0 con 0x7fd1f815ae80 2023-05-24T03:30:12.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.036+0000 7fd1effff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1f80aee90 0x7fd1f815c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:12.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.036+0000 7fd1effff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1f80aee90 0x7fd1f815c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39640/0 (socket says 172.21.15.146:39640) 2023-05-24T03:30:12.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.036+0000 7fd1effff700 1 -- 172.21.15.146:0/852186510 learned_addr learned my addr 172.21.15.146:0/852186510 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:12.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.036+0000 7fd1fc92d700 1 --2- 172.21.15.146:0/852186510 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1f815ae80 0x7fd1f80ca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:12.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.036+0000 7fd1f7fff700 1 --2- 172.21.15.146:0/852186510 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1e4003bc0 0x7fd1f81561e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:12.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.036+0000 7fd1effff700 1 -- 172.21.15.146:0/852186510 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1f815ae80 msgr2=0x7fd1f80ca7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:12.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.036+0000 7fd1effff700 1 --2- 172.21.15.146:0/852186510 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1f815ae80 0x7fd1f80ca7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:12.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.036+0000 7fd1effff700 1 -- 172.21.15.146:0/852186510 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1e4003bc0 msgr2=0x7fd1f81561e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:12.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.036+0000 7fd1effff700 1 --2- 172.21.15.146:0/852186510 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1e4003bc0 0x7fd1f81561e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:12.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.036+0000 7fd1effff700 1 -- 172.21.15.146:0/852186510 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f806d190 con 0x7fd1f80aee90 2023-05-24T03:30:12.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.036+0000 7fd1effff700 1 --2- 172.21.15.146:0/852186510 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1f80aee90 0x7fd1f815c890 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd1e0007310 tx=0x7fd1e0007620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:12.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.037+0000 7fd1f57fa700 1 -- 172.21.15.146:0/852186510 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e0011580 con 0x7fd1f80aee90 2023-05-24T03:30:12.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.037+0000 7fd1f57fa700 1 -- 172.21.15.146:0/852186510 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e00116e0 con 0x7fd1f80aee90 2023-05-24T03:30:12.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.037+0000 7fd1f57fa700 1 -- 172.21.15.146:0/852186510 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e0011a50 con 0x7fd1f80aee90 2023-05-24T03:30:12.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.037+0000 7fd1fe390700 1 -- 172.21.15.146:0/852186510 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1f815ac60 con 0x7fd1f80aee90 2023-05-24T03:30:12.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.037+0000 7fd1fe390700 1 -- 172.21.15.146:0/852186510 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1f8071660 con 0x7fd1f80aee90 2023-05-24T03:30:12.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.037+0000 7fd1fe390700 1 -- 172.21.15.146:0/852186510 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1f804e810 con 0x7fd1f80aee90 2023-05-24T03:30:12.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.038+0000 7fd1f57fa700 1 -- 172.21.15.146:0/852186510 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd1e0011bb0 con 0x7fd1f80aee90 2023-05-24T03:30:12.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.038+0000 7fd1f57fa700 1 --2- 172.21.15.146:0/852186510 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fd1d806ace0 0x7fd1d806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:12.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.038+0000 7fd1f57fa700 1 -- 172.21.15.146:0/852186510 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd1e0089670 con 0x7fd1f80aee90 2023-05-24T03:30:12.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.038+0000 7fd1f7fff700 1 --2- 172.21.15.146:0/852186510 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fd1d806ace0 0x7fd1d806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:12.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.039+0000 7fd1f7fff700 1 --2- 172.21.15.146:0/852186510 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fd1d806ace0 0x7fd1d806d190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd1f80ac9d0 tx=0x7fd1e800a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:12.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.043+0000 7fd1f57fa700 1 -- 172.21.15.146:0/852186510 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fd1e0054430 con 0x7fd1f80aee90 2023-05-24T03:30:12.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.228+0000 7fd1fe390700 1 -- 172.21.15.146:0/852186510 --> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd1f80d0c60 con 0x7fd1d806ace0 2023-05-24T03:30:12.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.238+0000 7fd1f57fa700 1 -- 172.21.15.146:0/852186510 <== mgr.4104 v2:172.21.15.146:6832/1985394169 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367318 (secure 0 0 0) 0x7fd1f80d0c60 con 0x7fd1d806ace0 2023-05-24T03:30:12.246 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:30:12.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.241+0000 7fd1fe390700 1 -- 172.21.15.146:0/852186510 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fd1d806ace0 msgr2=0x7fd1d806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:12.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.241+0000 7fd1fe390700 1 --2- 172.21.15.146:0/852186510 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fd1d806ace0 0x7fd1d806d190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd1f80ac9d0 tx=0x7fd1e800a000 comp rx=0 tx=0).stop 2023-05-24T03:30:12.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.241+0000 7fd1fe390700 1 -- 172.21.15.146:0/852186510 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1f80aee90 msgr2=0x7fd1f815c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:12.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.241+0000 7fd1fe390700 1 --2- 172.21.15.146:0/852186510 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1f80aee90 0x7fd1f815c890 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd1e0007310 tx=0x7fd1e0007620 comp rx=0 tx=0).stop 2023-05-24T03:30:12.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.241+0000 7fd1fe390700 1 -- 172.21.15.146:0/852186510 shutdown_connections 2023-05-24T03:30:12.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.241+0000 7fd1fe390700 1 --2- 172.21.15.146:0/852186510 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fd1d806ace0 0x7fd1d806d190 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:12.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.241+0000 7fd1fe390700 1 --2- 172.21.15.146:0/852186510 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1f815ae80 0x7fd1f80ca7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:12.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.241+0000 7fd1fe390700 1 --2- 172.21.15.146:0/852186510 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1e4003bc0 0x7fd1f81561e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:12.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.241+0000 7fd1fe390700 1 --2- 172.21.15.146:0/852186510 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1f80aee90 0x7fd1f815c890 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:12.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.241+0000 7fd1fe390700 1 -- 172.21.15.146:0/852186510 >> 172.21.15.146:0/852186510 conn(0x7fd1f80cfea0 msgr2=0x7fd1f80ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:12.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.241+0000 7fd1fe390700 1 -- 172.21.15.146:0/852186510 shutdown_connections 2023-05-24T03:30:12.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.241+0000 7fd1fe390700 1 -- 172.21.15.146:0/852186510 wait complete. 2023-05-24T03:30:12.250 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-05-24T03:30:12.258 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2023-05-24T03:30:10.713485+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":147016,"kb_used_data":3592,"kb_used_omap":0,"kb_used_meta":143360,"kb_avail":754827704,"statfs":{"total":773094113280,"available":772943568896,"internally_reserved":0,"allocated":3678208,"data_stored":2186592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":146800640},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003538"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.232284+0000","last_change":"2023-05-24T03:29:44.490120+0000","last_active":"2023-05-24T03:29:49.232284+0000","last_peered":"2023-05-24T03:29:49.232284+0000","last_clean":"2023-05-24T03:29:49.232284+0000","last_became_active":"2023-05-24T03:29:44.489854+0000","last_became_peered":"2023-05-24T03:29:44.489854+0000","last_unstale":"2023-05-24T03:29:49.232284+0000","last_undegraded":"2023-05-24T03:29:49.232284+0000","last_fullsized":"2023-05-24T03:29:49.232284+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:33:03.914585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.923811+0000","last_change":"2023-05-24T03:29:44.495973+0000","last_active":"2023-05-24T03:29:48.923811+0000","last_peered":"2023-05-24T03:29:48.923811+0000","last_clean":"2023-05-24T03:29:48.923811+0000","last_became_active":"2023-05-24T03:29:44.495700+0000","last_became_peered":"2023-05-24T03:29:44.495700+0000","last_unstale":"2023-05-24T03:29:48.923811+0000","last_undegraded":"2023-05-24T03:29:48.923811+0000","last_fullsized":"2023-05-24T03:29:48.923811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:27:09.189901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925500+0000","last_change":"2023-05-24T03:29:44.499947+0000","last_active":"2023-05-24T03:29:48.925500+0000","last_peered":"2023-05-24T03:29:48.925500+0000","last_clean":"2023-05-24T03:29:48.925500+0000","last_became_active":"2023-05-24T03:29:44.499663+0000","last_became_peered":"2023-05-24T03:29:44.499663+0000","last_unstale":"2023-05-24T03:29:48.925500+0000","last_undegraded":"2023-05-24T03:29:48.925500+0000","last_fullsized":"2023-05-24T03:29:48.925500+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:14:55.806370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798091+0000","last_change":"2023-05-24T03:29:44.498790+0000","last_active":"2023-05-24T03:29:49.798091+0000","last_peered":"2023-05-24T03:29:49.798091+0000","last_clean":"2023-05-24T03:29:49.798091+0000","last_became_active":"2023-05-24T03:29:44.498528+0000","last_became_peered":"2023-05-24T03:29:44.498528+0000","last_unstale":"2023-05-24T03:29:49.798091+0000","last_undegraded":"2023-05-24T03:29:49.798091+0000","last_fullsized":"2023-05-24T03:29:49.798091+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:37:55.804539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156224+0000","last_change":"2023-05-24T03:29:44.504225+0000","last_active":"2023-05-24T03:29:49.156224+0000","last_peered":"2023-05-24T03:29:49.156224+0000","last_clean":"2023-05-24T03:29:49.156224+0000","last_became_active":"2023-05-24T03:29:44.503998+0000","last_became_peered":"2023-05-24T03:29:44.503998+0000","last_unstale":"2023-05-24T03:29:49.156224+0000","last_undegraded":"2023-05-24T03:29:49.156224+0000","last_fullsized":"2023-05-24T03:29:49.156224+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:12:39.912312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925136+0000","last_change":"2023-05-24T03:29:44.500355+0000","last_active":"2023-05-24T03:29:48.925136+0000","last_peered":"2023-05-24T03:29:48.925136+0000","last_clean":"2023-05-24T03:29:48.925136+0000","last_became_active":"2023-05-24T03:29:44.500065+0000","last_became_peered":"2023-05-24T03:29:44.500065+0000","last_unstale":"2023-05-24T03:29:48.925136+0000","last_undegraded":"2023-05-24T03:29:48.925136+0000","last_fullsized":"2023-05-24T03:29:48.925136+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:43:04.720238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.711626+0000","last_change":"2023-05-24T03:29:44.499607+0000","last_active":"2023-05-24T03:29:49.711626+0000","last_peered":"2023-05-24T03:29:49.711626+0000","last_clean":"2023-05-24T03:29:49.711626+0000","last_became_active":"2023-05-24T03:29:44.499324+0000","last_became_peered":"2023-05-24T03:29:44.499324+0000","last_unstale":"2023-05-24T03:29:49.711626+0000","last_undegraded":"2023-05-24T03:29:49.711626+0000","last_fullsized":"2023-05-24T03:29:49.711626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:54:54.025911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.923288+0000","last_change":"2023-05-24T03:29:44.500576+0000","last_active":"2023-05-24T03:29:48.923288+0000","last_peered":"2023-05-24T03:29:48.923288+0000","last_clean":"2023-05-24T03:29:48.923288+0000","last_became_active":"2023-05-24T03:29:44.500260+0000","last_became_peered":"2023-05-24T03:29:44.500260+0000","last_unstale":"2023-05-24T03:29:48.923288+0000","last_undegraded":"2023-05-24T03:29:48.923288+0000","last_fullsized":"2023-05-24T03:29:48.923288+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:16:38.784464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156365+0000","last_change":"2023-05-24T03:29:44.502655+0000","last_active":"2023-05-24T03:29:49.156365+0000","last_peered":"2023-05-24T03:29:49.156365+0000","last_clean":"2023-05-24T03:29:49.156365+0000","last_became_active":"2023-05-24T03:29:44.502341+0000","last_became_peered":"2023-05-24T03:29:44.502341+0000","last_unstale":"2023-05-24T03:29:49.156365+0000","last_undegraded":"2023-05-24T03:29:49.156365+0000","last_fullsized":"2023-05-24T03:29:49.156365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:17:26.378756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924197+0000","last_change":"2023-05-24T03:29:44.500505+0000","last_active":"2023-05-24T03:29:48.924197+0000","last_peered":"2023-05-24T03:29:48.924197+0000","last_clean":"2023-05-24T03:29:48.924197+0000","last_became_active":"2023-05-24T03:29:44.500156+0000","last_became_peered":"2023-05-24T03:29:44.500156+0000","last_unstale":"2023-05-24T03:29:48.924197+0000","last_undegraded":"2023-05-24T03:29:48.924197+0000","last_fullsized":"2023-05-24T03:29:48.924197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:52:13.818279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925752+0000","last_change":"2023-05-24T03:29:44.492850+0000","last_active":"2023-05-24T03:29:48.925752+0000","last_peered":"2023-05-24T03:29:48.925752+0000","last_clean":"2023-05-24T03:29:48.925752+0000","last_became_active":"2023-05-24T03:29:44.492573+0000","last_became_peered":"2023-05-24T03:29:44.492573+0000","last_unstale":"2023-05-24T03:29:48.925752+0000","last_undegraded":"2023-05-24T03:29:48.925752+0000","last_fullsized":"2023-05-24T03:29:48.925752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:27:24.810532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.232125+0000","last_change":"2023-05-24T03:29:44.501565+0000","last_active":"2023-05-24T03:29:49.232125+0000","last_peered":"2023-05-24T03:29:49.232125+0000","last_clean":"2023-05-24T03:29:49.232125+0000","last_became_active":"2023-05-24T03:29:44.501371+0000","last_became_peered":"2023-05-24T03:29:44.501371+0000","last_unstale":"2023-05-24T03:29:49.232125+0000","last_undegraded":"2023-05-24T03:29:49.232125+0000","last_fullsized":"2023-05-24T03:29:49.232125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:51:11.755899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.232142+0000","last_change":"2023-05-24T03:29:44.490972+0000","last_active":"2023-05-24T03:29:49.232142+0000","last_peered":"2023-05-24T03:29:49.232142+0000","last_clean":"2023-05-24T03:29:49.232142+0000","last_became_active":"2023-05-24T03:29:44.490411+0000","last_became_peered":"2023-05-24T03:29:44.490411+0000","last_unstale":"2023-05-24T03:29:49.232142+0000","last_undegraded":"2023-05-24T03:29:49.232142+0000","last_fullsized":"2023-05-24T03:29:49.232142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:43:24.929689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.923436+0000","last_change":"2023-05-24T03:29:44.495213+0000","last_active":"2023-05-24T03:29:48.923436+0000","last_peered":"2023-05-24T03:29:48.923436+0000","last_clean":"2023-05-24T03:29:48.923436+0000","last_became_active":"2023-05-24T03:29:44.494879+0000","last_became_peered":"2023-05-24T03:29:44.494879+0000","last_unstale":"2023-05-24T03:29:48.923436+0000","last_undegraded":"2023-05-24T03:29:48.923436+0000","last_fullsized":"2023-05-24T03:29:48.923436+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:12:39.912312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.711461+0000","last_change":"2023-05-24T03:29:44.499673+0000","last_active":"2023-05-24T03:29:49.711461+0000","last_peered":"2023-05-24T03:29:49.711461+0000","last_clean":"2023-05-24T03:29:49.711461+0000","last_became_active":"2023-05-24T03:29:44.499393+0000","last_became_peered":"2023-05-24T03:29:44.499393+0000","last_unstale":"2023-05-24T03:29:49.711461+0000","last_undegraded":"2023-05-24T03:29:49.711461+0000","last_fullsized":"2023-05-24T03:29:49.711461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:55:32.189744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925151+0000","last_change":"2023-05-24T03:29:44.501101+0000","last_active":"2023-05-24T03:29:48.925151+0000","last_peered":"2023-05-24T03:29:48.925151+0000","last_clean":"2023-05-24T03:29:48.925151+0000","last_became_active":"2023-05-24T03:29:44.500818+0000","last_became_peered":"2023-05-24T03:29:44.500818+0000","last_unstale":"2023-05-24T03:29:48.925151+0000","last_undegraded":"2023-05-24T03:29:48.925151+0000","last_fullsized":"2023-05-24T03:29:48.925151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:44:17.635928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156394+0000","last_change":"2023-05-24T03:29:44.500209+0000","last_active":"2023-05-24T03:29:49.156394+0000","last_peered":"2023-05-24T03:29:49.156394+0000","last_clean":"2023-05-24T03:29:49.156394+0000","last_became_active":"2023-05-24T03:29:44.499543+0000","last_became_peered":"2023-05-24T03:29:44.499543+0000","last_unstale":"2023-05-24T03:29:49.156394+0000","last_undegraded":"2023-05-24T03:29:49.156394+0000","last_fullsized":"2023-05-24T03:29:49.156394+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:54:54.025911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925839+0000","last_change":"2023-05-24T03:29:44.492545+0000","last_active":"2023-05-24T03:29:48.925839+0000","last_peered":"2023-05-24T03:29:48.925839+0000","last_clean":"2023-05-24T03:29:48.925839+0000","last_became_active":"2023-05-24T03:29:44.492109+0000","last_became_peered":"2023-05-24T03:29:44.492109+0000","last_unstale":"2023-05-24T03:29:48.925839+0000","last_undegraded":"2023-05-24T03:29:48.925839+0000","last_fullsized":"2023-05-24T03:29:48.925839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:14:30.274935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.232313+0000","last_change":"2023-05-24T03:29:44.480834+0000","last_active":"2023-05-24T03:29:49.232313+0000","last_peered":"2023-05-24T03:29:49.232313+0000","last_clean":"2023-05-24T03:29:49.232313+0000","last_became_active":"2023-05-24T03:29:44.480597+0000","last_became_peered":"2023-05-24T03:29:44.480597+0000","last_unstale":"2023-05-24T03:29:49.232313+0000","last_undegraded":"2023-05-24T03:29:49.232313+0000","last_fullsized":"2023-05-24T03:29:49.232313+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:10:15.509028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925476+0000","last_change":"2023-05-24T03:29:44.501003+0000","last_active":"2023-05-24T03:29:48.925476+0000","last_peered":"2023-05-24T03:29:48.925476+0000","last_clean":"2023-05-24T03:29:48.925476+0000","last_became_active":"2023-05-24T03:29:44.499405+0000","last_became_peered":"2023-05-24T03:29:44.499405+0000","last_unstale":"2023-05-24T03:29:48.925476+0000","last_undegraded":"2023-05-24T03:29:48.925476+0000","last_fullsized":"2023-05-24T03:29:48.925476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:26:26.500917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.711735+0000","last_change":"2023-05-24T03:29:44.499151+0000","last_active":"2023-05-24T03:29:49.711735+0000","last_peered":"2023-05-24T03:29:49.711735+0000","last_clean":"2023-05-24T03:29:49.711735+0000","last_became_active":"2023-05-24T03:29:44.498782+0000","last_became_peered":"2023-05-24T03:29:44.498782+0000","last_unstale":"2023-05-24T03:29:49.711735+0000","last_undegraded":"2023-05-24T03:29:49.711735+0000","last_fullsized":"2023-05-24T03:29:49.711735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:48:28.516583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.155935+0000","last_change":"2023-05-24T03:29:44.498675+0000","last_active":"2023-05-24T03:29:49.155935+0000","last_peered":"2023-05-24T03:29:49.155935+0000","last_clean":"2023-05-24T03:29:49.155935+0000","last_became_active":"2023-05-24T03:29:44.498463+0000","last_became_peered":"2023-05-24T03:29:44.498463+0000","last_unstale":"2023-05-24T03:29:49.155935+0000","last_undegraded":"2023-05-24T03:29:49.155935+0000","last_fullsized":"2023-05-24T03:29:49.155935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:51:21.843236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.797699+0000","last_change":"2023-05-24T03:29:44.500169+0000","last_active":"2023-05-24T03:29:49.797699+0000","last_peered":"2023-05-24T03:29:49.797699+0000","last_clean":"2023-05-24T03:29:49.797699+0000","last_became_active":"2023-05-24T03:29:44.499960+0000","last_became_peered":"2023-05-24T03:29:44.499960+0000","last_unstale":"2023-05-24T03:29:49.797699+0000","last_undegraded":"2023-05-24T03:29:49.797699+0000","last_fullsized":"2023-05-24T03:29:49.797699+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:55:32.189744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.711518+0000","last_change":"2023-05-24T03:29:44.499015+0000","last_active":"2023-05-24T03:29:49.711518+0000","last_peered":"2023-05-24T03:29:49.711518+0000","last_clean":"2023-05-24T03:29:49.711518+0000","last_became_active":"2023-05-24T03:29:44.498437+0000","last_became_peered":"2023-05-24T03:29:44.498437+0000","last_unstale":"2023-05-24T03:29:49.711518+0000","last_undegraded":"2023-05-24T03:29:49.711518+0000","last_fullsized":"2023-05-24T03:29:49.711518+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:27:09.189901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920628+0000","last_change":"2023-05-24T03:29:44.481162+0000","last_active":"2023-05-24T03:29:48.920628+0000","last_peered":"2023-05-24T03:29:48.920628+0000","last_clean":"2023-05-24T03:29:48.920628+0000","last_became_active":"2023-05-24T03:29:44.481004+0000","last_became_peered":"2023-05-24T03:29:44.481004+0000","last_unstale":"2023-05-24T03:29:48.920628+0000","last_undegraded":"2023-05-24T03:29:48.920628+0000","last_fullsized":"2023-05-24T03:29:48.920628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:55:32.189744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920849+0000","last_change":"2023-05-24T03:29:44.481942+0000","last_active":"2023-05-24T03:29:48.920849+0000","last_peered":"2023-05-24T03:29:48.920849+0000","last_clean":"2023-05-24T03:29:48.920849+0000","last_became_active":"2023-05-24T03:29:44.481686+0000","last_became_peered":"2023-05-24T03:29:44.481686+0000","last_unstale":"2023-05-24T03:29:48.920849+0000","last_undegraded":"2023-05-24T03:29:48.920849+0000","last_fullsized":"2023-05-24T03:29:48.920849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:13:02.352900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924263+0000","last_change":"2023-05-24T03:29:44.502948+0000","last_active":"2023-05-24T03:29:48.924263+0000","last_peered":"2023-05-24T03:29:48.924263+0000","last_clean":"2023-05-24T03:29:48.924263+0000","last_became_active":"2023-05-24T03:29:44.502669+0000","last_became_peered":"2023-05-24T03:29:44.502669+0000","last_unstale":"2023-05-24T03:29:48.924263+0000","last_undegraded":"2023-05-24T03:29:48.924263+0000","last_fullsized":"2023-05-24T03:29:48.924263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:04:07.700748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925372+0000","last_change":"2023-05-24T03:29:48.523138+0000","last_active":"2023-05-24T03:29:48.925372+0000","last_peered":"2023-05-24T03:29:48.925372+0000","last_clean":"2023-05-24T03:29:48.925372+0000","last_became_active":"2023-05-24T03:29:48.522749+0000","last_became_peered":"2023-05-24T03:29:48.522749+0000","last_unstale":"2023-05-24T03:29:48.925372+0000","last_undegraded":"2023-05-24T03:29:48.925372+0000","last_fullsized":"2023-05-24T03:29:48.925372+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:20:12.731273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925118+0000","last_change":"2023-05-24T03:29:44.086543+0000","last_active":"2023-05-24T03:29:48.925118+0000","last_peered":"2023-05-24T03:29:48.925118+0000","last_clean":"2023-05-24T03:29:48.925118+0000","last_became_active":"2023-05-24T03:29:44.086143+0000","last_became_peered":"2023-05-24T03:29:44.086143+0000","last_unstale":"2023-05-24T03:29:48.925118+0000","last_undegraded":"2023-05-24T03:29:48.925118+0000","last_fullsized":"2023-05-24T03:29:48.925118+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:22:00.186684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798333+0000","last_change":"2023-05-24T03:29:44.491005+0000","last_active":"2023-05-24T03:29:49.798333+0000","last_peered":"2023-05-24T03:29:49.798333+0000","last_clean":"2023-05-24T03:29:49.798333+0000","last_became_active":"2023-05-24T03:29:44.490772+0000","last_became_peered":"2023-05-24T03:29:44.490772+0000","last_unstale":"2023-05-24T03:29:49.798333+0000","last_undegraded":"2023-05-24T03:29:49.798333+0000","last_fullsized":"2023-05-24T03:29:49.798333+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:04:07.700748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798539+0000","last_change":"2023-05-24T03:29:48.523521+0000","last_active":"2023-05-24T03:29:49.798539+0000","last_peered":"2023-05-24T03:29:49.798539+0000","last_clean":"2023-05-24T03:29:49.798539+0000","last_became_active":"2023-05-24T03:29:48.523125+0000","last_became_peered":"2023-05-24T03:29:48.523125+0000","last_unstale":"2023-05-24T03:29:49.798539+0000","last_undegraded":"2023-05-24T03:29:49.798539+0000","last_fullsized":"2023-05-24T03:29:49.798539+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:44:02.617382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920004+0000","last_change":"2023-05-24T03:29:44.084408+0000","last_active":"2023-05-24T03:29:48.920004+0000","last_peered":"2023-05-24T03:29:48.920004+0000","last_clean":"2023-05-24T03:29:48.920004+0000","last_became_active":"2023-05-24T03:29:44.084099+0000","last_became_peered":"2023-05-24T03:29:44.084099+0000","last_unstale":"2023-05-24T03:29:48.920004+0000","last_undegraded":"2023-05-24T03:29:48.920004+0000","last_fullsized":"2023-05-24T03:29:48.920004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:14:05.716019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156351+0000","last_change":"2023-05-24T03:29:44.503346+0000","last_active":"2023-05-24T03:29:49.156351+0000","last_peered":"2023-05-24T03:29:49.156351+0000","last_clean":"2023-05-24T03:29:49.156351+0000","last_became_active":"2023-05-24T03:29:44.503039+0000","last_became_peered":"2023-05-24T03:29:44.503039+0000","last_unstale":"2023-05-24T03:29:49.156351+0000","last_undegraded":"2023-05-24T03:29:49.156351+0000","last_fullsized":"2023-05-24T03:29:49.156351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:55:32.189744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156521+0000","last_change":"2023-05-24T03:29:48.529615+0000","last_active":"2023-05-24T03:29:49.156521+0000","last_peered":"2023-05-24T03:29:49.156521+0000","last_clean":"2023-05-24T03:29:49.156521+0000","last_became_active":"2023-05-24T03:29:48.529142+0000","last_became_peered":"2023-05-24T03:29:48.529142+0000","last_unstale":"2023-05-24T03:29:49.156521+0000","last_undegraded":"2023-05-24T03:29:49.156521+0000","last_fullsized":"2023-05-24T03:29:49.156521+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:48:31.938863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798028+0000","last_change":"2023-05-24T03:29:44.085410+0000","last_active":"2023-05-24T03:29:49.798028+0000","last_peered":"2023-05-24T03:29:49.798028+0000","last_clean":"2023-05-24T03:29:49.798028+0000","last_became_active":"2023-05-24T03:29:44.084907+0000","last_became_peered":"2023-05-24T03:29:44.084907+0000","last_unstale":"2023-05-24T03:29:49.798028+0000","last_undegraded":"2023-05-24T03:29:49.798028+0000","last_fullsized":"2023-05-24T03:29:49.798028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:06:44.879201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798596+0000","last_change":"2023-05-24T03:29:44.497128+0000","last_active":"2023-05-24T03:29:49.798596+0000","last_peered":"2023-05-24T03:29:49.798596+0000","last_clean":"2023-05-24T03:29:49.798596+0000","last_became_active":"2023-05-24T03:29:44.496746+0000","last_became_peered":"2023-05-24T03:29:44.496746+0000","last_unstale":"2023-05-24T03:29:49.798596+0000","last_undegraded":"2023-05-24T03:29:49.798596+0000","last_fullsized":"2023-05-24T03:29:49.798596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:50:28.601742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798309+0000","last_change":"2023-05-24T03:29:48.520693+0000","last_active":"2023-05-24T03:29:49.798309+0000","last_peered":"2023-05-24T03:29:49.798309+0000","last_clean":"2023-05-24T03:29:49.798309+0000","last_became_active":"2023-05-24T03:29:48.520319+0000","last_became_peered":"2023-05-24T03:29:48.520319+0000","last_unstale":"2023-05-24T03:29:49.798309+0000","last_undegraded":"2023-05-24T03:29:49.798309+0000","last_fullsized":"2023-05-24T03:29:49.798309+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:55:04.423811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156490+0000","last_change":"2023-05-24T03:29:44.088769+0000","last_active":"2023-05-24T03:29:49.156490+0000","last_peered":"2023-05-24T03:29:49.156490+0000","last_clean":"2023-05-24T03:29:49.156490+0000","last_became_active":"2023-05-24T03:29:44.088267+0000","last_became_peered":"2023-05-24T03:29:44.088267+0000","last_unstale":"2023-05-24T03:29:49.156490+0000","last_undegraded":"2023-05-24T03:29:49.156490+0000","last_fullsized":"2023-05-24T03:29:49.156490+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:06:44.879201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.797921+0000","last_change":"2023-05-24T03:29:44.489309+0000","last_active":"2023-05-24T03:29:49.797921+0000","last_peered":"2023-05-24T03:29:49.797921+0000","last_clean":"2023-05-24T03:29:49.797921+0000","last_became_active":"2023-05-24T03:29:44.488666+0000","last_became_peered":"2023-05-24T03:29:44.488666+0000","last_unstale":"2023-05-24T03:29:49.797921+0000","last_undegraded":"2023-05-24T03:29:49.797921+0000","last_fullsized":"2023-05-24T03:29:49.797921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:27:09.189901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.711386+0000","last_change":"2023-05-24T03:29:48.518108+0000","last_active":"2023-05-24T03:29:49.711386+0000","last_peered":"2023-05-24T03:29:49.711386+0000","last_clean":"2023-05-24T03:29:49.711386+0000","last_became_active":"2023-05-24T03:29:48.517771+0000","last_became_peered":"2023-05-24T03:29:48.517771+0000","last_unstale":"2023-05-24T03:29:49.711386+0000","last_undegraded":"2023-05-24T03:29:49.711386+0000","last_fullsized":"2023-05-24T03:29:49.711386+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:37:26.748143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.923964+0000","last_change":"2023-05-24T03:29:44.087910+0000","last_active":"2023-05-24T03:29:48.923964+0000","last_peered":"2023-05-24T03:29:48.923964+0000","last_clean":"2023-05-24T03:29:48.923964+0000","last_became_active":"2023-05-24T03:29:44.087601+0000","last_became_peered":"2023-05-24T03:29:44.087601+0000","last_unstale":"2023-05-24T03:29:48.923964+0000","last_undegraded":"2023-05-24T03:29:48.923964+0000","last_fullsized":"2023-05-24T03:29:48.923964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:59:05.268973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.797675+0000","last_change":"2023-05-24T03:29:44.496020+0000","last_active":"2023-05-24T03:29:49.797675+0000","last_peered":"2023-05-24T03:29:49.797675+0000","last_clean":"2023-05-24T03:29:49.797675+0000","last_became_active":"2023-05-24T03:29:44.495752+0000","last_became_peered":"2023-05-24T03:29:44.495752+0000","last_unstale":"2023-05-24T03:29:49.797675+0000","last_undegraded":"2023-05-24T03:29:49.797675+0000","last_fullsized":"2023-05-24T03:29:49.797675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:42:07.310986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798229+0000","last_change":"2023-05-24T03:29:48.529893+0000","last_active":"2023-05-24T03:29:49.798229+0000","last_peered":"2023-05-24T03:29:49.798229+0000","last_clean":"2023-05-24T03:29:49.798229+0000","last_became_active":"2023-05-24T03:29:48.529514+0000","last_became_peered":"2023-05-24T03:29:48.529514+0000","last_unstale":"2023-05-24T03:29:49.798229+0000","last_undegraded":"2023-05-24T03:29:49.798229+0000","last_fullsized":"2023-05-24T03:29:49.798229+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:19:31.096262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.711996+0000","last_change":"2023-05-24T03:29:44.091648+0000","last_active":"2023-05-24T03:29:49.711996+0000","last_peered":"2023-05-24T03:29:49.711996+0000","last_clean":"2023-05-24T03:29:49.711996+0000","last_became_active":"2023-05-24T03:29:44.091390+0000","last_became_peered":"2023-05-24T03:29:44.091390+0000","last_unstale":"2023-05-24T03:29:49.711996+0000","last_undegraded":"2023-05-24T03:29:49.711996+0000","last_fullsized":"2023-05-24T03:29:49.711996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:37:43.011120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920406+0000","last_change":"2023-05-24T03:29:44.481629+0000","last_active":"2023-05-24T03:29:48.920406+0000","last_peered":"2023-05-24T03:29:48.920406+0000","last_clean":"2023-05-24T03:29:48.920406+0000","last_became_active":"2023-05-24T03:29:44.481385+0000","last_became_peered":"2023-05-24T03:29:44.481385+0000","last_unstale":"2023-05-24T03:29:48.920406+0000","last_undegraded":"2023-05-24T03:29:48.920406+0000","last_fullsized":"2023-05-24T03:29:48.920406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:27:52.176207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920327+0000","last_change":"2023-05-24T03:29:48.524712+0000","last_active":"2023-05-24T03:29:48.920327+0000","last_peered":"2023-05-24T03:29:48.920327+0000","last_clean":"2023-05-24T03:29:48.920327+0000","last_became_active":"2023-05-24T03:29:48.524312+0000","last_became_peered":"2023-05-24T03:29:48.524312+0000","last_unstale":"2023-05-24T03:29:48.920327+0000","last_undegraded":"2023-05-24T03:29:48.920327+0000","last_fullsized":"2023-05-24T03:29:48.920327+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:13:47.041051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'9","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:53.574777+0000","last_change":"2023-05-24T03:29:44.079067+0000","last_active":"2023-05-24T03:29:53.574777+0000","last_peered":"2023-05-24T03:29:53.574777+0000","last_clean":"2023-05-24T03:29:53.574777+0000","last_became_active":"2023-05-24T03:29:44.078785+0000","last_became_peered":"2023-05-24T03:29:44.078785+0000","last_unstale":"2023-05-24T03:29:53.574777+0000","last_undegraded":"2023-05-24T03:29:53.574777+0000","last_fullsized":"2023-05-24T03:29:53.574777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:32:31.553230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925391+0000","last_change":"2023-05-24T03:29:44.497603+0000","last_active":"2023-05-24T03:29:48.925391+0000","last_peered":"2023-05-24T03:29:48.925391+0000","last_clean":"2023-05-24T03:29:48.925391+0000","last_became_active":"2023-05-24T03:29:44.497120+0000","last_became_peered":"2023-05-24T03:29:44.497120+0000","last_unstale":"2023-05-24T03:29:48.925391+0000","last_undegraded":"2023-05-24T03:29:48.925391+0000","last_fullsized":"2023-05-24T03:29:48.925391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:18:47.235377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924432+0000","last_change":"2023-05-24T03:29:48.531846+0000","last_active":"2023-05-24T03:29:48.924432+0000","last_peered":"2023-05-24T03:29:48.924432+0000","last_clean":"2023-05-24T03:29:48.924432+0000","last_became_active":"2023-05-24T03:29:48.531538+0000","last_became_peered":"2023-05-24T03:29:48.531538+0000","last_unstale":"2023-05-24T03:29:48.924432+0000","last_undegraded":"2023-05-24T03:29:48.924432+0000","last_fullsized":"2023-05-24T03:29:48.924432+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:59:12.868748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.711788+0000","last_change":"2023-05-24T03:29:44.087315+0000","last_active":"2023-05-24T03:29:49.711788+0000","last_peered":"2023-05-24T03:29:49.711788+0000","last_clean":"2023-05-24T03:29:49.711788+0000","last_became_active":"2023-05-24T03:29:44.086997+0000","last_became_peered":"2023-05-24T03:29:44.086997+0000","last_unstale":"2023-05-24T03:29:49.711788+0000","last_undegraded":"2023-05-24T03:29:49.711788+0000","last_fullsized":"2023-05-24T03:29:49.711788+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:06:44.879201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798223+0000","last_change":"2023-05-24T03:29:44.487497+0000","last_active":"2023-05-24T03:29:49.798223+0000","last_peered":"2023-05-24T03:29:49.798223+0000","last_clean":"2023-05-24T03:29:49.798223+0000","last_became_active":"2023-05-24T03:29:44.487257+0000","last_became_peered":"2023-05-24T03:29:44.487257+0000","last_unstale":"2023-05-24T03:29:49.798223+0000","last_undegraded":"2023-05-24T03:29:49.798223+0000","last_fullsized":"2023-05-24T03:29:49.798223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:37:44.017565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798223+0000","last_change":"2023-05-24T03:29:48.526115+0000","last_active":"2023-05-24T03:29:49.798223+0000","last_peered":"2023-05-24T03:29:49.798223+0000","last_clean":"2023-05-24T03:29:49.798223+0000","last_became_active":"2023-05-24T03:29:48.525726+0000","last_became_peered":"2023-05-24T03:29:48.525726+0000","last_unstale":"2023-05-24T03:29:49.798223+0000","last_undegraded":"2023-05-24T03:29:49.798223+0000","last_fullsized":"2023-05-24T03:29:49.798223+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:59:09.697698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.155791+0000","last_change":"2023-05-24T03:29:44.084599+0000","last_active":"2023-05-24T03:29:49.155791+0000","last_peered":"2023-05-24T03:29:49.155791+0000","last_clean":"2023-05-24T03:29:49.155791+0000","last_became_active":"2023-05-24T03:29:44.084278+0000","last_became_peered":"2023-05-24T03:29:44.084278+0000","last_unstale":"2023-05-24T03:29:49.155791+0000","last_undegraded":"2023-05-24T03:29:49.155791+0000","last_fullsized":"2023-05-24T03:29:49.155791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:13:42.612325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924229+0000","last_change":"2023-05-24T03:29:44.498378+0000","last_active":"2023-05-24T03:29:48.924229+0000","last_peered":"2023-05-24T03:29:48.924229+0000","last_clean":"2023-05-24T03:29:48.924229+0000","last_became_active":"2023-05-24T03:29:44.498097+0000","last_became_peered":"2023-05-24T03:29:44.498097+0000","last_unstale":"2023-05-24T03:29:48.924229+0000","last_undegraded":"2023-05-24T03:29:48.924229+0000","last_fullsized":"2023-05-24T03:29:48.924229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:37:44.017565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798670+0000","last_change":"2023-05-24T03:29:48.525018+0000","last_active":"2023-05-24T03:29:49.798670+0000","last_peered":"2023-05-24T03:29:49.798670+0000","last_clean":"2023-05-24T03:29:49.798670+0000","last_became_active":"2023-05-24T03:29:48.524602+0000","last_became_peered":"2023-05-24T03:29:48.524602+0000","last_unstale":"2023-05-24T03:29:49.798670+0000","last_undegraded":"2023-05-24T03:29:49.798670+0000","last_fullsized":"2023-05-24T03:29:49.798670+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:25:43.600049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.711568+0000","last_change":"2023-05-24T03:29:44.085212+0000","last_active":"2023-05-24T03:29:49.711568+0000","last_peered":"2023-05-24T03:29:49.711568+0000","last_clean":"2023-05-24T03:29:49.711568+0000","last_became_active":"2023-05-24T03:29:44.085001+0000","last_became_peered":"2023-05-24T03:29:44.085001+0000","last_unstale":"2023-05-24T03:29:49.711568+0000","last_undegraded":"2023-05-24T03:29:49.711568+0000","last_fullsized":"2023-05-24T03:29:49.711568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:13:01.346454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156439+0000","last_change":"2023-05-24T03:29:44.500883+0000","last_active":"2023-05-24T03:29:49.156439+0000","last_peered":"2023-05-24T03:29:49.156439+0000","last_clean":"2023-05-24T03:29:49.156439+0000","last_became_active":"2023-05-24T03:29:44.500631+0000","last_became_peered":"2023-05-24T03:29:44.500631+0000","last_unstale":"2023-05-24T03:29:49.156439+0000","last_undegraded":"2023-05-24T03:29:49.156439+0000","last_fullsized":"2023-05-24T03:29:49.156439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:47:24.077381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.923764+0000","last_change":"2023-05-24T03:29:48.523523+0000","last_active":"2023-05-24T03:29:48.923764+0000","last_peered":"2023-05-24T03:29:48.923764+0000","last_clean":"2023-05-24T03:29:48.923764+0000","last_became_active":"2023-05-24T03:29:48.523138+0000","last_became_peered":"2023-05-24T03:29:48.523138+0000","last_unstale":"2023-05-24T03:29:48.923764+0000","last_undegraded":"2023-05-24T03:29:48.923764+0000","last_fullsized":"2023-05-24T03:29:48.923764+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:17:29.801036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.797983+0000","last_change":"2023-05-24T03:29:44.085229+0000","last_active":"2023-05-24T03:29:49.797983+0000","last_peered":"2023-05-24T03:29:49.797983+0000","last_clean":"2023-05-24T03:29:49.797983+0000","last_became_active":"2023-05-24T03:29:44.084914+0000","last_became_peered":"2023-05-24T03:29:44.084914+0000","last_unstale":"2023-05-24T03:29:49.797983+0000","last_undegraded":"2023-05-24T03:29:49.797983+0000","last_fullsized":"2023-05-24T03:29:49.797983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:13:33.993784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798728+0000","last_change":"2023-05-24T03:29:44.496038+0000","last_active":"2023-05-24T03:29:49.798728+0000","last_peered":"2023-05-24T03:29:49.798728+0000","last_clean":"2023-05-24T03:29:49.798728+0000","last_became_active":"2023-05-24T03:29:44.495795+0000","last_became_peered":"2023-05-24T03:29:44.495795+0000","last_unstale":"2023-05-24T03:29:49.798728+0000","last_undegraded":"2023-05-24T03:29:49.798728+0000","last_fullsized":"2023-05-24T03:29:49.798728+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:09:24.928940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.712227+0000","last_change":"2023-05-24T03:29:48.518930+0000","last_active":"2023-05-24T03:29:49.712227+0000","last_peered":"2023-05-24T03:29:49.712227+0000","last_clean":"2023-05-24T03:29:49.712227+0000","last_became_active":"2023-05-24T03:29:48.518531+0000","last_became_peered":"2023-05-24T03:29:48.518531+0000","last_unstale":"2023-05-24T03:29:49.712227+0000","last_undegraded":"2023-05-24T03:29:49.712227+0000","last_fullsized":"2023-05-24T03:29:49.712227+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:04:11.123028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.712271+0000","last_change":"2023-05-24T03:29:44.089650+0000","last_active":"2023-05-24T03:29:49.712271+0000","last_peered":"2023-05-24T03:29:49.712271+0000","last_clean":"2023-05-24T03:29:49.712271+0000","last_became_active":"2023-05-24T03:29:44.089340+0000","last_became_peered":"2023-05-24T03:29:44.089340+0000","last_unstale":"2023-05-24T03:29:49.712271+0000","last_undegraded":"2023-05-24T03:29:49.712271+0000","last_fullsized":"2023-05-24T03:29:49.712271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:25:39.171324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.923182+0000","last_change":"2023-05-24T03:29:44.498089+0000","last_active":"2023-05-24T03:29:48.923182+0000","last_peered":"2023-05-24T03:29:48.923182+0000","last_clean":"2023-05-24T03:29:48.923182+0000","last_became_active":"2023-05-24T03:29:44.497795+0000","last_became_peered":"2023-05-24T03:29:44.497795+0000","last_unstale":"2023-05-24T03:29:48.923182+0000","last_undegraded":"2023-05-24T03:29:48.923182+0000","last_fullsized":"2023-05-24T03:29:48.923182+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:30:56.976033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.231935+0000","last_change":"2023-05-24T03:29:48.521349+0000","last_active":"2023-05-24T03:29:49.231935+0000","last_peered":"2023-05-24T03:29:49.231935+0000","last_clean":"2023-05-24T03:29:49.231935+0000","last_became_active":"2023-05-24T03:29:48.520899+0000","last_became_peered":"2023-05-24T03:29:48.520899+0000","last_unstale":"2023-05-24T03:29:49.231935+0000","last_undegraded":"2023-05-24T03:29:49.231935+0000","last_fullsized":"2023-05-24T03:29:49.231935+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:39:27.313301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.712201+0000","last_change":"2023-05-24T03:29:44.086355+0000","last_active":"2023-05-24T03:29:49.712201+0000","last_peered":"2023-05-24T03:29:49.712201+0000","last_clean":"2023-05-24T03:29:49.712201+0000","last_became_active":"2023-05-24T03:29:44.086054+0000","last_became_peered":"2023-05-24T03:29:44.086054+0000","last_unstale":"2023-05-24T03:29:49.712201+0000","last_undegraded":"2023-05-24T03:29:49.712201+0000","last_fullsized":"2023-05-24T03:29:49.712201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:59:08.440023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924885+0000","last_change":"2023-05-24T03:29:44.492413+0000","last_active":"2023-05-24T03:29:48.924885+0000","last_peered":"2023-05-24T03:29:48.924885+0000","last_clean":"2023-05-24T03:29:48.924885+0000","last_became_active":"2023-05-24T03:29:44.492099+0000","last_became_peered":"2023-05-24T03:29:44.492099+0000","last_unstale":"2023-05-24T03:29:48.924885+0000","last_undegraded":"2023-05-24T03:29:48.924885+0000","last_fullsized":"2023-05-24T03:29:48.924885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:10:14.728343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.232089+0000","last_change":"2023-05-24T03:29:48.522128+0000","last_active":"2023-05-24T03:29:49.232089+0000","last_peered":"2023-05-24T03:29:49.232089+0000","last_clean":"2023-05-24T03:29:49.232089+0000","last_became_active":"2023-05-24T03:29:48.521729+0000","last_became_peered":"2023-05-24T03:29:48.521729+0000","last_unstale":"2023-05-24T03:29:49.232089+0000","last_undegraded":"2023-05-24T03:29:49.232089+0000","last_fullsized":"2023-05-24T03:29:49.232089+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:56:43.026692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.712235+0000","last_change":"2023-05-24T03:29:44.088761+0000","last_active":"2023-05-24T03:29:49.712235+0000","last_peered":"2023-05-24T03:29:49.712235+0000","last_clean":"2023-05-24T03:29:49.712235+0000","last_became_active":"2023-05-24T03:29:44.088459+0000","last_became_peered":"2023-05-24T03:29:44.088459+0000","last_unstale":"2023-05-24T03:29:49.712235+0000","last_undegraded":"2023-05-24T03:29:49.712235+0000","last_fullsized":"2023-05-24T03:29:49.712235+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:59:51.303175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.797882+0000","last_change":"2023-05-24T03:29:44.490252+0000","last_active":"2023-05-24T03:29:49.797882+0000","last_peered":"2023-05-24T03:29:49.797882+0000","last_clean":"2023-05-24T03:29:49.797882+0000","last_became_active":"2023-05-24T03:29:44.489975+0000","last_became_peered":"2023-05-24T03:29:44.489975+0000","last_unstale":"2023-05-24T03:29:49.797882+0000","last_undegraded":"2023-05-24T03:29:49.797882+0000","last_fullsized":"2023-05-24T03:29:49.797882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:23:37.430993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.232052+0000","last_change":"2023-05-24T03:29:48.523911+0000","last_active":"2023-05-24T03:29:49.232052+0000","last_peered":"2023-05-24T03:29:49.232052+0000","last_clean":"2023-05-24T03:29:49.232052+0000","last_became_active":"2023-05-24T03:29:48.523545+0000","last_became_peered":"2023-05-24T03:29:48.523545+0000","last_unstale":"2023-05-24T03:29:49.232052+0000","last_undegraded":"2023-05-24T03:29:49.232052+0000","last_fullsized":"2023-05-24T03:29:49.232052+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:03:23.555501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.923539+0000","last_change":"2023-05-24T03:29:44.091185+0000","last_active":"2023-05-24T03:29:48.923539+0000","last_peered":"2023-05-24T03:29:48.923539+0000","last_clean":"2023-05-24T03:29:48.923539+0000","last_became_active":"2023-05-24T03:29:44.090887+0000","last_became_peered":"2023-05-24T03:29:44.090887+0000","last_unstale":"2023-05-24T03:29:48.923539+0000","last_undegraded":"2023-05-24T03:29:48.923539+0000","last_fullsized":"2023-05-24T03:29:48.923539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:37:22.319418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156514+0000","last_change":"2023-05-24T03:29:44.502570+0000","last_active":"2023-05-24T03:29:49.156514+0000","last_peered":"2023-05-24T03:29:49.156514+0000","last_clean":"2023-05-24T03:29:49.156514+0000","last_became_active":"2023-05-24T03:29:44.502286+0000","last_became_peered":"2023-05-24T03:29:44.502286+0000","last_unstale":"2023-05-24T03:29:49.156514+0000","last_undegraded":"2023-05-24T03:29:49.156514+0000","last_fullsized":"2023-05-24T03:29:49.156514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:59:06.275418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.232426+0000","last_change":"2023-05-24T03:29:48.521750+0000","last_active":"2023-05-24T03:29:49.232426+0000","last_peered":"2023-05-24T03:29:49.232426+0000","last_clean":"2023-05-24T03:29:49.232426+0000","last_became_active":"2023-05-24T03:29:48.520960+0000","last_became_peered":"2023-05-24T03:29:48.520960+0000","last_unstale":"2023-05-24T03:29:49.232426+0000","last_undegraded":"2023-05-24T03:29:49.232426+0000","last_fullsized":"2023-05-24T03:29:49.232426+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T03:39:23.517439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.797919+0000","last_change":"2023-05-24T03:29:44.088157+0000","last_active":"2023-05-24T03:29:49.797919+0000","last_peered":"2023-05-24T03:29:49.797919+0000","last_clean":"2023-05-24T03:29:49.797919+0000","last_became_active":"2023-05-24T03:29:44.087869+0000","last_became_peered":"2023-05-24T03:29:44.087869+0000","last_unstale":"2023-05-24T03:29:49.797919+0000","last_undegraded":"2023-05-24T03:29:49.797919+0000","last_fullsized":"2023-05-24T03:29:49.797919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:47:23.070936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925265+0000","last_change":"2023-05-24T03:29:44.501176+0000","last_active":"2023-05-24T03:29:48.925265+0000","last_peered":"2023-05-24T03:29:48.925265+0000","last_clean":"2023-05-24T03:29:48.925265+0000","last_became_active":"2023-05-24T03:29:44.499700+0000","last_became_peered":"2023-05-24T03:29:44.499700+0000","last_unstale":"2023-05-24T03:29:48.925265+0000","last_undegraded":"2023-05-24T03:29:48.925265+0000","last_fullsized":"2023-05-24T03:29:48.925265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:31:52.511256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920217+0000","last_change":"2023-05-24T03:29:48.522778+0000","last_active":"2023-05-24T03:29:48.920217+0000","last_peered":"2023-05-24T03:29:48.920217+0000","last_clean":"2023-05-24T03:29:48.920217+0000","last_became_active":"2023-05-24T03:29:48.522104+0000","last_became_peered":"2023-05-24T03:29:48.522104+0000","last_unstale":"2023-05-24T03:29:48.920217+0000","last_undegraded":"2023-05-24T03:29:48.920217+0000","last_fullsized":"2023-05-24T03:29:48.920217+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:43:13.521320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.797884+0000","last_change":"2023-05-24T03:29:44.085211+0000","last_active":"2023-05-24T03:29:49.797884+0000","last_peered":"2023-05-24T03:29:49.797884+0000","last_clean":"2023-05-24T03:29:49.797884+0000","last_became_active":"2023-05-24T03:29:44.084894+0000","last_became_peered":"2023-05-24T03:29:44.084894+0000","last_unstale":"2023-05-24T03:29:49.797884+0000","last_undegraded":"2023-05-24T03:29:49.797884+0000","last_fullsized":"2023-05-24T03:29:49.797884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:12:00.580737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925495+0000","last_change":"2023-05-24T03:29:44.492807+0000","last_active":"2023-05-24T03:29:48.925495+0000","last_peered":"2023-05-24T03:29:48.925495+0000","last_clean":"2023-05-24T03:29:48.925495+0000","last_became_active":"2023-05-24T03:29:44.492462+0000","last_became_peered":"2023-05-24T03:29:44.492462+0000","last_unstale":"2023-05-24T03:29:48.925495+0000","last_undegraded":"2023-05-24T03:29:48.925495+0000","last_fullsized":"2023-05-24T03:29:48.925495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:58:20.689097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924069+0000","last_change":"2023-05-24T03:29:48.524960+0000","last_active":"2023-05-24T03:29:48.924069+0000","last_peered":"2023-05-24T03:29:48.924069+0000","last_clean":"2023-05-24T03:29:48.924069+0000","last_became_active":"2023-05-24T03:29:48.524023+0000","last_became_peered":"2023-05-24T03:29:48.524023+0000","last_unstale":"2023-05-24T03:29:48.924069+0000","last_undegraded":"2023-05-24T03:29:48.924069+0000","last_fullsized":"2023-05-24T03:29:48.924069+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:06:49.307926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924625+0000","last_change":"2023-05-24T03:29:44.082700+0000","last_active":"2023-05-24T03:29:48.924625+0000","last_peered":"2023-05-24T03:29:48.924625+0000","last_clean":"2023-05-24T03:29:48.924625+0000","last_became_active":"2023-05-24T03:29:44.082382+0000","last_became_peered":"2023-05-24T03:29:44.082382+0000","last_unstale":"2023-05-24T03:29:48.924625+0000","last_undegraded":"2023-05-24T03:29:48.924625+0000","last_fullsized":"2023-05-24T03:29:48.924625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:25:39.171324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925735+0000","last_change":"2023-05-24T03:29:44.501409+0000","last_active":"2023-05-24T03:29:48.925735+0000","last_peered":"2023-05-24T03:29:48.925735+0000","last_clean":"2023-05-24T03:29:48.925735+0000","last_became_active":"2023-05-24T03:29:44.501080+0000","last_became_peered":"2023-05-24T03:29:44.501080+0000","last_unstale":"2023-05-24T03:29:48.925735+0000","last_undegraded":"2023-05-24T03:29:48.925735+0000","last_fullsized":"2023-05-24T03:29:48.925735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T03:40:05.771938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925745+0000","last_change":"2023-05-24T03:29:48.519383+0000","last_active":"2023-05-24T03:29:48.925745+0000","last_peered":"2023-05-24T03:29:48.925745+0000","last_clean":"2023-05-24T03:29:48.925745+0000","last_became_active":"2023-05-24T03:29:48.519046+0000","last_became_peered":"2023-05-24T03:29:48.519046+0000","last_unstale":"2023-05-24T03:29:48.925745+0000","last_undegraded":"2023-05-24T03:29:48.925745+0000","last_fullsized":"2023-05-24T03:29:48.925745+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:55:49.240935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.797812+0000","last_change":"2023-05-24T03:29:44.085771+0000","last_active":"2023-05-24T03:29:49.797812+0000","last_peered":"2023-05-24T03:29:49.797812+0000","last_clean":"2023-05-24T03:29:49.797812+0000","last_became_active":"2023-05-24T03:29:44.085420+0000","last_became_peered":"2023-05-24T03:29:44.085420+0000","last_unstale":"2023-05-24T03:29:49.797812+0000","last_undegraded":"2023-05-24T03:29:49.797812+0000","last_fullsized":"2023-05-24T03:29:49.797812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:17:25.372310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920855+0000","last_change":"2023-05-24T03:29:44.491345+0000","last_active":"2023-05-24T03:29:48.920855+0000","last_peered":"2023-05-24T03:29:48.920855+0000","last_clean":"2023-05-24T03:29:48.920855+0000","last_became_active":"2023-05-24T03:29:44.491089+0000","last_became_peered":"2023-05-24T03:29:44.491089+0000","last_unstale":"2023-05-24T03:29:48.920855+0000","last_undegraded":"2023-05-24T03:29:48.920855+0000","last_fullsized":"2023-05-24T03:29:48.920855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:27:09.189901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156263+0000","last_change":"2023-05-24T03:29:48.530105+0000","last_active":"2023-05-24T03:29:49.156263+0000","last_peered":"2023-05-24T03:29:49.156263+0000","last_clean":"2023-05-24T03:29:49.156263+0000","last_became_active":"2023-05-24T03:29:48.529157+0000","last_became_peered":"2023-05-24T03:29:48.529157+0000","last_unstale":"2023-05-24T03:29:49.156263+0000","last_undegraded":"2023-05-24T03:29:49.156263+0000","last_fullsized":"2023-05-24T03:29:49.156263+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:16:42.206744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920406+0000","last_change":"2023-05-24T03:29:39.143199+0000","last_active":"2023-05-24T03:29:48.920406+0000","last_peered":"2023-05-24T03:29:48.920406+0000","last_clean":"2023-05-24T03:29:48.920406+0000","last_became_active":"2023-05-24T03:29:39.142867+0000","last_became_peered":"2023-05-24T03:29:39.142867+0000","last_unstale":"2023-05-24T03:29:48.920406+0000","last_undegraded":"2023-05-24T03:29:48.920406+0000","last_fullsized":"2023-05-24T03:29:48.920406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:30:50.951434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924073+0000","last_change":"2023-05-24T03:29:44.087790+0000","last_active":"2023-05-24T03:29:48.924073+0000","last_peered":"2023-05-24T03:29:48.924073+0000","last_clean":"2023-05-24T03:29:48.924073+0000","last_became_active":"2023-05-24T03:29:44.087475+0000","last_became_peered":"2023-05-24T03:29:44.087475+0000","last_unstale":"2023-05-24T03:29:48.924073+0000","last_undegraded":"2023-05-24T03:29:48.924073+0000","last_fullsized":"2023-05-24T03:29:48.924073+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:19:26.667537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920215+0000","last_change":"2023-05-24T03:29:44.497235+0000","last_active":"2023-05-24T03:29:48.920215+0000","last_peered":"2023-05-24T03:29:48.920215+0000","last_clean":"2023-05-24T03:29:48.920215+0000","last_became_active":"2023-05-24T03:29:44.497015+0000","last_became_peered":"2023-05-24T03:29:44.497015+0000","last_unstale":"2023-05-24T03:29:48.920215+0000","last_undegraded":"2023-05-24T03:29:48.920215+0000","last_fullsized":"2023-05-24T03:29:48.920215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:57:57.662351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156092+0000","last_change":"2023-05-24T03:29:48.527805+0000","last_active":"2023-05-24T03:29:49.156092+0000","last_peered":"2023-05-24T03:29:49.156092+0000","last_clean":"2023-05-24T03:29:49.156092+0000","last_became_active":"2023-05-24T03:29:48.527010+0000","last_became_peered":"2023-05-24T03:29:48.527010+0000","last_unstale":"2023-05-24T03:29:49.156092+0000","last_undegraded":"2023-05-24T03:29:49.156092+0000","last_fullsized":"2023-05-24T03:29:49.156092+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:27:55.598487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.923462+0000","last_change":"2023-05-24T03:29:39.048516+0000","last_active":"2023-05-24T03:29:48.923462+0000","last_peered":"2023-05-24T03:29:48.923462+0000","last_clean":"2023-05-24T03:29:48.923462+0000","last_became_active":"2023-05-24T03:29:39.048141+0000","last_became_peered":"2023-05-24T03:29:39.048141+0000","last_unstale":"2023-05-24T03:29:48.923462+0000","last_undegraded":"2023-05-24T03:29:48.923462+0000","last_fullsized":"2023-05-24T03:29:48.923462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:42:01.286387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925527+0000","last_change":"2023-05-24T03:29:44.085282+0000","last_active":"2023-05-24T03:29:48.925527+0000","last_peered":"2023-05-24T03:29:48.925527+0000","last_clean":"2023-05-24T03:29:48.925527+0000","last_became_active":"2023-05-24T03:29:44.084944+0000","last_became_peered":"2023-05-24T03:29:44.084944+0000","last_unstale":"2023-05-24T03:29:48.925527+0000","last_undegraded":"2023-05-24T03:29:48.925527+0000","last_fullsized":"2023-05-24T03:29:48.925527+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:09:43.787048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920293+0000","last_change":"2023-05-24T03:29:44.483553+0000","last_active":"2023-05-24T03:29:48.920293+0000","last_peered":"2023-05-24T03:29:48.920293+0000","last_clean":"2023-05-24T03:29:48.920293+0000","last_became_active":"2023-05-24T03:29:44.483134+0000","last_became_peered":"2023-05-24T03:29:44.483134+0000","last_unstale":"2023-05-24T03:29:48.920293+0000","last_undegraded":"2023-05-24T03:29:48.920293+0000","last_fullsized":"2023-05-24T03:29:48.920293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:51:21.843236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.232485+0000","last_change":"2023-05-24T03:29:48.519249+0000","last_active":"2023-05-24T03:29:49.232485+0000","last_peered":"2023-05-24T03:29:49.232485+0000","last_clean":"2023-05-24T03:29:49.232485+0000","last_became_active":"2023-05-24T03:29:48.518546+0000","last_became_peered":"2023-05-24T03:29:48.518546+0000","last_unstale":"2023-05-24T03:29:49.232485+0000","last_undegraded":"2023-05-24T03:29:49.232485+0000","last_fullsized":"2023-05-24T03:29:49.232485+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:03:54.662293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.232195+0000","last_change":"2023-05-24T03:29:39.310351+0000","last_active":"2023-05-24T03:29:49.232195+0000","last_peered":"2023-05-24T03:29:49.232195+0000","last_clean":"2023-05-24T03:29:49.232195+0000","last_became_active":"2023-05-24T03:29:39.310070+0000","last_became_peered":"2023-05-24T03:29:39.310070+0000","last_unstale":"2023-05-24T03:29:49.232195+0000","last_undegraded":"2023-05-24T03:29:49.232195+0000","last_fullsized":"2023-05-24T03:29:49.232195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:13:08.585653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.919973+0000","last_change":"2023-05-24T03:29:44.075504+0000","last_active":"2023-05-24T03:29:48.919973+0000","last_peered":"2023-05-24T03:29:48.919973+0000","last_clean":"2023-05-24T03:29:48.919973+0000","last_became_active":"2023-05-24T03:29:44.074551+0000","last_became_peered":"2023-05-24T03:29:44.074551+0000","last_unstale":"2023-05-24T03:29:48.919973+0000","last_undegraded":"2023-05-24T03:29:48.919973+0000","last_fullsized":"2023-05-24T03:29:48.919973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:00:51.565754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920676+0000","last_change":"2023-05-24T03:29:44.496225+0000","last_active":"2023-05-24T03:29:48.920676+0000","last_peered":"2023-05-24T03:29:48.920676+0000","last_clean":"2023-05-24T03:29:48.920676+0000","last_became_active":"2023-05-24T03:29:44.496030+0000","last_became_peered":"2023-05-24T03:29:44.496030+0000","last_unstale":"2023-05-24T03:29:48.920676+0000","last_undegraded":"2023-05-24T03:29:48.920676+0000","last_fullsized":"2023-05-24T03:29:48.920676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:37:23.325863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.711961+0000","last_change":"2023-05-24T03:29:48.523816+0000","last_active":"2023-05-24T03:29:49.711961+0000","last_peered":"2023-05-24T03:29:49.711961+0000","last_clean":"2023-05-24T03:29:49.711961+0000","last_became_active":"2023-05-24T03:29:48.523380+0000","last_became_peered":"2023-05-24T03:29:48.523380+0000","last_unstale":"2023-05-24T03:29:49.711961+0000","last_undegraded":"2023-05-24T03:29:49.711961+0000","last_fullsized":"2023-05-24T03:29:49.711961+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:59:09.697698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.923885+0000","last_change":"2023-05-24T03:29:39.051113+0000","last_active":"2023-05-24T03:29:48.923885+0000","last_peered":"2023-05-24T03:29:48.923885+0000","last_clean":"2023-05-24T03:29:48.923885+0000","last_became_active":"2023-05-24T03:29:39.050751+0000","last_became_peered":"2023-05-24T03:29:39.050751+0000","last_unstale":"2023-05-24T03:29:48.923885+0000","last_undegraded":"2023-05-24T03:29:48.923885+0000","last_fullsized":"2023-05-24T03:29:48.923885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:54:48.001313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":183,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.711482+0000","last_change":"2023-05-24T03:29:34.025679+0000","last_active":"2023-05-24T03:29:49.711482+0000","last_peered":"2023-05-24T03:29:49.711482+0000","last_clean":"2023-05-24T03:29:49.711482+0000","last_became_active":"2023-05-24T03:29:34.024728+0000","last_became_peered":"2023-05-24T03:29:34.024728+0000","last_unstale":"2023-05-24T03:29:49.711482+0000","last_undegraded":"2023-05-24T03:29:49.711482+0000","last_fullsized":"2023-05-24T03:29:49.711482+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:32.968348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:32.968348+0000","last_clean_scrub_stamp":"2023-05-24T03:29:32.968348+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:17:15.286781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.797849+0000","last_change":"2023-05-24T03:29:44.086373+0000","last_active":"2023-05-24T03:29:49.797849+0000","last_peered":"2023-05-24T03:29:49.797849+0000","last_clean":"2023-05-24T03:29:49.797849+0000","last_became_active":"2023-05-24T03:29:44.086125+0000","last_became_peered":"2023-05-24T03:29:44.086125+0000","last_unstale":"2023-05-24T03:29:49.797849+0000","last_undegraded":"2023-05-24T03:29:49.797849+0000","last_fullsized":"2023-05-24T03:29:49.797849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:13:01.346454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798145+0000","last_change":"2023-05-24T03:29:44.492654+0000","last_active":"2023-05-24T03:29:49.798145+0000","last_peered":"2023-05-24T03:29:49.798145+0000","last_clean":"2023-05-24T03:29:49.798145+0000","last_became_active":"2023-05-24T03:29:44.492375+0000","last_became_peered":"2023-05-24T03:29:44.492375+0000","last_unstale":"2023-05-24T03:29:49.798145+0000","last_undegraded":"2023-05-24T03:29:49.798145+0000","last_fullsized":"2023-05-24T03:29:49.798145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:59:38.574199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.923773+0000","last_change":"2023-05-24T03:29:48.525206+0000","last_active":"2023-05-24T03:29:48.923773+0000","last_peered":"2023-05-24T03:29:48.923773+0000","last_clean":"2023-05-24T03:29:48.923773+0000","last_became_active":"2023-05-24T03:29:48.524615+0000","last_became_peered":"2023-05-24T03:29:48.524615+0000","last_unstale":"2023-05-24T03:29:48.923773+0000","last_undegraded":"2023-05-24T03:29:48.923773+0000","last_fullsized":"2023-05-24T03:29:48.923773+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:13:05.775179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.711704+0000","last_change":"2023-05-24T03:29:39.054117+0000","last_active":"2023-05-24T03:29:49.711704+0000","last_peered":"2023-05-24T03:29:49.711704+0000","last_clean":"2023-05-24T03:29:49.711704+0000","last_became_active":"2023-05-24T03:29:39.053813+0000","last_became_peered":"2023-05-24T03:29:39.053813+0000","last_unstale":"2023-05-24T03:29:49.711704+0000","last_undegraded":"2023-05-24T03:29:49.711704+0000","last_fullsized":"2023-05-24T03:29:49.711704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:47:18.052783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156076+0000","last_change":"2023-05-24T03:29:44.090147+0000","last_active":"2023-05-24T03:29:49.156076+0000","last_peered":"2023-05-24T03:29:49.156076+0000","last_clean":"2023-05-24T03:29:49.156076+0000","last_became_active":"2023-05-24T03:29:44.089943+0000","last_became_peered":"2023-05-24T03:29:44.089943+0000","last_unstale":"2023-05-24T03:29:49.156076+0000","last_undegraded":"2023-05-24T03:29:49.156076+0000","last_fullsized":"2023-05-24T03:29:49.156076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:30:55.969587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156224+0000","last_change":"2023-05-24T03:29:44.498467+0000","last_active":"2023-05-24T03:29:49.156224+0000","last_peered":"2023-05-24T03:29:49.156224+0000","last_clean":"2023-05-24T03:29:49.156224+0000","last_became_active":"2023-05-24T03:29:44.498130+0000","last_became_peered":"2023-05-24T03:29:44.498130+0000","last_unstale":"2023-05-24T03:29:49.156224+0000","last_undegraded":"2023-05-24T03:29:49.156224+0000","last_fullsized":"2023-05-24T03:29:49.156224+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:42:07.310986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798266+0000","last_change":"2023-05-24T03:29:48.520034+0000","last_active":"2023-05-24T03:29:49.798266+0000","last_peered":"2023-05-24T03:29:49.798266+0000","last_clean":"2023-05-24T03:29:49.798266+0000","last_became_active":"2023-05-24T03:29:48.519673+0000","last_became_peered":"2023-05-24T03:29:48.519673+0000","last_unstale":"2023-05-24T03:29:49.798266+0000","last_undegraded":"2023-05-24T03:29:49.798266+0000","last_fullsized":"2023-05-24T03:29:49.798266+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:47:00.839865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.711979+0000","last_change":"2023-05-24T03:29:39.143215+0000","last_active":"2023-05-24T03:29:49.711979+0000","last_peered":"2023-05-24T03:29:49.711979+0000","last_clean":"2023-05-24T03:29:49.711979+0000","last_became_active":"2023-05-24T03:29:39.142949+0000","last_became_peered":"2023-05-24T03:29:39.142949+0000","last_unstale":"2023-05-24T03:29:49.711979+0000","last_undegraded":"2023-05-24T03:29:49.711979+0000","last_fullsized":"2023-05-24T03:29:49.711979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:52:07.793681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920538+0000","last_change":"2023-05-24T03:29:44.074869+0000","last_active":"2023-05-24T03:29:48.920538+0000","last_peered":"2023-05-24T03:29:48.920538+0000","last_clean":"2023-05-24T03:29:48.920538+0000","last_became_active":"2023-05-24T03:29:44.074374+0000","last_became_peered":"2023-05-24T03:29:44.074374+0000","last_unstale":"2023-05-24T03:29:48.920538+0000","last_undegraded":"2023-05-24T03:29:48.920538+0000","last_fullsized":"2023-05-24T03:29:48.920538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:16:37.778018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156370+0000","last_change":"2023-05-24T03:29:44.499979+0000","last_active":"2023-05-24T03:29:49.156370+0000","last_peered":"2023-05-24T03:29:49.156370+0000","last_clean":"2023-05-24T03:29:49.156370+0000","last_became_active":"2023-05-24T03:29:44.499768+0000","last_became_peered":"2023-05-24T03:29:44.499768+0000","last_unstale":"2023-05-24T03:29:49.156370+0000","last_undegraded":"2023-05-24T03:29:49.156370+0000","last_fullsized":"2023-05-24T03:29:49.156370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:13:02.352900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924990+0000","last_change":"2023-05-24T03:29:48.530781+0000","last_active":"2023-05-24T03:29:48.924990+0000","last_peered":"2023-05-24T03:29:48.924990+0000","last_clean":"2023-05-24T03:29:48.924990+0000","last_became_active":"2023-05-24T03:29:48.530401+0000","last_became_peered":"2023-05-24T03:29:48.530401+0000","last_unstale":"2023-05-24T03:29:48.924990+0000","last_undegraded":"2023-05-24T03:29:48.924990+0000","last_fullsized":"2023-05-24T03:29:48.924990+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:56:52.111906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798616+0000","last_change":"2023-05-24T03:29:44.084278+0000","last_active":"2023-05-24T03:29:49.798616+0000","last_peered":"2023-05-24T03:29:49.798616+0000","last_clean":"2023-05-24T03:29:49.798616+0000","last_became_active":"2023-05-24T03:29:44.083929+0000","last_became_peered":"2023-05-24T03:29:44.083929+0000","last_unstale":"2023-05-24T03:29:49.798616+0000","last_undegraded":"2023-05-24T03:29:49.798616+0000","last_fullsized":"2023-05-24T03:29:49.798616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:59:51.303175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920595+0000","last_change":"2023-05-24T03:29:39.045821+0000","last_active":"2023-05-24T03:29:48.920595+0000","last_peered":"2023-05-24T03:29:48.920595+0000","last_clean":"2023-05-24T03:29:48.920595+0000","last_became_active":"2023-05-24T03:29:39.045543+0000","last_became_peered":"2023-05-24T03:29:39.045543+0000","last_unstale":"2023-05-24T03:29:48.920595+0000","last_undegraded":"2023-05-24T03:29:48.920595+0000","last_fullsized":"2023-05-24T03:29:48.920595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:12:33.887713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.797728+0000","last_change":"2023-05-24T03:29:44.496106+0000","last_active":"2023-05-24T03:29:49.797728+0000","last_peered":"2023-05-24T03:29:49.797728+0000","last_clean":"2023-05-24T03:29:49.797728+0000","last_became_active":"2023-05-24T03:29:44.495816+0000","last_became_peered":"2023-05-24T03:29:44.495816+0000","last_unstale":"2023-05-24T03:29:49.797728+0000","last_undegraded":"2023-05-24T03:29:49.797728+0000","last_fullsized":"2023-05-24T03:29:49.797728+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:37:23.325863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.797716+0000","last_change":"2023-05-24T03:29:48.527602+0000","last_active":"2023-05-24T03:29:49.797716+0000","last_peered":"2023-05-24T03:29:49.797716+0000","last_clean":"2023-05-24T03:29:49.797716+0000","last_became_active":"2023-05-24T03:29:48.527196+0000","last_became_peered":"2023-05-24T03:29:48.527196+0000","last_unstale":"2023-05-24T03:29:49.797716+0000","last_undegraded":"2023-05-24T03:29:49.797716+0000","last_fullsized":"2023-05-24T03:29:49.797716+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:12:43.334592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798516+0000","last_change":"2023-05-24T03:29:39.046445+0000","last_active":"2023-05-24T03:29:49.798516+0000","last_peered":"2023-05-24T03:29:49.798516+0000","last_clean":"2023-05-24T03:29:49.798516+0000","last_became_active":"2023-05-24T03:29:39.046149+0000","last_became_peered":"2023-05-24T03:29:39.046149+0000","last_unstale":"2023-05-24T03:29:49.798516+0000","last_undegraded":"2023-05-24T03:29:49.798516+0000","last_fullsized":"2023-05-24T03:29:49.798516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:11:20.972024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"28'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156361+0000","last_change":"2023-05-24T03:29:44.088780+0000","last_active":"2023-05-24T03:29:49.156361+0000","last_peered":"2023-05-24T03:29:49.156361+0000","last_clean":"2023-05-24T03:29:49.156361+0000","last_became_active":"2023-05-24T03:29:44.088495+0000","last_became_peered":"2023-05-24T03:29:44.088495+0000","last_unstale":"2023-05-24T03:29:49.156361+0000","last_undegraded":"2023-05-24T03:29:49.156361+0000","last_fullsized":"2023-05-24T03:29:49.156361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:37:22.319418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924732+0000","last_change":"2023-05-24T03:29:44.496966+0000","last_active":"2023-05-24T03:29:48.924732+0000","last_peered":"2023-05-24T03:29:48.924732+0000","last_clean":"2023-05-24T03:29:48.924732+0000","last_became_active":"2023-05-24T03:29:44.496597+0000","last_became_peered":"2023-05-24T03:29:44.496597+0000","last_unstale":"2023-05-24T03:29:48.924732+0000","last_undegraded":"2023-05-24T03:29:48.924732+0000","last_fullsized":"2023-05-24T03:29:48.924732+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:09:24.928940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920813+0000","last_change":"2023-05-24T03:29:48.524541+0000","last_active":"2023-05-24T03:29:48.920813+0000","last_peered":"2023-05-24T03:29:48.920813+0000","last_clean":"2023-05-24T03:29:48.920813+0000","last_became_active":"2023-05-24T03:29:48.524170+0000","last_became_peered":"2023-05-24T03:29:48.524170+0000","last_unstale":"2023-05-24T03:29:48.920813+0000","last_undegraded":"2023-05-24T03:29:48.920813+0000","last_fullsized":"2023-05-24T03:29:48.920813+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:17:29.801036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156385+0000","last_change":"2023-05-24T03:29:44.090259+0000","last_active":"2023-05-24T03:29:49.156385+0000","last_peered":"2023-05-24T03:29:49.156385+0000","last_clean":"2023-05-24T03:29:49.156385+0000","last_became_active":"2023-05-24T03:29:44.089993+0000","last_became_peered":"2023-05-24T03:29:44.089993+0000","last_unstale":"2023-05-24T03:29:49.156385+0000","last_undegraded":"2023-05-24T03:29:49.156385+0000","last_fullsized":"2023-05-24T03:29:49.156385+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:27:08.183456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.232199+0000","last_change":"2023-05-24T03:29:44.481933+0000","last_active":"2023-05-24T03:29:49.232199+0000","last_peered":"2023-05-24T03:29:49.232199+0000","last_clean":"2023-05-24T03:29:49.232199+0000","last_became_active":"2023-05-24T03:29:44.481655+0000","last_became_peered":"2023-05-24T03:29:44.481655+0000","last_unstale":"2023-05-24T03:29:49.232199+0000","last_undegraded":"2023-05-24T03:29:49.232199+0000","last_fullsized":"2023-05-24T03:29:49.232199+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:06:36.510598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.712009+0000","last_change":"2023-05-24T03:29:48.516800+0000","last_active":"2023-05-24T03:29:49.712009+0000","last_peered":"2023-05-24T03:29:49.712009+0000","last_clean":"2023-05-24T03:29:49.712009+0000","last_became_active":"2023-05-24T03:29:48.516366+0000","last_became_peered":"2023-05-24T03:29:48.516366+0000","last_unstale":"2023-05-24T03:29:49.712009+0000","last_undegraded":"2023-05-24T03:29:49.712009+0000","last_fullsized":"2023-05-24T03:29:49.712009+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:19:31.096262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.923650+0000","last_change":"2023-05-24T03:29:44.094179+0000","last_active":"2023-05-24T03:29:48.923650+0000","last_peered":"2023-05-24T03:29:48.923650+0000","last_clean":"2023-05-24T03:29:48.923650+0000","last_became_active":"2023-05-24T03:29:44.093909+0000","last_became_peered":"2023-05-24T03:29:44.093909+0000","last_unstale":"2023-05-24T03:29:48.923650+0000","last_undegraded":"2023-05-24T03:29:48.923650+0000","last_fullsized":"2023-05-24T03:29:48.923650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:55:31.183299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924979+0000","last_change":"2023-05-24T03:29:44.497379+0000","last_active":"2023-05-24T03:29:48.924979+0000","last_peered":"2023-05-24T03:29:48.924979+0000","last_clean":"2023-05-24T03:29:48.924979+0000","last_became_active":"2023-05-24T03:29:44.496679+0000","last_became_peered":"2023-05-24T03:29:44.496679+0000","last_unstale":"2023-05-24T03:29:48.924979+0000","last_undegraded":"2023-05-24T03:29:48.924979+0000","last_fullsized":"2023-05-24T03:29:48.924979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:53:47.591081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924043+0000","last_change":"2023-05-24T03:29:48.529231+0000","last_active":"2023-05-24T03:29:48.924043+0000","last_peered":"2023-05-24T03:29:48.924043+0000","last_clean":"2023-05-24T03:29:48.924043+0000","last_became_active":"2023-05-24T03:29:48.528862+0000","last_became_peered":"2023-05-24T03:29:48.528862+0000","last_unstale":"2023-05-24T03:29:48.924043+0000","last_undegraded":"2023-05-24T03:29:48.924043+0000","last_fullsized":"2023-05-24T03:29:48.924043+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:48:31.938863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.923932+0000","last_change":"2023-05-24T03:29:44.090289+0000","last_active":"2023-05-24T03:29:48.923932+0000","last_peered":"2023-05-24T03:29:48.923932+0000","last_clean":"2023-05-24T03:29:48.923932+0000","last_became_active":"2023-05-24T03:29:44.089949+0000","last_became_peered":"2023-05-24T03:29:44.089949+0000","last_unstale":"2023-05-24T03:29:48.923932+0000","last_undegraded":"2023-05-24T03:29:48.923932+0000","last_fullsized":"2023-05-24T03:29:48.923932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:47:23.070936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924880+0000","last_change":"2023-05-24T03:29:44.498632+0000","last_active":"2023-05-24T03:29:48.924880+0000","last_peered":"2023-05-24T03:29:48.924880+0000","last_clean":"2023-05-24T03:29:48.924880+0000","last_became_active":"2023-05-24T03:29:44.498350+0000","last_became_peered":"2023-05-24T03:29:44.498350+0000","last_unstale":"2023-05-24T03:29:48.924880+0000","last_undegraded":"2023-05-24T03:29:48.924880+0000","last_fullsized":"2023-05-24T03:29:48.924880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:02:32.050380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.924648+0000","last_change":"2023-05-24T03:29:48.523434+0000","last_active":"2023-05-24T03:29:48.924648+0000","last_peered":"2023-05-24T03:29:48.924648+0000","last_clean":"2023-05-24T03:29:48.924648+0000","last_became_active":"2023-05-24T03:29:48.522228+0000","last_became_peered":"2023-05-24T03:29:48.522228+0000","last_unstale":"2023-05-24T03:29:48.924648+0000","last_undegraded":"2023-05-24T03:29:48.924648+0000","last_fullsized":"2023-05-24T03:29:48.924648+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:59:55.731900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798448+0000","last_change":"2023-05-24T03:29:44.083178+0000","last_active":"2023-05-24T03:29:49.798448+0000","last_peered":"2023-05-24T03:29:49.798448+0000","last_clean":"2023-05-24T03:29:49.798448+0000","last_became_active":"2023-05-24T03:29:44.082903+0000","last_became_peered":"2023-05-24T03:29:44.082903+0000","last_unstale":"2023-05-24T03:29:49.798448+0000","last_undegraded":"2023-05-24T03:29:49.798448+0000","last_fullsized":"2023-05-24T03:29:49.798448+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:59:08.440023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798028+0000","last_change":"2023-05-24T03:29:44.488206+0000","last_active":"2023-05-24T03:29:49.798028+0000","last_peered":"2023-05-24T03:29:49.798028+0000","last_clean":"2023-05-24T03:29:49.798028+0000","last_became_active":"2023-05-24T03:29:44.487925+0000","last_became_peered":"2023-05-24T03:29:44.487925+0000","last_unstale":"2023-05-24T03:29:49.798028+0000","last_undegraded":"2023-05-24T03:29:49.798028+0000","last_fullsized":"2023-05-24T03:29:49.798028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:48:28.516583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920063+0000","last_change":"2023-05-24T03:29:48.519899+0000","last_active":"2023-05-24T03:29:48.920063+0000","last_peered":"2023-05-24T03:29:48.920063+0000","last_clean":"2023-05-24T03:29:48.920063+0000","last_became_active":"2023-05-24T03:29:48.519517+0000","last_became_peered":"2023-05-24T03:29:48.519517+0000","last_unstale":"2023-05-24T03:29:48.920063+0000","last_undegraded":"2023-05-24T03:29:48.920063+0000","last_fullsized":"2023-05-24T03:29:48.920063+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:26:20.594013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.156596+0000","last_change":"2023-05-24T03:29:44.088545+0000","last_active":"2023-05-24T03:29:49.156596+0000","last_peered":"2023-05-24T03:29:49.156596+0000","last_clean":"2023-05-24T03:29:49.156596+0000","last_became_active":"2023-05-24T03:29:44.087891+0000","last_became_peered":"2023-05-24T03:29:44.087891+0000","last_unstale":"2023-05-24T03:29:49.156596+0000","last_undegraded":"2023-05-24T03:29:49.156596+0000","last_fullsized":"2023-05-24T03:29:49.156596+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:19:26.667537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925035+0000","last_change":"2023-05-24T03:29:44.493246+0000","last_active":"2023-05-24T03:29:48.925035+0000","last_peered":"2023-05-24T03:29:48.925035+0000","last_clean":"2023-05-24T03:29:48.925035+0000","last_became_active":"2023-05-24T03:29:44.492923+0000","last_became_peered":"2023-05-24T03:29:44.492923+0000","last_unstale":"2023-05-24T03:29:48.925035+0000","last_undegraded":"2023-05-24T03:29:48.925035+0000","last_fullsized":"2023-05-24T03:29:48.925035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:59:05.161810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798054+0000","last_change":"2023-05-24T03:29:44.486961+0000","last_active":"2023-05-24T03:29:49.798054+0000","last_peered":"2023-05-24T03:29:49.798054+0000","last_clean":"2023-05-24T03:29:49.798054+0000","last_became_active":"2023-05-24T03:29:44.483898+0000","last_became_peered":"2023-05-24T03:29:44.483898+0000","last_unstale":"2023-05-24T03:29:49.798054+0000","last_undegraded":"2023-05-24T03:29:49.798054+0000","last_fullsized":"2023-05-24T03:29:49.798054+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:17:10.507341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.798199+0000","last_change":"2023-05-24T03:29:44.494451+0000","last_active":"2023-05-24T03:29:49.798199+0000","last_peered":"2023-05-24T03:29:49.798199+0000","last_clean":"2023-05-24T03:29:49.798199+0000","last_became_active":"2023-05-24T03:29:44.494073+0000","last_became_peered":"2023-05-24T03:29:44.494073+0000","last_unstale":"2023-05-24T03:29:49.798199+0000","last_undegraded":"2023-05-24T03:29:49.798199+0000","last_fullsized":"2023-05-24T03:29:49.798199+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:52:13.818279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.925451+0000","last_change":"2023-05-24T03:29:44.498119+0000","last_active":"2023-05-24T03:29:48.925451+0000","last_peered":"2023-05-24T03:29:48.925451+0000","last_clean":"2023-05-24T03:29:48.925451+0000","last_became_active":"2023-05-24T03:29:44.497832+0000","last_became_peered":"2023-05-24T03:29:44.497832+0000","last_unstale":"2023-05-24T03:29:48.925451+0000","last_undegraded":"2023-05-24T03:29:48.925451+0000","last_fullsized":"2023-05-24T03:29:48.925451+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:27:13.487917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:49.797913+0000","last_change":"2023-05-24T03:29:44.496468+0000","last_active":"2023-05-24T03:29:49.797913+0000","last_peered":"2023-05-24T03:29:49.797913+0000","last_clean":"2023-05-24T03:29:49.797913+0000","last_became_active":"2023-05-24T03:29:44.496197+0000","last_became_peered":"2023-05-24T03:29:44.496197+0000","last_unstale":"2023-05-24T03:29:49.797913+0000","last_undegraded":"2023-05-24T03:29:49.797913+0000","last_fullsized":"2023-05-24T03:29:49.797913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:54:54.025911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-24T03:29:48.920554+0000","last_change":"2023-05-24T03:29:44.495194+0000","last_active":"2023-05-24T03:29:48.920554+0000","last_peered":"2023-05-24T03:29:48.920554+0000","last_clean":"2023-05-24T03:29:48.920554+0000","last_became_active":"2023-05-24T03:29:44.494928+0000","last_became_peered":"2023-05-24T03:29:44.494928+0000","last_unstale":"2023-05-24T03:29:48.920554+0000","last_undegraded":"2023-05-24T03:29:48.920554+0000","last_fullsized":"2023-05-24T03:29:48.920554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:42:07.310986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18832,"kb_used_data":904,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353008,"statfs":{"total":96636764160,"available":96617480192,"internally_reserved":0,"allocated":925696,"data_stored":718998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18224,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353616,"statfs":{"total":96636764160,"available":96618102784,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18224,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353616,"statfs":{"total":96636764160,"available":96618102784,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18808,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353032,"statfs":{"total":96636764160,"available":96617504768,"internally_reserved":0,"allocated":901120,"data_stored":715522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18224,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353616,"statfs":{"total":96636764160,"available":96618102784,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18228,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353612,"statfs":{"total":96636764160,"available":96618098688,"internally_reserved":0,"allocated":307200,"data_stored":124662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18244,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353596,"statfs":{"total":96636764160,"available":96618082304,"internally_reserved":0,"allocated":323584,"data_stored":128470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18232,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94353608,"statfs":{"total":96636764160,"available":96618094592,"internally_reserved":0,"allocated":311296,"data_stored":125224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-24T03:30:12.266 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-05-24T03:30:12.266 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-05-24T03:30:12.267 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-05-24T03:30:12.267 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-05-24T03:30:12.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.414+0000 7fc0bbef8700 1 Processor -- start 2023-05-24T03:30:12.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.414+0000 7fc0bbef8700 1 -- start start 2023-05-24T03:30:12.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.414+0000 7fc0bbef8700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc0b406a460 0x7fc0b40cf890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:12.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.415+0000 7fc0bbef8700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc0b40af020 0x7fc0b4160fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:12.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.415+0000 7fc0bbef8700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0b4071f30 con 0x7fc0b40717c0 2023-05-24T03:30:12.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.415+0000 7fc0bbef8700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0b40af730 con 0x7fc0b406a460 2023-05-24T03:30:12.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.415+0000 7fc0bbef8700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b415ce80 con 0x7fc0b40af020 2023-05-24T03:30:12.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.415+0000 7fc0ba495700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc0b40717c0 0x7fc0b406a830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46102/0 (socket says 172.21.15.146:46102) 2023-05-24T03:30:12.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.415+0000 7fc0ba495700 1 -- 172.21.15.146:0/2846321416 learned_addr learned my addr 172.21.15.146:0/2846321416 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:30:12.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.415+0000 7fc0b9493700 1 --2- 172.21.15.146:0/2846321416 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc0b40af020 0x7fc0b4160fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:12.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.415+0000 7fc0b9c94700 1 --2- 172.21.15.146:0/2846321416 >> v2:172.21.15.151:3300/0 conn(0x7fc0b406a460 0x7fc0b40cf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:12.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.415+0000 7fc0b8c92700 1 -- 172.21.15.146:0/2846321416 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3735413384 0 0) 0x7fc0b4071f30 con 0x7fc0b40717c0 2023-05-24T03:30:12.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.415+0000 7fc0b8c92700 1 -- 172.21.15.146:0/2846321416 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0a00035b0 con 0x7fc0b40717c0 2023-05-24T03:30:12.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.415+0000 7fc0b8c92700 1 -- 172.21.15.146:0/2846321416 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 743756551 0 0) 0x7fc0a00035b0 con 0x7fc0b40717c0 2023-05-24T03:30:12.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.415+0000 7fc0b9493700 1 -- 172.21.15.146:0/2846321416 >> v2:172.21.15.151:3300/0 conn(0x7fc0b406a460 msgr2=0x7fc0b40cf890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:12.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.415+0000 7fc0b9493700 1 --2- 172.21.15.146:0/2846321416 >> v2:172.21.15.151:3300/0 conn(0x7fc0b406a460 0x7fc0b40cf890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:12.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.415+0000 7fc0b9493700 1 -- 172.21.15.146:0/2846321416 >> v1:172.21.15.146:6789/0 conn(0x7fc0b40717c0 legacy=0x7fc0b406a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:12.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.415+0000 7fc0b9493700 1 -- 172.21.15.146:0/2846321416 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b4072210 con 0x7fc0b40af020 2023-05-24T03:30:12.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.415+0000 7fc0b9c94700 1 --2- 172.21.15.146:0/2846321416 >> v2:172.21.15.151:3300/0 conn(0x7fc0b406a460 0x7fc0b40cf890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T03:30:12.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.415+0000 7fc0b9493700 1 --2- 172.21.15.146:0/2846321416 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc0b40af020 0x7fc0b4160fe0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0009840 tx=0x7fc0b0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2f9a64dfc46c152 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:12.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.416+0000 7fc0b8c92700 1 -- 172.21.15.146:0/2846321416 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac0019f0 con 0x7fc0b40af020 2023-05-24T03:30:12.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.416+0000 7fc0b8c92700 1 -- 172.21.15.146:0/2846321416 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b0004030 con 0x7fc0b40af020 2023-05-24T03:30:12.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.416+0000 7fc0b8c92700 1 -- 172.21.15.146:0/2846321416 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b00043c0 con 0x7fc0b40af020 2023-05-24T03:30:12.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.416+0000 7fc0bbef8700 1 -- 172.21.15.146:0/2846321416 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc0b40af020 msgr2=0x7fc0b4160fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:12.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.416+0000 7fc0bbef8700 1 --2- 172.21.15.146:0/2846321416 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc0b40af020 0x7fc0b4160fe0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0009840 tx=0x7fc0b0009b50 comp rx=0 tx=0).stop 2023-05-24T03:30:12.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.416+0000 7fc0bbef8700 1 -- 172.21.15.146:0/2846321416 shutdown_connections 2023-05-24T03:30:12.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.416+0000 7fc0bbef8700 1 --2- 172.21.15.146:0/2846321416 >> v2:172.21.15.151:3300/0 conn(0x7fc0b406a460 0x7fc0b40cf890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:12.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.416+0000 7fc0bbef8700 1 --2- 172.21.15.146:0/2846321416 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc0b40af020 0x7fc0b4160fe0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:12.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.416+0000 7fc0bbef8700 1 -- 172.21.15.146:0/2846321416 >> 172.21.15.146:0/2846321416 conn(0x7fc0b40cfe40 msgr2=0x7fc0b40d0240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:12.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.416+0000 7fc0bbef8700 1 -- 172.21.15.146:0/2846321416 shutdown_connections 2023-05-24T03:30:12.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.416+0000 7fc0bbef8700 1 -- 172.21.15.146:0/2846321416 wait complete. 2023-05-24T03:30:12.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.417+0000 7fc0bbef8700 1 Processor -- start 2023-05-24T03:30:12.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.417+0000 7fc0bbef8700 1 -- start start 2023-05-24T03:30:12.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.418+0000 7fc0bbef8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0b406a460 0x7fc0b4153ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:12.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.418+0000 7fc0bbef8700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0b40717c0 0x7fc0b40b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:12.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.418+0000 7fc0bbef8700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc0b4154560 0x7fc0b40b5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:12.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.418+0000 7fc0bbef8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b41f1fc0 con 0x7fc0b406a460 2023-05-24T03:30:12.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.418+0000 7fc0bbef8700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b40b2620 con 0x7fc0b40717c0 2023-05-24T03:30:12.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.418+0000 7fc0bbef8700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b40af8a0 con 0x7fc0b4154560 2023-05-24T03:30:12.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.418+0000 7fc0b9c94700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0b406a460 0x7fc0b4153ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:12.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.418+0000 7fc0b9c94700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0b406a460 0x7fc0b4153ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39652/0 (socket says 172.21.15.146:39652) 2023-05-24T03:30:12.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.418+0000 7fc0b9c94700 1 -- 172.21.15.146:0/1207875011 learned_addr learned my addr 172.21.15.146:0/1207875011 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:12.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.418+0000 7fc0ba495700 1 --2- 172.21.15.146:0/1207875011 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc0b4154560 0x7fc0b40b5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:12.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.418+0000 7fc0b9493700 1 --2- 172.21.15.146:0/1207875011 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0b40717c0 0x7fc0b40b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:12.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.419+0000 7fc0b9c94700 1 -- 172.21.15.146:0/1207875011 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc0b4154560 msgr2=0x7fc0b40b5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:12.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.419+0000 7fc0b9c94700 1 --2- 172.21.15.146:0/1207875011 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc0b4154560 0x7fc0b40b5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:12.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.419+0000 7fc0b9c94700 1 -- 172.21.15.146:0/1207875011 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0b40717c0 msgr2=0x7fc0b40b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:12.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.419+0000 7fc0b9c94700 1 --2- 172.21.15.146:0/1207875011 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0b40717c0 0x7fc0b40b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:12.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.419+0000 7fc0b9c94700 1 -- 172.21.15.146:0/1207875011 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a40094a0 con 0x7fc0b406a460 2023-05-24T03:30:12.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.419+0000 7fc0ba495700 1 --2- 172.21.15.146:0/1207875011 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc0b4154560 0x7fc0b40b5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:30:12.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.419+0000 7fc0b9493700 1 --2- 172.21.15.146:0/1207875011 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0b40717c0 0x7fc0b40b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:30:12.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.419+0000 7fc0b9c94700 1 --2- 172.21.15.146:0/1207875011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0b406a460 0x7fc0b4153ed0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc0a400ebe0 tx=0x7fc0a4009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:12.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.419+0000 7fc0aa7fc700 1 -- 172.21.15.146:0/1207875011 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a400c910 con 0x7fc0b406a460 2023-05-24T03:30:12.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.419+0000 7fc0aa7fc700 1 -- 172.21.15.146:0/1207875011 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a400ca70 con 0x7fc0b406a460 2023-05-24T03:30:12.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.419+0000 7fc0bbef8700 1 -- 172.21.15.146:0/1207875011 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0b00094a0 con 0x7fc0b406a460 2023-05-24T03:30:12.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.419+0000 7fc0aa7fc700 1 -- 172.21.15.146:0/1207875011 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a400cde0 con 0x7fc0b406a460 2023-05-24T03:30:12.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.419+0000 7fc0bbef8700 1 -- 172.21.15.146:0/1207875011 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0b41607e0 con 0x7fc0b406a460 2023-05-24T03:30:12.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.420+0000 7fc0bbef8700 1 -- 172.21.15.146:0/1207875011 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0b4160500 con 0x7fc0b406a460 2023-05-24T03:30:12.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.420+0000 7fc0aa7fc700 1 -- 172.21.15.146:0/1207875011 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc0a4013470 con 0x7fc0b406a460 2023-05-24T03:30:12.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.421+0000 7fc0aa7fc700 1 --2- 172.21.15.146:0/1207875011 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fc09806ace0 0x7fc09806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:12.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.421+0000 7fc0aa7fc700 1 -- 172.21.15.146:0/1207875011 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc0a4089940 con 0x7fc0b406a460 2023-05-24T03:30:12.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.421+0000 7fc0b9493700 1 --2- 172.21.15.146:0/1207875011 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fc09806ace0 0x7fc09806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:12.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.421+0000 7fc0b9493700 1 --2- 172.21.15.146:0/1207875011 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fc09806ace0 0x7fc09806d190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4072010 tx=0x7fc0b0013040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:12.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.425+0000 7fc0aa7fc700 1 -- 172.21.15.146:0/1207875011 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc0a4054700 con 0x7fc0b406a460 2023-05-24T03:30:12.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.660+0000 7fc0bbef8700 1 -- 172.21.15.146:0/1207875011 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fc0b40b04b0 con 0x7fc0b406a460 2023-05-24T03:30:12.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.660+0000 7fc0aa7fc700 1 -- 172.21.15.146:0/1207875011 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fc0a4057d20 con 0x7fc0b406a460 2023-05-24T03:30:12.665 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:30:12.665 INFO:teuthology.orchestra.run.smithi146.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-05-24T03:30:12.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.662+0000 7fc0bbef8700 1 -- 172.21.15.146:0/1207875011 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fc09806ace0 msgr2=0x7fc09806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:12.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.662+0000 7fc0bbef8700 1 --2- 172.21.15.146:0/1207875011 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fc09806ace0 0x7fc09806d190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4072010 tx=0x7fc0b0013040 comp rx=0 tx=0).stop 2023-05-24T03:30:12.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.662+0000 7fc0bbef8700 1 -- 172.21.15.146:0/1207875011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0b406a460 msgr2=0x7fc0b4153ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:12.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.662+0000 7fc0bbef8700 1 --2- 172.21.15.146:0/1207875011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0b406a460 0x7fc0b4153ed0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc0a400ebe0 tx=0x7fc0a4009ec0 comp rx=0 tx=0).stop 2023-05-24T03:30:12.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.662+0000 7fc0bbef8700 1 -- 172.21.15.146:0/1207875011 shutdown_connections 2023-05-24T03:30:12.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.662+0000 7fc0bbef8700 1 --2- 172.21.15.146:0/1207875011 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fc09806ace0 0x7fc09806d190 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:12.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.662+0000 7fc0bbef8700 1 --2- 172.21.15.146:0/1207875011 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc0b4154560 0x7fc0b40b5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:12.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.662+0000 7fc0bbef8700 1 --2- 172.21.15.146:0/1207875011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0b406a460 0x7fc0b4153ed0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:12.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.662+0000 7fc0bbef8700 1 --2- 172.21.15.146:0/1207875011 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0b40717c0 0x7fc0b40b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:12.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.662+0000 7fc0bbef8700 1 -- 172.21.15.146:0/1207875011 >> 172.21.15.146:0/1207875011 conn(0x7fc0b40cfe40 msgr2=0x7fc0b415c320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:12.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.662+0000 7fc0bbef8700 1 -- 172.21.15.146:0/1207875011 shutdown_connections 2023-05-24T03:30:12.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.662+0000 7fc0bbef8700 1 -- 172.21.15.146:0/1207875011 wait complete. 2023-05-24T03:30:12.679 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-05-24T03:30:12.680 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-24T03:30:12.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.797+0000 7f4327a24700 1 Processor -- start 2023-05-24T03:30:12.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.797+0000 7f4327a24700 1 -- start start 2023-05-24T03:30:12.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.797+0000 7f4327a24700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4320073760 0x7f43200711c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:12.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.797+0000 7f4327a24700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f432015e7c0 0x7f432015ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:12.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.797+0000 7f4327a24700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f432006bce0 con 0x7f43200aebc0 2023-05-24T03:30:12.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.797+0000 7f4327a24700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f432015f160 con 0x7f4320073760 2023-05-24T03:30:12.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.797+0000 7f4327a24700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43200aef90 con 0x7f432015e7c0 2023-05-24T03:30:12.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.797+0000 7f4324fbf700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4320073760 0x7f43200711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:12.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.798+0000 7f43257c0700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f43200aebc0 0x7f43200af810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46112/0 (socket says 172.21.15.146:46112) 2023-05-24T03:30:12.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.798+0000 7f43257c0700 1 -- 172.21.15.146:0/1279997910 learned_addr learned my addr 172.21.15.146:0/1279997910 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:30:12.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.798+0000 7f4325fc1700 1 --2- 172.21.15.146:0/1279997910 >> v2:172.21.15.151:3300/0 conn(0x7f432015e7c0 0x7f432015ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:12.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.798+0000 7f4324fbf700 1 -- 172.21.15.146:0/1279997910 >> v2:172.21.15.151:3300/0 conn(0x7f432015e7c0 msgr2=0x7f432015ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:12.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.798+0000 7f4324fbf700 1 --2- 172.21.15.146:0/1279997910 >> v2:172.21.15.151:3300/0 conn(0x7f432015e7c0 0x7f432015ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:12.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.798+0000 7f4324fbf700 1 -- 172.21.15.146:0/1279997910 >> v1:172.21.15.146:6789/0 conn(0x7f43200aebc0 legacy=0x7f43200af810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:12.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.798+0000 7f4324fbf700 1 -- 172.21.15.146:0/1279997910 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4320073bd0 con 0x7f4320073760 2023-05-24T03:30:12.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.798+0000 7f4317fff700 1 -- 172.21.15.146:0/1279997910 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3858180918 0 0) 0x7f432006bce0 con 0x7f43200aebc0 2023-05-24T03:30:12.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.798+0000 7f4325fc1700 1 --2- 172.21.15.146:0/1279997910 >> v2:172.21.15.151:3300/0 conn(0x7f432015e7c0 0x7f432015ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:30:12.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.798+0000 7f4324fbf700 1 --2- 172.21.15.146:0/1279997910 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4320073760 0x7f43200711c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f432006c340 tx=0x7f431c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6732311a83e283 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:12.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.798+0000 7f4317fff700 1 -- 172.21.15.146:0/1279997910 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431c011830 con 0x7f4320073760 2023-05-24T03:30:12.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.798+0000 7f4317fff700 1 -- 172.21.15.146:0/1279997910 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f431c011990 con 0x7f4320073760 2023-05-24T03:30:12.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.798+0000 7f4317fff700 1 -- 172.21.15.146:0/1279997910 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431c011d20 con 0x7f4320073760 2023-05-24T03:30:12.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.799+0000 7f4327a24700 1 -- 172.21.15.146:0/1279997910 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4320073760 msgr2=0x7f43200711c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:12.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.799+0000 7f4327a24700 1 --2- 172.21.15.146:0/1279997910 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4320073760 0x7f43200711c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f432006c340 tx=0x7f431c009b20 comp rx=0 tx=0).stop 2023-05-24T03:30:12.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.799+0000 7f4327a24700 1 -- 172.21.15.146:0/1279997910 shutdown_connections 2023-05-24T03:30:12.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.799+0000 7f4327a24700 1 --2- 172.21.15.146:0/1279997910 >> v2:172.21.15.151:3300/0 conn(0x7f432015e7c0 0x7f432015ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:12.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.799+0000 7f4327a24700 1 --2- 172.21.15.146:0/1279997910 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4320073760 0x7f43200711c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:12.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.799+0000 7f4327a24700 1 -- 172.21.15.146:0/1279997910 >> 172.21.15.146:0/1279997910 conn(0x7f43200cf6c0 msgr2=0x7f43200cfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:12.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.799+0000 7f4327a24700 1 -- 172.21.15.146:0/1279997910 shutdown_connections 2023-05-24T03:30:12.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.799+0000 7f4327a24700 1 -- 172.21.15.146:0/1279997910 wait complete. 2023-05-24T03:30:12.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.800+0000 7f4327a24700 1 Processor -- start 2023-05-24T03:30:12.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.800+0000 7f4327a24700 1 -- start start 2023-05-24T03:30:12.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.801+0000 7f4327a24700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4320073760 0x7f43201522a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:12.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.801+0000 7f4327a24700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43200aebc0 0x7f43200c8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:12.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.801+0000 7f4327a24700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f432015e7c0 0x7f43200ca930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:12.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.801+0000 7f4327a24700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43200c88e0 con 0x7f432015e7c0 2023-05-24T03:30:12.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.801+0000 7f4327a24700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43200c7cd0 con 0x7f43200aebc0 2023-05-24T03:30:12.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.801+0000 7f4327a24700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43200c7fb0 con 0x7f4320073760 2023-05-24T03:30:12.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.801+0000 7f4325fc1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f432015e7c0 0x7f43200ca930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:12.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.801+0000 7f4325fc1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f432015e7c0 0x7f43200ca930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39670/0 (socket says 172.21.15.146:39670) 2023-05-24T03:30:12.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.801+0000 7f4325fc1700 1 -- 172.21.15.146:0/3518578786 learned_addr learned my addr 172.21.15.146:0/3518578786 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:12.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.802+0000 7f4324fbf700 1 --2- 172.21.15.146:0/3518578786 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43200aebc0 0x7f43200c8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:12.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.802+0000 7f43257c0700 1 --2- 172.21.15.146:0/3518578786 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4320073760 0x7f43201522a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:12.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.802+0000 7f4325fc1700 1 -- 172.21.15.146:0/3518578786 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4320073760 msgr2=0x7f43201522a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:12.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.802+0000 7f4325fc1700 1 --2- 172.21.15.146:0/3518578786 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4320073760 0x7f43201522a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:12.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.802+0000 7f4325fc1700 1 -- 172.21.15.146:0/3518578786 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43200aebc0 msgr2=0x7f43200c8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:12.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.802+0000 7f4325fc1700 1 --2- 172.21.15.146:0/3518578786 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43200aebc0 0x7f43200c8d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:12.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.802+0000 7f4325fc1700 1 -- 172.21.15.146:0/3518578786 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f431c0094a0 con 0x7f432015e7c0 2023-05-24T03:30:12.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.802+0000 7f4324fbf700 1 --2- 172.21.15.146:0/3518578786 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43200aebc0 0x7f43200c8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:30:12.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.802+0000 7f4325fc1700 1 --2- 172.21.15.146:0/3518578786 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f432015e7c0 0x7f43200ca930 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4318009fa0 tx=0x7f431800d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:12.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.802+0000 7f4315ffb700 1 -- 172.21.15.146:0/3518578786 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4318003a20 con 0x7f432015e7c0 2023-05-24T03:30:12.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.802+0000 7f4315ffb700 1 -- 172.21.15.146:0/3518578786 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f431800f040 con 0x7f432015e7c0 2023-05-24T03:30:12.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.802+0000 7f4327a24700 1 -- 172.21.15.146:0/3518578786 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f432006ba00 con 0x7f432015e7c0 2023-05-24T03:30:12.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.802+0000 7f4315ffb700 1 -- 172.21.15.146:0/3518578786 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4318003de0 con 0x7f432015e7c0 2023-05-24T03:30:12.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.802+0000 7f4327a24700 1 -- 172.21.15.146:0/3518578786 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f432006b720 con 0x7f432015e7c0 2023-05-24T03:30:12.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.803+0000 7f4327a24700 1 -- 172.21.15.146:0/3518578786 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43200af2f0 con 0x7f432015e7c0 2023-05-24T03:30:12.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.803+0000 7f4315ffb700 1 -- 172.21.15.146:0/3518578786 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4318004030 con 0x7f432015e7c0 2023-05-24T03:30:12.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.804+0000 7f4315ffb700 1 --2- 172.21.15.146:0/3518578786 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f430406ace0 0x7f430406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:12.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.804+0000 7f4315ffb700 1 -- 172.21.15.146:0/3518578786 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f43180899a0 con 0x7f432015e7c0 2023-05-24T03:30:12.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.804+0000 7f43257c0700 1 --2- 172.21.15.146:0/3518578786 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f430406ace0 0x7f430406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:12.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.804+0000 7f43257c0700 1 --2- 172.21.15.146:0/3518578786 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f430406ace0 0x7f430406d190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4310000f60 tx=0x7f4310009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:12.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:12.809+0000 7f4315ffb700 1 -- 172.21.15.146:0/3518578786 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f4318054750 con 0x7f432015e7c0 2023-05-24T03:30:12.962 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T03:30:12.964 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T03:30:13.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.004+0000 7f4327a24700 1 -- 172.21.15.146:0/3518578786 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f432004e810 con 0x7f432015e7c0 2023-05-24T03:30:13.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.006+0000 7f4315ffb700 1 -- 172.21.15.146:0/3518578786 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20156 (secure 0 0 0) 0x7f4318057d70 con 0x7f432015e7c0 2023-05-24T03:30:13.010 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:30:13.010 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":28,"fsid":"11ca0adb-7672-4713-bde7-451e8b743ae9","created":"2023-05-24T03:29:19.113659+0000","modified":"2023-05-24T03:29:48.912599+0000","last_up_change":"2023-05-24T03:29:30.962339+0000","last_in_change":"2023-05-24T03:29:21.706540+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-24T03:29:32.749984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-24T03:29:37.719623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-24T03:29:42.165379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-24T03:29:43.431615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-24T03:29:46.503075+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f24b319b-fcc8-4385-b0cb-78138fc31417","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6801","nonce":3353593100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6803","nonce":3353593100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6807","nonce":3353593100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6805","nonce":3353593100}]},"public_addr":"172.21.15.146:6801/3353593100","cluster_addr":"172.21.15.146:6803/3353593100","heartbeat_back_addr":"172.21.15.146:6807/3353593100","heartbeat_front_addr":"172.21.15.146:6805/3353593100","state":["exists","up"]},{"osd":1,"uuid":"c9639ea9-8f9b-498e-92c8-aa976edbf1da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6821","nonce":2537488734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6825","nonce":2537488734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6831","nonce":2537488734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6827","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6829","nonce":2537488734}]},"public_addr":"172.21.15.146:6821/2537488734","cluster_addr":"172.21.15.146:6825/2537488734","heartbeat_back_addr":"172.21.15.146:6831/2537488734","heartbeat_front_addr":"172.21.15.146:6829/2537488734","state":["exists","up"]},{"osd":2,"uuid":"7a6cfc6d-b0ca-4cb6-a66d-4001ec184657","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6809","nonce":1800242932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6811","nonce":1800242932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6815","nonce":1800242932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6813","nonce":1800242932}]},"public_addr":"172.21.15.146:6809/1800242932","cluster_addr":"172.21.15.146:6811/1800242932","heartbeat_back_addr":"172.21.15.146:6815/1800242932","heartbeat_front_addr":"172.21.15.146:6813/1800242932","state":["exists","up"]},{"osd":3,"uuid":"401509f7-cecd-44a2-b0ae-22c81a5d93c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6817","nonce":1749783580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6820","nonce":1749783580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6828","nonce":1749783580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6824","nonce":1749783580}]},"public_addr":"172.21.15.146:6817/1749783580","cluster_addr":"172.21.15.146:6820/1749783580","heartbeat_back_addr":"172.21.15.146:6828/1749783580","heartbeat_front_addr":"172.21.15.146:6824/1749783580","state":["exists","up"]},{"osd":4,"uuid":"9d07f440-d125-4f99-a825-411fab894d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6811","nonce":163453435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6814","nonce":163453435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6819","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6821","nonce":163453435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6818","nonce":163453435}]},"public_addr":"172.21.15.151:6811/163453435","cluster_addr":"172.21.15.151:6814/163453435","heartbeat_back_addr":"172.21.15.151:6821/163453435","heartbeat_front_addr":"172.21.15.151:6818/163453435","state":["exists","up"]},{"osd":5,"uuid":"9b2266e2-9e52-4f0e-96da-e703a6c23a6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6801","nonce":3283474903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6803","nonce":3283474903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6807","nonce":3283474903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6805","nonce":3283474903}]},"public_addr":"172.21.15.151:6801/3283474903","cluster_addr":"172.21.15.151:6803/3283474903","heartbeat_back_addr":"172.21.15.151:6807/3283474903","heartbeat_front_addr":"172.21.15.151:6805/3283474903","state":["exists","up"]},{"osd":6,"uuid":"5daedf77-0a83-49e7-b497-d9ed10436972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6825","nonce":3889424178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6827","nonce":3889424178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6831","nonce":3889424178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6829","nonce":3889424178}]},"public_addr":"172.21.15.151:6825/3889424178","cluster_addr":"172.21.15.151:6827/3889424178","heartbeat_back_addr":"172.21.15.151:6831/3889424178","heartbeat_front_addr":"172.21.15.151:6829/3889424178","state":["exists","up"]},{"osd":7,"uuid":"86ae4f7e-c01f-4c3d-a0dd-98160c209309","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6810","nonce":563291208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6815","nonce":563291208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6823","nonce":563291208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6820","nonce":563291208}]},"public_addr":"172.21.15.151:6810/563291208","cluster_addr":"172.21.15.151:6815/563291208","heartbeat_back_addr":"172.21.15.151:6823/563291208","heartbeat_front_addr":"172.21.15.151:6820/563291208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.872472+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.937126+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.877234+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.884793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.881632+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.938293+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.857661+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.945883+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-24T03:30:13.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.007+0000 7f4327a24700 1 -- 172.21.15.146:0/3518578786 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f430406ace0 msgr2=0x7f430406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:13.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.007+0000 7f4327a24700 1 --2- 172.21.15.146:0/3518578786 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f430406ace0 0x7f430406d190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4310000f60 tx=0x7f4310009040 comp rx=0 tx=0).stop 2023-05-24T03:30:13.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.007+0000 7f4327a24700 1 -- 172.21.15.146:0/3518578786 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f432015e7c0 msgr2=0x7f43200ca930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:13.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.007+0000 7f4327a24700 1 --2- 172.21.15.146:0/3518578786 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f432015e7c0 0x7f43200ca930 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4318009fa0 tx=0x7f431800d460 comp rx=0 tx=0).stop 2023-05-24T03:30:13.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.007+0000 7f4327a24700 1 -- 172.21.15.146:0/3518578786 shutdown_connections 2023-05-24T03:30:13.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.007+0000 7f4327a24700 1 --2- 172.21.15.146:0/3518578786 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f430406ace0 0x7f430406d190 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:13.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.007+0000 7f4327a24700 1 --2- 172.21.15.146:0/3518578786 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f432015e7c0 0x7f43200ca930 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:13.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.007+0000 7f4327a24700 1 --2- 172.21.15.146:0/3518578786 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4320073760 0x7f43201522a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:13.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.007+0000 7f4327a24700 1 --2- 172.21.15.146:0/3518578786 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43200aebc0 0x7f43200c8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:13.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.007+0000 7f4327a24700 1 -- 172.21.15.146:0/3518578786 >> 172.21.15.146:0/3518578786 conn(0x7f43200cf6c0 msgr2=0x7f43200b18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:13.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.007+0000 7f4327a24700 1 -- 172.21.15.146:0/3518578786 shutdown_connections 2023-05-24T03:30:13.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.008+0000 7f4327a24700 1 -- 172.21.15.146:0/3518578786 wait complete. 2023-05-24T03:30:13.024 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-24T03:29:32.749984+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-24T03:29:37.719623+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-24T03:29:42.165379+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-24T03:29:43.431615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-24T03:29:46.503075+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-24T03:30:13.025 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-24T03:30:13.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.184+0000 7f7ee455c700 1 Processor -- start 2023-05-24T03:30:13.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.184+0000 7f7ee455c700 1 -- start start 2023-05-24T03:30:13.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.186+0000 7f7ee455c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7edc0d0110 0x7f7edc0ce110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:13.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.186+0000 7f7ee455c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7edc0cd950 con 0x7f7edc0b2d00 2023-05-24T03:30:13.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.186+0000 7f7ee455c700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7edc0b36b0 con 0x7f7edc15af00 2023-05-24T03:30:13.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.186+0000 7f7ee455c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7edc0b3990 con 0x7f7edc0d0110 2023-05-24T03:30:13.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.186+0000 7f7ee2af9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7edc0d0110 0x7f7edc0ce110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:13.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.186+0000 7f7ee1af7700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f7edc0b2d00 0x7f7edc0d0660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46128/0 (socket says 172.21.15.146:46128) 2023-05-24T03:30:13.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.186+0000 7f7ee1af7700 1 -- 172.21.15.146:0/3033092906 learned_addr learned my addr 172.21.15.146:0/3033092906 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:30:13.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.186+0000 7f7ee2af9700 1 -- 172.21.15.146:0/3033092906 >> v1:172.21.15.151:6789/0 conn(0x7f7edc15af00 legacy=0x7f7edc15e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:13.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.186+0000 7f7ee2af9700 1 -- 172.21.15.146:0/3033092906 >> v1:172.21.15.146:6789/0 conn(0x7f7edc0b2d00 legacy=0x7f7edc0d0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:13.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.186+0000 7f7ee2af9700 1 -- 172.21.15.146:0/3033092906 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7edc15f6b0 con 0x7f7edc0d0110 2023-05-24T03:30:13.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.186+0000 7f7ee2af9700 1 --2- 172.21.15.146:0/3033092906 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7edc0d0110 0x7f7edc0ce110 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4009d90 tx=0x7f7ed400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8155ae9c3b209d4d server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:13.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.186+0000 7f7ee12f6700 1 -- 172.21.15.146:0/3033092906 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed400e070 con 0x7f7edc0d0110 2023-05-24T03:30:13.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.186+0000 7f7ee12f6700 1 -- 172.21.15.146:0/3033092906 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed400bbd0 con 0x7f7edc0d0110 2023-05-24T03:30:13.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.186+0000 7f7ee12f6700 1 -- 172.21.15.146:0/3033092906 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed4012430 con 0x7f7edc0d0110 2023-05-24T03:30:13.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.186+0000 7f7ee455c700 1 -- 172.21.15.146:0/3033092906 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7edc0d0110 msgr2=0x7f7edc0ce110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:13.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.186+0000 7f7ee455c700 1 --2- 172.21.15.146:0/3033092906 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7edc0d0110 0x7f7edc0ce110 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4009d90 tx=0x7f7ed400b330 comp rx=0 tx=0).stop 2023-05-24T03:30:13.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.186+0000 7f7ee455c700 1 -- 172.21.15.146:0/3033092906 shutdown_connections 2023-05-24T03:30:13.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.186+0000 7f7ee455c700 1 --2- 172.21.15.146:0/3033092906 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7edc0d0110 0x7f7edc0ce110 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:13.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.186+0000 7f7ee455c700 1 -- 172.21.15.146:0/3033092906 >> 172.21.15.146:0/3033092906 conn(0x7f7edc06e2a0 msgr2=0x7f7edc06e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:13.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.186+0000 7f7ee455c700 1 -- 172.21.15.146:0/3033092906 shutdown_connections 2023-05-24T03:30:13.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.186+0000 7f7ee455c700 1 -- 172.21.15.146:0/3033092906 wait complete. 2023-05-24T03:30:13.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.187+0000 7f7ee455c700 1 Processor -- start 2023-05-24T03:30:13.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.187+0000 7f7ee455c700 1 -- start start 2023-05-24T03:30:13.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.188+0000 7f7ee455c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7edc0b2d00 0x7f7edc0c54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:13.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.188+0000 7f7ee455c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7edc0d0110 0x7f7edc0c4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:13.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.188+0000 7f7ee455c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7edc15af00 0x7f7edc1efe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:13.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.188+0000 7f7ee455c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc0c5180 con 0x7f7edc0d0110 2023-05-24T03:30:13.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.188+0000 7f7ee455c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc1f0390 con 0x7f7edc15af00 2023-05-24T03:30:13.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.188+0000 7f7ee455c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc0c8840 con 0x7f7edc0b2d00 2023-05-24T03:30:13.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.188+0000 7f7ee1af7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7edc0d0110 0x7f7edc0c4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:13.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.188+0000 7f7ee1af7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7edc0d0110 0x7f7edc0c4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39682/0 (socket says 172.21.15.146:39682) 2023-05-24T03:30:13.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.188+0000 7f7ee1af7700 1 -- 172.21.15.146:0/4239968074 learned_addr learned my addr 172.21.15.146:0/4239968074 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:13.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.188+0000 7f7ee22f8700 1 --2- 172.21.15.146:0/4239968074 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7edc0b2d00 0x7f7edc0c54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:13.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.188+0000 7f7ee2af9700 1 --2- 172.21.15.146:0/4239968074 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7edc15af00 0x7f7edc1efe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:13.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.188+0000 7f7ee1af7700 1 -- 172.21.15.146:0/4239968074 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7edc0b2d00 msgr2=0x7f7edc0c54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:13.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.188+0000 7f7ee1af7700 1 --2- 172.21.15.146:0/4239968074 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7edc0b2d00 0x7f7edc0c54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:13.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.188+0000 7f7ee1af7700 1 -- 172.21.15.146:0/4239968074 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7edc15af00 msgr2=0x7f7edc1efe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:13.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.188+0000 7f7ee1af7700 1 --2- 172.21.15.146:0/4239968074 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7edc15af00 0x7f7edc1efe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:13.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.188+0000 7f7ee1af7700 1 -- 172.21.15.146:0/4239968074 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed4009a70 con 0x7f7edc0d0110 2023-05-24T03:30:13.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.188+0000 7f7ee2af9700 1 --2- 172.21.15.146:0/4239968074 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7edc15af00 0x7f7edc1efe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:30:13.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.189+0000 7f7ee1af7700 1 --2- 172.21.15.146:0/4239968074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7edc0d0110 0x7f7edc0c4c40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc00c4b0 tx=0x7f7ecc00c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:13.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.189+0000 7f7ed2ffd700 1 -- 172.21.15.146:0/4239968074 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc005d70 con 0x7f7edc0d0110 2023-05-24T03:30:13.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.189+0000 7f7ed2ffd700 1 -- 172.21.15.146:0/4239968074 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ecc0070d0 con 0x7f7edc0d0110 2023-05-24T03:30:13.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.189+0000 7f7ed2ffd700 1 -- 172.21.15.146:0/4239968074 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc007440 con 0x7f7edc0d0110 2023-05-24T03:30:13.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.189+0000 7f7ee455c700 1 -- 172.21.15.146:0/4239968074 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7edc0cb970 con 0x7f7edc0d0110 2023-05-24T03:30:13.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.189+0000 7f7ee455c700 1 -- 172.21.15.146:0/4239968074 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7edc0cdbf0 con 0x7f7edc0d0110 2023-05-24T03:30:13.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.190+0000 7f7ee455c700 1 -- 172.21.15.146:0/4239968074 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7edc15efb0 con 0x7f7edc0d0110 2023-05-24T03:30:13.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.190+0000 7f7ed2ffd700 1 -- 172.21.15.146:0/4239968074 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7ecc0075a0 con 0x7f7edc0d0110 2023-05-24T03:30:13.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.190+0000 7f7ed2ffd700 1 --2- 172.21.15.146:0/4239968074 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f7ec006ace0 0x7f7ec006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:13.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.191+0000 7f7ed2ffd700 1 -- 172.21.15.146:0/4239968074 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7ecc0889e0 con 0x7f7edc0d0110 2023-05-24T03:30:13.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.191+0000 7f7ee22f8700 1 --2- 172.21.15.146:0/4239968074 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f7ec006ace0 0x7f7ec006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:13.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.191+0000 7f7ee22f8700 1 --2- 172.21.15.146:0/4239968074 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f7ec006ace0 0x7f7ec006d190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8007fd0 tx=0x7f7ed8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:13.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.195+0000 7f7ed2ffd700 1 -- 172.21.15.146:0/4239968074 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f7ecc053850 con 0x7f7edc0d0110 2023-05-24T03:30:13.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.384+0000 7f7ee455c700 1 -- 172.21.15.146:0/4239968074 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7edc0c89b0 con 0x7f7edc0d0110 2023-05-24T03:30:13.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.386+0000 7f7ed2ffd700 1 -- 172.21.15.146:0/4239968074 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7ecc056e70 con 0x7f7edc0d0110 2023-05-24T03:30:13.390 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2023-05-24T03:30:13.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.388+0000 7f7ee455c700 1 -- 172.21.15.146:0/4239968074 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f7ec006ace0 msgr2=0x7f7ec006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:13.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.388+0000 7f7ee455c700 1 --2- 172.21.15.146:0/4239968074 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f7ec006ace0 0x7f7ec006d190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8007fd0 tx=0x7f7ed8009040 comp rx=0 tx=0).stop 2023-05-24T03:30:13.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.388+0000 7f7ee455c700 1 -- 172.21.15.146:0/4239968074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7edc0d0110 msgr2=0x7f7edc0c4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:13.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.388+0000 7f7ee455c700 1 --2- 172.21.15.146:0/4239968074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7edc0d0110 0x7f7edc0c4c40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc00c4b0 tx=0x7f7ecc00c7c0 comp rx=0 tx=0).stop 2023-05-24T03:30:13.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.388+0000 7f7ee455c700 1 -- 172.21.15.146:0/4239968074 shutdown_connections 2023-05-24T03:30:13.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.388+0000 7f7ee455c700 1 --2- 172.21.15.146:0/4239968074 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f7ec006ace0 0x7f7ec006d190 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:13.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.388+0000 7f7ee455c700 1 --2- 172.21.15.146:0/4239968074 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7edc15af00 0x7f7edc1efe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:13.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.388+0000 7f7ee455c700 1 --2- 172.21.15.146:0/4239968074 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7edc0b2d00 0x7f7edc0c54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:13.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.388+0000 7f7ee455c700 1 --2- 172.21.15.146:0/4239968074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7edc0d0110 0x7f7edc0c4c40 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:13.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.388+0000 7f7ee455c700 1 -- 172.21.15.146:0/4239968074 >> 172.21.15.146:0/4239968074 conn(0x7f7edc06e2a0 msgr2=0x7f7edc0b1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:13.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.388+0000 7f7ee455c700 1 -- 172.21.15.146:0/4239968074 shutdown_connections 2023-05-24T03:30:13.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.388+0000 7f7ee455c700 1 -- 172.21.15.146:0/4239968074 wait complete. 2023-05-24T03:30:13.403 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-24T03:30:13.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.524+0000 7f32b17f8700 1 Processor -- start 2023-05-24T03:30:13.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.524+0000 7f32b17f8700 1 -- start start 2023-05-24T03:30:13.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.525+0000 7f32b17f8700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32ac06baa0 0x7f32ac0cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:13.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.525+0000 7f32b17f8700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32ac0cd960 con 0x7f32ac0d2a30 2023-05-24T03:30:13.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.525+0000 7f32b17f8700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32ac1612b0 con 0x7f32ac0d0240 2023-05-24T03:30:13.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.525+0000 7f32b17f8700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac0cdc00 con 0x7f32ac06baa0 2023-05-24T03:30:13.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.525+0000 7f32aaffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f32ac0d2a30 0x7f32ac0cfb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46140/0 (socket says 172.21.15.146:46140) 2023-05-24T03:30:13.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.525+0000 7f32aaffd700 1 -- 172.21.15.146:0/3634163550 learned_addr learned my addr 172.21.15.146:0/3634163550 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:30:13.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.525+0000 7f32aa7fc700 1 --2- 172.21.15.146:0/3634163550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32ac06baa0 0x7f32ac0cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:13.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.525+0000 7f32a9ffb700 1 -- 172.21.15.146:0/3634163550 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1538235921 0 0) 0x7f32ac0cd960 con 0x7f32ac0d2a30 2023-05-24T03:30:13.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.525+0000 7f32a9ffb700 1 -- 172.21.15.146:0/3634163550 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32940035b0 con 0x7f32ac0d2a30 2023-05-24T03:30:13.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.525+0000 7f32a9ffb700 1 -- 172.21.15.146:0/3634163550 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 840607757 0 0) 0x7f32940035b0 con 0x7f32ac0d2a30 2023-05-24T03:30:13.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.525+0000 7f32a9ffb700 1 -- 172.21.15.146:0/3634163550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32ac06baa0 msgr2=0x7f32ac0cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:13.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.525+0000 7f32a9ffb700 1 --2- 172.21.15.146:0/3634163550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32ac06baa0 0x7f32ac0cf530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:13.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.525+0000 7f32a9ffb700 1 -- 172.21.15.146:0/3634163550 >> v1:172.21.15.151:6789/0 conn(0x7f32ac0d0240 legacy=0x7f32ac0b80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:13.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.525+0000 7f32a9ffb700 1 -- 172.21.15.146:0/3634163550 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32ac161590 con 0x7f32ac0d2a30 2023-05-24T03:30:13.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.525+0000 7f32a9ffb700 1 -- 172.21.15.146:0/3634163550 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1301887351 0 0) 0x7f329c0017f0 con 0x7f32ac0d2a30 2023-05-24T03:30:13.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.525+0000 7f32a9ffb700 1 -- 172.21.15.146:0/3634163550 >> v1:172.21.15.146:6789/0 conn(0x7f32ac0d2a30 legacy=0x7f32ac0cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:13.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.525+0000 7f32a9ffb700 1 --2- 172.21.15.146:0/3634163550 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3294003a30 0x7f3294003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:13.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.525+0000 7f32a9ffb700 1 --2- 172.21.15.146:0/3634163550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32ac06baa0 0x7f3294004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:13.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.525+0000 7f32a9ffb700 1 --2- 172.21.15.146:0/3634163550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3294004d90 0x7f3294005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:13.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.525+0000 7f32a9ffb700 1 -- 172.21.15.146:0/3634163550 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac0cdc00 con 0x7f3294003a30 2023-05-24T03:30:13.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.525+0000 7f32a9ffb700 1 -- 172.21.15.146:0/3634163550 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f329400ba10 con 0x7f3294004d90 2023-05-24T03:30:13.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.525+0000 7f32a9ffb700 1 -- 172.21.15.146:0/3634163550 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f329400bbd0 con 0x7f32ac06baa0 2023-05-24T03:30:13.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.525+0000 7f32aaffd700 1 --2- 172.21.15.146:0/3634163550 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3294003a30 0x7f3294003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:13.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.526+0000 7f32aa7fc700 1 --2- 172.21.15.146:0/3634163550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32ac06baa0 0x7f3294004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:13.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.526+0000 7f32ab7fe700 1 --2- 172.21.15.146:0/3634163550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3294004d90 0x7f3294005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:13.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.526+0000 7f32aaffd700 1 -- 172.21.15.146:0/3634163550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32ac06baa0 msgr2=0x7f3294004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:13.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.526+0000 7f32aaffd700 1 --2- 172.21.15.146:0/3634163550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32ac06baa0 0x7f3294004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:13.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.526+0000 7f32aaffd700 1 -- 172.21.15.146:0/3634163550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3294004d90 msgr2=0x7f3294005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:13.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.526+0000 7f32aaffd700 1 --2- 172.21.15.146:0/3634163550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3294004d90 0x7f3294005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:13.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.526+0000 7f32aaffd700 1 -- 172.21.15.146:0/3634163550 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32940035b0 con 0x7f3294003a30 2023-05-24T03:30:13.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.526+0000 7f32aaffd700 1 --2- 172.21.15.146:0/3634163550 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3294003a30 0x7f3294003e00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f329c007960 tx=0x7f3294005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1f3d18b34b87d7f server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:13.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.526+0000 7f32a9ffb700 1 -- 172.21.15.146:0/3634163550 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329c017070 con 0x7f3294003a30 2023-05-24T03:30:13.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.526+0000 7f32a9ffb700 1 -- 172.21.15.146:0/3634163550 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f329c012bd0 con 0x7f3294003a30 2023-05-24T03:30:13.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.526+0000 7f32a9ffb700 1 -- 172.21.15.146:0/3634163550 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329c0122f0 con 0x7f3294003a30 2023-05-24T03:30:13.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.527+0000 7f32b17f8700 1 -- 172.21.15.146:0/3634163550 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3294003a30 msgr2=0x7f3294003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:13.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.527+0000 7f32b17f8700 1 --2- 172.21.15.146:0/3634163550 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3294003a30 0x7f3294003e00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f329c007960 tx=0x7f3294005880 comp rx=0 tx=0).stop 2023-05-24T03:30:13.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.527+0000 7f32ab7fe700 1 -- 172.21.15.146:0/3634163550 reap_dead start 2023-05-24T03:30:13.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.527+0000 7f32b17f8700 1 -- 172.21.15.146:0/3634163550 shutdown_connections 2023-05-24T03:30:13.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.527+0000 7f32b17f8700 1 -- 172.21.15.146:0/3634163550 >> 172.21.15.146:0/3634163550 conn(0x7f32ac0743a0 msgr2=0x7f32ac06af50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:13.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.527+0000 7f32b17f8700 1 -- 172.21.15.146:0/3634163550 shutdown_connections 2023-05-24T03:30:13.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.527+0000 7f32b17f8700 1 -- 172.21.15.146:0/3634163550 wait complete. 2023-05-24T03:30:13.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.528+0000 7f32b17f8700 1 Processor -- start 2023-05-24T03:30:13.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.528+0000 7f32b17f8700 1 -- start start 2023-05-24T03:30:13.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.529+0000 7f32b17f8700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3294003a30 0x7f32ac1597b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:13.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.529+0000 7f32b17f8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32ac0c92b0 0x7f32ac0c9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:13.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.529+0000 7f32b17f8700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32ac15b740 0x7f32ac15bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:13.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.529+0000 7f32b17f8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac0cb2a0 con 0x7f32ac0c92b0 2023-05-24T03:30:13.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.529+0000 7f32b17f8700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac15c120 con 0x7f3294003a30 2023-05-24T03:30:13.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.529+0000 7f32b17f8700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac0ca340 con 0x7f32ac15b740 2023-05-24T03:30:13.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.529+0000 7f32aa7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32ac0c92b0 0x7f32ac0c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:13.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.529+0000 7f32aa7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32ac0c92b0 0x7f32ac0c9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39702/0 (socket says 172.21.15.146:39702) 2023-05-24T03:30:13.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.529+0000 7f32aa7fc700 1 -- 172.21.15.146:0/2281386057 learned_addr learned my addr 172.21.15.146:0/2281386057 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:13.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.529+0000 7f32aaffd700 1 --2- 172.21.15.146:0/2281386057 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3294003a30 0x7f32ac1597b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:13.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.529+0000 7f32ab7fe700 1 --2- 172.21.15.146:0/2281386057 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32ac15b740 0x7f32ac15bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:13.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.529+0000 7f32aa7fc700 1 -- 172.21.15.146:0/2281386057 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32ac15b740 msgr2=0x7f32ac15bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:13.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.529+0000 7f32aa7fc700 1 --2- 172.21.15.146:0/2281386057 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32ac15b740 0x7f32ac15bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:13.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.529+0000 7f32aa7fc700 1 -- 172.21.15.146:0/2281386057 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3294003a30 msgr2=0x7f32ac1597b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:13.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.529+0000 7f32aa7fc700 1 --2- 172.21.15.146:0/2281386057 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3294003a30 0x7f32ac1597b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:13.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.529+0000 7f32aa7fc700 1 -- 172.21.15.146:0/2281386057 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32ac1469e0 con 0x7f32ac0c92b0 2023-05-24T03:30:13.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.529+0000 7f32ab7fe700 1 --2- 172.21.15.146:0/2281386057 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32ac15b740 0x7f32ac15bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:30:13.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.529+0000 7f32aa7fc700 1 --2- 172.21.15.146:0/2281386057 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32ac0c92b0 0x7f32ac0c9720 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f32a0011ad0 tx=0x7f32a0011de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:13.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.529+0000 7f32937fe700 1 -- 172.21.15.146:0/2281386057 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a000f8e0 con 0x7f32ac0c92b0 2023-05-24T03:30:13.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.529+0000 7f32937fe700 1 -- 172.21.15.146:0/2281386057 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a000fa40 con 0x7f32ac0c92b0 2023-05-24T03:30:13.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.529+0000 7f32b17f8700 1 -- 172.21.15.146:0/2281386057 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32ac146850 con 0x7f32ac0c92b0 2023-05-24T03:30:13.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.530+0000 7f32937fe700 1 -- 172.21.15.146:0/2281386057 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a000fdf0 con 0x7f32ac0c92b0 2023-05-24T03:30:13.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.530+0000 7f32b17f8700 1 -- 172.21.15.146:0/2281386057 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32ac0d1e50 con 0x7f32ac0c92b0 2023-05-24T03:30:13.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.530+0000 7f32b17f8700 1 -- 172.21.15.146:0/2281386057 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32ac072ae0 con 0x7f32ac0c92b0 2023-05-24T03:30:13.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.531+0000 7f32937fe700 1 -- 172.21.15.146:0/2281386057 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f32a0014440 con 0x7f32ac0c92b0 2023-05-24T03:30:13.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.531+0000 7f32937fe700 1 --2- 172.21.15.146:0/2281386057 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f329806ace0 0x7f329806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:13.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.531+0000 7f32aaffd700 1 --2- 172.21.15.146:0/2281386057 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f329806ace0 0x7f329806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:13.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.531+0000 7f32937fe700 1 -- 172.21.15.146:0/2281386057 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f32a0089d10 con 0x7f32ac0c92b0 2023-05-24T03:30:13.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.532+0000 7f32aaffd700 1 --2- 172.21.15.146:0/2281386057 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f329806ace0 0x7f329806d190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f32ac15a740 tx=0x7f329c018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:13.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.536+0000 7f32937fe700 1 -- 172.21.15.146:0/2281386057 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f32a008f020 con 0x7f32ac0c92b0 2023-05-24T03:30:13.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.722+0000 7f32b17f8700 1 -- 172.21.15.146:0/2281386057 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f32ac068d00 con 0x7f32ac0c92b0 2023-05-24T03:30:13.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.722+0000 7f32937fe700 1 -- 172.21.15.146:0/2281386057 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f32a00220a0 con 0x7f32ac0c92b0 2023-05-24T03:30:13.727 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2023-05-24T03:30:13.729 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.724+0000 7f32b17f8700 1 -- 172.21.15.146:0/2281386057 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f329806ace0 msgr2=0x7f329806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:13.729 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.724+0000 7f32b17f8700 1 --2- 172.21.15.146:0/2281386057 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f329806ace0 0x7f329806d190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f32ac15a740 tx=0x7f329c018000 comp rx=0 tx=0).stop 2023-05-24T03:30:13.729 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.724+0000 7f32b17f8700 1 -- 172.21.15.146:0/2281386057 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32ac0c92b0 msgr2=0x7f32ac0c9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:13.729 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.724+0000 7f32b17f8700 1 --2- 172.21.15.146:0/2281386057 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32ac0c92b0 0x7f32ac0c9720 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f32a0011ad0 tx=0x7f32a0011de0 comp rx=0 tx=0).stop 2023-05-24T03:30:13.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.724+0000 7f32b17f8700 1 -- 172.21.15.146:0/2281386057 shutdown_connections 2023-05-24T03:30:13.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.724+0000 7f32b17f8700 1 --2- 172.21.15.146:0/2281386057 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f329806ace0 0x7f329806d190 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:13.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.724+0000 7f32b17f8700 1 --2- 172.21.15.146:0/2281386057 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32ac15b740 0x7f32ac15bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:13.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.724+0000 7f32b17f8700 1 --2- 172.21.15.146:0/2281386057 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3294003a30 0x7f32ac1597b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:13.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.724+0000 7f32b17f8700 1 --2- 172.21.15.146:0/2281386057 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32ac0c92b0 0x7f32ac0c9720 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:13.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.724+0000 7f32b17f8700 1 -- 172.21.15.146:0/2281386057 >> 172.21.15.146:0/2281386057 conn(0x7f32ac0743a0 msgr2=0x7f32ac15e370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:13.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.724+0000 7f32b17f8700 1 -- 172.21.15.146:0/2281386057 shutdown_connections 2023-05-24T03:30:13.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.724+0000 7f32b17f8700 1 -- 172.21.15.146:0/2281386057 wait complete. 2023-05-24T03:30:13.740 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-24T03:30:13.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.861+0000 7fed52589700 1 Processor -- start 2023-05-24T03:30:13.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.861+0000 7fed52589700 1 -- start start 2023-05-24T03:30:13.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.862+0000 7fed52589700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fed4c0b2d00 0x7fed4c0ce110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:13.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.862+0000 7fed52589700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed4c0cd950 con 0x7fed4c0d0110 2023-05-24T03:30:13.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.862+0000 7fed52589700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed4c0b36b0 con 0x7fed4c15af00 2023-05-24T03:30:13.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.862+0000 7fed52589700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c0b3990 con 0x7fed4c0b2d00 2023-05-24T03:30:13.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.862+0000 7fed50b26700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fed4c0d0110 0x7fed4c0d0660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46164/0 (socket says 172.21.15.146:46164) 2023-05-24T03:30:13.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.862+0000 7fed50b26700 1 -- 172.21.15.146:0/1709793541 learned_addr learned my addr 172.21.15.146:0/1709793541 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:30:13.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.862+0000 7fed4b7fe700 1 --2- 172.21.15.146:0/1709793541 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fed4c0b2d00 0x7fed4c0ce110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:13.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.862+0000 7fed4affd700 1 -- 172.21.15.146:0/1709793541 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3356419327 0 0) 0x7fed4c0cd950 con 0x7fed4c0d0110 2023-05-24T03:30:13.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.862+0000 7fed4affd700 1 -- 172.21.15.146:0/1709793541 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed340035b0 con 0x7fed4c0d0110 2023-05-24T03:30:13.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.862+0000 7fed4affd700 1 -- 172.21.15.146:0/1709793541 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2820649670 0 0) 0x7fed340035b0 con 0x7fed4c0d0110 2023-05-24T03:30:13.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.862+0000 7fed4affd700 1 -- 172.21.15.146:0/1709793541 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fed4c0b2d00 msgr2=0x7fed4c0ce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:13.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.862+0000 7fed4affd700 1 --2- 172.21.15.146:0/1709793541 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fed4c0b2d00 0x7fed4c0ce110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:13.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.862+0000 7fed4affd700 1 -- 172.21.15.146:0/1709793541 >> v1:172.21.15.151:6789/0 conn(0x7fed4c15af00 legacy=0x7fed4c15e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:13.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.862+0000 7fed4affd700 1 -- 172.21.15.146:0/1709793541 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed4c15f6b0 con 0x7fed4c0d0110 2023-05-24T03:30:13.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.862+0000 7fed4affd700 1 -- 172.21.15.146:0/1709793541 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1301887351 0 0) 0x7fed440019f0 con 0x7fed4c0d0110 2023-05-24T03:30:13.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.862+0000 7fed4affd700 1 -- 172.21.15.146:0/1709793541 >> v1:172.21.15.146:6789/0 conn(0x7fed4c0d0110 legacy=0x7fed4c0d0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:13.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.862+0000 7fed4affd700 1 --2- 172.21.15.146:0/1709793541 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed34003a30 0x7fed34003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:13.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.862+0000 7fed4affd700 1 --2- 172.21.15.146:0/1709793541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fed340043d0 0x7fed34004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:13.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.862+0000 7fed4affd700 1 --2- 172.21.15.146:0/1709793541 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fed4c0b2d00 0x7fed340050f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:13.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.862+0000 7fed4affd700 1 -- 172.21.15.146:0/1709793541 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c0b3990 con 0x7fed34003a30 2023-05-24T03:30:13.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.862+0000 7fed4affd700 1 -- 172.21.15.146:0/1709793541 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed3400ba10 con 0x7fed340043d0 2023-05-24T03:30:13.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.862+0000 7fed4affd700 1 -- 172.21.15.146:0/1709793541 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed3400bba0 con 0x7fed4c0b2d00 2023-05-24T03:30:13.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.862+0000 7fed4bfff700 1 --2- 172.21.15.146:0/1709793541 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed34003a30 0x7fed34003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:13.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.863+0000 7fed4b7fe700 1 --2- 172.21.15.146:0/1709793541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fed340043d0 0x7fed34004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:13.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.863+0000 7fed50b26700 1 --2- 172.21.15.146:0/1709793541 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fed4c0b2d00 0x7fed340050f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:13.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.863+0000 7fed4bfff700 1 -- 172.21.15.146:0/1709793541 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fed4c0b2d00 msgr2=0x7fed340050f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:13.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.863+0000 7fed4bfff700 1 --2- 172.21.15.146:0/1709793541 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fed4c0b2d00 0x7fed340050f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:13.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.863+0000 7fed4bfff700 1 -- 172.21.15.146:0/1709793541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fed340043d0 msgr2=0x7fed34004890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:13.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.863+0000 7fed4bfff700 1 --2- 172.21.15.146:0/1709793541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fed340043d0 0x7fed34004890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:13.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.863+0000 7fed4bfff700 1 -- 172.21.15.146:0/1709793541 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed340035b0 con 0x7fed34003a30 2023-05-24T03:30:13.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.863+0000 7fed4bfff700 1 --2- 172.21.15.146:0/1709793541 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed34003a30 0x7fed34003e00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fed3c0018b0 tx=0x7fed34005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aba67a5bced5c0f server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:13.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.863+0000 7fed4affd700 1 -- 172.21.15.146:0/1709793541 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed3c001370 con 0x7fed34003a30 2023-05-24T03:30:13.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.863+0000 7fed4affd700 1 -- 172.21.15.146:0/1709793541 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed3c00c6b0 con 0x7fed34003a30 2023-05-24T03:30:13.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.863+0000 7fed4affd700 1 -- 172.21.15.146:0/1709793541 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed3c00ca60 con 0x7fed34003a30 2023-05-24T03:30:13.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.864+0000 7fed52589700 1 -- 172.21.15.146:0/1709793541 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed34003a30 msgr2=0x7fed34003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:13.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.864+0000 7fed52589700 1 --2- 172.21.15.146:0/1709793541 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed34003a30 0x7fed34003e00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fed3c0018b0 tx=0x7fed34005880 comp rx=0 tx=0).stop 2023-05-24T03:30:13.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.864+0000 7fed50b26700 1 -- 172.21.15.146:0/1709793541 reap_dead start 2023-05-24T03:30:13.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.864+0000 7fed52589700 1 -- 172.21.15.146:0/1709793541 shutdown_connections 2023-05-24T03:30:13.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.864+0000 7fed52589700 1 -- 172.21.15.146:0/1709793541 >> 172.21.15.146:0/1709793541 conn(0x7fed4c06e2a0 msgr2=0x7fed4c06e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:13.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.864+0000 7fed52589700 1 -- 172.21.15.146:0/1709793541 shutdown_connections 2023-05-24T03:30:13.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.864+0000 7fed52589700 1 -- 172.21.15.146:0/1709793541 wait complete. 2023-05-24T03:30:13.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.865+0000 7fed52589700 1 Processor -- start 2023-05-24T03:30:13.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.865+0000 7fed52589700 1 -- start start 2023-05-24T03:30:13.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.866+0000 7fed52589700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fed34003a30 0x7fed4c1599f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:13.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.866+0000 7fed52589700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fed4c15d140 0x7fed4c15d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:13.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.866+0000 7fed52589700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed4c15b2d0 0x7fed4c15b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:13.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.866+0000 7fed52589700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c06b7a0 con 0x7fed4c15b2d0 2023-05-24T03:30:13.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.866+0000 7fed52589700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c15e450 con 0x7fed4c15d140 2023-05-24T03:30:13.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.866+0000 7fed52589700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c15dbb0 con 0x7fed34003a30 2023-05-24T03:30:13.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.866+0000 7fed50b26700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed4c15b2d0 0x7fed4c15b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:13.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.866+0000 7fed50b26700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed4c15b2d0 0x7fed4c15b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39724/0 (socket says 172.21.15.146:39724) 2023-05-24T03:30:13.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.866+0000 7fed50b26700 1 -- 172.21.15.146:0/4033486541 learned_addr learned my addr 172.21.15.146:0/4033486541 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:13.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.866+0000 7fed4bfff700 1 --2- 172.21.15.146:0/4033486541 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fed34003a30 0x7fed4c1599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:13.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.866+0000 7fed4b7fe700 1 --2- 172.21.15.146:0/4033486541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fed4c15d140 0x7fed4c15d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:13.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.866+0000 7fed50b26700 1 -- 172.21.15.146:0/4033486541 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fed34003a30 msgr2=0x7fed4c1599f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:13.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.866+0000 7fed50b26700 1 --2- 172.21.15.146:0/4033486541 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fed34003a30 0x7fed4c1599f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:13.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.866+0000 7fed50b26700 1 -- 172.21.15.146:0/4033486541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fed4c15d140 msgr2=0x7fed4c15d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:13.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.866+0000 7fed50b26700 1 --2- 172.21.15.146:0/4033486541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fed4c15d140 0x7fed4c15d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:13.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.866+0000 7fed50b26700 1 -- 172.21.15.146:0/4033486541 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed4c0cb970 con 0x7fed4c15b2d0 2023-05-24T03:30:13.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.866+0000 7fed50b26700 1 --2- 172.21.15.146:0/4033486541 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed4c15b2d0 0x7fed4c15b740 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fed44000f80 tx=0x7fed4400a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:13.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.866+0000 7fed48ff9700 1 -- 172.21.15.146:0/4033486541 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4400ad50 con 0x7fed4c15b2d0 2023-05-24T03:30:13.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.866+0000 7fed48ff9700 1 -- 172.21.15.146:0/4033486541 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed440133f0 con 0x7fed4c15b2d0 2023-05-24T03:30:13.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.866+0000 7fed52589700 1 -- 172.21.15.146:0/4033486541 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed4c0cdbf0 con 0x7fed4c15b2d0 2023-05-24T03:30:13.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.866+0000 7fed48ff9700 1 -- 172.21.15.146:0/4033486541 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed440137a0 con 0x7fed4c15b2d0 2023-05-24T03:30:13.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.867+0000 7fed52589700 1 -- 172.21.15.146:0/4033486541 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed4c0ce110 con 0x7fed4c15b2d0 2023-05-24T03:30:13.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.868+0000 7fed52589700 1 -- 172.21.15.146:0/4033486541 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed4c06b8e0 con 0x7fed4c15b2d0 2023-05-24T03:30:13.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.868+0000 7fed48ff9700 1 -- 172.21.15.146:0/4033486541 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fed44013900 con 0x7fed4c15b2d0 2023-05-24T03:30:13.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.868+0000 7fed48ff9700 1 --2- 172.21.15.146:0/4033486541 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fed3806ad10 0x7fed3806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:13.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.868+0000 7fed48ff9700 1 -- 172.21.15.146:0/4033486541 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fed4408a1f0 con 0x7fed4c15b2d0 2023-05-24T03:30:13.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.868+0000 7fed4bfff700 1 --2- 172.21.15.146:0/4033486541 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fed3806ad10 0x7fed3806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:13.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.869+0000 7fed4bfff700 1 --2- 172.21.15.146:0/4033486541 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fed3806ad10 0x7fed3806d1c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fed3c0018b0 tx=0x7fed3c005040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:13.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:13.873+0000 7fed48ff9700 1 -- 172.21.15.146:0/4033486541 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fed4c06b8e0 con 0x7fed4c15b2d0 2023-05-24T03:30:14.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.061+0000 7fed52589700 1 -- 172.21.15.146:0/4033486541 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fed4c06b8e0 con 0x7fed4c15b2d0 2023-05-24T03:30:14.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.061+0000 7fed48ff9700 1 -- 172.21.15.146:0/4033486541 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fed4c06b8e0 con 0x7fed4c15b2d0 2023-05-24T03:30:14.065 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2023-05-24T03:30:14.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.063+0000 7fed52589700 1 -- 172.21.15.146:0/4033486541 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fed3806ad10 msgr2=0x7fed3806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:14.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.063+0000 7fed52589700 1 --2- 172.21.15.146:0/4033486541 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fed3806ad10 0x7fed3806d1c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fed3c0018b0 tx=0x7fed3c005040 comp rx=0 tx=0).stop 2023-05-24T03:30:14.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.063+0000 7fed52589700 1 -- 172.21.15.146:0/4033486541 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed4c15b2d0 msgr2=0x7fed4c15b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:14.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.063+0000 7fed52589700 1 --2- 172.21.15.146:0/4033486541 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed4c15b2d0 0x7fed4c15b740 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fed44000f80 tx=0x7fed4400a640 comp rx=0 tx=0).stop 2023-05-24T03:30:14.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.063+0000 7fed52589700 1 -- 172.21.15.146:0/4033486541 shutdown_connections 2023-05-24T03:30:14.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.063+0000 7fed52589700 1 --2- 172.21.15.146:0/4033486541 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fed3806ad10 0x7fed3806d1c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:14.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.063+0000 7fed52589700 1 --2- 172.21.15.146:0/4033486541 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed4c15b2d0 0x7fed4c15b740 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:14.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.063+0000 7fed52589700 1 --2- 172.21.15.146:0/4033486541 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fed34003a30 0x7fed4c1599f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:14.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.063+0000 7fed52589700 1 --2- 172.21.15.146:0/4033486541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fed4c15d140 0x7fed4c15d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:14.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.063+0000 7fed52589700 1 -- 172.21.15.146:0/4033486541 >> 172.21.15.146:0/4033486541 conn(0x7fed4c06e2a0 msgr2=0x7fed4c0cce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:14.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.063+0000 7fed52589700 1 -- 172.21.15.146:0/4033486541 shutdown_connections 2023-05-24T03:30:14.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.063+0000 7fed52589700 1 -- 172.21.15.146:0/4033486541 wait complete. 2023-05-24T03:30:14.079 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-24T03:30:14.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.200+0000 7ff947fde700 1 Processor -- start 2023-05-24T03:30:14.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.200+0000 7ff947fde700 1 -- start start 2023-05-24T03:30:14.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.201+0000 7ff947fde700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff94015cd90 0x7ff9400cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:14.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.202+0000 7ff947fde700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff9400aefd0 0x7ff940160d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:14.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.202+0000 7ff947fde700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9400cfd00 con 0x7ff94006a460 2023-05-24T03:30:14.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.202+0000 7ff947fde700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff940072350 con 0x7ff94015cd90 2023-05-24T03:30:14.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.202+0000 7ff947fde700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9400cf460 con 0x7ff9400aefd0 2023-05-24T03:30:14.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.202+0000 7ff945579700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff94015cd90 0x7ff9400cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:14.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.202+0000 7ff945d7a700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff94006a460 0x7ff94006a830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46180/0 (socket says 172.21.15.146:46180) 2023-05-24T03:30:14.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.202+0000 7ff945d7a700 1 -- 172.21.15.146:0/2183818367 learned_addr learned my addr 172.21.15.146:0/2183818367 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:30:14.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.202+0000 7ff94657b700 1 --2- 172.21.15.146:0/2183818367 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff9400aefd0 0x7ff940160d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:14.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.202+0000 7ff944d78700 1 -- 172.21.15.146:0/2183818367 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3147732642 0 0) 0x7ff930001110 con 0x7ff94006a460 2023-05-24T03:30:14.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.202+0000 7ff944d78700 1 -- 172.21.15.146:0/2183818367 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff92c0035b0 con 0x7ff94006a460 2023-05-24T03:30:14.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.202+0000 7ff945579700 1 -- 172.21.15.146:0/2183818367 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff9400aefd0 msgr2=0x7ff940160d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:14.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.202+0000 7ff945579700 1 --2- 172.21.15.146:0/2183818367 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff9400aefd0 0x7ff940160d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:14.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.202+0000 7ff945579700 1 -- 172.21.15.146:0/2183818367 >> v1:172.21.15.146:6789/0 conn(0x7ff94006a460 legacy=0x7ff94006a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:14.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.202+0000 7ff945579700 1 -- 172.21.15.146:0/2183818367 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9400cf740 con 0x7ff94015cd90 2023-05-24T03:30:14.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.202+0000 7ff945579700 1 --2- 172.21.15.146:0/2183818367 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff94015cd90 0x7ff9400cede0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff93c009840 tx=0x7ff93c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cc9a18d3ff4dd0e server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:14.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.202+0000 7ff944d78700 1 -- 172.21.15.146:0/2183818367 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c011830 con 0x7ff94015cd90 2023-05-24T03:30:14.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.202+0000 7ff944d78700 1 -- 172.21.15.146:0/2183818367 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93c011990 con 0x7ff94015cd90 2023-05-24T03:30:14.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.202+0000 7ff944d78700 1 -- 172.21.15.146:0/2183818367 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c011d20 con 0x7ff94015cd90 2023-05-24T03:30:14.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.203+0000 7ff947fde700 1 -- 172.21.15.146:0/2183818367 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff94015cd90 msgr2=0x7ff9400cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:14.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.203+0000 7ff947fde700 1 --2- 172.21.15.146:0/2183818367 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff94015cd90 0x7ff9400cede0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff93c009840 tx=0x7ff93c009b50 comp rx=0 tx=0).stop 2023-05-24T03:30:14.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.203+0000 7ff947fde700 1 -- 172.21.15.146:0/2183818367 shutdown_connections 2023-05-24T03:30:14.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.203+0000 7ff947fde700 1 --2- 172.21.15.146:0/2183818367 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff9400aefd0 0x7ff940160d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:14.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.203+0000 7ff947fde700 1 --2- 172.21.15.146:0/2183818367 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff94015cd90 0x7ff9400cede0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:14.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.203+0000 7ff947fde700 1 -- 172.21.15.146:0/2183818367 >> 172.21.15.146:0/2183818367 conn(0x7ff9400cfea0 msgr2=0x7ff9400d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:14.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.203+0000 7ff947fde700 1 -- 172.21.15.146:0/2183818367 shutdown_connections 2023-05-24T03:30:14.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.203+0000 7ff947fde700 1 -- 172.21.15.146:0/2183818367 wait complete. 2023-05-24T03:30:14.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.204+0000 7ff947fde700 1 Processor -- start 2023-05-24T03:30:14.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.204+0000 7ff947fde700 1 -- start start 2023-05-24T03:30:14.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.205+0000 7ff947fde700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff94006a460 0x7ff9400c64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:14.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.205+0000 7ff947fde700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9400aefd0 0x7ff9400af8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:14.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.205+0000 7ff947fde700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff9401f2650 0x7ff94015a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:14.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.205+0000 7ff947fde700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9401f2e80 con 0x7ff9400aefd0 2023-05-24T03:30:14.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.205+0000 7ff947fde700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9401f3160 con 0x7ff94006a460 2023-05-24T03:30:14.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.205+0000 7ff947fde700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9401f3440 con 0x7ff9401f2650 2023-05-24T03:30:14.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.205+0000 7ff945579700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9400aefd0 0x7ff9400af8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:14.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.205+0000 7ff945579700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9400aefd0 0x7ff9400af8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39734/0 (socket says 172.21.15.146:39734) 2023-05-24T03:30:14.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.205+0000 7ff945579700 1 -- 172.21.15.146:0/598792287 learned_addr learned my addr 172.21.15.146:0/598792287 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:14.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.205+0000 7ff94657b700 1 --2- 172.21.15.146:0/598792287 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff9401f2650 0x7ff94015a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:14.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.205+0000 7ff945d7a700 1 --2- 172.21.15.146:0/598792287 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff94006a460 0x7ff9400c64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:14.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.205+0000 7ff945579700 1 -- 172.21.15.146:0/598792287 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff9401f2650 msgr2=0x7ff94015a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:14.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.205+0000 7ff945579700 1 --2- 172.21.15.146:0/598792287 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff9401f2650 0x7ff94015a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:14.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.205+0000 7ff945579700 1 -- 172.21.15.146:0/598792287 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff94006a460 msgr2=0x7ff9400c64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:14.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.205+0000 7ff945579700 1 --2- 172.21.15.146:0/598792287 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff94006a460 0x7ff9400c64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:14.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.205+0000 7ff945579700 1 -- 172.21.15.146:0/598792287 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff93c0094a0 con 0x7ff9400aefd0 2023-05-24T03:30:14.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.205+0000 7ff94657b700 1 --2- 172.21.15.146:0/598792287 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff9401f2650 0x7ff94015a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:30:14.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.205+0000 7ff945d7a700 1 --2- 172.21.15.146:0/598792287 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff94006a460 0x7ff9400c64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:30:14.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.206+0000 7ff945579700 1 --2- 172.21.15.146:0/598792287 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9400aefd0 0x7ff9400af8c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff93c0090b0 tx=0x7ff93c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:14.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.206+0000 7ff9367fc700 1 -- 172.21.15.146:0/598792287 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c0045d0 con 0x7ff9400aefd0 2023-05-24T03:30:14.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.206+0000 7ff9367fc700 1 -- 172.21.15.146:0/598792287 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93c01f070 con 0x7ff9400aefd0 2023-05-24T03:30:14.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.206+0000 7ff947fde700 1 -- 172.21.15.146:0/598792287 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff940160800 con 0x7ff9400aefd0 2023-05-24T03:30:14.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.206+0000 7ff9367fc700 1 -- 172.21.15.146:0/598792287 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c0038a0 con 0x7ff9400aefd0 2023-05-24T03:30:14.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.206+0000 7ff947fde700 1 -- 172.21.15.146:0/598792287 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9400cfa20 con 0x7ff9400aefd0 2023-05-24T03:30:14.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.207+0000 7ff947fde700 1 -- 172.21.15.146:0/598792287 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9400af620 con 0x7ff9400aefd0 2023-05-24T03:30:14.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.207+0000 7ff9367fc700 1 -- 172.21.15.146:0/598792287 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff93c003a00 con 0x7ff9400aefd0 2023-05-24T03:30:14.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.207+0000 7ff9367fc700 1 --2- 172.21.15.146:0/598792287 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7ff92406ace0 0x7ff92406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:14.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.208+0000 7ff9367fc700 1 -- 172.21.15.146:0/598792287 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff93c021070 con 0x7ff9400aefd0 2023-05-24T03:30:14.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.208+0000 7ff945d7a700 1 --2- 172.21.15.146:0/598792287 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7ff92406ace0 0x7ff92406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:14.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.208+0000 7ff945d7a700 1 --2- 172.21.15.146:0/598792287 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7ff92406ace0 0x7ff92406d190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff930007fd0 tx=0x7ff930009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:14.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.212+0000 7ff9367fc700 1 -- 172.21.15.146:0/598792287 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ff93c055ce0 con 0x7ff9400aefd0 2023-05-24T03:30:14.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.401+0000 7ff947fde700 1 -- 172.21.15.146:0/598792287 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff9401f3610 con 0x7ff9400aefd0 2023-05-24T03:30:14.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.402+0000 7ff9367fc700 1 -- 172.21.15.146:0/598792287 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff93c0150a0 con 0x7ff9400aefd0 2023-05-24T03:30:14.406 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2023-05-24T03:30:14.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.404+0000 7ff947fde700 1 -- 172.21.15.146:0/598792287 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7ff92406ace0 msgr2=0x7ff92406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:14.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.404+0000 7ff947fde700 1 --2- 172.21.15.146:0/598792287 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7ff92406ace0 0x7ff92406d190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff930007fd0 tx=0x7ff930009040 comp rx=0 tx=0).stop 2023-05-24T03:30:14.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.404+0000 7ff947fde700 1 -- 172.21.15.146:0/598792287 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9400aefd0 msgr2=0x7ff9400af8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:14.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.404+0000 7ff947fde700 1 --2- 172.21.15.146:0/598792287 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9400aefd0 0x7ff9400af8c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff93c0090b0 tx=0x7ff93c004750 comp rx=0 tx=0).stop 2023-05-24T03:30:14.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.404+0000 7ff947fde700 1 -- 172.21.15.146:0/598792287 shutdown_connections 2023-05-24T03:30:14.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.404+0000 7ff947fde700 1 --2- 172.21.15.146:0/598792287 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7ff92406ace0 0x7ff92406d190 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:14.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.404+0000 7ff947fde700 1 --2- 172.21.15.146:0/598792287 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff9401f2650 0x7ff94015a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:14.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.404+0000 7ff947fde700 1 --2- 172.21.15.146:0/598792287 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff94006a460 0x7ff9400c64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:14.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.404+0000 7ff947fde700 1 --2- 172.21.15.146:0/598792287 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9400aefd0 0x7ff9400af8c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:14.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.404+0000 7ff947fde700 1 -- 172.21.15.146:0/598792287 >> 172.21.15.146:0/598792287 conn(0x7ff9400cfea0 msgr2=0x7ff94006a830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:14.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.404+0000 7ff947fde700 1 -- 172.21.15.146:0/598792287 shutdown_connections 2023-05-24T03:30:14.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.404+0000 7ff947fde700 1 -- 172.21.15.146:0/598792287 wait complete. 2023-05-24T03:30:14.420 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-24T03:30:14.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.540+0000 7fc64bcc4700 1 Processor -- start 2023-05-24T03:30:14.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.541+0000 7fc64bcc4700 1 -- start start 2023-05-24T03:30:14.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.542+0000 7fc64bcc4700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc6440c3960 0x7fc6440c3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:14.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.542+0000 7fc64bcc4700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6440c4320 con 0x7fc6440cc0b0 2023-05-24T03:30:14.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.542+0000 7fc64bcc4700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc64406d7a0 con 0x7fc6440b1920 2023-05-24T03:30:14.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.542+0000 7fc64bcc4700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc64406d190 con 0x7fc6440c3960 2023-05-24T03:30:14.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.542+0000 7fc64925f700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc6440cc0b0 0x7fc64406dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46194/0 (socket says 172.21.15.146:46194) 2023-05-24T03:30:14.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.542+0000 7fc64925f700 1 -- 172.21.15.146:0/724848408 learned_addr learned my addr 172.21.15.146:0/724848408 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:30:14.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.542+0000 7fc64a261700 1 --2- 172.21.15.146:0/724848408 >> v2:172.21.15.151:3300/0 conn(0x7fc6440c3960 0x7fc6440c3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:14.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.542+0000 7fc648a5e700 1 -- 172.21.15.146:0/724848408 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2438288268 0 0) 0x7fc638001110 con 0x7fc6440cc0b0 2023-05-24T03:30:14.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.542+0000 7fc648a5e700 1 -- 172.21.15.146:0/724848408 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6300035b0 con 0x7fc6440cc0b0 2023-05-24T03:30:14.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.542+0000 7fc648a5e700 1 -- 172.21.15.146:0/724848408 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2494182973 0 0) 0x7fc6300035b0 con 0x7fc6440cc0b0 2023-05-24T03:30:14.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.542+0000 7fc648a5e700 1 -- 172.21.15.146:0/724848408 >> v2:172.21.15.151:3300/0 conn(0x7fc6440c3960 msgr2=0x7fc6440c3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:14.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.542+0000 7fc648a5e700 1 --2- 172.21.15.146:0/724848408 >> v2:172.21.15.151:3300/0 conn(0x7fc6440c3960 0x7fc6440c3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:14.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.542+0000 7fc648a5e700 1 -- 172.21.15.146:0/724848408 >> v1:172.21.15.151:6789/0 conn(0x7fc6440b1920 legacy=0x7fc6440b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:14.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.542+0000 7fc648a5e700 1 -- 172.21.15.146:0/724848408 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc644071de0 con 0x7fc6440cc0b0 2023-05-24T03:30:14.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.542+0000 7fc648a5e700 1 -- 172.21.15.146:0/724848408 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1301887351 0 0) 0x7fc638001800 con 0x7fc6440cc0b0 2023-05-24T03:30:14.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.542+0000 7fc648a5e700 1 -- 172.21.15.146:0/724848408 >> v1:172.21.15.146:6789/0 conn(0x7fc6440cc0b0 legacy=0x7fc64406dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:14.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.542+0000 7fc648a5e700 1 --2- 172.21.15.146:0/724848408 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc630003a00 0x7fc630003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:14.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.542+0000 7fc648a5e700 1 --2- 172.21.15.146:0/724848408 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc630004850 0x7fc630004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:14.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.542+0000 7fc648a5e700 1 --2- 172.21.15.146:0/724848408 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc630005200 0x7fc63000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:14.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.543+0000 7fc648a5e700 1 -- 172.21.15.146:0/724848408 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64406d190 con 0x7fc630004850 2023-05-24T03:30:14.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.543+0000 7fc648a5e700 1 -- 172.21.15.146:0/724848408 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63000c080 con 0x7fc630003a00 2023-05-24T03:30:14.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.543+0000 7fc648a5e700 1 -- 172.21.15.146:0/724848408 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc63000c240 con 0x7fc630005200 2023-05-24T03:30:14.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.543+0000 7fc64925f700 1 --2- 172.21.15.146:0/724848408 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc630004850 0x7fc630004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:14.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.543+0000 7fc649a60700 1 --2- 172.21.15.146:0/724848408 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc630003a00 0x7fc630003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:14.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.543+0000 7fc64a261700 1 --2- 172.21.15.146:0/724848408 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc630005200 0x7fc63000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:14.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.543+0000 7fc64925f700 1 -- 172.21.15.146:0/724848408 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc630005200 msgr2=0x7fc63000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:14.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.543+0000 7fc64925f700 1 --2- 172.21.15.146:0/724848408 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc630005200 0x7fc63000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:14.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.543+0000 7fc64925f700 1 -- 172.21.15.146:0/724848408 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc630003a00 msgr2=0x7fc630003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:14.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.543+0000 7fc64925f700 1 --2- 172.21.15.146:0/724848408 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc630003a00 0x7fc630003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:14.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.543+0000 7fc64a261700 1 -- 172.21.15.146:0/724848408 reap_dead start 2023-05-24T03:30:14.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.543+0000 7fc64925f700 1 -- 172.21.15.146:0/724848408 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6300035b0 con 0x7fc630004850 2023-05-24T03:30:14.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.543+0000 7fc64925f700 1 --2- 172.21.15.146:0/724848408 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc630004850 0x7fc630004cc0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc63800c240 tx=0x7fc630005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=336d397541fa7484 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:14.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.543+0000 7fc648a5e700 1 -- 172.21.15.146:0/724848408 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc638007db0 con 0x7fc630004850 2023-05-24T03:30:14.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.543+0000 7fc648a5e700 1 -- 172.21.15.146:0/724848408 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc63800cd60 con 0x7fc630004850 2023-05-24T03:30:14.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.543+0000 7fc648a5e700 1 -- 172.21.15.146:0/724848408 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc638005b80 con 0x7fc630004850 2023-05-24T03:30:14.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.544+0000 7fc64bcc4700 1 -- 172.21.15.146:0/724848408 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc630004850 msgr2=0x7fc630004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:14.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.544+0000 7fc64bcc4700 1 --2- 172.21.15.146:0/724848408 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc630004850 0x7fc630004cc0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc63800c240 tx=0x7fc630005880 comp rx=0 tx=0).stop 2023-05-24T03:30:14.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.544+0000 7fc64bcc4700 1 -- 172.21.15.146:0/724848408 shutdown_connections 2023-05-24T03:30:14.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.544+0000 7fc64bcc4700 1 --2- 172.21.15.146:0/724848408 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc630004850 0x7fc630004cc0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:14.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.544+0000 7fc64bcc4700 1 -- 172.21.15.146:0/724848408 >> 172.21.15.146:0/724848408 conn(0x7fc6440cfea0 msgr2=0x7fc6440d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:14.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.544+0000 7fc64bcc4700 1 -- 172.21.15.146:0/724848408 shutdown_connections 2023-05-24T03:30:14.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.544+0000 7fc64bcc4700 1 -- 172.21.15.146:0/724848408 wait complete. 2023-05-24T03:30:14.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.545+0000 7fc64bcc4700 1 Processor -- start 2023-05-24T03:30:14.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.546+0000 7fc64bcc4700 1 -- start start 2023-05-24T03:30:14.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.546+0000 7fc64bcc4700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc630004850 0x7fc64415ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:14.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.546+0000 7fc64bcc4700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc644155430 0x7fc64415c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:14.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.546+0000 7fc64bcc4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc64415d070 0x7fc64414bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:14.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.546+0000 7fc64bcc4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64415bed0 con 0x7fc64415d070 2023-05-24T03:30:14.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.546+0000 7fc64bcc4700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64415c830 con 0x7fc644155430 2023-05-24T03:30:14.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.546+0000 7fc64bcc4700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc64415b250 con 0x7fc630004850 2023-05-24T03:30:14.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.546+0000 7fc64a261700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc64415d070 0x7fc64414bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:14.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.546+0000 7fc64a261700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc64415d070 0x7fc64414bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39756/0 (socket says 172.21.15.146:39756) 2023-05-24T03:30:14.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.546+0000 7fc64a261700 1 -- 172.21.15.146:0/2916682776 learned_addr learned my addr 172.21.15.146:0/2916682776 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:14.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.547+0000 7fc649a60700 1 --2- 172.21.15.146:0/2916682776 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc630004850 0x7fc64415ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:14.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.547+0000 7fc64925f700 1 --2- 172.21.15.146:0/2916682776 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc644155430 0x7fc64415c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:14.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.547+0000 7fc64a261700 1 -- 172.21.15.146:0/2916682776 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc630004850 msgr2=0x7fc64415ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:14.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.547+0000 7fc64a261700 1 --2- 172.21.15.146:0/2916682776 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc630004850 0x7fc64415ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:14.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.547+0000 7fc64a261700 1 -- 172.21.15.146:0/2916682776 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc644155430 msgr2=0x7fc64415c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:14.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.547+0000 7fc64a261700 1 --2- 172.21.15.146:0/2916682776 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc644155430 0x7fc64415c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:14.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.547+0000 7fc64a261700 1 -- 172.21.15.146:0/2916682776 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6440720c0 con 0x7fc64415d070 2023-05-24T03:30:14.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.547+0000 7fc64a261700 1 --2- 172.21.15.146:0/2916682776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc64415d070 0x7fc64414bef0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc6440ca4f0 tx=0x7fc63c011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:14.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.547+0000 7fc6367fc700 1 -- 172.21.15.146:0/2916682776 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63c00e040 con 0x7fc64415d070 2023-05-24T03:30:14.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.547+0000 7fc6367fc700 1 -- 172.21.15.146:0/2916682776 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc63c00f040 con 0x7fc64415d070 2023-05-24T03:30:14.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.547+0000 7fc64bcc4700 1 -- 172.21.15.146:0/2916682776 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc64406d430 con 0x7fc64415d070 2023-05-24T03:30:14.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.547+0000 7fc6367fc700 1 -- 172.21.15.146:0/2916682776 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63c00fdb0 con 0x7fc64415d070 2023-05-24T03:30:14.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.547+0000 7fc64bcc4700 1 -- 172.21.15.146:0/2916682776 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc644071a00 con 0x7fc64415d070 2023-05-24T03:30:14.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.548+0000 7fc64bcc4700 1 -- 172.21.15.146:0/2916682776 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc64415c010 con 0x7fc64415d070 2023-05-24T03:30:14.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.548+0000 7fc6367fc700 1 -- 172.21.15.146:0/2916682776 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc63c015430 con 0x7fc64415d070 2023-05-24T03:30:14.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.549+0000 7fc6367fc700 1 --2- 172.21.15.146:0/2916682776 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fc62806ace0 0x7fc62806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:14.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.549+0000 7fc6367fc700 1 -- 172.21.15.146:0/2916682776 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc63c089d40 con 0x7fc64415d070 2023-05-24T03:30:14.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.549+0000 7fc649a60700 1 --2- 172.21.15.146:0/2916682776 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fc62806ace0 0x7fc62806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:14.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.549+0000 7fc649a60700 1 --2- 172.21.15.146:0/2916682776 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fc62806ace0 0x7fc62806d190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc640000c00 tx=0x7fc640009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:14.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.553+0000 7fc6367fc700 1 -- 172.21.15.146:0/2916682776 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc64415c010 con 0x7fc64415d070 2023-05-24T03:30:14.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.741+0000 7fc64bcc4700 1 -- 172.21.15.146:0/2916682776 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc64415c010 con 0x7fc64415d070 2023-05-24T03:30:14.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.741+0000 7fc6367fc700 1 -- 172.21.15.146:0/2916682776 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc64415c010 con 0x7fc64415d070 2023-05-24T03:30:14.745 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2023-05-24T03:30:14.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.743+0000 7fc64bcc4700 1 -- 172.21.15.146:0/2916682776 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fc62806ace0 msgr2=0x7fc62806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:14.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.743+0000 7fc64bcc4700 1 --2- 172.21.15.146:0/2916682776 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fc62806ace0 0x7fc62806d190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc640000c00 tx=0x7fc640009040 comp rx=0 tx=0).stop 2023-05-24T03:30:14.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.743+0000 7fc64bcc4700 1 -- 172.21.15.146:0/2916682776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc64415d070 msgr2=0x7fc64414bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:14.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.743+0000 7fc64bcc4700 1 --2- 172.21.15.146:0/2916682776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc64415d070 0x7fc64414bef0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc6440ca4f0 tx=0x7fc63c011f80 comp rx=0 tx=0).stop 2023-05-24T03:30:14.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.743+0000 7fc64bcc4700 1 -- 172.21.15.146:0/2916682776 shutdown_connections 2023-05-24T03:30:14.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.743+0000 7fc64bcc4700 1 --2- 172.21.15.146:0/2916682776 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fc62806ace0 0x7fc62806d190 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:14.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.743+0000 7fc64bcc4700 1 --2- 172.21.15.146:0/2916682776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc64415d070 0x7fc64414bef0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:14.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.743+0000 7fc64bcc4700 1 --2- 172.21.15.146:0/2916682776 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc630004850 0x7fc64415ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:14.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.743+0000 7fc64bcc4700 1 --2- 172.21.15.146:0/2916682776 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc644155430 0x7fc64415c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:14.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.743+0000 7fc64bcc4700 1 -- 172.21.15.146:0/2916682776 >> 172.21.15.146:0/2916682776 conn(0x7fc6440cfea0 msgr2=0x7fc644159c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:14.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.743+0000 7fc64bcc4700 1 -- 172.21.15.146:0/2916682776 shutdown_connections 2023-05-24T03:30:14.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.743+0000 7fc64bcc4700 1 -- 172.21.15.146:0/2916682776 wait complete. 2023-05-24T03:30:14.759 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-24T03:30:14.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.877+0000 7f3df4080700 1 Processor -- start 2023-05-24T03:30:14.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.877+0000 7f3df4080700 1 -- start start 2023-05-24T03:30:14.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.878+0000 7f3df4080700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3dec071e30 0x7f3dec165550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:14.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.878+0000 7f3df4080700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dec0cb740 con 0x7f3dec15a9c0 2023-05-24T03:30:14.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.878+0000 7f3df4080700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dec0cba20 con 0x7f3dec0cc500 2023-05-24T03:30:14.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.878+0000 7f3df4080700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dec0cbd00 con 0x7f3dec071e30 2023-05-24T03:30:14.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.878+0000 7f3df261d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3dec071e30 0x7f3dec165550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:14.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.878+0000 7f3df1e1c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3dec15a9c0 0x7f3dec0b52e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46212/0 (socket says 172.21.15.146:46212) 2023-05-24T03:30:14.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.878+0000 7f3df1e1c700 1 -- 172.21.15.146:0/1027178241 learned_addr learned my addr 172.21.15.146:0/1027178241 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:30:14.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.878+0000 7f3df261d700 1 -- 172.21.15.146:0/1027178241 >> v1:172.21.15.151:6789/0 conn(0x7f3dec0cc500 legacy=0x7f3dec071720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:14.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.878+0000 7f3df261d700 1 -- 172.21.15.146:0/1027178241 >> v1:172.21.15.146:6789/0 conn(0x7f3dec15a9c0 legacy=0x7f3dec0b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:14.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.878+0000 7f3df261d700 1 -- 172.21.15.146:0/1027178241 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dec0cbfe0 con 0x7f3dec071e30 2023-05-24T03:30:14.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.878+0000 7f3df0e1a700 1 -- 172.21.15.146:0/1027178241 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2020143849 0 0) 0x7f3dec0cb740 con 0x7f3dec15a9c0 2023-05-24T03:30:14.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.878+0000 7f3df261d700 1 --2- 172.21.15.146:0/1027178241 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dec071e30 0x7f3dec165550 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3de4009d90 tx=0x7f3de400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5784514981d97c1d server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:14.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.878+0000 7f3df0e1a700 1 -- 172.21.15.146:0/1027178241 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de400e070 con 0x7f3dec071e30 2023-05-24T03:30:14.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.879+0000 7f3df0e1a700 1 -- 172.21.15.146:0/1027178241 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de400bbd0 con 0x7f3dec071e30 2023-05-24T03:30:14.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.879+0000 7f3df0e1a700 1 -- 172.21.15.146:0/1027178241 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de4012430 con 0x7f3dec071e30 2023-05-24T03:30:14.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.879+0000 7f3df4080700 1 -- 172.21.15.146:0/1027178241 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dec071e30 msgr2=0x7f3dec165550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:14.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.879+0000 7f3df4080700 1 --2- 172.21.15.146:0/1027178241 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dec071e30 0x7f3dec165550 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3de4009d90 tx=0x7f3de400b330 comp rx=0 tx=0).stop 2023-05-24T03:30:14.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.879+0000 7f3df4080700 1 -- 172.21.15.146:0/1027178241 shutdown_connections 2023-05-24T03:30:14.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.879+0000 7f3df4080700 1 --2- 172.21.15.146:0/1027178241 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dec071e30 0x7f3dec165550 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:14.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.879+0000 7f3df4080700 1 -- 172.21.15.146:0/1027178241 >> 172.21.15.146:0/1027178241 conn(0x7f3dec0cfea0 msgr2=0x7f3dec0d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:14.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.879+0000 7f3df4080700 1 -- 172.21.15.146:0/1027178241 shutdown_connections 2023-05-24T03:30:14.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.879+0000 7f3df4080700 1 -- 172.21.15.146:0/1027178241 wait complete. 2023-05-24T03:30:14.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.880+0000 7f3df4080700 1 Processor -- start 2023-05-24T03:30:14.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.880+0000 7f3df4080700 1 -- start start 2023-05-24T03:30:14.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.881+0000 7f3df4080700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3dec071e30 0x7f3dec152360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:14.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.881+0000 7f3df4080700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dec0cc500 0x7f3dec0ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:14.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.881+0000 7f3df4080700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3dec15a9c0 0x7f3dec0cd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:14.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.881+0000 7f3df4080700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec0b1380 con 0x7f3dec0cc500 2023-05-24T03:30:14.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.881+0000 7f3df4080700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec0cea20 con 0x7f3dec15a9c0 2023-05-24T03:30:14.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.881+0000 7f3df4080700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec0b0d00 con 0x7f3dec071e30 2023-05-24T03:30:14.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.881+0000 7f3df161b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dec0cc500 0x7f3dec0ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:14.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.881+0000 7f3df161b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dec0cc500 0x7f3dec0ac8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39768/0 (socket says 172.21.15.146:39768) 2023-05-24T03:30:14.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.881+0000 7f3df161b700 1 -- 172.21.15.146:0/1021593463 learned_addr learned my addr 172.21.15.146:0/1021593463 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:14.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.881+0000 7f3df261d700 1 --2- 172.21.15.146:0/1021593463 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3dec15a9c0 0x7f3dec0cd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:14.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.881+0000 7f3df1e1c700 1 --2- 172.21.15.146:0/1021593463 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3dec071e30 0x7f3dec152360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:14.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.881+0000 7f3df161b700 1 -- 172.21.15.146:0/1021593463 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3dec071e30 msgr2=0x7f3dec152360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:14.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.881+0000 7f3df161b700 1 --2- 172.21.15.146:0/1021593463 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3dec071e30 0x7f3dec152360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:14.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.881+0000 7f3df161b700 1 -- 172.21.15.146:0/1021593463 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3dec15a9c0 msgr2=0x7f3dec0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:14.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.881+0000 7f3df161b700 1 --2- 172.21.15.146:0/1021593463 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3dec15a9c0 0x7f3dec0cd9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:14.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.881+0000 7f3df161b700 1 -- 172.21.15.146:0/1021593463 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de4009a70 con 0x7f3dec0cc500 2023-05-24T03:30:14.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.881+0000 7f3df261d700 1 --2- 172.21.15.146:0/1021593463 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3dec15a9c0 0x7f3dec0cd9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:30:14.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.882+0000 7f3df161b700 1 --2- 172.21.15.146:0/1021593463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dec0cc500 0x7f3dec0ac8b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc00c4b0 tx=0x7f3ddc00c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:14.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.882+0000 7f3de27fc700 1 -- 172.21.15.146:0/1021593463 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc0052d0 con 0x7f3dec0cc500 2023-05-24T03:30:14.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.882+0000 7f3de27fc700 1 -- 172.21.15.146:0/1021593463 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ddc005430 con 0x7f3dec0cc500 2023-05-24T03:30:14.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.882+0000 7f3de27fc700 1 -- 172.21.15.146:0/1021593463 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc0038c0 con 0x7f3dec0cc500 2023-05-24T03:30:14.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.882+0000 7f3df4080700 1 -- 172.21.15.146:0/1021593463 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dec0b5da0 con 0x7f3dec0cc500 2023-05-24T03:30:14.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.882+0000 7f3df4080700 1 -- 172.21.15.146:0/1021593463 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dec15ad90 con 0x7f3dec0cc500 2023-05-24T03:30:14.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.883+0000 7f3df4080700 1 -- 172.21.15.146:0/1021593463 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dec0b14c0 con 0x7f3dec0cc500 2023-05-24T03:30:14.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.883+0000 7f3de27fc700 1 -- 172.21.15.146:0/1021593463 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3ddc003a20 con 0x7f3dec0cc500 2023-05-24T03:30:14.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.884+0000 7f3de27fc700 1 --2- 172.21.15.146:0/1021593463 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f3dd006ace0 0x7f3dd006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:14.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.884+0000 7f3df1e1c700 1 --2- 172.21.15.146:0/1021593463 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f3dd006ace0 0x7f3dd006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:14.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.884+0000 7f3de27fc700 1 -- 172.21.15.146:0/1021593463 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3ddc088bc0 con 0x7f3dec0cc500 2023-05-24T03:30:14.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.884+0000 7f3df1e1c700 1 --2- 172.21.15.146:0/1021593463 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f3dd006ace0 0x7f3dd006d190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3de8007fd0 tx=0x7f3de8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:14.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:14.888+0000 7f3de27fc700 1 -- 172.21.15.146:0/1021593463 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3dec0b14c0 con 0x7f3dec0cc500 2023-05-24T03:30:15.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.121+0000 7f3df4080700 1 -- 172.21.15.146:0/1021593463 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3dec0b14c0 con 0x7f3dec0cc500 2023-05-24T03:30:15.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.122+0000 7f3de27fc700 1 -- 172.21.15.146:0/1021593463 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4883 (secure 0 0 0) 0x7f3dec0b14c0 con 0x7f3dec0cc500 2023-05-24T03:30:15.126 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:30:15.126 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1500590330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1500590330},{"type":"v1","addr":"172.21.15.151:6835","nonce":1500590330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/3574684057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3574684057},{"type":"v1","addr":"172.21.15.146:6837","nonce":3574684057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/3420469594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3420469594},{"type":"v1","addr":"172.21.15.151:6833","nonce":3420469594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-24T03:29:44.469134+0000","modified":"2023-05-24T03:30:06.147392+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6836/4012487240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":4012487240},{"type":"v1","addr":"172.21.15.146:6836","nonce":4012487240}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-24T03:30:15.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.124+0000 7f3df4080700 1 -- 172.21.15.146:0/1021593463 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f3dd006ace0 msgr2=0x7f3dd006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:15.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.124+0000 7f3df4080700 1 --2- 172.21.15.146:0/1021593463 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f3dd006ace0 0x7f3dd006d190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3de8007fd0 tx=0x7f3de8009040 comp rx=0 tx=0).stop 2023-05-24T03:30:15.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.124+0000 7f3df4080700 1 -- 172.21.15.146:0/1021593463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dec0cc500 msgr2=0x7f3dec0ac8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:15.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.124+0000 7f3df4080700 1 --2- 172.21.15.146:0/1021593463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dec0cc500 0x7f3dec0ac8b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc00c4b0 tx=0x7f3ddc00c870 comp rx=0 tx=0).stop 2023-05-24T03:30:15.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.124+0000 7f3df4080700 1 -- 172.21.15.146:0/1021593463 shutdown_connections 2023-05-24T03:30:15.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.124+0000 7f3df4080700 1 --2- 172.21.15.146:0/1021593463 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f3dd006ace0 0x7f3dd006d190 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:15.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.124+0000 7f3df4080700 1 --2- 172.21.15.146:0/1021593463 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3dec15a9c0 0x7f3dec0cd9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:15.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.124+0000 7f3df4080700 1 --2- 172.21.15.146:0/1021593463 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3dec071e30 0x7f3dec152360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:15.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.124+0000 7f3df4080700 1 --2- 172.21.15.146:0/1021593463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dec0cc500 0x7f3dec0ac8b0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:15.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.124+0000 7f3df4080700 1 -- 172.21.15.146:0/1021593463 >> 172.21.15.146:0/1021593463 conn(0x7f3dec0cfea0 msgr2=0x7f3dec157bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:15.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.124+0000 7f3df4080700 1 -- 172.21.15.146:0/1021593463 shutdown_connections 2023-05-24T03:30:15.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.124+0000 7f3df4080700 1 -- 172.21.15.146:0/1021593463 wait complete. 2023-05-24T03:30:15.129 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 9 2023-05-24T03:30:15.140 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-24T03:30:15.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.257+0000 7f8098f65700 1 Processor -- start 2023-05-24T03:30:15.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.257+0000 7f8098f65700 1 -- start start 2023-05-24T03:30:15.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.258+0000 7f8098f65700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8094071f30 0x7f80940ca900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:15.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.258+0000 7f8098f65700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80940b20b0 con 0x7f809415ff20 2023-05-24T03:30:15.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.258+0000 7f8098f65700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80941602f0 con 0x7f80940ca460 2023-05-24T03:30:15.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.258+0000 7f8098f65700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80940cd090 con 0x7f8094071f30 2023-05-24T03:30:15.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.258+0000 7f8092d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8094071f30 0x7f80940ca900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:15.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.258+0000 7f809259c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f809415ff20 0x7f809406dbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46226/0 (socket says 172.21.15.146:46226) 2023-05-24T03:30:15.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.258+0000 7f809259c700 1 -- 172.21.15.146:0/3528531032 learned_addr learned my addr 172.21.15.146:0/3528531032 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:30:15.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.259+0000 7f8092d9d700 1 -- 172.21.15.146:0/3528531032 >> v1:172.21.15.151:6789/0 conn(0x7f80940ca460 legacy=0x7f8094071820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:15.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.259+0000 7f8092d9d700 1 -- 172.21.15.146:0/3528531032 >> v1:172.21.15.146:6789/0 conn(0x7f809415ff20 legacy=0x7f809406dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:15.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.259+0000 7f8092d9d700 1 -- 172.21.15.146:0/3528531032 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80940cd370 con 0x7f8094071f30 2023-05-24T03:30:15.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.259+0000 7f809159a700 1 -- 172.21.15.146:0/3528531032 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2896319656 0 0) 0x7f80940b20b0 con 0x7f809415ff20 2023-05-24T03:30:15.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.259+0000 7f8092d9d700 1 --2- 172.21.15.146:0/3528531032 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8094071f30 0x7f80940ca900 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f808c009d90 tx=0x7f808c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=636ecbaff0435d77 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:15.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.259+0000 7f809159a700 1 -- 172.21.15.146:0/3528531032 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c00e070 con 0x7f8094071f30 2023-05-24T03:30:15.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.259+0000 7f809159a700 1 -- 172.21.15.146:0/3528531032 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f808c00bbd0 con 0x7f8094071f30 2023-05-24T03:30:15.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.259+0000 7f809159a700 1 -- 172.21.15.146:0/3528531032 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c012430 con 0x7f8094071f30 2023-05-24T03:30:15.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.260+0000 7f8098f65700 1 -- 172.21.15.146:0/3528531032 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8094071f30 msgr2=0x7f80940ca900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:15.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.260+0000 7f8098f65700 1 --2- 172.21.15.146:0/3528531032 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8094071f30 0x7f80940ca900 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f808c009d90 tx=0x7f808c00b330 comp rx=0 tx=0).stop 2023-05-24T03:30:15.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.260+0000 7f8098f65700 1 -- 172.21.15.146:0/3528531032 shutdown_connections 2023-05-24T03:30:15.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.260+0000 7f8098f65700 1 --2- 172.21.15.146:0/3528531032 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8094071f30 0x7f80940ca900 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:15.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.260+0000 7f8098f65700 1 -- 172.21.15.146:0/3528531032 >> 172.21.15.146:0/3528531032 conn(0x7f809406ebf0 msgr2=0x7f809406eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:15.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.260+0000 7f8098f65700 1 -- 172.21.15.146:0/3528531032 shutdown_connections 2023-05-24T03:30:15.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.260+0000 7f8098f65700 1 -- 172.21.15.146:0/3528531032 wait complete. 2023-05-24T03:30:15.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.261+0000 7f8098f65700 1 Processor -- start 2023-05-24T03:30:15.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.261+0000 7f8098f65700 1 -- start start 2023-05-24T03:30:15.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.262+0000 7f8098f65700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8094071f30 0x7f80941544a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:15.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.262+0000 7f8098f65700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80940ca460 0x7f8094152220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:15.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.262+0000 7f8098f65700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f809415ff20 0x7f8094152760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:15.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.262+0000 7f8098f65700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8094155150 con 0x7f809415ff20 2023-05-24T03:30:15.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.262+0000 7f8098f65700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80940c7210 con 0x7f8094071f30 2023-05-24T03:30:15.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.262+0000 7f8098f65700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80940c74f0 con 0x7f80940ca460 2023-05-24T03:30:15.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.262+0000 7f8092d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f809415ff20 0x7f8094152760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:15.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.262+0000 7f8092d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f809415ff20 0x7f8094152760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39784/0 (socket says 172.21.15.146:39784) 2023-05-24T03:30:15.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.262+0000 7f8092d9d700 1 -- 172.21.15.146:0/2094769951 learned_addr learned my addr 172.21.15.146:0/2094769951 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:15.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.262+0000 7f809259c700 1 --2- 172.21.15.146:0/2094769951 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8094071f30 0x7f80941544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:15.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.262+0000 7f8091d9b700 1 --2- 172.21.15.146:0/2094769951 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80940ca460 0x7f8094152220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:15.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.262+0000 7f8092d9d700 1 -- 172.21.15.146:0/2094769951 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80940ca460 msgr2=0x7f8094152220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:15.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.262+0000 7f8092d9d700 1 --2- 172.21.15.146:0/2094769951 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80940ca460 0x7f8094152220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:15.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.262+0000 7f8092d9d700 1 -- 172.21.15.146:0/2094769951 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8094071f30 msgr2=0x7f80941544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:15.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.262+0000 7f8092d9d700 1 --2- 172.21.15.146:0/2094769951 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8094071f30 0x7f80941544a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:15.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.262+0000 7f8092d9d700 1 -- 172.21.15.146:0/2094769951 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f808c009a70 con 0x7f809415ff20 2023-05-24T03:30:15.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.262+0000 7f8091d9b700 1 --2- 172.21.15.146:0/2094769951 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80940ca460 0x7f8094152220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:30:15.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.262+0000 7f8092d9d700 1 --2- 172.21.15.146:0/2094769951 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f809415ff20 0x7f8094152760 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f808c014040 tx=0x7f808c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:15.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.262+0000 7f8082ffd700 1 -- 172.21.15.146:0/2094769951 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c01b820 con 0x7f809415ff20 2023-05-24T03:30:15.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.263+0000 7f8082ffd700 1 -- 172.21.15.146:0/2094769951 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f808c020070 con 0x7f809415ff20 2023-05-24T03:30:15.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.263+0000 7f8098f65700 1 -- 172.21.15.146:0/2094769951 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f809406d3d0 con 0x7f809415ff20 2023-05-24T03:30:15.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.263+0000 7f8082ffd700 1 -- 172.21.15.146:0/2094769951 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c01bc00 con 0x7f809415ff20 2023-05-24T03:30:15.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.263+0000 7f8098f65700 1 -- 172.21.15.146:0/2094769951 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f809406d0f0 con 0x7f809415ff20 2023-05-24T03:30:15.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.263+0000 7f8098f65700 1 -- 172.21.15.146:0/2094769951 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f809406d6b0 con 0x7f809415ff20 2023-05-24T03:30:15.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.264+0000 7f8082ffd700 1 -- 172.21.15.146:0/2094769951 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f808c026400 con 0x7f809415ff20 2023-05-24T03:30:15.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.264+0000 7f8082ffd700 1 --2- 172.21.15.146:0/2094769951 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f807406ace0 0x7f807406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:15.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.264+0000 7f8082ffd700 1 -- 172.21.15.146:0/2094769951 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f808c08b620 con 0x7f809415ff20 2023-05-24T03:30:15.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.264+0000 7f809259c700 1 --2- 172.21.15.146:0/2094769951 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f807406ace0 0x7f807406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:15.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.265+0000 7f809259c700 1 --2- 172.21.15.146:0/2094769951 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f807406ace0 0x7f807406d190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8084000f60 tx=0x7f8084004a50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:15.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.269+0000 7f8082ffd700 1 -- 172.21.15.146:0/2094769951 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f808c059f00 con 0x7f809415ff20 2023-05-24T03:30:15.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.459+0000 7f8098f65700 1 -- 172.21.15.146:0/2094769951 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f80940c8530 con 0x7f809415ff20 2023-05-24T03:30:15.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.460+0000 7f8082ffd700 1 -- 172.21.15.146:0/2094769951 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20156 (secure 0 0 0) 0x7f808c022090 con 0x7f809415ff20 2023-05-24T03:30:15.464 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:30:15.464 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":28,"fsid":"11ca0adb-7672-4713-bde7-451e8b743ae9","created":"2023-05-24T03:29:19.113659+0000","modified":"2023-05-24T03:29:48.912599+0000","last_up_change":"2023-05-24T03:29:30.962339+0000","last_in_change":"2023-05-24T03:29:21.706540+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-24T03:29:32.749984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-24T03:29:37.719623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-24T03:29:42.165379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-24T03:29:43.431615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-24T03:29:46.503075+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f24b319b-fcc8-4385-b0cb-78138fc31417","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6801","nonce":3353593100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6803","nonce":3353593100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6807","nonce":3353593100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6805","nonce":3353593100}]},"public_addr":"172.21.15.146:6801/3353593100","cluster_addr":"172.21.15.146:6803/3353593100","heartbeat_back_addr":"172.21.15.146:6807/3353593100","heartbeat_front_addr":"172.21.15.146:6805/3353593100","state":["exists","up"]},{"osd":1,"uuid":"c9639ea9-8f9b-498e-92c8-aa976edbf1da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6821","nonce":2537488734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6825","nonce":2537488734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6831","nonce":2537488734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6827","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6829","nonce":2537488734}]},"public_addr":"172.21.15.146:6821/2537488734","cluster_addr":"172.21.15.146:6825/2537488734","heartbeat_back_addr":"172.21.15.146:6831/2537488734","heartbeat_front_addr":"172.21.15.146:6829/2537488734","state":["exists","up"]},{"osd":2,"uuid":"7a6cfc6d-b0ca-4cb6-a66d-4001ec184657","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6809","nonce":1800242932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6811","nonce":1800242932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6815","nonce":1800242932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6813","nonce":1800242932}]},"public_addr":"172.21.15.146:6809/1800242932","cluster_addr":"172.21.15.146:6811/1800242932","heartbeat_back_addr":"172.21.15.146:6815/1800242932","heartbeat_front_addr":"172.21.15.146:6813/1800242932","state":["exists","up"]},{"osd":3,"uuid":"401509f7-cecd-44a2-b0ae-22c81a5d93c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6817","nonce":1749783580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6820","nonce":1749783580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6828","nonce":1749783580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6824","nonce":1749783580}]},"public_addr":"172.21.15.146:6817/1749783580","cluster_addr":"172.21.15.146:6820/1749783580","heartbeat_back_addr":"172.21.15.146:6828/1749783580","heartbeat_front_addr":"172.21.15.146:6824/1749783580","state":["exists","up"]},{"osd":4,"uuid":"9d07f440-d125-4f99-a825-411fab894d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6811","nonce":163453435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6814","nonce":163453435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6819","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6821","nonce":163453435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6818","nonce":163453435}]},"public_addr":"172.21.15.151:6811/163453435","cluster_addr":"172.21.15.151:6814/163453435","heartbeat_back_addr":"172.21.15.151:6821/163453435","heartbeat_front_addr":"172.21.15.151:6818/163453435","state":["exists","up"]},{"osd":5,"uuid":"9b2266e2-9e52-4f0e-96da-e703a6c23a6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6801","nonce":3283474903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6803","nonce":3283474903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6807","nonce":3283474903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6805","nonce":3283474903}]},"public_addr":"172.21.15.151:6801/3283474903","cluster_addr":"172.21.15.151:6803/3283474903","heartbeat_back_addr":"172.21.15.151:6807/3283474903","heartbeat_front_addr":"172.21.15.151:6805/3283474903","state":["exists","up"]},{"osd":6,"uuid":"5daedf77-0a83-49e7-b497-d9ed10436972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6825","nonce":3889424178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6827","nonce":3889424178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6831","nonce":3889424178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6829","nonce":3889424178}]},"public_addr":"172.21.15.151:6825/3889424178","cluster_addr":"172.21.15.151:6827/3889424178","heartbeat_back_addr":"172.21.15.151:6831/3889424178","heartbeat_front_addr":"172.21.15.151:6829/3889424178","state":["exists","up"]},{"osd":7,"uuid":"86ae4f7e-c01f-4c3d-a0dd-98160c209309","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6810","nonce":563291208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6815","nonce":563291208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6823","nonce":563291208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6820","nonce":563291208}]},"public_addr":"172.21.15.151:6810/563291208","cluster_addr":"172.21.15.151:6815/563291208","heartbeat_back_addr":"172.21.15.151:6823/563291208","heartbeat_front_addr":"172.21.15.151:6820/563291208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.872472+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.937126+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.877234+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.884793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.881632+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.938293+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.857661+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.945883+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-24T03:30:15.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.462+0000 7f8098f65700 1 -- 172.21.15.146:0/2094769951 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f807406ace0 msgr2=0x7f807406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:15.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.462+0000 7f8098f65700 1 --2- 172.21.15.146:0/2094769951 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f807406ace0 0x7f807406d190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8084000f60 tx=0x7f8084004a50 comp rx=0 tx=0).stop 2023-05-24T03:30:15.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.462+0000 7f8098f65700 1 -- 172.21.15.146:0/2094769951 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f809415ff20 msgr2=0x7f8094152760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:15.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.462+0000 7f8098f65700 1 --2- 172.21.15.146:0/2094769951 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f809415ff20 0x7f8094152760 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f808c014040 tx=0x7f808c004ad0 comp rx=0 tx=0).stop 2023-05-24T03:30:15.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.462+0000 7f8098f65700 1 -- 172.21.15.146:0/2094769951 shutdown_connections 2023-05-24T03:30:15.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.462+0000 7f8098f65700 1 --2- 172.21.15.146:0/2094769951 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f807406ace0 0x7f807406d190 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:15.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.462+0000 7f8098f65700 1 --2- 172.21.15.146:0/2094769951 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f809415ff20 0x7f8094152760 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:15.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.462+0000 7f8098f65700 1 --2- 172.21.15.146:0/2094769951 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8094071f30 0x7f80941544a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:15.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.462+0000 7f8098f65700 1 --2- 172.21.15.146:0/2094769951 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80940ca460 0x7f8094152220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:15.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.462+0000 7f8098f65700 1 -- 172.21.15.146:0/2094769951 >> 172.21.15.146:0/2094769951 conn(0x7f809406ebf0 msgr2=0x7f809415d970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:15.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.462+0000 7f8098f65700 1 -- 172.21.15.146:0/2094769951 shutdown_connections 2023-05-24T03:30:15.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.462+0000 7f8098f65700 1 -- 172.21.15.146:0/2094769951 wait complete. 2023-05-24T03:30:15.478 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-24T03:29:32.749984+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-24T03:29:37.719623+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-24T03:29:42.165379+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-24T03:29:43.431615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-24T03:29:46.503075+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-24T03:30:15.479 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-24T03:30:15.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.599+0000 7f019c445700 1 Processor -- start 2023-05-24T03:30:15.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.599+0000 7f019c445700 1 -- start start 2023-05-24T03:30:15.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.600+0000 7f019c445700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f019406a460 0x7f01940cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:15.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.600+0000 7f019c445700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f01940aefd0 0x7f0194160d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:15.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.600+0000 7f019c445700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01940cfd00 con 0x7f019415cd90 2023-05-24T03:30:15.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.600+0000 7f019c445700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0194072350 con 0x7f019406a460 2023-05-24T03:30:15.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.600+0000 7f019c445700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01940cf460 con 0x7f01940aefd0 2023-05-24T03:30:15.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.600+0000 7f019a9e2700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f01940aefd0 0x7f0194160d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:15.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.600+0000 7f019a1e1700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f019406a460 0x7f01940cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:15.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.600+0000 7f01999e0700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f019415cd90 0x7f019406a830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:45274/0 (socket says 172.21.15.146:45274) 2023-05-24T03:30:15.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.600+0000 7f019a1e1700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f019406a460 0x7f01940cede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:50970/0 (socket says 172.21.15.146:50970) 2023-05-24T03:30:15.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.600+0000 7f019a9e2700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f01940aefd0 0x7f0194160d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:52656/0 (socket says 172.21.15.146:52656) 2023-05-24T03:30:15.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.600+0000 7f01999e0700 1 -- 172.21.15.146:0/2644427324 learned_addr learned my addr 172.21.15.146:0/2644427324 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:30:15.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.600+0000 7f01991df700 1 -- 172.21.15.146:0/2644427324 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1183180575 0 0) 0x7f0184001110 con 0x7f019415cd90 2023-05-24T03:30:15.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.600+0000 7f01991df700 1 -- 172.21.15.146:0/2644427324 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01800035b0 con 0x7f019415cd90 2023-05-24T03:30:15.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.601+0000 7f019a9e2700 1 -- 172.21.15.146:0/2644427324 >> v2:172.21.15.151:3300/0 conn(0x7f019406a460 msgr2=0x7f01940cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:15.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.601+0000 7f019a9e2700 1 --2- 172.21.15.146:0/2644427324 >> v2:172.21.15.151:3300/0 conn(0x7f019406a460 0x7f01940cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:15.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.601+0000 7f019a9e2700 1 -- 172.21.15.146:0/2644427324 >> v1:172.21.15.151:6789/0 conn(0x7f019415cd90 legacy=0x7f019406a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:15.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.601+0000 7f019a9e2700 1 -- 172.21.15.146:0/2644427324 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01940cf740 con 0x7f01940aefd0 2023-05-24T03:30:15.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.601+0000 7f019a1e1700 1 --2- 172.21.15.146:0/2644427324 >> v2:172.21.15.151:3300/0 conn(0x7f019406a460 0x7f01940cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T03:30:15.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.601+0000 7f019a9e2700 1 --2- 172.21.15.146:0/2644427324 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f01940aefd0 0x7f0194160d20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f018c009d90 tx=0x7f018c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f033ada7e0d0f316 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:15.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.601+0000 7f01991df700 1 -- 172.21.15.146:0/2644427324 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018c00e070 con 0x7f01940aefd0 2023-05-24T03:30:15.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.601+0000 7f01991df700 1 -- 172.21.15.146:0/2644427324 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f018c00bb20 con 0x7f01940aefd0 2023-05-24T03:30:15.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.601+0000 7f01991df700 1 -- 172.21.15.146:0/2644427324 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018c012430 con 0x7f01940aefd0 2023-05-24T03:30:15.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.601+0000 7f019c445700 1 -- 172.21.15.146:0/2644427324 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f01940aefd0 msgr2=0x7f0194160d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:15.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.601+0000 7f019c445700 1 --2- 172.21.15.146:0/2644427324 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f01940aefd0 0x7f0194160d20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f018c009d90 tx=0x7f018c00b330 comp rx=0 tx=0).stop 2023-05-24T03:30:15.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.602+0000 7f019c445700 1 -- 172.21.15.146:0/2644427324 shutdown_connections 2023-05-24T03:30:15.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.602+0000 7f019c445700 1 --2- 172.21.15.146:0/2644427324 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f01940aefd0 0x7f0194160d20 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:15.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.602+0000 7f019c445700 1 --2- 172.21.15.146:0/2644427324 >> v2:172.21.15.151:3300/0 conn(0x7f019406a460 0x7f01940cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:15.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.602+0000 7f019c445700 1 -- 172.21.15.146:0/2644427324 >> 172.21.15.146:0/2644427324 conn(0x7f01940cfea0 msgr2=0x7f01940d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:15.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.602+0000 7f019c445700 1 -- 172.21.15.146:0/2644427324 shutdown_connections 2023-05-24T03:30:15.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.602+0000 7f019c445700 1 -- 172.21.15.146:0/2644427324 wait complete. 2023-05-24T03:30:15.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.603+0000 7f019c445700 1 Processor -- start 2023-05-24T03:30:15.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.603+0000 7f019c445700 1 -- start start 2023-05-24T03:30:15.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.603+0000 7f019c445700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f019406a460 0x7f0194152c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:15.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.604+0000 7f019c445700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f01940aefd0 0x7f01941f20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:15.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.604+0000 7f019c445700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f019415cd90 0x7f01940c4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:15.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.604+0000 7f019c445700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019415f020 con 0x7f019415cd90 2023-05-24T03:30:15.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.604+0000 7f019c445700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019415e450 con 0x7f01940aefd0 2023-05-24T03:30:15.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.604+0000 7f019c445700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f019415e6f0 con 0x7f019406a460 2023-05-24T03:30:15.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.604+0000 7f019a1e1700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f019406a460 0x7f0194152c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:15.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.604+0000 7f019a1e1700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f019406a460 0x7f0194152c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:52658/0 (socket says 172.21.15.146:52658) 2023-05-24T03:30:15.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.604+0000 7f019a9e2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f019415cd90 0x7f01940c4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:15.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.604+0000 7f01999e0700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f01940aefd0 0x7f01941f20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:15.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.604+0000 7f019a1e1700 1 -- 172.21.15.146:0/1800213403 learned_addr learned my addr 172.21.15.146:0/1800213403 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:15.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.604+0000 7f019a1e1700 1 -- 172.21.15.146:0/1800213403 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f01940aefd0 msgr2=0x7f01941f20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:15.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.604+0000 7f019a1e1700 1 --2- 172.21.15.146:0/1800213403 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f01940aefd0 0x7f01941f20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:15.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.604+0000 7f019a1e1700 1 -- 172.21.15.146:0/1800213403 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f019415cd90 msgr2=0x7f01940c4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:15.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.604+0000 7f019a1e1700 1 --2- 172.21.15.146:0/1800213403 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f019415cd90 0x7f01940c4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:15.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.604+0000 7f019a1e1700 1 -- 172.21.15.146:0/1800213403 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01900094a0 con 0x7f019406a460 2023-05-24T03:30:15.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.604+0000 7f019a1e1700 1 --2- 172.21.15.146:0/1800213403 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f019406a460 0x7f0194152c60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f019000ebe0 tx=0x7f019000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:15.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.604+0000 7f018affd700 1 -- 172.21.15.146:0/1800213403 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0190009760 con 0x7f019406a460 2023-05-24T03:30:15.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.604+0000 7f018affd700 1 -- 172.21.15.146:0/1800213403 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f019000c850 con 0x7f019406a460 2023-05-24T03:30:15.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.604+0000 7f019c445700 1 -- 172.21.15.146:0/1800213403 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f018c009a70 con 0x7f019406a460 2023-05-24T03:30:15.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.604+0000 7f018affd700 1 -- 172.21.15.146:0/1800213403 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019000cbe0 con 0x7f019406a460 2023-05-24T03:30:15.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.604+0000 7f019c445700 1 -- 172.21.15.146:0/1800213403 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0194160800 con 0x7f019406a460 2023-05-24T03:30:15.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.605+0000 7f019c445700 1 -- 172.21.15.146:0/1800213403 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01940cfa20 con 0x7f019406a460 2023-05-24T03:30:15.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.606+0000 7f018affd700 1 -- 172.21.15.146:0/1800213403 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f019000cd40 con 0x7f019406a460 2023-05-24T03:30:15.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.606+0000 7f018affd700 1 --2- 172.21.15.146:0/1800213403 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f017806ace0 0x7f017806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:15.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.606+0000 7f018affd700 1 -- 172.21.15.146:0/1800213403 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0190089770 con 0x7f019406a460 2023-05-24T03:30:15.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.606+0000 7f01999e0700 1 --2- 172.21.15.146:0/1800213403 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f017806ace0 0x7f017806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:15.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.607+0000 7f01999e0700 1 --2- 172.21.15.146:0/1800213403 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f017806ace0 0x7f017806d190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0184007fd0 tx=0x7f0184007c40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:15.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.611+0000 7f018affd700 1 -- 172.21.15.146:0/1800213403 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f0190054540 con 0x7f019406a460 2023-05-24T03:30:15.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.797+0000 7f019c445700 1 -- 172.21.15.146:0/1800213403 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f01940af620 con 0x7f019406a460 2023-05-24T03:30:15.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.798+0000 7f018affd700 1 -- 172.21.15.146:0/1800213403 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0190057b60 con 0x7f019406a460 2023-05-24T03:30:15.803 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2023-05-24T03:30:15.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.800+0000 7f019c445700 1 -- 172.21.15.146:0/1800213403 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f017806ace0 msgr2=0x7f017806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:15.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.800+0000 7f019c445700 1 --2- 172.21.15.146:0/1800213403 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f017806ace0 0x7f017806d190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0184007fd0 tx=0x7f0184007c40 comp rx=0 tx=0).stop 2023-05-24T03:30:15.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.800+0000 7f019c445700 1 -- 172.21.15.146:0/1800213403 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f019406a460 msgr2=0x7f0194152c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:15.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.800+0000 7f019c445700 1 --2- 172.21.15.146:0/1800213403 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f019406a460 0x7f0194152c60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f019000ebe0 tx=0x7f019000eef0 comp rx=0 tx=0).stop 2023-05-24T03:30:15.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.800+0000 7f019c445700 1 -- 172.21.15.146:0/1800213403 shutdown_connections 2023-05-24T03:30:15.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.800+0000 7f019c445700 1 --2- 172.21.15.146:0/1800213403 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f017806ace0 0x7f017806d190 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:15.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.800+0000 7f019c445700 1 --2- 172.21.15.146:0/1800213403 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f019415cd90 0x7f01940c4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:15.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.800+0000 7f019c445700 1 --2- 172.21.15.146:0/1800213403 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f019406a460 0x7f0194152c60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:15.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.800+0000 7f019c445700 1 --2- 172.21.15.146:0/1800213403 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f01940aefd0 0x7f01941f20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:15.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.800+0000 7f019c445700 1 -- 172.21.15.146:0/1800213403 >> 172.21.15.146:0/1800213403 conn(0x7f01940cfea0 msgr2=0x7f019406a830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:15.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.800+0000 7f019c445700 1 -- 172.21.15.146:0/1800213403 shutdown_connections 2023-05-24T03:30:15.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.800+0000 7f019c445700 1 -- 172.21.15.146:0/1800213403 wait complete. 2023-05-24T03:30:15.816 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-24T03:30:15.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.937+0000 7f6ff2b1d700 1 Processor -- start 2023-05-24T03:30:15.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.937+0000 7f6ff2b1d700 1 -- start start 2023-05-24T03:30:15.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.937+0000 7f6ff2b1d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6fec06a460 0x7f6fec0cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:15.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.937+0000 7f6ff2b1d700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6fec0aefd0 0x7f6fec160d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:15.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.937+0000 7f6ff2b1d700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fec0cfd00 con 0x7f6fec15cd90 2023-05-24T03:30:15.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.937+0000 7f6ff2b1d700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fec072350 con 0x7f6fec0aefd0 2023-05-24T03:30:15.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.937+0000 7f6ff2b1d700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fec0cf460 con 0x7f6fec06a460 2023-05-24T03:30:15.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.938+0000 7f6ff08b9700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6fec06a460 0x7f6fec0cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:15.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.938+0000 7f6ff08b9700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6fec06a460 0x7f6fec0cede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:52666/0 (socket says 172.21.15.146:52666) 2023-05-24T03:30:15.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.938+0000 7f6ff08b9700 1 -- 172.21.15.146:0/3063904563 learned_addr learned my addr 172.21.15.146:0/3063904563 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:15.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.938+0000 7f6ff10ba700 1 --2- 172.21.15.146:0/3063904563 >> v2:172.21.15.151:3300/0 conn(0x7f6fec0aefd0 0x7f6fec160d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:15.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.938+0000 7f6ff08b9700 1 -- 172.21.15.146:0/3063904563 >> v2:172.21.15.151:3300/0 conn(0x7f6fec0aefd0 msgr2=0x7f6fec160d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:15.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.938+0000 7f6ff08b9700 1 --2- 172.21.15.146:0/3063904563 >> v2:172.21.15.151:3300/0 conn(0x7f6fec0aefd0 0x7f6fec160d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:15.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.938+0000 7f6ff08b9700 1 -- 172.21.15.146:0/3063904563 >> v1:172.21.15.151:6789/0 conn(0x7f6fec15cd90 legacy=0x7f6fec06a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:15.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.938+0000 7f6feb7fe700 1 -- 172.21.15.146:0/3063904563 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2475971807 0 0) 0x7f6fd8001110 con 0x7f6fec15cd90 2023-05-24T03:30:15.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.938+0000 7f6ff08b9700 1 -- 172.21.15.146:0/3063904563 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fec0cf740 con 0x7f6fec06a460 2023-05-24T03:30:15.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.938+0000 7f6ff08b9700 1 --2- 172.21.15.146:0/3063904563 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6fec06a460 0x7f6fec0cede0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6fe00098f0 tx=0x7f6fe0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c116cf40fca98257 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:15.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.938+0000 7f6feb7fe700 1 -- 172.21.15.146:0/3063904563 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe0011830 con 0x7f6fec06a460 2023-05-24T03:30:15.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.939+0000 7f6feb7fe700 1 -- 172.21.15.146:0/3063904563 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe0011990 con 0x7f6fec06a460 2023-05-24T03:30:15.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.939+0000 7f6feb7fe700 1 -- 172.21.15.146:0/3063904563 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe0011d20 con 0x7f6fec06a460 2023-05-24T03:30:15.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.939+0000 7f6ff2b1d700 1 -- 172.21.15.146:0/3063904563 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6fec06a460 msgr2=0x7f6fec0cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:15.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.939+0000 7f6ff2b1d700 1 --2- 172.21.15.146:0/3063904563 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6fec06a460 0x7f6fec0cede0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6fe00098f0 tx=0x7f6fe0009c00 comp rx=0 tx=0).stop 2023-05-24T03:30:15.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.939+0000 7f6ff2b1d700 1 -- 172.21.15.146:0/3063904563 shutdown_connections 2023-05-24T03:30:15.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.939+0000 7f6ff2b1d700 1 --2- 172.21.15.146:0/3063904563 >> v2:172.21.15.151:3300/0 conn(0x7f6fec0aefd0 0x7f6fec160d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:15.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.939+0000 7f6ff2b1d700 1 --2- 172.21.15.146:0/3063904563 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6fec06a460 0x7f6fec0cede0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:15.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.939+0000 7f6ff2b1d700 1 -- 172.21.15.146:0/3063904563 >> 172.21.15.146:0/3063904563 conn(0x7f6fec0cfea0 msgr2=0x7f6fec0d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:15.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.939+0000 7f6ff2b1d700 1 -- 172.21.15.146:0/3063904563 shutdown_connections 2023-05-24T03:30:15.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.939+0000 7f6ff2b1d700 1 -- 172.21.15.146:0/3063904563 wait complete. 2023-05-24T03:30:15.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.940+0000 7f6ff2b1d700 1 Processor -- start 2023-05-24T03:30:15.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.940+0000 7f6ff2b1d700 1 -- start start 2023-05-24T03:30:15.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.941+0000 7f6ff2b1d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6fec06a460 0x7f6fec150e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:15.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.941+0000 7f6ff2b1d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fec0aefd0 0x7f6fec0af8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:15.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.941+0000 7f6ff2b1d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6fec15cd90 0x7f6fec0c59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:15.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.941+0000 7f6ff2b1d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fec0c5220 con 0x7f6fec0aefd0 2023-05-24T03:30:15.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.941+0000 7f6ff2b1d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fec15a9b0 con 0x7f6fec15cd90 2023-05-24T03:30:15.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.941+0000 7f6ff2b1d700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fec0c45e0 con 0x7f6fec06a460 2023-05-24T03:30:15.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.941+0000 7f6febfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fec0aefd0 0x7f6fec0af8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:15.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.941+0000 7f6febfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fec0aefd0 0x7f6fec0af8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39810/0 (socket says 172.21.15.146:39810) 2023-05-24T03:30:15.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.941+0000 7f6febfff700 1 -- 172.21.15.146:0/4175554877 learned_addr learned my addr 172.21.15.146:0/4175554877 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:15.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.941+0000 7f6ff08b9700 1 --2- 172.21.15.146:0/4175554877 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6fec06a460 0x7f6fec150e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:15.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.941+0000 7f6ff10ba700 1 --2- 172.21.15.146:0/4175554877 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6fec15cd90 0x7f6fec0c59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:15.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.942+0000 7f6febfff700 1 -- 172.21.15.146:0/4175554877 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6fec06a460 msgr2=0x7f6fec150e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:15.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.942+0000 7f6febfff700 1 --2- 172.21.15.146:0/4175554877 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6fec06a460 0x7f6fec150e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:15.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.942+0000 7f6febfff700 1 -- 172.21.15.146:0/4175554877 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6fec15cd90 msgr2=0x7f6fec0c59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:15.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.942+0000 7f6febfff700 1 --2- 172.21.15.146:0/4175554877 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6fec15cd90 0x7f6fec0c59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:15.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.942+0000 7f6febfff700 1 -- 172.21.15.146:0/4175554877 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe0009550 con 0x7f6fec0aefd0 2023-05-24T03:30:15.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.942+0000 7f6febfff700 1 --2- 172.21.15.146:0/4175554877 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fec0aefd0 0x7f6fec0af8c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6fd800c780 tx=0x7f6fd800ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:15.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.942+0000 7f6fe97fa700 1 -- 172.21.15.146:0/4175554877 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd80054e0 con 0x7f6fec0aefd0 2023-05-24T03:30:15.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.942+0000 7f6fe97fa700 1 -- 172.21.15.146:0/4175554877 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd8003680 con 0x7f6fec0aefd0 2023-05-24T03:30:15.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.942+0000 7f6ff2b1d700 1 -- 172.21.15.146:0/4175554877 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fec160800 con 0x7f6fec0aefd0 2023-05-24T03:30:15.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.942+0000 7f6fe97fa700 1 -- 172.21.15.146:0/4175554877 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd8003a30 con 0x7f6fec0aefd0 2023-05-24T03:30:15.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.942+0000 7f6ff2b1d700 1 -- 172.21.15.146:0/4175554877 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fec0cfa20 con 0x7f6fec0aefd0 2023-05-24T03:30:15.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.943+0000 7f6ff2b1d700 1 -- 172.21.15.146:0/4175554877 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fec0af620 con 0x7f6fec0aefd0 2023-05-24T03:30:15.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.943+0000 7f6fe97fa700 1 -- 172.21.15.146:0/4175554877 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6fd8003b90 con 0x7f6fec0aefd0 2023-05-24T03:30:15.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.944+0000 7f6fe97fa700 1 --2- 172.21.15.146:0/4175554877 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f6fd006ace0 0x7f6fd006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:15.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.944+0000 7f6fe97fa700 1 -- 172.21.15.146:0/4175554877 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6fd8088870 con 0x7f6fec0aefd0 2023-05-24T03:30:15.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.944+0000 7f6ff08b9700 1 --2- 172.21.15.146:0/4175554877 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f6fd006ace0 0x7f6fd006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:15.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.944+0000 7f6ff08b9700 1 --2- 172.21.15.146:0/4175554877 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f6fd006ace0 0x7f6fd006d190 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0014040 tx=0x7f6fe0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:15.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:15.948+0000 7f6fe97fa700 1 -- 172.21.15.146:0/4175554877 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f6fd8057200 con 0x7f6fec0aefd0 2023-05-24T03:30:16.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.137+0000 7f6ff2b1d700 1 -- 172.21.15.146:0/4175554877 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6fec0cfd00 con 0x7f6fec0aefd0 2023-05-24T03:30:16.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.138+0000 7f6fe97fa700 1 -- 172.21.15.146:0/4175554877 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6fd8017020 con 0x7f6fec0aefd0 2023-05-24T03:30:16.142 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2023-05-24T03:30:16.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.140+0000 7f6ff2b1d700 1 -- 172.21.15.146:0/4175554877 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f6fd006ace0 msgr2=0x7f6fd006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:16.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.140+0000 7f6ff2b1d700 1 --2- 172.21.15.146:0/4175554877 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f6fd006ace0 0x7f6fd006d190 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0014040 tx=0x7f6fe0008030 comp rx=0 tx=0).stop 2023-05-24T03:30:16.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.140+0000 7f6ff2b1d700 1 -- 172.21.15.146:0/4175554877 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fec0aefd0 msgr2=0x7f6fec0af8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:16.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.140+0000 7f6ff2b1d700 1 --2- 172.21.15.146:0/4175554877 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fec0aefd0 0x7f6fec0af8c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6fd800c780 tx=0x7f6fd800ca90 comp rx=0 tx=0).stop 2023-05-24T03:30:16.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.140+0000 7f6ff2b1d700 1 -- 172.21.15.146:0/4175554877 shutdown_connections 2023-05-24T03:30:16.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.140+0000 7f6ff2b1d700 1 --2- 172.21.15.146:0/4175554877 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f6fd006ace0 0x7f6fd006d190 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:16.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.140+0000 7f6ff2b1d700 1 --2- 172.21.15.146:0/4175554877 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6fec15cd90 0x7f6fec0c59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:16.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.140+0000 7f6ff2b1d700 1 --2- 172.21.15.146:0/4175554877 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6fec06a460 0x7f6fec150e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:16.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.140+0000 7f6ff2b1d700 1 --2- 172.21.15.146:0/4175554877 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fec0aefd0 0x7f6fec0af8c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:16.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.140+0000 7f6ff2b1d700 1 -- 172.21.15.146:0/4175554877 >> 172.21.15.146:0/4175554877 conn(0x7f6fec0cfea0 msgr2=0x7f6fec15c260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:16.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.140+0000 7f6ff2b1d700 1 -- 172.21.15.146:0/4175554877 shutdown_connections 2023-05-24T03:30:16.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.140+0000 7f6ff2b1d700 1 -- 172.21.15.146:0/4175554877 wait complete. 2023-05-24T03:30:16.156 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-24T03:30:16.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.276+0000 7f3e5cfe1700 1 Processor -- start 2023-05-24T03:30:16.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.276+0000 7f3e5cfe1700 1 -- start start 2023-05-24T03:30:16.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.277+0000 7f3e5cfe1700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e5815cd90 0x7f3e580cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:16.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.277+0000 7f3e5cfe1700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3e580aefd0 0x7f3e58160d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:16.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.277+0000 7f3e5cfe1700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e580cfd00 con 0x7f3e5806a460 2023-05-24T03:30:16.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.277+0000 7f3e5cfe1700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e58072350 con 0x7f3e580aefd0 2023-05-24T03:30:16.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.277+0000 7f3e5cfe1700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e580cf460 con 0x7f3e5815cd90 2023-05-24T03:30:16.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.277+0000 7f3e56d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3e580aefd0 0x7f3e58160d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:16.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.277+0000 7f3e5659c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3e5806a460 0x7f3e5806a830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46268/0 (socket says 172.21.15.146:46268) 2023-05-24T03:30:16.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.277+0000 7f3e5659c700 1 -- 172.21.15.146:0/4228328489 learned_addr learned my addr 172.21.15.146:0/4228328489 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:30:16.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.277+0000 7f3e55d9b700 1 --2- 172.21.15.146:0/4228328489 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e5815cd90 0x7f3e580cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:16.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.278+0000 7f3e56d9d700 1 -- 172.21.15.146:0/4228328489 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e5815cd90 msgr2=0x7f3e580cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:16.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.278+0000 7f3e56d9d700 1 --2- 172.21.15.146:0/4228328489 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e5815cd90 0x7f3e580cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:16.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.278+0000 7f3e56d9d700 1 -- 172.21.15.146:0/4228328489 >> v1:172.21.15.146:6789/0 conn(0x7f3e5806a460 legacy=0x7f3e5806a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:16.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.278+0000 7f3e56d9d700 1 -- 172.21.15.146:0/4228328489 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e580cf740 con 0x7f3e580aefd0 2023-05-24T03:30:16.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.278+0000 7f3e5559a700 1 -- 172.21.15.146:0/4228328489 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2648080084 0 0) 0x7f3e4c001110 con 0x7f3e5806a460 2023-05-24T03:30:16.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.278+0000 7f3e56d9d700 1 --2- 172.21.15.146:0/4228328489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e580aefd0 0x7f3e58160d20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3e50009d90 tx=0x7f3e5000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd90c2e29f95f261 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:16.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.278+0000 7f3e5559a700 1 -- 172.21.15.146:0/4228328489 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5000e070 con 0x7f3e580aefd0 2023-05-24T03:30:16.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.278+0000 7f3e5559a700 1 -- 172.21.15.146:0/4228328489 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e5000bbd0 con 0x7f3e580aefd0 2023-05-24T03:30:16.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.278+0000 7f3e5559a700 1 -- 172.21.15.146:0/4228328489 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e50012430 con 0x7f3e580aefd0 2023-05-24T03:30:16.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.278+0000 7f3e5cfe1700 1 -- 172.21.15.146:0/4228328489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e580aefd0 msgr2=0x7f3e58160d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:16.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.278+0000 7f3e5cfe1700 1 --2- 172.21.15.146:0/4228328489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e580aefd0 0x7f3e58160d20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3e50009d90 tx=0x7f3e5000b330 comp rx=0 tx=0).stop 2023-05-24T03:30:16.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.279+0000 7f3e5cfe1700 1 -- 172.21.15.146:0/4228328489 shutdown_connections 2023-05-24T03:30:16.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.279+0000 7f3e5cfe1700 1 --2- 172.21.15.146:0/4228328489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e580aefd0 0x7f3e58160d20 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:16.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.279+0000 7f3e5cfe1700 1 --2- 172.21.15.146:0/4228328489 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e5815cd90 0x7f3e580cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:16.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.279+0000 7f3e5cfe1700 1 -- 172.21.15.146:0/4228328489 >> 172.21.15.146:0/4228328489 conn(0x7f3e580cfea0 msgr2=0x7f3e580d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:16.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.279+0000 7f3e5cfe1700 1 -- 172.21.15.146:0/4228328489 shutdown_connections 2023-05-24T03:30:16.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.279+0000 7f3e5cfe1700 1 -- 172.21.15.146:0/4228328489 wait complete. 2023-05-24T03:30:16.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.280+0000 7f3e5cfe1700 1 Processor -- start 2023-05-24T03:30:16.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.280+0000 7f3e5cfe1700 1 -- start start 2023-05-24T03:30:16.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.281+0000 7f3e5cfe1700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e5806a460 0x7f3e5815a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:16.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.281+0000 7f3e5cfe1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e580aefd0 0x7f3e58152a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:16.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.281+0000 7f3e5cfe1700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e5815cd90 0x7f3e58159cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:16.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.281+0000 7f3e5cfe1700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e58153140 con 0x7f3e580aefd0 2023-05-24T03:30:16.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.281+0000 7f3e5cfe1700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5815ee40 con 0x7f3e5806a460 2023-05-24T03:30:16.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.281+0000 7f3e5cfe1700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5815f120 con 0x7f3e5815cd90 2023-05-24T03:30:16.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.281+0000 7f3e55d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e580aefd0 0x7f3e58152a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:16.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.281+0000 7f3e55d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e580aefd0 0x7f3e58152a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39824/0 (socket says 172.21.15.146:39824) 2023-05-24T03:30:16.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.281+0000 7f3e55d9b700 1 -- 172.21.15.146:0/451012679 learned_addr learned my addr 172.21.15.146:0/451012679 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:16.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.281+0000 7f3e56d9d700 1 --2- 172.21.15.146:0/451012679 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e5815cd90 0x7f3e58159cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:16.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.281+0000 7f3e5659c700 1 --2- 172.21.15.146:0/451012679 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e5806a460 0x7f3e5815a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:16.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.281+0000 7f3e55d9b700 1 -- 172.21.15.146:0/451012679 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e5815cd90 msgr2=0x7f3e58159cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:16.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.281+0000 7f3e55d9b700 1 --2- 172.21.15.146:0/451012679 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e5815cd90 0x7f3e58159cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:16.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.281+0000 7f3e55d9b700 1 -- 172.21.15.146:0/451012679 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e5806a460 msgr2=0x7f3e5815a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:16.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.281+0000 7f3e55d9b700 1 --2- 172.21.15.146:0/451012679 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e5806a460 0x7f3e5815a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:16.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.281+0000 7f3e55d9b700 1 -- 172.21.15.146:0/451012679 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e50009a70 con 0x7f3e580aefd0 2023-05-24T03:30:16.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.281+0000 7f3e55d9b700 1 --2- 172.21.15.146:0/451012679 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e580aefd0 0x7f3e58152a40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3e4800e810 tx=0x7f3e4800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:16.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.281+0000 7f3e46ffd700 1 -- 172.21.15.146:0/451012679 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e48013610 con 0x7f3e580aefd0 2023-05-24T03:30:16.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.281+0000 7f3e46ffd700 1 -- 172.21.15.146:0/451012679 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e48013770 con 0x7f3e580aefd0 2023-05-24T03:30:16.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.281+0000 7f3e5cfe1700 1 -- 172.21.15.146:0/451012679 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e58160800 con 0x7f3e580aefd0 2023-05-24T03:30:16.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.282+0000 7f3e46ffd700 1 -- 172.21.15.146:0/451012679 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e48013b00 con 0x7f3e580aefd0 2023-05-24T03:30:16.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.282+0000 7f3e5cfe1700 1 -- 172.21.15.146:0/451012679 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e580cfa20 con 0x7f3e580aefd0 2023-05-24T03:30:16.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.282+0000 7f3e5cfe1700 1 -- 172.21.15.146:0/451012679 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e580af620 con 0x7f3e580aefd0 2023-05-24T03:30:16.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.283+0000 7f3e46ffd700 1 -- 172.21.15.146:0/451012679 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3e48013c60 con 0x7f3e580aefd0 2023-05-24T03:30:16.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.283+0000 7f3e46ffd700 1 --2- 172.21.15.146:0/451012679 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f3e3806ace0 0x7f3e3806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:16.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.284+0000 7f3e5659c700 1 --2- 172.21.15.146:0/451012679 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f3e3806ace0 0x7f3e3806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:16.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.284+0000 7f3e46ffd700 1 -- 172.21.15.146:0/451012679 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3e48089400 con 0x7f3e580aefd0 2023-05-24T03:30:16.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.284+0000 7f3e5659c700 1 --2- 172.21.15.146:0/451012679 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f3e3806ace0 0x7f3e3806d190 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c000f60 tx=0x7f3e4c007c90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:16.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.288+0000 7f3e46ffd700 1 -- 172.21.15.146:0/451012679 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3e480541d0 con 0x7f3e580aefd0 2023-05-24T03:30:16.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.475+0000 7f3e5cfe1700 1 -- 172.21.15.146:0/451012679 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3e58153280 con 0x7f3e580aefd0 2023-05-24T03:30:16.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.476+0000 7f3e46ffd700 1 -- 172.21.15.146:0/451012679 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3e58153280 con 0x7f3e580aefd0 2023-05-24T03:30:16.480 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2023-05-24T03:30:16.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.478+0000 7f3e5cfe1700 1 -- 172.21.15.146:0/451012679 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f3e3806ace0 msgr2=0x7f3e3806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:16.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.478+0000 7f3e5cfe1700 1 --2- 172.21.15.146:0/451012679 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f3e3806ace0 0x7f3e3806d190 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c000f60 tx=0x7f3e4c007c90 comp rx=0 tx=0).stop 2023-05-24T03:30:16.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.478+0000 7f3e5cfe1700 1 -- 172.21.15.146:0/451012679 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e580aefd0 msgr2=0x7f3e58152a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:16.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.478+0000 7f3e5cfe1700 1 --2- 172.21.15.146:0/451012679 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e580aefd0 0x7f3e58152a40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3e4800e810 tx=0x7f3e4800ebd0 comp rx=0 tx=0).stop 2023-05-24T03:30:16.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.478+0000 7f3e5cfe1700 1 -- 172.21.15.146:0/451012679 shutdown_connections 2023-05-24T03:30:16.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.478+0000 7f3e5cfe1700 1 --2- 172.21.15.146:0/451012679 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f3e3806ace0 0x7f3e3806d190 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:16.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.478+0000 7f3e5cfe1700 1 --2- 172.21.15.146:0/451012679 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e5815cd90 0x7f3e58159cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:16.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.478+0000 7f3e5cfe1700 1 --2- 172.21.15.146:0/451012679 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e5806a460 0x7f3e5815a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:16.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.478+0000 7f3e5cfe1700 1 --2- 172.21.15.146:0/451012679 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e580aefd0 0x7f3e58152a40 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:16.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.478+0000 7f3e5cfe1700 1 -- 172.21.15.146:0/451012679 >> 172.21.15.146:0/451012679 conn(0x7f3e580cfea0 msgr2=0x7f3e58066100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:16.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.478+0000 7f3e5cfe1700 1 -- 172.21.15.146:0/451012679 shutdown_connections 2023-05-24T03:30:16.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.478+0000 7f3e5cfe1700 1 -- 172.21.15.146:0/451012679 wait complete. 2023-05-24T03:30:16.494 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-24T03:30:16.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.614+0000 7f64e9d97700 1 Processor -- start 2023-05-24T03:30:16.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.614+0000 7f64e9d97700 1 -- start start 2023-05-24T03:30:16.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.615+0000 7f64e9d97700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64e415cd90 0x7f64e40cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:16.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.615+0000 7f64e9d97700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f64e40aefd0 0x7f64e4160d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:16.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.615+0000 7f64e9d97700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64e40cfd00 con 0x7f64e406a460 2023-05-24T03:30:16.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.615+0000 7f64e9d97700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64e4072350 con 0x7f64e40aefd0 2023-05-24T03:30:16.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.615+0000 7f64e9d97700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64e40cf460 con 0x7f64e415cd90 2023-05-24T03:30:16.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.615+0000 7f64e3fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f64e40aefd0 0x7f64e4160d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:16.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.615+0000 7f64e3fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f64e40aefd0 0x7f64e4160d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39834/0 (socket says 172.21.15.146:39834) 2023-05-24T03:30:16.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.615+0000 7f64e3fff700 1 -- 172.21.15.146:0/1780188433 learned_addr learned my addr 172.21.15.146:0/1780188433 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:16.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.615+0000 7f64e2ffd700 1 --2- 172.21.15.146:0/1780188433 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64e415cd90 0x7f64e40cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:16.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.615+0000 7f64e3fff700 1 -- 172.21.15.146:0/1780188433 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64e415cd90 msgr2=0x7f64e40cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:16.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.615+0000 7f64e3fff700 1 --2- 172.21.15.146:0/1780188433 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64e415cd90 0x7f64e40cede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:16.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.615+0000 7f64e3fff700 1 -- 172.21.15.146:0/1780188433 >> v1:172.21.15.151:6789/0 conn(0x7f64e406a460 legacy=0x7f64e406a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:16.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.615+0000 7f64e3fff700 1 -- 172.21.15.146:0/1780188433 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e40cf740 con 0x7f64e40aefd0 2023-05-24T03:30:16.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.615+0000 7f64e3fff700 1 --2- 172.21.15.146:0/1780188433 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64e40aefd0 0x7f64e4160d20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f64dc009e50 tx=0x7f64dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcc39ab1e8b74064 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:16.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.615+0000 7f64e27fc700 1 -- 172.21.15.146:0/1780188433 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64dc00e070 con 0x7f64e40aefd0 2023-05-24T03:30:16.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.615+0000 7f64e27fc700 1 -- 172.21.15.146:0/1780188433 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64dc003a20 con 0x7f64e40aefd0 2023-05-24T03:30:16.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.615+0000 7f64e27fc700 1 -- 172.21.15.146:0/1780188433 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64dc003dd0 con 0x7f64e40aefd0 2023-05-24T03:30:16.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.616+0000 7f64e9d97700 1 -- 172.21.15.146:0/1780188433 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64e40aefd0 msgr2=0x7f64e4160d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:16.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.616+0000 7f64e9d97700 1 --2- 172.21.15.146:0/1780188433 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64e40aefd0 0x7f64e4160d20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f64dc009e50 tx=0x7f64dc00b330 comp rx=0 tx=0).stop 2023-05-24T03:30:16.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.616+0000 7f64e9d97700 1 -- 172.21.15.146:0/1780188433 shutdown_connections 2023-05-24T03:30:16.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.616+0000 7f64e9d97700 1 --2- 172.21.15.146:0/1780188433 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64e40aefd0 0x7f64e4160d20 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:16.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.616+0000 7f64e9d97700 1 --2- 172.21.15.146:0/1780188433 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64e415cd90 0x7f64e40cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:16.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.616+0000 7f64e9d97700 1 -- 172.21.15.146:0/1780188433 >> 172.21.15.146:0/1780188433 conn(0x7f64e40cfea0 msgr2=0x7f64e40d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:16.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.616+0000 7f64e9d97700 1 -- 172.21.15.146:0/1780188433 shutdown_connections 2023-05-24T03:30:16.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.616+0000 7f64e9d97700 1 -- 172.21.15.146:0/1780188433 wait complete. 2023-05-24T03:30:16.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.617+0000 7f64e9d97700 1 Processor -- start 2023-05-24T03:30:16.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.617+0000 7f64e9d97700 1 -- start start 2023-05-24T03:30:16.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.618+0000 7f64e9d97700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64e406a460 0x7f64e41e7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:16.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.618+0000 7f64e9d97700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64e40aefd0 0x7f64e41e8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:16.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.618+0000 7f64e9d97700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64e415cd90 0x7f64e4148800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:16.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.618+0000 7f64e9d97700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e415acb0 con 0x7f64e406a460 2023-05-24T03:30:16.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.618+0000 7f64e9d97700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e415b830 con 0x7f64e415cd90 2023-05-24T03:30:16.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.618+0000 7f64e9d97700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64e40c4600 con 0x7f64e40aefd0 2023-05-24T03:30:16.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.618+0000 7f64e37fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64e406a460 0x7f64e41e7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:16.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.618+0000 7f64e37fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64e406a460 0x7f64e41e7c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39836/0 (socket says 172.21.15.146:39836) 2023-05-24T03:30:16.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.618+0000 7f64e37fe700 1 -- 172.21.15.146:0/2471230751 learned_addr learned my addr 172.21.15.146:0/2471230751 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:16.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.618+0000 7f64e2ffd700 1 --2- 172.21.15.146:0/2471230751 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64e40aefd0 0x7f64e41e8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:16.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.618+0000 7f64e3fff700 1 --2- 172.21.15.146:0/2471230751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64e415cd90 0x7f64e4148800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:16.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.618+0000 7f64e37fe700 1 -- 172.21.15.146:0/2471230751 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64e40aefd0 msgr2=0x7f64e41e8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:16.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.618+0000 7f64e37fe700 1 --2- 172.21.15.146:0/2471230751 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64e40aefd0 0x7f64e41e8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:16.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.618+0000 7f64e37fe700 1 -- 172.21.15.146:0/2471230751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64e415cd90 msgr2=0x7f64e4148800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:16.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.618+0000 7f64e37fe700 1 --2- 172.21.15.146:0/2471230751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64e415cd90 0x7f64e4148800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:16.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.618+0000 7f64e37fe700 1 -- 172.21.15.146:0/2471230751 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64dc009b30 con 0x7f64e406a460 2023-05-24T03:30:16.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.618+0000 7f64e2ffd700 1 --2- 172.21.15.146:0/2471230751 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64e40aefd0 0x7f64e41e8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:30:16.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.619+0000 7f64e37fe700 1 --2- 172.21.15.146:0/2471230751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64e406a460 0x7f64e41e7c10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f64d400b500 tx=0x7f64d400b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:16.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.619+0000 7f64cbfff700 1 -- 172.21.15.146:0/2471230751 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d4011830 con 0x7f64e406a460 2023-05-24T03:30:16.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.619+0000 7f64cbfff700 1 -- 172.21.15.146:0/2471230751 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64d4011990 con 0x7f64e406a460 2023-05-24T03:30:16.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.619+0000 7f64e9d97700 1 -- 172.21.15.146:0/2471230751 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64e4160800 con 0x7f64e406a460 2023-05-24T03:30:16.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.619+0000 7f64cbfff700 1 -- 172.21.15.146:0/2471230751 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d4011d40 con 0x7f64e406a460 2023-05-24T03:30:16.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.619+0000 7f64e9d97700 1 -- 172.21.15.146:0/2471230751 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64e40cfa20 con 0x7f64e406a460 2023-05-24T03:30:16.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.620+0000 7f64e9d97700 1 -- 172.21.15.146:0/2471230751 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64e40af620 con 0x7f64e406a460 2023-05-24T03:30:16.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.620+0000 7f64cbfff700 1 -- 172.21.15.146:0/2471230751 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f64d401a400 con 0x7f64e406a460 2023-05-24T03:30:16.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.621+0000 7f64cbfff700 1 --2- 172.21.15.146:0/2471230751 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f64d006ace0 0x7f64d006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:16.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.621+0000 7f64cbfff700 1 -- 172.21.15.146:0/2471230751 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f64d40898d0 con 0x7f64e406a460 2023-05-24T03:30:16.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.621+0000 7f64e2ffd700 1 --2- 172.21.15.146:0/2471230751 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f64d006ace0 0x7f64d006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:16.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.621+0000 7f64e2ffd700 1 --2- 172.21.15.146:0/2471230751 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f64d006ace0 0x7f64d006d190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f64e40b01a0 tx=0x7f64d8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:16.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.625+0000 7f64cbfff700 1 -- 172.21.15.146:0/2471230751 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f64d4054690 con 0x7f64e406a460 2023-05-24T03:30:16.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.811+0000 7f64e9d97700 1 -- 172.21.15.146:0/2471230751 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f64e4068d00 con 0x7f64e406a460 2023-05-24T03:30:16.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.812+0000 7f64cbfff700 1 -- 172.21.15.146:0/2471230751 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f64d40150a0 con 0x7f64e406a460 2023-05-24T03:30:16.816 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2023-05-24T03:30:16.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.814+0000 7f64e9d97700 1 -- 172.21.15.146:0/2471230751 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f64d006ace0 msgr2=0x7f64d006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:16.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.814+0000 7f64e9d97700 1 --2- 172.21.15.146:0/2471230751 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f64d006ace0 0x7f64d006d190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f64e40b01a0 tx=0x7f64d8008040 comp rx=0 tx=0).stop 2023-05-24T03:30:16.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.814+0000 7f64e9d97700 1 -- 172.21.15.146:0/2471230751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64e406a460 msgr2=0x7f64e41e7c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:16.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.814+0000 7f64e9d97700 1 --2- 172.21.15.146:0/2471230751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64e406a460 0x7f64e41e7c10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f64d400b500 tx=0x7f64d400b8c0 comp rx=0 tx=0).stop 2023-05-24T03:30:16.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.814+0000 7f64e9d97700 1 -- 172.21.15.146:0/2471230751 shutdown_connections 2023-05-24T03:30:16.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.814+0000 7f64e9d97700 1 --2- 172.21.15.146:0/2471230751 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f64d006ace0 0x7f64d006d190 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:16.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.814+0000 7f64e9d97700 1 --2- 172.21.15.146:0/2471230751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64e415cd90 0x7f64e4148800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:16.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.814+0000 7f64e9d97700 1 --2- 172.21.15.146:0/2471230751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64e406a460 0x7f64e41e7c10 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:16.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.814+0000 7f64e9d97700 1 --2- 172.21.15.146:0/2471230751 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64e40aefd0 0x7f64e41e8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:16.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.814+0000 7f64e9d97700 1 -- 172.21.15.146:0/2471230751 >> 172.21.15.146:0/2471230751 conn(0x7f64e40cfea0 msgr2=0x7f64e406a830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:16.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.814+0000 7f64e9d97700 1 -- 172.21.15.146:0/2471230751 shutdown_connections 2023-05-24T03:30:16.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.814+0000 7f64e9d97700 1 -- 172.21.15.146:0/2471230751 wait complete. 2023-05-24T03:30:16.829 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-24T03:30:16.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.950+0000 7f2f7d637700 1 Processor -- start 2023-05-24T03:30:16.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.950+0000 7f2f7d637700 1 -- start start 2023-05-24T03:30:16.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.951+0000 7f2f7d637700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2f7815cf60 0x7f2f780ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:16.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.951+0000 7f2f7d637700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f780cf750 con 0x7f2f7815cb90 2023-05-24T03:30:16.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.951+0000 7f2f7d637700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f780cfa30 con 0x7f2f780b20f0 2023-05-24T03:30:16.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.951+0000 7f2f7d637700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7806d140 con 0x7f2f7815cf60 2023-05-24T03:30:16.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.951+0000 7f2f76ffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f2f7815cb90 0x7f2f780ced50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46296/0 (socket says 172.21.15.146:46296) 2023-05-24T03:30:16.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.951+0000 7f2f76ffd700 1 -- 172.21.15.146:0/231593223 learned_addr learned my addr 172.21.15.146:0/231593223 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:30:16.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.951+0000 7f2f767fc700 1 --2- 172.21.15.146:0/231593223 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2f7815cf60 0x7f2f780ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:16.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.951+0000 7f2f75ffb700 1 -- 172.21.15.146:0/231593223 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4281617008 0 0) 0x7f2f780cf750 con 0x7f2f7815cb90 2023-05-24T03:30:16.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.951+0000 7f2f75ffb700 1 -- 172.21.15.146:0/231593223 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f600035b0 con 0x7f2f7815cb90 2023-05-24T03:30:16.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.951+0000 7f2f767fc700 1 -- 172.21.15.146:0/231593223 >> v1:172.21.15.151:6789/0 conn(0x7f2f780b20f0 legacy=0x7f2f7806db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:16.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.951+0000 7f2f75ffb700 1 -- 172.21.15.146:0/231593223 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2386012540 0 0) 0x7f2f600035b0 con 0x7f2f7815cb90 2023-05-24T03:30:16.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.951+0000 7f2f767fc700 1 -- 172.21.15.146:0/231593223 >> v1:172.21.15.146:6789/0 conn(0x7f2f7815cb90 legacy=0x7f2f780ced50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:16.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.951+0000 7f2f767fc700 1 -- 172.21.15.146:0/231593223 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f7806d350 con 0x7f2f7815cf60 2023-05-24T03:30:16.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.951+0000 7f2f767fc700 1 --2- 172.21.15.146:0/231593223 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2f7815cf60 0x7f2f780ac8b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2f68009870 tx=0x7f2f68009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2efc3af427149a06 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:16.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.952+0000 7f2f75ffb700 1 -- 172.21.15.146:0/231593223 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c001670 con 0x7f2f7815cf60 2023-05-24T03:30:16.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.952+0000 7f2f75ffb700 1 -- 172.21.15.146:0/231593223 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f68004030 con 0x7f2f7815cf60 2023-05-24T03:30:16.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.952+0000 7f2f75ffb700 1 -- 172.21.15.146:0/231593223 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f680043c0 con 0x7f2f7815cf60 2023-05-24T03:30:16.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.952+0000 7f2f7d637700 1 -- 172.21.15.146:0/231593223 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2f7815cf60 msgr2=0x7f2f780ac8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:16.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.952+0000 7f2f7d637700 1 --2- 172.21.15.146:0/231593223 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2f7815cf60 0x7f2f780ac8b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2f68009870 tx=0x7f2f68009b80 comp rx=0 tx=0).stop 2023-05-24T03:30:16.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.952+0000 7f2f7d637700 1 -- 172.21.15.146:0/231593223 shutdown_connections 2023-05-24T03:30:16.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.952+0000 7f2f7d637700 1 --2- 172.21.15.146:0/231593223 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2f7815cf60 0x7f2f780ac8b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:16.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.952+0000 7f2f7d637700 1 -- 172.21.15.146:0/231593223 >> 172.21.15.146:0/231593223 conn(0x7f2f7806f860 msgr2=0x7f2f780b1970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:16.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.952+0000 7f2f7d637700 1 -- 172.21.15.146:0/231593223 shutdown_connections 2023-05-24T03:30:16.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.952+0000 7f2f7d637700 1 -- 172.21.15.146:0/231593223 wait complete. 2023-05-24T03:30:16.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.954+0000 7f2f7d637700 1 Processor -- start 2023-05-24T03:30:16.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.954+0000 7f2f7d637700 1 -- start start 2023-05-24T03:30:16.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.954+0000 7f2f7d637700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2f780b20f0 0x7f2f7815e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:16.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.954+0000 7f2f7d637700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f7815cb90 0x7f2f7814d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:16.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.954+0000 7f2f7d637700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f7815cf60 0x7f2f7814d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:16.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.954+0000 7f2f7d637700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f781f5d20 con 0x7f2f7815cf60 2023-05-24T03:30:16.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.954+0000 7f2f7d637700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f781f3ae0 con 0x7f2f7815cb90 2023-05-24T03:30:16.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.954+0000 7f2f7d637700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f781f34b0 con 0x7f2f780b20f0 2023-05-24T03:30:16.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.954+0000 7f2f777fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f7815cf60 0x7f2f7814d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:16.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.954+0000 7f2f777fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f7815cf60 0x7f2f7814d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39854/0 (socket says 172.21.15.146:39854) 2023-05-24T03:30:16.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.954+0000 7f2f777fe700 1 -- 172.21.15.146:0/2276830874 learned_addr learned my addr 172.21.15.146:0/2276830874 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:16.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.955+0000 7f2f767fc700 1 --2- 172.21.15.146:0/2276830874 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f7815cb90 0x7f2f7814d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:16.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.955+0000 7f2f76ffd700 1 --2- 172.21.15.146:0/2276830874 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2f780b20f0 0x7f2f7815e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:16.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.955+0000 7f2f777fe700 1 -- 172.21.15.146:0/2276830874 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2f780b20f0 msgr2=0x7f2f7815e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:16.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.955+0000 7f2f777fe700 1 --2- 172.21.15.146:0/2276830874 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2f780b20f0 0x7f2f7815e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:16.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.955+0000 7f2f777fe700 1 -- 172.21.15.146:0/2276830874 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f7815cb90 msgr2=0x7f2f7814d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:16.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.955+0000 7f2f777fe700 1 --2- 172.21.15.146:0/2276830874 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f7815cb90 0x7f2f7814d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:16.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.955+0000 7f2f777fe700 1 -- 172.21.15.146:0/2276830874 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f680094a0 con 0x7f2f7815cf60 2023-05-24T03:30:16.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.955+0000 7f2f777fe700 1 --2- 172.21.15.146:0/2276830874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f7815cf60 0x7f2f7814d610 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2f7000c870 tx=0x7f2f7000cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:16.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.955+0000 7f2f5f7fe700 1 -- 172.21.15.146:0/2276830874 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f70003e30 con 0x7f2f7815cf60 2023-05-24T03:30:16.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.955+0000 7f2f5f7fe700 1 -- 172.21.15.146:0/2276830874 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f70005070 con 0x7f2f7815cf60 2023-05-24T03:30:16.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.955+0000 7f2f7d637700 1 -- 172.21.15.146:0/2276830874 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f780cf460 con 0x7f2f7815cf60 2023-05-24T03:30:16.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.955+0000 7f2f5f7fe700 1 -- 172.21.15.146:0/2276830874 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f70005420 con 0x7f2f7815cf60 2023-05-24T03:30:16.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.955+0000 7f2f7d637700 1 -- 172.21.15.146:0/2276830874 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f7806d630 con 0x7f2f7815cf60 2023-05-24T03:30:16.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.956+0000 7f2f7d637700 1 -- 172.21.15.146:0/2276830874 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f7806e260 con 0x7f2f7815cf60 2023-05-24T03:30:16.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.957+0000 7f2f5f7fe700 1 -- 172.21.15.146:0/2276830874 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2f70005580 con 0x7f2f7815cf60 2023-05-24T03:30:16.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.957+0000 7f2f5f7fe700 1 --2- 172.21.15.146:0/2276830874 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f2f6406ace0 0x7f2f6406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:16.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.957+0000 7f2f5f7fe700 1 -- 172.21.15.146:0/2276830874 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2f700892e0 con 0x7f2f7815cf60 2023-05-24T03:30:16.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.957+0000 7f2f76ffd700 1 --2- 172.21.15.146:0/2276830874 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f2f6406ace0 0x7f2f6406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:16.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.957+0000 7f2f76ffd700 1 --2- 172.21.15.146:0/2276830874 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f2f6406ace0 0x7f2f6406d190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c000f60 tx=0x7f2f6c001e40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:16.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:16.961+0000 7f2f5f7fe700 1 -- 172.21.15.146:0/2276830874 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f2f70054130 con 0x7f2f7815cf60 2023-05-24T03:30:17.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.148+0000 7f2f7d637700 1 -- 172.21.15.146:0/2276830874 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2f781f3c50 con 0x7f2f7815cf60 2023-05-24T03:30:17.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.149+0000 7f2f5f7fe700 1 -- 172.21.15.146:0/2276830874 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2f70057750 con 0x7f2f7815cf60 2023-05-24T03:30:17.153 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2023-05-24T03:30:17.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.151+0000 7f2f7d637700 1 -- 172.21.15.146:0/2276830874 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f2f6406ace0 msgr2=0x7f2f6406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:17.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.151+0000 7f2f7d637700 1 --2- 172.21.15.146:0/2276830874 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f2f6406ace0 0x7f2f6406d190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c000f60 tx=0x7f2f6c001e40 comp rx=0 tx=0).stop 2023-05-24T03:30:17.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.151+0000 7f2f7d637700 1 -- 172.21.15.146:0/2276830874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f7815cf60 msgr2=0x7f2f7814d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:17.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.151+0000 7f2f7d637700 1 --2- 172.21.15.146:0/2276830874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f7815cf60 0x7f2f7814d610 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2f7000c870 tx=0x7f2f7000cb80 comp rx=0 tx=0).stop 2023-05-24T03:30:17.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.151+0000 7f2f7d637700 1 -- 172.21.15.146:0/2276830874 shutdown_connections 2023-05-24T03:30:17.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.151+0000 7f2f7d637700 1 --2- 172.21.15.146:0/2276830874 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f2f6406ace0 0x7f2f6406d190 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:17.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.151+0000 7f2f7d637700 1 --2- 172.21.15.146:0/2276830874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f7815cf60 0x7f2f7814d610 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:17.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.151+0000 7f2f7d637700 1 --2- 172.21.15.146:0/2276830874 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2f780b20f0 0x7f2f7815e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:17.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.151+0000 7f2f7d637700 1 --2- 172.21.15.146:0/2276830874 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f7815cb90 0x7f2f7814d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:17.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.151+0000 7f2f7d637700 1 -- 172.21.15.146:0/2276830874 >> 172.21.15.146:0/2276830874 conn(0x7f2f7806f860 msgr2=0x7f2f7815a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:17.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.151+0000 7f2f7d637700 1 -- 172.21.15.146:0/2276830874 shutdown_connections 2023-05-24T03:30:17.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.151+0000 7f2f7d637700 1 -- 172.21.15.146:0/2276830874 wait complete. 2023-05-24T03:30:17.167 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-24T03:30:17.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.283+0000 7fa6db418700 1 Processor -- start 2023-05-24T03:30:17.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.283+0000 7fa6db418700 1 -- start start 2023-05-24T03:30:17.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.284+0000 7fa6db418700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa6d415acd0 0x7fa6d40ce100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:17.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.284+0000 7fa6db418700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa6d40d1230 0x7fa6d40cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:17.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.284+0000 7fa6db418700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6d40cd940 con 0x7fa6d40d06d0 2023-05-24T03:30:17.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.284+0000 7fa6db418700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6d40b33d0 con 0x7fa6d40d1230 2023-05-24T03:30:17.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.284+0000 7fa6db418700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d40b3690 con 0x7fa6d415acd0 2023-05-24T03:30:17.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.284+0000 7fa6d89b3700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fa6d40d06d0 0x7fa6d40d0b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46312/0 (socket says 172.21.15.146:46312) 2023-05-24T03:30:17.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.284+0000 7fa6d89b3700 1 -- 172.21.15.146:0/3456430936 learned_addr learned my addr 172.21.15.146:0/3456430936 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:30:17.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.285+0000 7fa6d91b4700 1 --2- 172.21.15.146:0/3456430936 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa6d415acd0 0x7fa6d40ce100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:17.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.285+0000 7fa6d99b5700 1 --2- 172.21.15.146:0/3456430936 >> v2:172.21.15.151:3300/0 conn(0x7fa6d40d1230 0x7fa6d40cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:17.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.285+0000 7fa6cbfff700 1 -- 172.21.15.146:0/3456430936 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 390089285 0 0) 0x7fa6d40cd940 con 0x7fa6d40d06d0 2023-05-24T03:30:17.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.285+0000 7fa6cbfff700 1 -- 172.21.15.146:0/3456430936 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6c00035b0 con 0x7fa6d40d06d0 2023-05-24T03:30:17.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.285+0000 7fa6d91b4700 1 -- 172.21.15.146:0/3456430936 >> v2:172.21.15.151:3300/0 conn(0x7fa6d40d1230 msgr2=0x7fa6d40cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:17.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.285+0000 7fa6d91b4700 1 --2- 172.21.15.146:0/3456430936 >> v2:172.21.15.151:3300/0 conn(0x7fa6d40d1230 0x7fa6d40cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:17.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.285+0000 7fa6d91b4700 1 -- 172.21.15.146:0/3456430936 >> v1:172.21.15.146:6789/0 conn(0x7fa6d40d06d0 legacy=0x7fa6d40d0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:17.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.285+0000 7fa6d91b4700 1 -- 172.21.15.146:0/3456430936 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d40cdbe0 con 0x7fa6d415acd0 2023-05-24T03:30:17.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.285+0000 7fa6d99b5700 1 --2- 172.21.15.146:0/3456430936 >> v2:172.21.15.151:3300/0 conn(0x7fa6d40d1230 0x7fa6d40cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T03:30:17.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.285+0000 7fa6d91b4700 1 --2- 172.21.15.146:0/3456430936 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa6d415acd0 0x7fa6d40ce100 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4009840 tx=0x7fa6c4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eab2f114e91b31f3 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:17.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.285+0000 7fa6cbfff700 1 -- 172.21.15.146:0/3456430936 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c4011830 con 0x7fa6d415acd0 2023-05-24T03:30:17.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.285+0000 7fa6cbfff700 1 -- 172.21.15.146:0/3456430936 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c4011990 con 0x7fa6d415acd0 2023-05-24T03:30:17.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.285+0000 7fa6cbfff700 1 -- 172.21.15.146:0/3456430936 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c4011d20 con 0x7fa6d415acd0 2023-05-24T03:30:17.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.286+0000 7fa6db418700 1 -- 172.21.15.146:0/3456430936 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa6d415acd0 msgr2=0x7fa6d40ce100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:17.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.286+0000 7fa6db418700 1 --2- 172.21.15.146:0/3456430936 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa6d415acd0 0x7fa6d40ce100 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4009840 tx=0x7fa6c4009b50 comp rx=0 tx=0).stop 2023-05-24T03:30:17.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.286+0000 7fa6db418700 1 -- 172.21.15.146:0/3456430936 shutdown_connections 2023-05-24T03:30:17.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.286+0000 7fa6db418700 1 --2- 172.21.15.146:0/3456430936 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa6d415acd0 0x7fa6d40ce100 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:17.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.286+0000 7fa6db418700 1 --2- 172.21.15.146:0/3456430936 >> v2:172.21.15.151:3300/0 conn(0x7fa6d40d1230 0x7fa6d40cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:17.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.286+0000 7fa6db418700 1 -- 172.21.15.146:0/3456430936 >> 172.21.15.146:0/3456430936 conn(0x7fa6d406e2a0 msgr2=0x7fa6d406e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:17.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.286+0000 7fa6db418700 1 -- 172.21.15.146:0/3456430936 shutdown_connections 2023-05-24T03:30:17.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.286+0000 7fa6db418700 1 -- 172.21.15.146:0/3456430936 wait complete. 2023-05-24T03:30:17.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.287+0000 7fa6db418700 1 Processor -- start 2023-05-24T03:30:17.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.287+0000 7fa6db418700 1 -- start start 2023-05-24T03:30:17.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.288+0000 7fa6db418700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6d40d06d0 0x7fa6d415b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:17.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.288+0000 7fa6db418700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa6d40d1230 0x7fa6d415dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:17.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.288+0000 7fa6db418700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa6d415acd0 0x7fa6d4147350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:17.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.288+0000 7fa6db418700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d415f350 con 0x7fa6d40d06d0 2023-05-24T03:30:17.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.288+0000 7fa6db418700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d415e510 con 0x7fa6d415acd0 2023-05-24T03:30:17.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.288+0000 7fa6db418700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d415e7d0 con 0x7fa6d40d1230 2023-05-24T03:30:17.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.288+0000 7fa6d91b4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6d40d06d0 0x7fa6d415b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:17.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.288+0000 7fa6d91b4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6d40d06d0 0x7fa6d415b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39866/0 (socket says 172.21.15.146:39866) 2023-05-24T03:30:17.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.288+0000 7fa6d91b4700 1 -- 172.21.15.146:0/2139575966 learned_addr learned my addr 172.21.15.146:0/2139575966 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:17.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.288+0000 7fa6d99b5700 1 --2- 172.21.15.146:0/2139575966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa6d415acd0 0x7fa6d4147350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:17.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.288+0000 7fa6d89b3700 1 --2- 172.21.15.146:0/2139575966 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa6d40d1230 0x7fa6d415dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:17.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.288+0000 7fa6d91b4700 1 -- 172.21.15.146:0/2139575966 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa6d40d1230 msgr2=0x7fa6d415dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:17.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.288+0000 7fa6d91b4700 1 --2- 172.21.15.146:0/2139575966 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa6d40d1230 0x7fa6d415dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:17.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.288+0000 7fa6d91b4700 1 -- 172.21.15.146:0/2139575966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa6d415acd0 msgr2=0x7fa6d4147350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:17.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.288+0000 7fa6d91b4700 1 --2- 172.21.15.146:0/2139575966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa6d415acd0 0x7fa6d4147350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:17.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.288+0000 7fa6d91b4700 1 -- 172.21.15.146:0/2139575966 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6cc009a70 con 0x7fa6d40d06d0 2023-05-24T03:30:17.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.289+0000 7fa6d91b4700 1 --2- 172.21.15.146:0/2139575966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6d40d06d0 0x7fa6d415b880 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4009b90 tx=0x7fa6c4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:17.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.289+0000 7fa6c9ffb700 1 -- 172.21.15.146:0/2139575966 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c40036a0 con 0x7fa6d40d06d0 2023-05-24T03:30:17.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.289+0000 7fa6c9ffb700 1 -- 172.21.15.146:0/2139575966 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c4003800 con 0x7fa6d40d06d0 2023-05-24T03:30:17.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.289+0000 7fa6c9ffb700 1 -- 172.21.15.146:0/2139575966 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c4003b90 con 0x7fa6d40d06d0 2023-05-24T03:30:17.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.289+0000 7fa6db418700 1 -- 172.21.15.146:0/2139575966 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6c40094a0 con 0x7fa6d40d06d0 2023-05-24T03:30:17.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.289+0000 7fa6db418700 1 -- 172.21.15.146:0/2139575966 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6d40d03b0 con 0x7fa6d40d06d0 2023-05-24T03:30:17.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.290+0000 7fa6db418700 1 -- 172.21.15.146:0/2139575966 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6d40b3970 con 0x7fa6d40d06d0 2023-05-24T03:30:17.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.291+0000 7fa6c9ffb700 1 -- 172.21.15.146:0/2139575966 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa6c4003cf0 con 0x7fa6d40d06d0 2023-05-24T03:30:17.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.291+0000 7fa6c9ffb700 1 --2- 172.21.15.146:0/2139575966 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fa6b806ace0 0x7fa6b806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:17.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.291+0000 7fa6c9ffb700 1 -- 172.21.15.146:0/2139575966 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa6c408af20 con 0x7fa6d40d06d0 2023-05-24T03:30:17.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.291+0000 7fa6d89b3700 1 --2- 172.21.15.146:0/2139575966 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fa6b806ace0 0x7fa6b806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:17.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.292+0000 7fa6d89b3700 1 --2- 172.21.15.146:0/2139575966 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fa6b806ace0 0x7fa6b806d190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa6d00011e0 tx=0x7fa6d0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:17.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.295+0000 7fa6c9ffb700 1 -- 172.21.15.146:0/2139575966 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fa6c4055e70 con 0x7fa6d40d06d0 2023-05-24T03:30:17.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.527+0000 7fa6db418700 1 -- 172.21.15.146:0/2139575966 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa6d415b0a0 con 0x7fa6d40d06d0 2023-05-24T03:30:17.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.528+0000 7fa6c9ffb700 1 -- 172.21.15.146:0/2139575966 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4883 (secure 0 0 0) 0x7fa6c4059490 con 0x7fa6d40d06d0 2023-05-24T03:30:17.532 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:30:17.532 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1500590330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1500590330},{"type":"v1","addr":"172.21.15.151:6835","nonce":1500590330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/3574684057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3574684057},{"type":"v1","addr":"172.21.15.146:6837","nonce":3574684057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/3420469594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3420469594},{"type":"v1","addr":"172.21.15.151:6833","nonce":3420469594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-24T03:29:44.469134+0000","modified":"2023-05-24T03:30:06.147392+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6836/4012487240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":4012487240},{"type":"v1","addr":"172.21.15.146:6836","nonce":4012487240}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-24T03:30:17.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.530+0000 7fa6db418700 1 -- 172.21.15.146:0/2139575966 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fa6b806ace0 msgr2=0x7fa6b806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:17.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.530+0000 7fa6db418700 1 --2- 172.21.15.146:0/2139575966 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fa6b806ace0 0x7fa6b806d190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa6d00011e0 tx=0x7fa6d0009040 comp rx=0 tx=0).stop 2023-05-24T03:30:17.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.530+0000 7fa6db418700 1 -- 172.21.15.146:0/2139575966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6d40d06d0 msgr2=0x7fa6d415b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:17.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.530+0000 7fa6db418700 1 --2- 172.21.15.146:0/2139575966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6d40d06d0 0x7fa6d415b880 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4009b90 tx=0x7fa6c4004750 comp rx=0 tx=0).stop 2023-05-24T03:30:17.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.530+0000 7fa6db418700 1 -- 172.21.15.146:0/2139575966 shutdown_connections 2023-05-24T03:30:17.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.530+0000 7fa6db418700 1 --2- 172.21.15.146:0/2139575966 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fa6b806ace0 0x7fa6b806d190 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:17.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.530+0000 7fa6db418700 1 --2- 172.21.15.146:0/2139575966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa6d415acd0 0x7fa6d4147350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:17.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.530+0000 7fa6db418700 1 --2- 172.21.15.146:0/2139575966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6d40d06d0 0x7fa6d415b880 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:17.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.530+0000 7fa6db418700 1 --2- 172.21.15.146:0/2139575966 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa6d40d1230 0x7fa6d415dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:17.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.530+0000 7fa6db418700 1 -- 172.21.15.146:0/2139575966 >> 172.21.15.146:0/2139575966 conn(0x7fa6d406e2a0 msgr2=0x7fa6d40b3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:17.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.530+0000 7fa6db418700 1 -- 172.21.15.146:0/2139575966 shutdown_connections 2023-05-24T03:30:17.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.530+0000 7fa6db418700 1 -- 172.21.15.146:0/2139575966 wait complete. 2023-05-24T03:30:17.535 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 9 2023-05-24T03:30:17.546 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-24T03:30:17.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.663+0000 7fb694f64700 1 Processor -- start 2023-05-24T03:30:17.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.663+0000 7fb694f64700 1 -- start start 2023-05-24T03:30:17.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.664+0000 7fb694f64700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb6900cb8c0 0x7fb690161030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:17.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.664+0000 7fb694f64700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb6900cc1d0 0x7fb6900b1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:17.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.664+0000 7fb694f64700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6900b27e0 con 0x7fb6900cbc90 2023-05-24T03:30:17.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.664+0000 7fb694f64700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6900b2220 con 0x7fb6900cc1d0 2023-05-24T03:30:17.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.664+0000 7fb694f64700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6900b2500 con 0x7fb6900cb8c0 2023-05-24T03:30:17.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.664+0000 7fb68dd9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb6900cc1d0 0x7fb6900b1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:17.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.664+0000 7fb68dd9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb6900cc1d0 0x7fb6900b1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39872/0 (socket says 172.21.15.146:39872) 2023-05-24T03:30:17.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.664+0000 7fb68dd9b700 1 -- 172.21.15.146:0/2436886685 learned_addr learned my addr 172.21.15.146:0/2436886685 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:17.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.664+0000 7fb68e59c700 1 --2- 172.21.15.146:0/2436886685 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb6900cb8c0 0x7fb690161030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:17.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.664+0000 7fb68dd9b700 1 -- 172.21.15.146:0/2436886685 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb6900cb8c0 msgr2=0x7fb690161030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:17.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.664+0000 7fb68dd9b700 1 --2- 172.21.15.146:0/2436886685 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb6900cb8c0 0x7fb690161030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:17.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.664+0000 7fb68dd9b700 1 -- 172.21.15.146:0/2436886685 >> v1:172.21.15.151:6789/0 conn(0x7fb6900cbc90 legacy=0x7fb69006a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:17.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.664+0000 7fb68dd9b700 1 -- 172.21.15.146:0/2436886685 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb690160830 con 0x7fb6900cc1d0 2023-05-24T03:30:17.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.664+0000 7fb68dd9b700 1 --2- 172.21.15.146:0/2436886685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6900cc1d0 0x7fb6900b1920 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb6840098f0 tx=0x7fb684009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d616f7192318a451 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:17.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.664+0000 7fb68d59a700 1 -- 172.21.15.146:0/2436886685 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68400b8a0 con 0x7fb6900cc1d0 2023-05-24T03:30:17.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.664+0000 7fb68d59a700 1 -- 172.21.15.146:0/2436886685 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb68400ba00 con 0x7fb6900cc1d0 2023-05-24T03:30:17.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.664+0000 7fb68d59a700 1 -- 172.21.15.146:0/2436886685 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68400bd90 con 0x7fb6900cc1d0 2023-05-24T03:30:17.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.665+0000 7fb694f64700 1 -- 172.21.15.146:0/2436886685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6900cc1d0 msgr2=0x7fb6900b1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:17.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.665+0000 7fb694f64700 1 --2- 172.21.15.146:0/2436886685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6900cc1d0 0x7fb6900b1920 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb6840098f0 tx=0x7fb684009c00 comp rx=0 tx=0).stop 2023-05-24T03:30:17.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.665+0000 7fb694f64700 1 -- 172.21.15.146:0/2436886685 shutdown_connections 2023-05-24T03:30:17.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.665+0000 7fb694f64700 1 --2- 172.21.15.146:0/2436886685 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb6900cb8c0 0x7fb690161030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:17.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.665+0000 7fb694f64700 1 --2- 172.21.15.146:0/2436886685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6900cc1d0 0x7fb6900b1920 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:17.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.665+0000 7fb694f64700 1 -- 172.21.15.146:0/2436886685 >> 172.21.15.146:0/2436886685 conn(0x7fb6900cfea0 msgr2=0x7fb6900d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:17.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.665+0000 7fb694f64700 1 -- 172.21.15.146:0/2436886685 shutdown_connections 2023-05-24T03:30:17.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.665+0000 7fb694f64700 1 -- 172.21.15.146:0/2436886685 wait complete. 2023-05-24T03:30:17.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.666+0000 7fb694f64700 1 Processor -- start 2023-05-24T03:30:17.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.666+0000 7fb694f64700 1 -- start start 2023-05-24T03:30:17.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.667+0000 7fb694f64700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb6900cb8c0 0x7fb6901f20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:17.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.667+0000 7fb694f64700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb6900cbc90 0x7fb6901f4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:17.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.667+0000 7fb694f64700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6900cc1d0 0x7fb6901f5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:17.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.667+0000 7fb694f64700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6900c6ee0 con 0x7fb6900cc1d0 2023-05-24T03:30:17.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.667+0000 7fb694f64700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6901f2620 con 0x7fb6900cb8c0 2023-05-24T03:30:17.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.667+0000 7fb694f64700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6901f53d0 con 0x7fb6900cbc90 2023-05-24T03:30:17.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.667+0000 7fb68ed9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6900cc1d0 0x7fb6901f5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:17.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.667+0000 7fb68ed9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6900cc1d0 0x7fb6901f5650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39878/0 (socket says 172.21.15.146:39878) 2023-05-24T03:30:17.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.667+0000 7fb68ed9d700 1 -- 172.21.15.146:0/3709496398 learned_addr learned my addr 172.21.15.146:0/3709496398 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:17.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.667+0000 7fb68e59c700 1 --2- 172.21.15.146:0/3709496398 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb6900cb8c0 0x7fb6901f20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:17.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.667+0000 7fb68dd9b700 1 --2- 172.21.15.146:0/3709496398 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb6900cbc90 0x7fb6901f4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:17.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.667+0000 7fb68ed9d700 1 -- 172.21.15.146:0/3709496398 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb6900cbc90 msgr2=0x7fb6901f4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:17.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.667+0000 7fb68ed9d700 1 --2- 172.21.15.146:0/3709496398 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb6900cbc90 0x7fb6901f4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:17.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.667+0000 7fb68ed9d700 1 -- 172.21.15.146:0/3709496398 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb6900cb8c0 msgr2=0x7fb6901f20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:17.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.667+0000 7fb68ed9d700 1 --2- 172.21.15.146:0/3709496398 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb6900cb8c0 0x7fb6901f20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:17.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.667+0000 7fb68ed9d700 1 -- 172.21.15.146:0/3709496398 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb684009550 con 0x7fb6900cc1d0 2023-05-24T03:30:17.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.667+0000 7fb68dd9b700 1 --2- 172.21.15.146:0/3709496398 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb6900cbc90 0x7fb6901f4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:30:17.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.667+0000 7fb68e59c700 1 --2- 172.21.15.146:0/3709496398 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb6900cb8c0 0x7fb6901f20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:30:17.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.668+0000 7fb68ed9d700 1 --2- 172.21.15.146:0/3709496398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6900cc1d0 0x7fb6901f5650 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb68800cbc0 tx=0x7fb68800cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:17.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.668+0000 7fb67effd700 1 -- 172.21.15.146:0/3709496398 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb688003c00 con 0x7fb6900cc1d0 2023-05-24T03:30:17.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.668+0000 7fb67effd700 1 -- 172.21.15.146:0/3709496398 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb688003d60 con 0x7fb6900cc1d0 2023-05-24T03:30:17.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.668+0000 7fb694f64700 1 -- 172.21.15.146:0/3709496398 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb690161570 con 0x7fb6900cc1d0 2023-05-24T03:30:17.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.668+0000 7fb67effd700 1 -- 172.21.15.146:0/3709496398 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68800abf0 con 0x7fb6900cc1d0 2023-05-24T03:30:17.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.668+0000 7fb694f64700 1 -- 172.21.15.146:0/3709496398 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb690160b10 con 0x7fb6900cc1d0 2023-05-24T03:30:17.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.669+0000 7fb694f64700 1 -- 172.21.15.146:0/3709496398 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb69004e810 con 0x7fb6900cc1d0 2023-05-24T03:30:17.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.669+0000 7fb67effd700 1 -- 172.21.15.146:0/3709496398 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb68800ad50 con 0x7fb6900cc1d0 2023-05-24T03:30:17.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.670+0000 7fb67effd700 1 --2- 172.21.15.146:0/3709496398 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fb67006ace0 0x7fb67006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:17.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.670+0000 7fb68e59c700 1 --2- 172.21.15.146:0/3709496398 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fb67006ace0 0x7fb67006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:17.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.670+0000 7fb67effd700 1 -- 172.21.15.146:0/3709496398 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb6880898f0 con 0x7fb6900cc1d0 2023-05-24T03:30:17.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.670+0000 7fb68e59c700 1 --2- 172.21.15.146:0/3709496398 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fb67006ace0 0x7fb67006d190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb6800099f0 tx=0x7fb680008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:17.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.674+0000 7fb67effd700 1 -- 172.21.15.146:0/3709496398 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fb688054610 con 0x7fb6900cc1d0 2023-05-24T03:30:17.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.864+0000 7fb694f64700 1 -- 172.21.15.146:0/3709496398 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb6900b5e20 con 0x7fb6900cc1d0 2023-05-24T03:30:17.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.865+0000 7fb67effd700 1 -- 172.21.15.146:0/3709496398 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20156 (secure 0 0 0) 0x7fb688057c30 con 0x7fb6900cc1d0 2023-05-24T03:30:17.869 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:30:17.869 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":28,"fsid":"11ca0adb-7672-4713-bde7-451e8b743ae9","created":"2023-05-24T03:29:19.113659+0000","modified":"2023-05-24T03:29:48.912599+0000","last_up_change":"2023-05-24T03:29:30.962339+0000","last_in_change":"2023-05-24T03:29:21.706540+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-24T03:29:32.749984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-24T03:29:37.719623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-24T03:29:42.165379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-24T03:29:43.431615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-24T03:29:46.503075+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f24b319b-fcc8-4385-b0cb-78138fc31417","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6801","nonce":3353593100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6803","nonce":3353593100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6807","nonce":3353593100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6805","nonce":3353593100}]},"public_addr":"172.21.15.146:6801/3353593100","cluster_addr":"172.21.15.146:6803/3353593100","heartbeat_back_addr":"172.21.15.146:6807/3353593100","heartbeat_front_addr":"172.21.15.146:6805/3353593100","state":["exists","up"]},{"osd":1,"uuid":"c9639ea9-8f9b-498e-92c8-aa976edbf1da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6821","nonce":2537488734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6825","nonce":2537488734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6831","nonce":2537488734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6827","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6829","nonce":2537488734}]},"public_addr":"172.21.15.146:6821/2537488734","cluster_addr":"172.21.15.146:6825/2537488734","heartbeat_back_addr":"172.21.15.146:6831/2537488734","heartbeat_front_addr":"172.21.15.146:6829/2537488734","state":["exists","up"]},{"osd":2,"uuid":"7a6cfc6d-b0ca-4cb6-a66d-4001ec184657","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6809","nonce":1800242932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6811","nonce":1800242932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6815","nonce":1800242932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6813","nonce":1800242932}]},"public_addr":"172.21.15.146:6809/1800242932","cluster_addr":"172.21.15.146:6811/1800242932","heartbeat_back_addr":"172.21.15.146:6815/1800242932","heartbeat_front_addr":"172.21.15.146:6813/1800242932","state":["exists","up"]},{"osd":3,"uuid":"401509f7-cecd-44a2-b0ae-22c81a5d93c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6817","nonce":1749783580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6820","nonce":1749783580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6828","nonce":1749783580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6824","nonce":1749783580}]},"public_addr":"172.21.15.146:6817/1749783580","cluster_addr":"172.21.15.146:6820/1749783580","heartbeat_back_addr":"172.21.15.146:6828/1749783580","heartbeat_front_addr":"172.21.15.146:6824/1749783580","state":["exists","up"]},{"osd":4,"uuid":"9d07f440-d125-4f99-a825-411fab894d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6811","nonce":163453435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6814","nonce":163453435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6819","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6821","nonce":163453435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6818","nonce":163453435}]},"public_addr":"172.21.15.151:6811/163453435","cluster_addr":"172.21.15.151:6814/163453435","heartbeat_back_addr":"172.21.15.151:6821/163453435","heartbeat_front_addr":"172.21.15.151:6818/163453435","state":["exists","up"]},{"osd":5,"uuid":"9b2266e2-9e52-4f0e-96da-e703a6c23a6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6801","nonce":3283474903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6803","nonce":3283474903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6807","nonce":3283474903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6805","nonce":3283474903}]},"public_addr":"172.21.15.151:6801/3283474903","cluster_addr":"172.21.15.151:6803/3283474903","heartbeat_back_addr":"172.21.15.151:6807/3283474903","heartbeat_front_addr":"172.21.15.151:6805/3283474903","state":["exists","up"]},{"osd":6,"uuid":"5daedf77-0a83-49e7-b497-d9ed10436972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6825","nonce":3889424178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6827","nonce":3889424178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6831","nonce":3889424178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6829","nonce":3889424178}]},"public_addr":"172.21.15.151:6825/3889424178","cluster_addr":"172.21.15.151:6827/3889424178","heartbeat_back_addr":"172.21.15.151:6831/3889424178","heartbeat_front_addr":"172.21.15.151:6829/3889424178","state":["exists","up"]},{"osd":7,"uuid":"86ae4f7e-c01f-4c3d-a0dd-98160c209309","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6810","nonce":563291208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6815","nonce":563291208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6823","nonce":563291208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6820","nonce":563291208}]},"public_addr":"172.21.15.151:6810/563291208","cluster_addr":"172.21.15.151:6815/563291208","heartbeat_back_addr":"172.21.15.151:6823/563291208","heartbeat_front_addr":"172.21.15.151:6820/563291208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.872472+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.937126+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.877234+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.884793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.881632+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.938293+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.857661+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.945883+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-24T03:30:17.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.867+0000 7fb694f64700 1 -- 172.21.15.146:0/3709496398 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fb67006ace0 msgr2=0x7fb67006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:17.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.867+0000 7fb694f64700 1 --2- 172.21.15.146:0/3709496398 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fb67006ace0 0x7fb67006d190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb6800099f0 tx=0x7fb680008040 comp rx=0 tx=0).stop 2023-05-24T03:30:17.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.867+0000 7fb694f64700 1 -- 172.21.15.146:0/3709496398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6900cc1d0 msgr2=0x7fb6901f5650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:17.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.867+0000 7fb694f64700 1 --2- 172.21.15.146:0/3709496398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6900cc1d0 0x7fb6901f5650 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb68800cbc0 tx=0x7fb68800cf80 comp rx=0 tx=0).stop 2023-05-24T03:30:17.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.867+0000 7fb694f64700 1 -- 172.21.15.146:0/3709496398 shutdown_connections 2023-05-24T03:30:17.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.867+0000 7fb694f64700 1 --2- 172.21.15.146:0/3709496398 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fb67006ace0 0x7fb67006d190 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:17.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.867+0000 7fb694f64700 1 --2- 172.21.15.146:0/3709496398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6900cc1d0 0x7fb6901f5650 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:17.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.867+0000 7fb694f64700 1 --2- 172.21.15.146:0/3709496398 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb6900cb8c0 0x7fb6901f20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:17.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.867+0000 7fb694f64700 1 --2- 172.21.15.146:0/3709496398 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb6900cbc90 0x7fb6901f4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:17.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.867+0000 7fb694f64700 1 -- 172.21.15.146:0/3709496398 >> 172.21.15.146:0/3709496398 conn(0x7fb6900cfea0 msgr2=0x7fb69006a460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:17.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.867+0000 7fb694f64700 1 -- 172.21.15.146:0/3709496398 shutdown_connections 2023-05-24T03:30:17.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:17.867+0000 7fb694f64700 1 -- 172.21.15.146:0/3709496398 wait complete. 2023-05-24T03:30:17.884 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-24T03:30:18.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.001+0000 7fe6d7693700 1 Processor -- start 2023-05-24T03:30:18.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.001+0000 7fe6d7693700 1 -- start start 2023-05-24T03:30:18.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.002+0000 7fe6d7693700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6d015a9c0 0x7fe6d00b52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:18.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.002+0000 7fe6d7693700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe6d00cc500 0x7fe6d0071720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:18.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.002+0000 7fe6d7693700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe6d00b5820 0x7fe6d0071c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:18.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.002+0000 7fe6d7693700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6d00cb740 con 0x7fe6d00b5820 2023-05-24T03:30:18.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.002+0000 7fe6d7693700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6d00cba20 con 0x7fe6d00cc500 2023-05-24T03:30:18.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.002+0000 7fe6d7693700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d00cbd00 con 0x7fe6d015a9c0 2023-05-24T03:30:18.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.002+0000 7fe6d5c30700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe6d00b5820 0x7fe6d0071c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:18.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.002+0000 7fe6d5c30700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe6d00b5820 0x7fe6d0071c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39888/0 (socket says 172.21.15.146:39888) 2023-05-24T03:30:18.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.002+0000 7fe6d5c30700 1 -- 172.21.15.146:0/3091740763 learned_addr learned my addr 172.21.15.146:0/3091740763 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:18.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.002+0000 7fe6d542f700 1 --2- 172.21.15.146:0/3091740763 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6d015a9c0 0x7fe6d00b52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:18.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.002+0000 7fe6d4c2e700 1 --2- 172.21.15.146:0/3091740763 >> v2:172.21.15.151:3300/0 conn(0x7fe6d00cc500 0x7fe6d0071720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:18.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.002+0000 7fe6d5c30700 1 -- 172.21.15.146:0/3091740763 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6d015a9c0 msgr2=0x7fe6d00b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:18.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.002+0000 7fe6d5c30700 1 --2- 172.21.15.146:0/3091740763 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6d015a9c0 0x7fe6d00b52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:18.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.002+0000 7fe6d5c30700 1 -- 172.21.15.146:0/3091740763 >> v2:172.21.15.151:3300/0 conn(0x7fe6d00cc500 msgr2=0x7fe6d0071720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:18.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.002+0000 7fe6d5c30700 1 --2- 172.21.15.146:0/3091740763 >> v2:172.21.15.151:3300/0 conn(0x7fe6d00cc500 0x7fe6d0071720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:18.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.002+0000 7fe6d5c30700 1 -- 172.21.15.146:0/3091740763 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d00cbfe0 con 0x7fe6d00b5820 2023-05-24T03:30:18.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.003+0000 7fe6d5c30700 1 --2- 172.21.15.146:0/3091740763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6d00b5820 0x7fe6d0071c60 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe6d0070d40 tx=0x7fe6c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73bf1338bc137873 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:18.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.003+0000 7fe6c7fff700 1 -- 172.21.15.146:0/3091740763 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c800e070 con 0x7fe6d00b5820 2023-05-24T03:30:18.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.003+0000 7fe6c7fff700 1 -- 172.21.15.146:0/3091740763 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c800b9c0 con 0x7fe6d00b5820 2023-05-24T03:30:18.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.003+0000 7fe6c7fff700 1 -- 172.21.15.146:0/3091740763 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c800bd70 con 0x7fe6d00b5820 2023-05-24T03:30:18.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.003+0000 7fe6d7693700 1 -- 172.21.15.146:0/3091740763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6d00b5820 msgr2=0x7fe6d0071c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:18.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.003+0000 7fe6d7693700 1 --2- 172.21.15.146:0/3091740763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6d00b5820 0x7fe6d0071c60 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe6d0070d40 tx=0x7fe6c800b330 comp rx=0 tx=0).stop 2023-05-24T03:30:18.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.003+0000 7fe6d7693700 1 -- 172.21.15.146:0/3091740763 shutdown_connections 2023-05-24T03:30:18.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.003+0000 7fe6d7693700 1 --2- 172.21.15.146:0/3091740763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6d00b5820 0x7fe6d0071c60 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:18.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.003+0000 7fe6d7693700 1 --2- 172.21.15.146:0/3091740763 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6d015a9c0 0x7fe6d00b52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:18.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.003+0000 7fe6d7693700 1 --2- 172.21.15.146:0/3091740763 >> v2:172.21.15.151:3300/0 conn(0x7fe6d00cc500 0x7fe6d0071720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:18.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.003+0000 7fe6d7693700 1 -- 172.21.15.146:0/3091740763 >> 172.21.15.146:0/3091740763 conn(0x7fe6d00cfea0 msgr2=0x7fe6d00d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:18.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.003+0000 7fe6d7693700 1 -- 172.21.15.146:0/3091740763 shutdown_connections 2023-05-24T03:30:18.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.003+0000 7fe6d7693700 1 -- 172.21.15.146:0/3091740763 wait complete. 2023-05-24T03:30:18.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.005+0000 7fe6d7693700 1 Processor -- start 2023-05-24T03:30:18.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.005+0000 7fe6d7693700 1 -- start start 2023-05-24T03:30:18.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.005+0000 7fe6d7693700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6d00b5820 0x7fe6d00c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:18.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.005+0000 7fe6d7693700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6d00cc500 0x7fe6d00b3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:18.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.005+0000 7fe6d7693700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6d015a9c0 0x7fe6d00b4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:18.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.005+0000 7fe6d7693700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d00ad9a0 con 0x7fe6d015a9c0 2023-05-24T03:30:18.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.005+0000 7fe6d7693700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d00af2e0 con 0x7fe6d00b5820 2023-05-24T03:30:18.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.005+0000 7fe6d7693700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d00ad6c0 con 0x7fe6d00cc500 2023-05-24T03:30:18.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.005+0000 7fe6d5c30700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6d015a9c0 0x7fe6d00b4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:18.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.005+0000 7fe6d5c30700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6d015a9c0 0x7fe6d00b4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39894/0 (socket says 172.21.15.146:39894) 2023-05-24T03:30:18.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.005+0000 7fe6d5c30700 1 -- 172.21.15.146:0/1513751274 learned_addr learned my addr 172.21.15.146:0/1513751274 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:18.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.005+0000 7fe6d4c2e700 1 --2- 172.21.15.146:0/1513751274 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6d00cc500 0x7fe6d00b3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:18.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.005+0000 7fe6d542f700 1 --2- 172.21.15.146:0/1513751274 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6d00b5820 0x7fe6d00c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:18.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.006+0000 7fe6d5c30700 1 -- 172.21.15.146:0/1513751274 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6d00cc500 msgr2=0x7fe6d00b3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:18.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.006+0000 7fe6d5c30700 1 --2- 172.21.15.146:0/1513751274 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6d00cc500 0x7fe6d00b3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:18.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.006+0000 7fe6d5c30700 1 -- 172.21.15.146:0/1513751274 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6d00b5820 msgr2=0x7fe6d00c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:18.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.006+0000 7fe6d5c30700 1 --2- 172.21.15.146:0/1513751274 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6d00b5820 0x7fe6d00c98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:18.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.006+0000 7fe6d5c30700 1 -- 172.21.15.146:0/1513751274 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c8009b30 con 0x7fe6d015a9c0 2023-05-24T03:30:18.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.006+0000 7fe6d5c30700 1 --2- 172.21.15.146:0/1513751274 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6d015a9c0 0x7fe6d00b4260 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe6d00b2a90 tx=0x7fe6c8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:18.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.006+0000 7fe6c5ffb700 1 -- 172.21.15.146:0/1513751274 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c80099b0 con 0x7fe6d015a9c0 2023-05-24T03:30:18.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.006+0000 7fe6c5ffb700 1 -- 172.21.15.146:0/1513751274 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c8004250 con 0x7fe6d015a9c0 2023-05-24T03:30:18.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.006+0000 7fe6d7693700 1 -- 172.21.15.146:0/1513751274 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6d00b5da0 con 0x7fe6d015a9c0 2023-05-24T03:30:18.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.006+0000 7fe6c5ffb700 1 -- 172.21.15.146:0/1513751274 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c8004600 con 0x7fe6d015a9c0 2023-05-24T03:30:18.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.006+0000 7fe6d7693700 1 -- 172.21.15.146:0/1513751274 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6d015ad90 con 0x7fe6d015a9c0 2023-05-24T03:30:18.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.007+0000 7fe6d7693700 1 -- 172.21.15.146:0/1513751274 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6d006b2a0 con 0x7fe6d015a9c0 2023-05-24T03:30:18.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.008+0000 7fe6c5ffb700 1 -- 172.21.15.146:0/1513751274 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe6c8004760 con 0x7fe6d015a9c0 2023-05-24T03:30:18.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.008+0000 7fe6c5ffb700 1 --2- 172.21.15.146:0/1513751274 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fe6b406ace0 0x7fe6b406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:18.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.008+0000 7fe6c5ffb700 1 -- 172.21.15.146:0/1513751274 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe6c808ae30 con 0x7fe6d015a9c0 2023-05-24T03:30:18.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.008+0000 7fe6d542f700 1 --2- 172.21.15.146:0/1513751274 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fe6b406ace0 0x7fe6b406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:18.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.009+0000 7fe6d542f700 1 --2- 172.21.15.146:0/1513751274 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fe6b406ace0 0x7fe6b406d190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe6d01571a0 tx=0x7fe6c0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:18.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.012+0000 7fe6c5ffb700 1 -- 172.21.15.146:0/1513751274 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fe6c8055da0 con 0x7fe6d015a9c0 2023-05-24T03:30:18.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.241+0000 7fe6d7693700 1 -- 172.21.15.146:0/1513751274 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe6d004e810 con 0x7fe6d015a9c0 2023-05-24T03:30:18.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.242+0000 7fe6c5ffb700 1 -- 172.21.15.146:0/1513751274 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4883 (secure 0 0 0) 0x7fe6c8020090 con 0x7fe6d015a9c0 2023-05-24T03:30:18.245 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:30:18.246 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1500590330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1500590330},{"type":"v1","addr":"172.21.15.151:6835","nonce":1500590330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/3574684057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3574684057},{"type":"v1","addr":"172.21.15.146:6837","nonce":3574684057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/3420469594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3420469594},{"type":"v1","addr":"172.21.15.151:6833","nonce":3420469594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-24T03:29:44.469134+0000","modified":"2023-05-24T03:30:06.147392+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6836/4012487240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":4012487240},{"type":"v1","addr":"172.21.15.146:6836","nonce":4012487240}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-24T03:30:18.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.244+0000 7fe6d7693700 1 -- 172.21.15.146:0/1513751274 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fe6b406ace0 msgr2=0x7fe6b406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:18.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.244+0000 7fe6d7693700 1 --2- 172.21.15.146:0/1513751274 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fe6b406ace0 0x7fe6b406d190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe6d01571a0 tx=0x7fe6c0008040 comp rx=0 tx=0).stop 2023-05-24T03:30:18.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.244+0000 7fe6d7693700 1 -- 172.21.15.146:0/1513751274 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6d015a9c0 msgr2=0x7fe6d00b4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:18.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.244+0000 7fe6d7693700 1 --2- 172.21.15.146:0/1513751274 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6d015a9c0 0x7fe6d00b4260 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe6d00b2a90 tx=0x7fe6c8004ad0 comp rx=0 tx=0).stop 2023-05-24T03:30:18.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.244+0000 7fe6d7693700 1 -- 172.21.15.146:0/1513751274 shutdown_connections 2023-05-24T03:30:18.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.244+0000 7fe6d7693700 1 --2- 172.21.15.146:0/1513751274 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fe6b406ace0 0x7fe6b406d190 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:18.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.244+0000 7fe6d7693700 1 --2- 172.21.15.146:0/1513751274 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6d015a9c0 0x7fe6d00b4260 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:18.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.244+0000 7fe6d7693700 1 --2- 172.21.15.146:0/1513751274 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6d00b5820 0x7fe6d00c98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:18.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.244+0000 7fe6d7693700 1 --2- 172.21.15.146:0/1513751274 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6d00cc500 0x7fe6d00b3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:18.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.244+0000 7fe6d7693700 1 -- 172.21.15.146:0/1513751274 >> 172.21.15.146:0/1513751274 conn(0x7fe6d00cfea0 msgr2=0x7fe6d0157310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:18.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.244+0000 7fe6d7693700 1 -- 172.21.15.146:0/1513751274 shutdown_connections 2023-05-24T03:30:18.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.244+0000 7fe6d7693700 1 -- 172.21.15.146:0/1513751274 wait complete. 2023-05-24T03:30:18.250 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 9 2023-05-24T03:30:18.662 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-05-24T03:29:44.469134+0000', 'modified': '2023-05-24T03:30:06.147392+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4290}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4290': {'gid': 4290, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.146:6836/4012487240', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6835', 'nonce': 4012487240}, {'type': 'v1', 'addr': '172.21.15.146:6836', 'nonce': 4012487240}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-05-24T03:30:18.663 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-05-24T03:30:18.663 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-05-24T03:30:18.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.783+0000 7f7dfcb08700 1 Processor -- start 2023-05-24T03:30:18.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.783+0000 7f7dfcb08700 1 -- start start 2023-05-24T03:30:18.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.784+0000 7f7dfcb08700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7df80cb8c0 0x7f7df8161030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:18.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.784+0000 7f7dfcb08700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7df80cc1d0 0x7f7df80b1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:18.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.784+0000 7f7dfcb08700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7df80cbc90 0x7f7df806a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:18.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.784+0000 7f7dfcb08700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7df80b27e0 con 0x7f7df80cc1d0 2023-05-24T03:30:18.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.784+0000 7f7dfcb08700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7df80b2220 con 0x7f7df80cbc90 2023-05-24T03:30:18.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.784+0000 7f7dfcb08700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7df80b2500 con 0x7f7df80cb8c0 2023-05-24T03:30:18.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.784+0000 7f7df5d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7df80cc1d0 0x7f7df80b1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:18.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.784+0000 7f7df5d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7df80cc1d0 0x7f7df80b1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39900/0 (socket says 172.21.15.146:39900) 2023-05-24T03:30:18.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.784+0000 7f7df5d9b700 1 -- 172.21.15.146:0/3738837558 learned_addr learned my addr 172.21.15.146:0/3738837558 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:18.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.784+0000 7f7df6d9d700 1 --2- 172.21.15.146:0/3738837558 >> v2:172.21.15.151:3300/0 conn(0x7f7df80cbc90 0x7f7df806a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:18.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.784+0000 7f7df659c700 1 --2- 172.21.15.146:0/3738837558 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7df80cb8c0 0x7f7df8161030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:18.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.784+0000 7f7df5d9b700 1 -- 172.21.15.146:0/3738837558 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7df80cb8c0 msgr2=0x7f7df8161030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:18.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.784+0000 7f7df5d9b700 1 --2- 172.21.15.146:0/3738837558 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7df80cb8c0 0x7f7df8161030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:18.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.784+0000 7f7df5d9b700 1 -- 172.21.15.146:0/3738837558 >> v2:172.21.15.151:3300/0 conn(0x7f7df80cbc90 msgr2=0x7f7df806a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:18.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.784+0000 7f7df5d9b700 1 --2- 172.21.15.146:0/3738837558 >> v2:172.21.15.151:3300/0 conn(0x7f7df80cbc90 0x7f7df806a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:18.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.784+0000 7f7df5d9b700 1 -- 172.21.15.146:0/3738837558 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df8160830 con 0x7f7df80cc1d0 2023-05-24T03:30:18.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.784+0000 7f7df6d9d700 1 --2- 172.21.15.146:0/3738837558 >> v2:172.21.15.151:3300/0 conn(0x7f7df80cbc90 0x7f7df806a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:30:18.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.784+0000 7f7df659c700 1 --2- 172.21.15.146:0/3738837558 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7df80cb8c0 0x7f7df8161030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:30:18.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.785+0000 7f7df5d9b700 1 --2- 172.21.15.146:0/3738837558 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7df80cc1d0 0x7f7df80b1920 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7df806b540 tx=0x7f7de8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7864991447b0bf server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:18.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.785+0000 7f7df559a700 1 -- 172.21.15.146:0/3738837558 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de800b870 con 0x7f7df80cc1d0 2023-05-24T03:30:18.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.785+0000 7f7df559a700 1 -- 172.21.15.146:0/3738837558 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de800b9d0 con 0x7f7df80cc1d0 2023-05-24T03:30:18.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.785+0000 7f7df559a700 1 -- 172.21.15.146:0/3738837558 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de800bd60 con 0x7f7df80cc1d0 2023-05-24T03:30:18.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.785+0000 7f7dfcb08700 1 -- 172.21.15.146:0/3738837558 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7df80cc1d0 msgr2=0x7f7df80b1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:18.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.785+0000 7f7dfcb08700 1 --2- 172.21.15.146:0/3738837558 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7df80cc1d0 0x7f7df80b1920 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7df806b540 tx=0x7f7de8009bd0 comp rx=0 tx=0).stop 2023-05-24T03:30:18.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.785+0000 7f7dfcb08700 1 -- 172.21.15.146:0/3738837558 shutdown_connections 2023-05-24T03:30:18.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.785+0000 7f7dfcb08700 1 --2- 172.21.15.146:0/3738837558 >> v2:172.21.15.151:3300/0 conn(0x7f7df80cbc90 0x7f7df806a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:18.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.785+0000 7f7dfcb08700 1 --2- 172.21.15.146:0/3738837558 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7df80cb8c0 0x7f7df8161030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:18.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.785+0000 7f7dfcb08700 1 --2- 172.21.15.146:0/3738837558 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7df80cc1d0 0x7f7df80b1920 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:18.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.785+0000 7f7dfcb08700 1 -- 172.21.15.146:0/3738837558 >> 172.21.15.146:0/3738837558 conn(0x7f7df80cfea0 msgr2=0x7f7df80d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:18.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.785+0000 7f7dfcb08700 1 -- 172.21.15.146:0/3738837558 shutdown_connections 2023-05-24T03:30:18.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.785+0000 7f7dfcb08700 1 -- 172.21.15.146:0/3738837558 wait complete. 2023-05-24T03:30:18.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.787+0000 7f7dfcb08700 1 Processor -- start 2023-05-24T03:30:18.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.787+0000 7f7dfcb08700 1 -- start start 2023-05-24T03:30:18.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.788+0000 7f7dfcb08700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7df80cb8c0 0x7f7df814d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:18.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.788+0000 7f7dfcb08700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7df80cbc90 0x7f7df80b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:18.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.788+0000 7f7dfcb08700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7df80cc1d0 0x7f7df80c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:18.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.788+0000 7f7dfcb08700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df80cb100 con 0x7f7df80cc1d0 2023-05-24T03:30:18.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.788+0000 7f7dfcb08700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df815d860 con 0x7f7df80cb8c0 2023-05-24T03:30:18.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.788+0000 7f7dfcb08700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7df815db40 con 0x7f7df80cbc90 2023-05-24T03:30:18.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.788+0000 7f7df6d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7df80cc1d0 0x7f7df80c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:18.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.788+0000 7f7df6d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7df80cc1d0 0x7f7df80c8be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39908/0 (socket says 172.21.15.146:39908) 2023-05-24T03:30:18.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.788+0000 7f7df659c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7df80cb8c0 0x7f7df814d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:18.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.788+0000 7f7df6d9d700 1 -- 172.21.15.146:0/769323081 learned_addr learned my addr 172.21.15.146:0/769323081 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:18.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.788+0000 7f7df5d9b700 1 --2- 172.21.15.146:0/769323081 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7df80cbc90 0x7f7df80b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:18.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.788+0000 7f7df6d9d700 1 -- 172.21.15.146:0/769323081 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7df80cbc90 msgr2=0x7f7df80b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:18.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.788+0000 7f7df6d9d700 1 --2- 172.21.15.146:0/769323081 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7df80cbc90 0x7f7df80b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:18.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.788+0000 7f7df6d9d700 1 -- 172.21.15.146:0/769323081 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7df80cb8c0 msgr2=0x7f7df814d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:18.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.788+0000 7f7df6d9d700 1 --2- 172.21.15.146:0/769323081 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7df80cb8c0 0x7f7df814d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:18.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.788+0000 7f7df6d9d700 1 -- 172.21.15.146:0/769323081 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de8009550 con 0x7f7df80cc1d0 2023-05-24T03:30:18.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.788+0000 7f7df6d9d700 1 --2- 172.21.15.146:0/769323081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7df80cc1d0 0x7f7df80c8be0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7df000ce80 tx=0x7f7df000ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:18.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.788+0000 7f7de6ffd700 1 -- 172.21.15.146:0/769323081 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df000ad40 con 0x7f7df80cc1d0 2023-05-24T03:30:18.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.788+0000 7f7de6ffd700 1 -- 172.21.15.146:0/769323081 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df0015440 con 0x7f7df80cc1d0 2023-05-24T03:30:18.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.788+0000 7f7dfcb08700 1 -- 172.21.15.146:0/769323081 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7df8161570 con 0x7f7df80cc1d0 2023-05-24T03:30:18.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.788+0000 7f7de6ffd700 1 -- 172.21.15.146:0/769323081 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df000aea0 con 0x7f7df80cc1d0 2023-05-24T03:30:18.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.788+0000 7f7dfcb08700 1 -- 172.21.15.146:0/769323081 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7df8160b10 con 0x7f7df80cc1d0 2023-05-24T03:30:18.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.790+0000 7f7de6ffd700 1 -- 172.21.15.146:0/769323081 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7df000d430 con 0x7f7df80cc1d0 2023-05-24T03:30:18.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.790+0000 7f7de6ffd700 1 --2- 172.21.15.146:0/769323081 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f7dd806ace0 0x7f7dd806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:18.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.790+0000 7f7de6ffd700 1 -- 172.21.15.146:0/769323081 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7df0089a80 con 0x7f7df80cc1d0 2023-05-24T03:30:18.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.790+0000 7f7df659c700 1 --2- 172.21.15.146:0/769323081 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f7dd806ace0 0x7f7dd806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:18.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.790+0000 7f7df659c700 1 --2- 172.21.15.146:0/769323081 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f7dd806ace0 0x7f7dd806d190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7dec006fd0 tx=0x7f7dec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:18.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.792+0000 7f7e08c94b80 1 Processor -- start 2023-05-24T03:30:18.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.792+0000 7f7e08c94b80 1 -- start start 2023-05-24T03:30:18.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.793+0000 7f7e08c94b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55cc52265060 0x55cc52265790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:18.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.793+0000 7f7e08c94b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc5223c850 0x55cc5223f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:18.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.793+0000 7f7e08c94b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc52284c90 0x55cc52269210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:18.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.793+0000 7f7e08c94b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc52143010 con 0x55cc52284c90 2023-05-24T03:30:18.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.793+0000 7f7e08c94b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc52195850 con 0x55cc5223c850 2023-05-24T03:30:18.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.793+0000 7f7e08c94b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cc5218ece0 con 0x55cc52265060 2023-05-24T03:30:18.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.793+0000 7f7df6d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc52284c90 0x55cc52269210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:18.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.793+0000 7f7df6d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc52284c90 0x55cc52269210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39916/0 (socket says 172.21.15.146:39916) 2023-05-24T03:30:18.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.793+0000 7f7df6d9d700 1 -- 172.21.15.146:0/1841624817 learned_addr learned my addr 172.21.15.146:0/1841624817 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:18.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.793+0000 7f7df659c700 1 --2- 172.21.15.146:0/1841624817 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55cc52265060 0x55cc52265790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:18.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.793+0000 7f7df5d9b700 1 --2- 172.21.15.146:0/1841624817 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc5223c850 0x55cc5223f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:18.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.793+0000 7f7df6d9d700 1 -- 172.21.15.146:0/1841624817 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55cc52265060 msgr2=0x55cc52265790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:18.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.793+0000 7f7df6d9d700 1 --2- 172.21.15.146:0/1841624817 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55cc52265060 0x55cc52265790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:18.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.793+0000 7f7df6d9d700 1 -- 172.21.15.146:0/1841624817 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc5223c850 msgr2=0x55cc5223f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:18.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.793+0000 7f7df6d9d700 1 --2- 172.21.15.146:0/1841624817 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc5223c850 0x55cc5223f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:18.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.793+0000 7f7df6d9d700 1 -- 172.21.15.146:0/1841624817 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc520105e0 con 0x55cc52284c90 2023-05-24T03:30:18.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.794+0000 7f7df6d9d700 1 --2- 172.21.15.146:0/1841624817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc52284c90 0x55cc52269210 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7df0087b60 tx=0x7f7df0058020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ead691b6ae9a4546 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:18.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.794+0000 7f7dd7fff700 1 -- 172.21.15.146:0/1841624817 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df0056930 con 0x55cc52284c90 2023-05-24T03:30:18.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.794+0000 7f7dd7fff700 1 -- 172.21.15.146:0/1841624817 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df005c170 con 0x55cc52284c90 2023-05-24T03:30:18.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.794+0000 7f7dd7fff700 1 -- 172.21.15.146:0/1841624817 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df0060450 con 0x55cc52284c90 2023-05-24T03:30:18.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.794+0000 7f7e08c94b80 1 -- 172.21.15.146:0/1841624817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc52284c90 msgr2=0x55cc52269210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:18.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.794+0000 7f7e08c94b80 1 --2- 172.21.15.146:0/1841624817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc52284c90 0x55cc52269210 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7df0087b60 tx=0x7f7df0058020 comp rx=0 tx=0).stop 2023-05-24T03:30:18.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.794+0000 7f7e08c94b80 1 -- 172.21.15.146:0/1841624817 shutdown_connections 2023-05-24T03:30:18.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.794+0000 7f7e08c94b80 1 --2- 172.21.15.146:0/1841624817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc52284c90 0x55cc52269210 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:18.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.794+0000 7f7e08c94b80 1 --2- 172.21.15.146:0/1841624817 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55cc52265060 0x55cc52265790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:18.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.794+0000 7f7e08c94b80 1 --2- 172.21.15.146:0/1841624817 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc5223c850 0x55cc5223f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:18.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.794+0000 7f7e08c94b80 1 -- 172.21.15.146:0/1841624817 >> 172.21.15.146:0/1841624817 conn(0x55cc52233ed0 msgr2=0x55cc52284210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:18.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.794+0000 7f7e08c94b80 1 -- 172.21.15.146:0/1841624817 shutdown_connections 2023-05-24T03:30:18.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.794+0000 7f7e08c94b80 1 -- 172.21.15.146:0/1841624817 wait complete. 2023-05-24T03:30:18.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.795+0000 7f7e08c94b80 1 -- start start 2023-05-24T03:30:18.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.795+0000 7f7e08c94b80 1 Processor -- start 2023-05-24T03:30:18.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.796+0000 7f7e08c94b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc5223c850 0x55cc52286dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:18.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.796+0000 7f7e08c94b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc52265060 0x55cc522380c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:18.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.796+0000 7f7e08c94b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55cc52284c90 0x55cc52238600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:18.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.796+0000 7f7e08c94b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc52130890 con 0x55cc5223c850 2023-05-24T03:30:18.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.796+0000 7f7e08c94b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc52130530 con 0x55cc52265060 2023-05-24T03:30:18.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.796+0000 7f7e08c94b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cc520128d0 con 0x55cc52284c90 2023-05-24T03:30:18.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.796+0000 7f7e08c94b80 10 client.0 _ll_register_callbacks cb 0x55cc5214e730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-24T03:30:18.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.796+0000 7f7df659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc5223c850 0x55cc52286dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:18.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.796+0000 7f7df659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc5223c850 0x55cc52286dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39918/0 (socket says 172.21.15.146:39918) 2023-05-24T03:30:18.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.796+0000 7f7df659c700 1 -- 172.21.15.146:0/3603525177 learned_addr learned my addr 172.21.15.146:0/3603525177 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:18.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.796+0000 7f7df6d9d700 1 --2- 172.21.15.146:0/3603525177 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55cc52284c90 0x55cc52238600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:18.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.796+0000 7f7df5d9b700 1 --2- 172.21.15.146:0/3603525177 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc52265060 0x55cc522380c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:18.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.796+0000 7f7df659c700 1 -- 172.21.15.146:0/3603525177 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55cc52284c90 msgr2=0x55cc52238600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:18.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.796+0000 7f7df659c700 1 --2- 172.21.15.146:0/3603525177 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55cc52284c90 0x55cc52238600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:18.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.796+0000 7f7df659c700 1 -- 172.21.15.146:0/3603525177 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc52265060 msgr2=0x55cc522380c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:18.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.796+0000 7f7df659c700 1 --2- 172.21.15.146:0/3603525177 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc52265060 0x55cc522380c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:18.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.796+0000 7f7df659c700 1 -- 172.21.15.146:0/3603525177 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7df8160b10 con 0x55cc5223c850 2023-05-24T03:30:18.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.796+0000 7f7df6d9d700 1 --2- 172.21.15.146:0/3603525177 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55cc52284c90 0x55cc52238600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:30:18.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.797+0000 7f7df659c700 1 --2- 172.21.15.146:0/3603525177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc5223c850 0x55cc52286dd0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7dec0157d0 tx=0x7f7dec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a820e80df044f7b2 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:18.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.797+0000 7f7dd57fa700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-05-24T03:30:18.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.797+0000 7f7dd57fa700 1 -- 172.21.15.146:0/3603525177 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dec013420 con 0x55cc5223c850 2023-05-24T03:30:18.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.797+0000 7f7dd57fa700 1 -- 172.21.15.146:0/3603525177 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7dec01a040 con 0x55cc5223c850 2023-05-24T03:30:18.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.797+0000 7f7e08c94b80 1 -- 172.21.15.146:0/3603525177 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cc52231690 con 0x55cc5223c850 2023-05-24T03:30:18.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.797+0000 7f7dd57fa700 1 -- 172.21.15.146:0/3603525177 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7dec013580 con 0x55cc5223c850 2023-05-24T03:30:18.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.797+0000 7f7e08c94b80 10 client.4896 fetch_fsmap learned FSMap version 9 2023-05-24T03:30:18.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.797+0000 7f7e08c94b80 1 -- 172.21.15.146:0/3603525177 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55cc52155140 con 0x55cc5223c850 2023-05-24T03:30:18.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.797+0000 7f7dd57fa700 1 -- 172.21.15.146:0/3603525177 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cc52231690 con 0x55cc5223c850 2023-05-24T03:30:18.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.797+0000 7f7dd57fa700 1 -- 172.21.15.146:0/3603525177 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f7dec0136e0 con 0x55cc5223c850 2023-05-24T03:30:18.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.797+0000 7f7e08c94b80 10 client.4896 fetch_fsmap finished waiting for FSMap version 9 2023-05-24T03:30:18.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.797+0000 7f7e08c94b80 10 client.4896 resolve_mds: resolved name 'c' to daemon mds.c 2023-05-24T03:30:18.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.797+0000 7f7e08c94b80 20 client.4896 populate_metadata read hostname 'smithi146' 2023-05-24T03:30:18.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.797+0000 7f7e08c94b80 1 --2- 172.21.15.146:0/3603525177 >> [v2:172.21.15.146:6835/4012487240,v1:172.21.15.146:6836/4012487240] conn(0x55cc522943f0 0x55cc522a1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:18.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.797+0000 7f7e08c94b80 4 client.4896 mds_command: new command op to 4290 tid=0[{"prefix": "get_command_descriptions"}] 2023-05-24T03:30:18.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.797+0000 7f7e08c94b80 1 -- 172.21.15.146:0/3603525177 --> [v2:172.21.15.146:6835/4012487240,v1:172.21.15.146:6836/4012487240] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cc52151050 con 0x55cc522943f0 2023-05-24T03:30:18.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.797+0000 7f7df5d9b700 1 --2- 172.21.15.146:0/3603525177 >> [v2:172.21.15.146:6835/4012487240,v1:172.21.15.146:6836/4012487240] conn(0x55cc522943f0 0x55cc522a1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:18.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.798+0000 7f7dd57fa700 10 client.4896 ms_handle_connect on v2:172.21.15.146:6835/4012487240 2023-05-24T03:30:18.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.798+0000 7f7df5d9b700 1 --2- 172.21.15.146:0/3603525177 >> [v2:172.21.15.146:6835/4012487240,v1:172.21.15.146:6836/4012487240] conn(0x55cc522943f0 0x55cc522a1000 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7d6b0c400862e6b server_cookie=488c03eb1e7bb3f1 in_seq=0 out_seq=0 2023-05-24T03:30:18.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.798+0000 7f7dd57fa700 1 -- 172.21.15.146:0/3603525177 <== mds.0 v2:172.21.15.146:6835/4012487240 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55cc52151050 con 0x55cc522943f0 2023-05-24T03:30:18.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.798+0000 7f7dd57fa700 10 client.4896 handle_command_reply: tid=0 2023-05-24T03:30:18.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.798+0000 7f7e08c94b80 1 client.4896 shutdown 2023-05-24T03:30:18.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.798+0000 7f7e08c94b80 1 -- 172.21.15.146:0/3603525177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc5223c850 msgr2=0x55cc52286dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:18.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.798+0000 7f7e08c94b80 1 --2- 172.21.15.146:0/3603525177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc5223c850 0x55cc52286dd0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7dec0157d0 tx=0x7f7dec004750 comp rx=0 tx=0).stop 2023-05-24T03:30:18.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.798+0000 7f7e08c94b80 1 -- 172.21.15.146:0/3603525177 shutdown_connections 2023-05-24T03:30:18.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.798+0000 7f7e08c94b80 1 --2- 172.21.15.146:0/3603525177 >> [v2:172.21.15.146:6835/4012487240,v1:172.21.15.146:6836/4012487240] conn(0x55cc522943f0 0x55cc522a1000 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:18.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.798+0000 7f7e08c94b80 1 --2- 172.21.15.146:0/3603525177 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55cc52284c90 0x55cc52238600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:18.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.798+0000 7f7dd57fa700 0 client.4896 ms_handle_reset on v2:172.21.15.146:6835/4012487240 2023-05-24T03:30:18.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.798+0000 7f7e08c94b80 1 --2- 172.21.15.146:0/3603525177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc5223c850 0x55cc52286dd0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:18.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.798+0000 7f7e08c94b80 1 --2- 172.21.15.146:0/3603525177 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc52265060 0x55cc522380c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:18.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.798+0000 7f7e08c94b80 1 -- 172.21.15.146:0/3603525177 >> 172.21.15.146:0/3603525177 conn(0x55cc52233ed0 msgr2=0x55cc5223a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:18.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.798+0000 7f7e08c94b80 1 -- 172.21.15.146:0/3603525177 shutdown_connections 2023-05-24T03:30:18.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.798+0000 7f7e08c94b80 1 -- 172.21.15.146:0/3603525177 wait complete. 2023-05-24T03:30:18.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.799+0000 7f7e08c94b80 20 client.4896 trim_cache size 0 max 16384 2023-05-24T03:30:18.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.816+0000 7f7e08c94b80 1 Processor -- start 2023-05-24T03:30:18.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.816+0000 7f7e08c94b80 1 -- start start 2023-05-24T03:30:18.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.817+0000 7f7e08c94b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc5223c850 0x55cc522393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:18.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.817+0000 7f7e08c94b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc52265060 0x55cc52269200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:18.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.817+0000 7f7e08c94b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55cc52284c90 0x55cc52269740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:18.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.817+0000 7f7e08c94b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc5223c100 con 0x55cc52265060 2023-05-24T03:30:18.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.817+0000 7f7e08c94b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc52235f50 con 0x55cc5223c850 2023-05-24T03:30:18.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.817+0000 7f7e08c94b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cc52293080 con 0x55cc52284c90 2023-05-24T03:30:18.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.817+0000 7f7df5d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc52265060 0x55cc52269200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:18.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.817+0000 7f7df5d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc52265060 0x55cc52269200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39928/0 (socket says 172.21.15.146:39928) 2023-05-24T03:30:18.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.817+0000 7f7df5d9b700 1 -- 172.21.15.146:0/2444229759 learned_addr learned my addr 172.21.15.146:0/2444229759 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:18.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.817+0000 7f7df6d9d700 1 --2- 172.21.15.146:0/2444229759 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55cc52284c90 0x55cc52269740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:18.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.817+0000 7f7df659c700 1 --2- 172.21.15.146:0/2444229759 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc5223c850 0x55cc522393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:18.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.817+0000 7f7df5d9b700 1 -- 172.21.15.146:0/2444229759 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55cc52284c90 msgr2=0x55cc52269740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:18.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.817+0000 7f7df5d9b700 1 --2- 172.21.15.146:0/2444229759 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55cc52284c90 0x55cc52269740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:18.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.817+0000 7f7df5d9b700 1 -- 172.21.15.146:0/2444229759 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc5223c850 msgr2=0x55cc522393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:18.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.817+0000 7f7df5d9b700 1 --2- 172.21.15.146:0/2444229759 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc5223c850 0x55cc522393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:18.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.817+0000 7f7df5d9b700 1 -- 172.21.15.146:0/2444229759 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc52154e90 con 0x55cc52265060 2023-05-24T03:30:18.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.817+0000 7f7df5d9b700 1 --2- 172.21.15.146:0/2444229759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc52265060 0x55cc52269200 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7de8014040 tx=0x7f7de8010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df353b2e42af5c63 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:18.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.818+0000 7f7de4ff9700 1 -- 172.21.15.146:0/2444229759 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de800be30 con 0x55cc52265060 2023-05-24T03:30:18.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.818+0000 7f7de4ff9700 1 -- 172.21.15.146:0/2444229759 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de8021040 con 0x55cc52265060 2023-05-24T03:30:18.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.818+0000 7f7de4ff9700 1 -- 172.21.15.146:0/2444229759 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de80279d0 con 0x55cc52265060 2023-05-24T03:30:18.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.818+0000 7f7e08c94b80 1 -- 172.21.15.146:0/2444229759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc52265060 msgr2=0x55cc52269200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:18.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.818+0000 7f7e08c94b80 1 --2- 172.21.15.146:0/2444229759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc52265060 0x55cc52269200 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7de8014040 tx=0x7f7de8010000 comp rx=0 tx=0).stop 2023-05-24T03:30:18.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.818+0000 7f7e08c94b80 1 -- 172.21.15.146:0/2444229759 shutdown_connections 2023-05-24T03:30:18.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.818+0000 7f7e08c94b80 1 --2- 172.21.15.146:0/2444229759 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55cc52284c90 0x55cc52269740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:18.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.818+0000 7f7e08c94b80 1 --2- 172.21.15.146:0/2444229759 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc5223c850 0x55cc522393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:18.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.818+0000 7f7e08c94b80 1 --2- 172.21.15.146:0/2444229759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc52265060 0x55cc52269200 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:18.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.818+0000 7f7e08c94b80 1 -- 172.21.15.146:0/2444229759 >> 172.21.15.146:0/2444229759 conn(0x55cc52233ed0 msgr2=0x55cc52264550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:18.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.818+0000 7f7e08c94b80 1 -- 172.21.15.146:0/2444229759 shutdown_connections 2023-05-24T03:30:18.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.818+0000 7f7e08c94b80 1 -- 172.21.15.146:0/2444229759 wait complete. 2023-05-24T03:30:18.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.819+0000 7f7e08c94b80 1 -- start start 2023-05-24T03:30:18.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.819+0000 7f7e08c94b80 1 Processor -- start 2023-05-24T03:30:18.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.820+0000 7f7e08c94b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc5223c850 0x55cc522e4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:18.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.820+0000 7f7e08c94b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc52265060 0x55cc52295ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:18.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.820+0000 7f7e08c94b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55cc52284c90 0x55cc52269200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:18.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.820+0000 7f7e08c94b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc52287b60 con 0x55cc52265060 2023-05-24T03:30:18.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.820+0000 7f7e08c94b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc522808e0 con 0x55cc5223c850 2023-05-24T03:30:18.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.820+0000 7f7e08c94b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cc5223e090 con 0x55cc52284c90 2023-05-24T03:30:18.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.820+0000 7f7e08c94b80 10 client.0 _ll_register_callbacks cb 0x55cc5214e730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-24T03:30:18.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.820+0000 7f7df5d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc52265060 0x55cc52295ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:18.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.820+0000 7f7df5d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc52265060 0x55cc52295ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39934/0 (socket says 172.21.15.146:39934) 2023-05-24T03:30:18.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.820+0000 7f7df5d9b700 1 -- 172.21.15.146:0/25405161 learned_addr learned my addr 172.21.15.146:0/25405161 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:18.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.820+0000 7f7df6d9d700 1 --2- 172.21.15.146:0/25405161 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55cc52284c90 0x55cc52269200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:18.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.820+0000 7f7df659c700 1 --2- 172.21.15.146:0/25405161 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc5223c850 0x55cc522e4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:18.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.820+0000 7f7df5d9b700 1 -- 172.21.15.146:0/25405161 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55cc52284c90 msgr2=0x55cc52269200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:18.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.820+0000 7f7df5d9b700 1 --2- 172.21.15.146:0/25405161 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55cc52284c90 0x55cc52269200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:18.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.820+0000 7f7df5d9b700 1 -- 172.21.15.146:0/25405161 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc5223c850 msgr2=0x55cc522e4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:18.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.820+0000 7f7df5d9b700 1 --2- 172.21.15.146:0/25405161 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc5223c850 0x55cc522e4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:18.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.820+0000 7f7df5d9b700 1 -- 172.21.15.146:0/25405161 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7df8160830 con 0x55cc52265060 2023-05-24T03:30:18.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.820+0000 7f7df5d9b700 1 --2- 172.21.15.146:0/25405161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc52265060 0x55cc52295ec0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7de8014040 tx=0x7f7de80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac14b42c56319811 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:18.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.820+0000 7f7dd57fa700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-05-24T03:30:18.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.820+0000 7f7dd57fa700 1 -- 172.21.15.146:0/25405161 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de80279d0 con 0x55cc52265060 2023-05-24T03:30:18.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.820+0000 7f7dd57fa700 1 -- 172.21.15.146:0/25405161 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7de8027b30 con 0x55cc52265060 2023-05-24T03:30:18.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.820+0000 7f7e08c94b80 1 -- 172.21.15.146:0/25405161 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7df005c170 con 0x55cc52265060 2023-05-24T03:30:18.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.821+0000 7f7dd57fa700 1 -- 172.21.15.146:0/25405161 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7de8027cf0 con 0x55cc52265060 2023-05-24T03:30:18.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.821+0000 7f7e08c94b80 10 client.4902 fetch_fsmap learned FSMap version 9 2023-05-24T03:30:18.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.821+0000 7f7e08c94b80 1 -- 172.21.15.146:0/25405161 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55cc51fa5c10 con 0x55cc52265060 2023-05-24T03:30:18.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.821+0000 7f7dd57fa700 1 -- 172.21.15.146:0/25405161 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df005c170 con 0x55cc52265060 2023-05-24T03:30:18.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.821+0000 7f7dd57fa700 1 -- 172.21.15.146:0/25405161 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f7de8004040 con 0x55cc52265060 2023-05-24T03:30:18.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.821+0000 7f7e08c94b80 10 client.4902 fetch_fsmap finished waiting for FSMap version 9 2023-05-24T03:30:18.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.821+0000 7f7e08c94b80 10 client.4902 resolve_mds: resolved name 'c' to daemon mds.c 2023-05-24T03:30:18.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.821+0000 7f7e08c94b80 20 client.4902 populate_metadata read hostname 'smithi146' 2023-05-24T03:30:18.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.821+0000 7f7e08c94b80 1 --2- 172.21.15.146:0/25405161 >> [v2:172.21.15.146:6835/4012487240,v1:172.21.15.146:6836/4012487240] conn(0x55cc522ee860 0x55cc522eec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:18.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.821+0000 7f7e08c94b80 4 client.4902 mds_command: new command op to 4290 tid=0[{"prefix": "status"}] 2023-05-24T03:30:18.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.821+0000 7f7e08c94b80 1 -- 172.21.15.146:0/25405161 --> [v2:172.21.15.146:6835/4012487240,v1:172.21.15.146:6836/4012487240] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55cc5215d610 con 0x55cc522ee860 2023-05-24T03:30:18.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.821+0000 7f7df659c700 1 --2- 172.21.15.146:0/25405161 >> [v2:172.21.15.146:6835/4012487240,v1:172.21.15.146:6836/4012487240] conn(0x55cc522ee860 0x55cc522eec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:18.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.821+0000 7f7dd57fa700 10 client.4902 ms_handle_connect on v2:172.21.15.146:6835/4012487240 2023-05-24T03:30:18.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.821+0000 7f7df659c700 1 --2- 172.21.15.146:0/25405161 >> [v2:172.21.15.146:6835/4012487240,v1:172.21.15.146:6836/4012487240] conn(0x55cc522ee860 0x55cc522eec30 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f0bd7c568d7c745 server_cookie=b68eacf647c2eb34 in_seq=0 out_seq=0 2023-05-24T03:30:18.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.821+0000 7f7dd57fa700 1 -- 172.21.15.146:0/25405161 <== mds.0 v2:172.21.15.146:6835/4012487240 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55cc5215d610 con 0x55cc522ee860 2023-05-24T03:30:18.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.821+0000 7f7dd57fa700 10 client.4902 handle_command_reply: tid=0 2023-05-24T03:30:18.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.821+0000 7f7e08c94b80 1 client.4902 shutdown 2023-05-24T03:30:18.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.822+0000 7f7e08c94b80 1 -- 172.21.15.146:0/25405161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc52265060 msgr2=0x55cc52295ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:18.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.822+0000 7f7e08c94b80 1 --2- 172.21.15.146:0/25405161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc52265060 0x55cc52295ec0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7de8014040 tx=0x7f7de80047c0 comp rx=0 tx=0).stop 2023-05-24T03:30:18.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.822+0000 7f7e08c94b80 1 -- 172.21.15.146:0/25405161 shutdown_connections 2023-05-24T03:30:18.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.822+0000 7f7e08c94b80 1 --2- 172.21.15.146:0/25405161 >> [v2:172.21.15.146:6835/4012487240,v1:172.21.15.146:6836/4012487240] conn(0x55cc522ee860 0x55cc522eec30 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:18.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.822+0000 7f7e08c94b80 1 --2- 172.21.15.146:0/25405161 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55cc52284c90 0x55cc52269200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:18.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.822+0000 7f7e08c94b80 1 --2- 172.21.15.146:0/25405161 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc5223c850 0x55cc522e4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:18.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.822+0000 7f7e08c94b80 1 --2- 172.21.15.146:0/25405161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cc52265060 0x55cc52295ec0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:18.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.822+0000 7f7dd57fa700 0 client.4902 ms_handle_reset on v2:172.21.15.146:6835/4012487240 2023-05-24T03:30:18.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.822+0000 7f7e08c94b80 1 -- 172.21.15.146:0/25405161 >> 172.21.15.146:0/25405161 conn(0x55cc52233ed0 msgr2=0x55cc5226a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:18.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.822+0000 7f7e08c94b80 1 -- 172.21.15.146:0/25405161 shutdown_connections 2023-05-24T03:30:18.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.822+0000 7f7e08c94b80 1 -- 172.21.15.146:0/25405161 wait complete. 2023-05-24T03:30:18.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.822+0000 7f7e08c94b80 20 client.4902 trim_cache size 0 max 16384 2023-05-24T03:30:18.842 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-05-24T03:30:18.842 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "11ca0adb-7672-4713-bde7-451e8b743ae9", 2023-05-24T03:30:18.842 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2023-05-24T03:30:18.842 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 4290, 2023-05-24T03:30:18.842 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2023-05-24T03:30:18.842 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2023-05-24T03:30:18.843 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2023-05-24T03:30:18.843 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 34.350914281000001, 2023-05-24T03:30:18.843 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 9, 2023-05-24T03:30:18.843 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 28, 2023-05-24T03:30:18.843 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 28, 2023-05-24T03:30:18.843 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 39.670032153000001 2023-05-24T03:30:18.843 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-05-24T03:30:18.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.822+0000 7f7dfcb08700 1 -- 172.21.15.146:0/769323081 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f7dd806ace0 msgr2=0x7f7dd806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:18.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.822+0000 7f7dfcb08700 1 --2- 172.21.15.146:0/769323081 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f7dd806ace0 0x7f7dd806d190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7dec006fd0 tx=0x7f7dec008040 comp rx=0 tx=0).stop 2023-05-24T03:30:18.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.822+0000 7f7dfcb08700 1 -- 172.21.15.146:0/769323081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7df80cc1d0 msgr2=0x7f7df80c8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:18.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.822+0000 7f7dfcb08700 1 --2- 172.21.15.146:0/769323081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7df80cc1d0 0x7f7df80c8be0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7df000ce80 tx=0x7f7df000ceb0 comp rx=0 tx=0).stop 2023-05-24T03:30:18.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.822+0000 7f7dfcb08700 1 -- 172.21.15.146:0/769323081 shutdown_connections 2023-05-24T03:30:18.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.822+0000 7f7dfcb08700 1 --2- 172.21.15.146:0/769323081 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f7dd806ace0 0x7f7dd806d190 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:18.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.822+0000 7f7dfcb08700 1 --2- 172.21.15.146:0/769323081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7df80cc1d0 0x7f7df80c8be0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:18.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.822+0000 7f7dfcb08700 1 --2- 172.21.15.146:0/769323081 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7df80cb8c0 0x7f7df814d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:18.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.822+0000 7f7dfcb08700 1 --2- 172.21.15.146:0/769323081 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7df80cbc90 0x7f7df80b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:18.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.822+0000 7f7dfcb08700 1 -- 172.21.15.146:0/769323081 >> 172.21.15.146:0/769323081 conn(0x7f7df80cfea0 msgr2=0x7f7df815bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:18.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.822+0000 7f7dfcb08700 1 -- 172.21.15.146:0/769323081 shutdown_connections 2023-05-24T03:30:18.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:18.822+0000 7f7dfcb08700 1 -- 172.21.15.146:0/769323081 wait complete. 2023-05-24T03:30:18.847 INFO:teuthology.run_tasks:Running task kclient... 2023-05-24T03:30:18.866 INFO:tasks.kclient:Mounting kernel clients... 2023-05-24T03:30:18.866 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-05-24T03:30:18.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:18.867 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2023-05-24T03:30:18.883 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-05-24T03:30:18.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:18.884 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-05-24T03:30:18.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:18.969 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link delete ceph-brx 2023-05-24T03:30:19.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:19.085 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2023-05-24T03:30:19.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:19.103 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link delete ceph-brx 2023-05-24T03:30:19.172 INFO:teuthology.orchestra.run.smithi146.stderr:Cannot find device "ceph-brx" 2023-05-24T03:30:19.173 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-24T03:30:19.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:19.175 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2023-05-24T03:30:19.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:19.197 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link delete ceph-brx 2023-05-24T03:30:19.272 INFO:teuthology.orchestra.run.smithi151.stderr:Cannot find device "ceph-brx" 2023-05-24T03:30:19.273 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-24T03:30:19.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:19.274 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2023-05-24T03:30:19.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:19.333 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link delete ceph-brx 2023-05-24T03:30:19.403 INFO:teuthology.orchestra.run.smithi151.stderr:Cannot find device "ceph-brx" 2023-05-24T03:30:19.404 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-24T03:30:19.405 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-05-24T03:30:19.405 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-05-24T03:30:19.405 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-05-24T03:30:19.406 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-24T03:30:19.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.526+0000 7f5395705700 1 Processor -- start 2023-05-24T03:30:19.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.526+0000 7f5395705700 1 -- start start 2023-05-24T03:30:19.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.526+0000 7f5395705700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f53901597f0 0x7f539006d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:19.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.526+0000 7f5395705700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f53900ccf80 0x7f53900cd380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:19.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.526+0000 7f5395705700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5390159bc0 con 0x7f539006fff0 2023-05-24T03:30:19.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.526+0000 7f5395705700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f539006cde0 con 0x7f53900ccf80 2023-05-24T03:30:19.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.526+0000 7f5395705700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f539006cab0 con 0x7f53901597f0 2023-05-24T03:30:19.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.527+0000 7f538f7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f53900ccf80 0x7f53900cd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:19.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.527+0000 7f538f7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f53900ccf80 0x7f53900cd380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39944/0 (socket says 172.21.15.146:39944) 2023-05-24T03:30:19.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.527+0000 7f538f7fe700 1 -- 172.21.15.146:0/1598364119 learned_addr learned my addr 172.21.15.146:0/1598364119 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:19.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.527+0000 7f538effd700 1 --2- 172.21.15.146:0/1598364119 >> v2:172.21.15.151:3300/0 conn(0x7f53901597f0 0x7f539006d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:19.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.527+0000 7f538f7fe700 1 -- 172.21.15.146:0/1598364119 >> v2:172.21.15.151:3300/0 conn(0x7f53901597f0 msgr2=0x7f539006d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:19.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.527+0000 7f538f7fe700 1 --2- 172.21.15.146:0/1598364119 >> v2:172.21.15.151:3300/0 conn(0x7f53901597f0 0x7f539006d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:19.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.527+0000 7f538f7fe700 1 -- 172.21.15.146:0/1598364119 >> v1:172.21.15.151:6789/0 conn(0x7f539006fff0 legacy=0x7f5390070470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:19.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.527+0000 7f538f7fe700 1 -- 172.21.15.146:0/1598364119 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53900ca500 con 0x7f53900ccf80 2023-05-24T03:30:19.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.527+0000 7f538f7fe700 1 --2- 172.21.15.146:0/1598364119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53900ccf80 0x7f53900cd380 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f539006fa00 tx=0x7f5380009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3094203fd77e5fe server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:19.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.527+0000 7f538dffb700 1 -- 172.21.15.146:0/1598364119 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5380004230 con 0x7f53900ccf80 2023-05-24T03:30:19.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.527+0000 7f538dffb700 1 -- 172.21.15.146:0/1598364119 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5380004390 con 0x7f53900ccf80 2023-05-24T03:30:19.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.527+0000 7f538dffb700 1 -- 172.21.15.146:0/1598364119 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53800036a0 con 0x7f53900ccf80 2023-05-24T03:30:19.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.528+0000 7f5395705700 1 -- 172.21.15.146:0/1598364119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53900ccf80 msgr2=0x7f53900cd380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:19.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.528+0000 7f5395705700 1 --2- 172.21.15.146:0/1598364119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53900ccf80 0x7f53900cd380 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f539006fa00 tx=0x7f5380009bd0 comp rx=0 tx=0).stop 2023-05-24T03:30:19.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.528+0000 7f5395705700 1 -- 172.21.15.146:0/1598364119 shutdown_connections 2023-05-24T03:30:19.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.528+0000 7f5395705700 1 --2- 172.21.15.146:0/1598364119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53900ccf80 0x7f53900cd380 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:19.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.528+0000 7f5395705700 1 --2- 172.21.15.146:0/1598364119 >> v2:172.21.15.151:3300/0 conn(0x7f53901597f0 0x7f539006d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:19.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.528+0000 7f5395705700 1 -- 172.21.15.146:0/1598364119 >> 172.21.15.146:0/1598364119 conn(0x7f539006b0b0 msgr2=0x7f53900cedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:19.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.528+0000 7f5395705700 1 -- 172.21.15.146:0/1598364119 shutdown_connections 2023-05-24T03:30:19.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.528+0000 7f5395705700 1 -- 172.21.15.146:0/1598364119 wait complete. 2023-05-24T03:30:19.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.529+0000 7f5395705700 1 Processor -- start 2023-05-24T03:30:19.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.529+0000 7f5395705700 1 -- start start 2023-05-24T03:30:19.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.530+0000 7f5395705700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f539006fff0 0x7f53900b03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:19.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.530+0000 7f5395705700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f53900ccf80 0x7f53901511e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:19.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.530+0000 7f5395705700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53901597f0 0x7f53901582c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:19.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.530+0000 7f5395705700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53900b4010 con 0x7f53901597f0 2023-05-24T03:30:19.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.530+0000 7f5395705700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53900b3120 con 0x7f53900ccf80 2023-05-24T03:30:19.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.530+0000 7f5395705700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53900b3400 con 0x7f539006fff0 2023-05-24T03:30:19.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.530+0000 7f538f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53901597f0 0x7f53901582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:19.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.530+0000 7f538f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53901597f0 0x7f53901582c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39950/0 (socket says 172.21.15.146:39950) 2023-05-24T03:30:19.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.530+0000 7f538f7fe700 1 -- 172.21.15.146:0/1788291615 learned_addr learned my addr 172.21.15.146:0/1788291615 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:19.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.530+0000 7f538effd700 1 --2- 172.21.15.146:0/1788291615 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f539006fff0 0x7f53900b03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:19.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.530+0000 7f538e7fc700 1 --2- 172.21.15.146:0/1788291615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f53900ccf80 0x7f53901511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:19.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.530+0000 7f538f7fe700 1 -- 172.21.15.146:0/1788291615 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f539006fff0 msgr2=0x7f53900b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:19.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.530+0000 7f538f7fe700 1 --2- 172.21.15.146:0/1788291615 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f539006fff0 0x7f53900b03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:19.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.530+0000 7f538f7fe700 1 -- 172.21.15.146:0/1788291615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f53900ccf80 msgr2=0x7f53901511e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:19.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.530+0000 7f538f7fe700 1 --2- 172.21.15.146:0/1788291615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f53900ccf80 0x7f53901511e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:19.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.530+0000 7f538f7fe700 1 -- 172.21.15.146:0/1788291615 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5380009550 con 0x7f53901597f0 2023-05-24T03:30:19.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.530+0000 7f538f7fe700 1 --2- 172.21.15.146:0/1788291615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53901597f0 0x7f53901582c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5380009130 tx=0x7f5380004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:19.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.530+0000 7f53877fe700 1 -- 172.21.15.146:0/1788291615 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5380003b90 con 0x7f53901597f0 2023-05-24T03:30:19.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.531+0000 7f53877fe700 1 -- 172.21.15.146:0/1788291615 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f538001f070 con 0x7f53901597f0 2023-05-24T03:30:19.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.531+0000 7f53877fe700 1 -- 172.21.15.146:0/1788291615 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5380011630 con 0x7f53901597f0 2023-05-24T03:30:19.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.531+0000 7f5395705700 1 -- 172.21.15.146:0/1788291615 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53900ca220 con 0x7f53901597f0 2023-05-24T03:30:19.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.531+0000 7f5395705700 1 -- 172.21.15.146:0/1788291615 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53900c9f40 con 0x7f53901597f0 2023-05-24T03:30:19.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.531+0000 7f5395705700 1 -- 172.21.15.146:0/1788291615 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f539006d7b0 con 0x7f53901597f0 2023-05-24T03:30:19.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.532+0000 7f53877fe700 1 -- 172.21.15.146:0/1788291615 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5380021030 con 0x7f53901597f0 2023-05-24T03:30:19.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.532+0000 7f53877fe700 1 --2- 172.21.15.146:0/1788291615 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f537006ace0 0x7f537006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:19.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.532+0000 7f53877fe700 1 -- 172.21.15.146:0/1788291615 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f538008aa50 con 0x7f53901597f0 2023-05-24T03:30:19.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.532+0000 7f538effd700 1 --2- 172.21.15.146:0/1788291615 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f537006ace0 0x7f537006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:19.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.533+0000 7f538effd700 1 --2- 172.21.15.146:0/1788291615 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f537006ace0 0x7f537006d190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5388003c10 tx=0x7f53880098d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:19.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.537+0000 7f53877fe700 1 -- 172.21.15.146:0/1788291615 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f5380055820 con 0x7f53901597f0 2023-05-24T03:30:19.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.768+0000 7f5395705700 1 -- 172.21.15.146:0/1788291615 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5390159bc0 con 0x7f53901597f0 2023-05-24T03:30:19.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.769+0000 7f53877fe700 1 -- 172.21.15.146:0/1788291615 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f5390159bc0 con 0x7f53901597f0 2023-05-24T03:30:19.773 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-05-24T03:30:19.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.771+0000 7f5395705700 1 -- 172.21.15.146:0/1788291615 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f537006ace0 msgr2=0x7f537006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:19.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.771+0000 7f5395705700 1 --2- 172.21.15.146:0/1788291615 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f537006ace0 0x7f537006d190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5388003c10 tx=0x7f53880098d0 comp rx=0 tx=0).stop 2023-05-24T03:30:19.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.771+0000 7f5395705700 1 -- 172.21.15.146:0/1788291615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53901597f0 msgr2=0x7f53901582c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:19.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.771+0000 7f5395705700 1 --2- 172.21.15.146:0/1788291615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53901597f0 0x7f53901582c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5380009130 tx=0x7f5380004750 comp rx=0 tx=0).stop 2023-05-24T03:30:19.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.771+0000 7f5395705700 1 -- 172.21.15.146:0/1788291615 shutdown_connections 2023-05-24T03:30:19.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.771+0000 7f5395705700 1 --2- 172.21.15.146:0/1788291615 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f537006ace0 0x7f537006d190 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:19.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.771+0000 7f5395705700 1 --2- 172.21.15.146:0/1788291615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53901597f0 0x7f53901582c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:19.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.771+0000 7f5395705700 1 --2- 172.21.15.146:0/1788291615 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f539006fff0 0x7f53900b03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:19.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.771+0000 7f5395705700 1 --2- 172.21.15.146:0/1788291615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f53900ccf80 0x7f53901511e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:19.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.771+0000 7f5395705700 1 -- 172.21.15.146:0/1788291615 >> 172.21.15.146:0/1788291615 conn(0x7f539006b0b0 msgr2=0x7f5390159d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:19.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.771+0000 7f5395705700 1 -- 172.21.15.146:0/1788291615 shutdown_connections 2023-05-24T03:30:19.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:19.771+0000 7f5395705700 1 -- 172.21.15.146:0/1788291615 wait complete. 2023-05-24T03:30:19.786 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-24T03:30:19.787 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-24T03:30:19.787 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2023-05-24T03:30:19.787 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-05-24T03:30:19.787 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-05-24T03:30:19.787 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-24T03:30:19.788 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-24T03:30:19.788 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-24T03:30:19.788 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-24T03:30:19.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:19.789 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2023-05-24T03:30:19.806 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-24T03:30:19.806 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-24T03:30:19.806 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2023-05-24T03:30:19.806 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-05-24T03:30:19.807 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2023-05-24T03:30:19.807 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-05-24T03:30:19.807 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-24T03:30:19.807 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2023-05-24T03:30:19.807 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-24T03:30:19.807 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2023-05-24T03:30:19.807 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-24T03:30:19.807 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2023-05-24T03:30:19.808 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-24T03:30:19.808 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2023-05-24T03:30:19.808 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-05-24T03:30:19.808 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42262sec preferred_lft 42262sec 2023-05-24T03:30:19.808 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::1ab9:7f4d:347e:588/64 scope link noprefixroute 2023-05-24T03:30:19.808 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-05-24T03:30:19.809 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-05-24T03:30:19.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:19.809 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-05-24T03:30:19.809 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-05-24T03:30:19.810 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link add name ceph-brx type bridge 2023-05-24T03:30:19.810 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip addr flush dev ceph-brx 2023-05-24T03:30:19.810 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set ceph-brx up 2023-05-24T03:30:19.810 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-05-24T03:30:19.811 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-05-24T03:30:19.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:19.923 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-24T03:30:19.949 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-05-24T03:30:19.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:19.950 DEBUG:teuthology.orchestra.run.smithi146:> route 2023-05-24T03:30:20.009 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2023-05-24T03:30:20.009 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-24T03:30:20.009 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-05-24T03:30:20.010 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-05-24T03:30:20.010 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-24T03:30:20.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:20.010 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-05-24T03:30:20.011 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-05-24T03:30:20.011 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-05-24T03:30:20.011 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-05-24T03:30:20.011 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-05-24T03:30:20.012 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-05-24T03:30:20.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:20.117 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2023-05-24T03:30:20.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:20.135 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list-id 2023-05-24T03:30:20.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:20.192 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-05-24T03:30:20.192 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-05-24T03:30:20.192 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-24T03:30:20.193 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-05-24T03:30:20.193 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-05-24T03:30:20.285 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-05-24T03:30:20.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:20.286 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-05-24T03:30:20.286 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-05-24T03:30:20.286 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-05-24T03:30:20.287 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-05-24T03:30:20.287 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-05-24T03:30:20.287 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-05-24T03:30:20.287 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-05-24T03:30:20.288 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-05-24T03:30:20.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:20.510 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-05-24T03:30:20.511 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-05-24T03:30:20.511 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2023-05-24T03:30:20.511 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set dev brx.0 master ceph-brx 2023-05-24T03:30:20.511 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-05-24T03:30:20.626 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-24T03:30:20.626 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-05-24T03:30:20.645 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-05-24T03:30:20.646 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-24T03:30:20.646 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-05-24T03:30:20.701 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-05-24T03:30:20.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:20.702 DEBUG:teuthology.orchestra.run.smithi146:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-05-24T03:30:20.787 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-05-24T03:30:20.787 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-05-24T03:30:20.922 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-05-24T03:30:20.922 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-05-24T03:30:20.923 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.151:3300,172.21.15.151:3301" 2023-05-24T03:30:20.923 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: trying mount with new device syntax: 0@11ca0adb-7672-4713-bde7-451e8b743ae9.cephfs=/ 2023-05-24T03:30:20.923 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.146:3300/172.21.15.151:3300/172.21.15.151:3301" will pass to kernel 2023-05-24T03:30:20.923 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: v2 mount support check returned 2 2023-05-24T03:30:20.923 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: kernel does not support v2 syntax 2023-05-24T03:30:20.923 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: switching to using v1 address with old syntax 2023-05-24T03:30:21.000 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-05-24T03:30:21.000 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-05-24T03:30:21.001 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.151:3300,172.21.15.151:3301" 2023-05-24T03:30:21.001 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: trying mount with new device syntax: 0@11ca0adb-7672-4713-bde7-451e8b743ae9.cephfs=/ 2023-05-24T03:30:21.001 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.146:3300/172.21.15.151:3300/172.21.15.151:3301" will pass to kernel 2023-05-24T03:30:21.001 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: v2 mount support check returned 2 2023-05-24T03:30:21.001 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: kernel does not support v2 syntax 2023-05-24T03:30:21.001 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: switching to using v1 address with old syntax 2023-05-24T03:30:21.001 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:6789,172.21.15.151:6789,172.21.15.151:6790" 2023-05-24T03:30:21.002 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.146:6789,172.21.15.151:6789,172.21.15.151:6790:/ 2023-05-24T03:30:21.002 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=11ca0adb-7672-4713-bde7-451e8b743ae9" will pass to kernel 2023-05-24T03:30:21.003 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-05-24T03:30:21.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:21.004 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-05-24T03:30:21.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:21.032 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-05-24T03:30:21.103 INFO:teuthology.orchestra.run.smithi146.stdout:client4765 2023-05-24T03:30:21.104 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-05-24T03:30:21.104 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-24T03:30:21.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:21.162 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-05-24T03:30:21.233 INFO:teuthology.orchestra.run.smithi146.stdout:client4765 2023-05-24T03:30:21.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:21.234 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-05-24T03:30:21.305 INFO:teuthology.orchestra.run.smithi146.stdout:client4765 2023-05-24T03:30:21.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:21.306 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/11ca0adb-7672-4713-bde7-451e8b743ae9.client4765/status') 2023-05-24T03:30:21.386 INFO:teuthology.orchestra.run.smithi146.stdout:instance: client.4765 (3)172.21.15.146:0/1229089354 2023-05-24T03:30:21.386 INFO:teuthology.orchestra.run.smithi146.stdout:blocklisted: false 2023-05-24T03:30:21.387 INFO:teuthology.orchestra.run.smithi146.stderr:0+1 records in 2023-05-24T03:30:21.387 INFO:teuthology.orchestra.run.smithi146.stderr:0+1 records out 2023-05-24T03:30:21.387 INFO:teuthology.orchestra.run.smithi146.stderr:71 bytes copied, 2.409e-05 s, 2.9 MB/s 2023-05-24T03:30:21.387 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-05-24T03:30:21.388 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-05-24T03:30:21.388 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-05-24T03:30:21.388 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-24T03:30:21.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.545+0000 7f16ad70d700 1 Processor -- start 2023-05-24T03:30:21.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.545+0000 7f16ad70d700 1 -- start start 2023-05-24T03:30:21.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.545+0000 7f16ad70d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f16a80b0ac0 0x7f16a80ce490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:21.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.545+0000 7f16ad70d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16a80b0e90 0x7f16a815d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:21.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.545+0000 7f16ad70d700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f16a80cca60 0x7f16a806c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:21.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.545+0000 7f16ad70d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16a806bf00 con 0x7f16a80b0ac0 2023-05-24T03:30:21.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.545+0000 7f16ad70d700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16a815d950 con 0x7f16a80cca60 2023-05-24T03:30:21.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.545+0000 7f16ad70d700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a80c9430 con 0x7f16a80b0e90 2023-05-24T03:30:21.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.546+0000 7f16a6ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f16a80b0ac0 0x7f16a80ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:21.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.546+0000 7f16a6ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f16a80b0ac0 0x7f16a80ce490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39958/0 (socket says 172.21.15.146:39958) 2023-05-24T03:30:21.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.546+0000 7f16a6ffd700 1 -- 172.21.15.146:0/3477670499 learned_addr learned my addr 172.21.15.146:0/3477670499 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:21.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.546+0000 7f16a77fe700 1 --2- 172.21.15.146:0/3477670499 >> v2:172.21.15.151:3300/0 conn(0x7f16a80cca60 0x7f16a806c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:21.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.546+0000 7f16a67fc700 1 --2- 172.21.15.146:0/3477670499 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16a80b0e90 0x7f16a815d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:21.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.546+0000 7f16a6ffd700 1 -- 172.21.15.146:0/3477670499 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16a80b0e90 msgr2=0x7f16a815d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:21.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.546+0000 7f16a6ffd700 1 --2- 172.21.15.146:0/3477670499 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16a80b0e90 0x7f16a815d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:21.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.546+0000 7f16a6ffd700 1 -- 172.21.15.146:0/3477670499 >> v2:172.21.15.151:3300/0 conn(0x7f16a80cca60 msgr2=0x7f16a806c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:21.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.546+0000 7f16a6ffd700 1 --2- 172.21.15.146:0/3477670499 >> v2:172.21.15.151:3300/0 conn(0x7f16a80cca60 0x7f16a806c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:21.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.546+0000 7f16a6ffd700 1 -- 172.21.15.146:0/3477670499 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a80c9710 con 0x7f16a80b0ac0 2023-05-24T03:30:21.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.546+0000 7f16a6ffd700 1 --2- 172.21.15.146:0/3477670499 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16a80b0ac0 0x7f16a80ce490 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f16a8066fa0 tx=0x7f1698009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc0065b0cc2a6a52 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:21.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.546+0000 7f16a5ffb700 1 -- 172.21.15.146:0/3477670499 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169800b870 con 0x7f16a80b0ac0 2023-05-24T03:30:21.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.546+0000 7f16a5ffb700 1 -- 172.21.15.146:0/3477670499 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169800b9d0 con 0x7f16a80b0ac0 2023-05-24T03:30:21.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.546+0000 7f16a5ffb700 1 -- 172.21.15.146:0/3477670499 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169800bd60 con 0x7f16a80b0ac0 2023-05-24T03:30:21.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.547+0000 7f16ad70d700 1 -- 172.21.15.146:0/3477670499 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16a80b0ac0 msgr2=0x7f16a80ce490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:21.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.547+0000 7f16ad70d700 1 --2- 172.21.15.146:0/3477670499 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16a80b0ac0 0x7f16a80ce490 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f16a8066fa0 tx=0x7f1698009bd0 comp rx=0 tx=0).stop 2023-05-24T03:30:21.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.547+0000 7f16ad70d700 1 -- 172.21.15.146:0/3477670499 shutdown_connections 2023-05-24T03:30:21.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.547+0000 7f16ad70d700 1 --2- 172.21.15.146:0/3477670499 >> v2:172.21.15.151:3300/0 conn(0x7f16a80cca60 0x7f16a806c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:21.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.547+0000 7f16ad70d700 1 --2- 172.21.15.146:0/3477670499 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16a80b0ac0 0x7f16a80ce490 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:21.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.547+0000 7f16ad70d700 1 --2- 172.21.15.146:0/3477670499 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16a80b0e90 0x7f16a815d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:21.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.547+0000 7f16ad70d700 1 -- 172.21.15.146:0/3477670499 >> 172.21.15.146:0/3477670499 conn(0x7f16a806b0b0 msgr2=0x7f16a80cedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:21.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.547+0000 7f16ad70d700 1 -- 172.21.15.146:0/3477670499 shutdown_connections 2023-05-24T03:30:21.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.547+0000 7f16ad70d700 1 -- 172.21.15.146:0/3477670499 wait complete. 2023-05-24T03:30:21.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.548+0000 7f16ad70d700 1 Processor -- start 2023-05-24T03:30:21.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.548+0000 7f16ad70d700 1 -- start start 2023-05-24T03:30:21.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.549+0000 7f16ad70d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16a80b0ac0 0x7f16a8156bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:21.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.549+0000 7f16ad70d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16a80b0e90 0x7f16a80ae940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:21.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.549+0000 7f16ad70d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16a80cca60 0x7f16a80aee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:21.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.549+0000 7f16ad70d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a8157110 con 0x7f16a80b0e90 2023-05-24T03:30:21.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.549+0000 7f16ad70d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a81650d0 con 0x7f16a80b0ac0 2023-05-24T03:30:21.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.549+0000 7f16ad70d700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a8152950 con 0x7f16a80cca60 2023-05-24T03:30:21.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.549+0000 7f16a67fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16a80b0e90 0x7f16a80ae940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:21.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.549+0000 7f16a67fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16a80b0e90 0x7f16a80ae940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39964/0 (socket says 172.21.15.146:39964) 2023-05-24T03:30:21.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.549+0000 7f16a67fc700 1 -- 172.21.15.146:0/1756197346 learned_addr learned my addr 172.21.15.146:0/1756197346 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:21.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.549+0000 7f16a77fe700 1 --2- 172.21.15.146:0/1756197346 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16a80cca60 0x7f16a80aee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:21.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.549+0000 7f16a6ffd700 1 --2- 172.21.15.146:0/1756197346 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16a80b0ac0 0x7f16a8156bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:21.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.549+0000 7f16a67fc700 1 -- 172.21.15.146:0/1756197346 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16a80cca60 msgr2=0x7f16a80aee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:21.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.549+0000 7f16a67fc700 1 --2- 172.21.15.146:0/1756197346 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16a80cca60 0x7f16a80aee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:21.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.549+0000 7f16a67fc700 1 -- 172.21.15.146:0/1756197346 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16a80b0ac0 msgr2=0x7f16a8156bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:21.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.549+0000 7f16a67fc700 1 --2- 172.21.15.146:0/1756197346 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16a80b0ac0 0x7f16a8156bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:21.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.549+0000 7f16a67fc700 1 -- 172.21.15.146:0/1756197346 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1698009550 con 0x7f16a80b0e90 2023-05-24T03:30:21.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.549+0000 7f16a6ffd700 1 --2- 172.21.15.146:0/1756197346 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16a80b0ac0 0x7f16a8156bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:30:21.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.550+0000 7f16a67fc700 1 --2- 172.21.15.146:0/1756197346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16a80b0e90 0x7f16a80ae940 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f169c00e810 tx=0x7f169c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:21.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.550+0000 7f168f7fe700 1 -- 172.21.15.146:0/1756197346 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169c013610 con 0x7f16a80b0e90 2023-05-24T03:30:21.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.550+0000 7f168f7fe700 1 -- 172.21.15.146:0/1756197346 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169c013790 con 0x7f16a80b0e90 2023-05-24T03:30:21.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.550+0000 7f16ad70d700 1 -- 172.21.15.146:0/1756197346 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16a80cea70 con 0x7f16a80b0e90 2023-05-24T03:30:21.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.550+0000 7f168f7fe700 1 -- 172.21.15.146:0/1756197346 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169c013b40 con 0x7f16a80b0e90 2023-05-24T03:30:21.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.550+0000 7f16ad70d700 1 -- 172.21.15.146:0/1756197346 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16a80c99f0 con 0x7f16a80b0e90 2023-05-24T03:30:21.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.551+0000 7f16ad70d700 1 -- 172.21.15.146:0/1756197346 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16a80cce60 con 0x7f16a80b0e90 2023-05-24T03:30:21.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.551+0000 7f168f7fe700 1 -- 172.21.15.146:0/1756197346 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f169c013ca0 con 0x7f16a80b0e90 2023-05-24T03:30:21.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.552+0000 7f168f7fe700 1 --2- 172.21.15.146:0/1756197346 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f169406ace0 0x7f169406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:21.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.552+0000 7f168f7fe700 1 -- 172.21.15.146:0/1756197346 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f169c089380 con 0x7f16a80b0e90 2023-05-24T03:30:21.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.552+0000 7f16a6ffd700 1 --2- 172.21.15.146:0/1756197346 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f169406ace0 0x7f169406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:21.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.552+0000 7f16a6ffd700 1 --2- 172.21.15.146:0/1756197346 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f169406ace0 0x7f169406d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1698000c00 tx=0x7f1698008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:21.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.556+0000 7f168f7fe700 1 -- 172.21.15.146:0/1756197346 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f169c057bd0 con 0x7f16a80b0e90 2023-05-24T03:30:21.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.785+0000 7f16ad70d700 1 -- 172.21.15.146:0/1756197346 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f16a8165240 con 0x7f16a80b0e90 2023-05-24T03:30:21.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.785+0000 7f168f7fe700 1 -- 172.21.15.146:0/1756197346 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f169c009440 con 0x7f16a80b0e90 2023-05-24T03:30:21.789 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-05-24T03:30:21.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.787+0000 7f16ad70d700 1 -- 172.21.15.146:0/1756197346 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f169406ace0 msgr2=0x7f169406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:21.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.787+0000 7f16ad70d700 1 --2- 172.21.15.146:0/1756197346 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f169406ace0 0x7f169406d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1698000c00 tx=0x7f1698008030 comp rx=0 tx=0).stop 2023-05-24T03:30:21.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.787+0000 7f16ad70d700 1 -- 172.21.15.146:0/1756197346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16a80b0e90 msgr2=0x7f16a80ae940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:21.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.787+0000 7f16ad70d700 1 --2- 172.21.15.146:0/1756197346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16a80b0e90 0x7f16a80ae940 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f169c00e810 tx=0x7f169c00eb20 comp rx=0 tx=0).stop 2023-05-24T03:30:21.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.787+0000 7f16ad70d700 1 -- 172.21.15.146:0/1756197346 shutdown_connections 2023-05-24T03:30:21.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.787+0000 7f16ad70d700 1 --2- 172.21.15.146:0/1756197346 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f169406ace0 0x7f169406d190 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:21.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.787+0000 7f16ad70d700 1 --2- 172.21.15.146:0/1756197346 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16a80cca60 0x7f16a80aee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:21.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.788+0000 7f16ad70d700 1 --2- 172.21.15.146:0/1756197346 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16a80b0ac0 0x7f16a8156bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:21.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.788+0000 7f16ad70d700 1 --2- 172.21.15.146:0/1756197346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16a80b0e90 0x7f16a80ae940 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:21.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.788+0000 7f16ad70d700 1 -- 172.21.15.146:0/1756197346 >> 172.21.15.146:0/1756197346 conn(0x7f16a806b0b0 msgr2=0x7f16a80b0010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:21.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.788+0000 7f16ad70d700 1 -- 172.21.15.146:0/1756197346 shutdown_connections 2023-05-24T03:30:21.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:21.788+0000 7f16ad70d700 1 -- 172.21.15.146:0/1756197346 wait complete. 2023-05-24T03:30:21.803 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-24T03:30:21.803 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-24T03:30:21.804 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2023-05-24T03:30:21.804 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-05-24T03:30:21.804 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-05-24T03:30:21.804 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-24T03:30:21.804 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-24T03:30:21.805 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-24T03:30:21.805 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-05-24T03:30:21.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:21.805 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2023-05-24T03:30:21.822 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-24T03:30:21.823 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-24T03:30:21.823 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2023-05-24T03:30:21.823 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-05-24T03:30:21.823 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2023-05-24T03:30:21.823 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-05-24T03:30:21.823 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-24T03:30:21.823 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2023-05-24T03:30:21.823 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-24T03:30:21.824 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2023-05-24T03:30:21.824 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-24T03:30:21.824 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2023-05-24T03:30:21.824 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-24T03:30:21.824 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2023-05-24T03:30:21.824 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-05-24T03:30:21.825 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42260sec preferred_lft 42260sec 2023-05-24T03:30:21.825 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::1ab9:7f4d:347e:588/64 scope link noprefixroute 2023-05-24T03:30:21.825 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-05-24T03:30:21.825 INFO:teuthology.orchestra.run.smithi146.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-24T03:30:21.825 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether ba:1c:f1:07:a5:74 brd ff:ff:ff:ff:ff:ff 2023-05-24T03:30:21.825 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-05-24T03:30:21.825 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-05-24T03:30:21.825 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::60d5:77ff:fe23:704c/64 scope link 2023-05-24T03:30:21.826 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-05-24T03:30:21.826 INFO:teuthology.orchestra.run.smithi146.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-24T03:30:21.826 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether ba:1c:f1:07:a5:74 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-24T03:30:21.826 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::b81c:f1ff:fe07:a574/64 scope link tentative 2023-05-24T03:30:21.826 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-05-24T03:30:21.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:21.827 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-24T03:30:21.887 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-05-24T03:30:21.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:21.889 DEBUG:teuthology.orchestra.run.smithi146:> route 2023-05-24T03:30:21.948 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2023-05-24T03:30:21.948 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-24T03:30:21.948 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-05-24T03:30:21.948 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-05-24T03:30:21.949 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-24T03:30:21.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:21.949 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-05-24T03:30:21.949 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-05-24T03:30:21.950 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-05-24T03:30:21.950 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-05-24T03:30:21.950 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-05-24T03:30:21.950 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-05-24T03:30:22.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:22.054 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2023-05-24T03:30:22.070 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-05-24T03:30:22.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:22.071 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list-id 2023-05-24T03:30:22.127 INFO:teuthology.orchestra.run.smithi146.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-05-24T03:30:22.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:22.129 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-05-24T03:30:22.129 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-05-24T03:30:22.129 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-05-24T03:30:22.129 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-05-24T03:30:22.130 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-05-24T03:30:22.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:22.221 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-05-24T03:30:22.254 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-24T03:30:22.254 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-24T03:30:22.254 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2023-05-24T03:30:22.255 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-05-24T03:30:22.255 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2023-05-24T03:30:22.255 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-05-24T03:30:22.255 INFO:teuthology.orchestra.run.smithi146.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-24T03:30:22.255 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 32:66:97:a4:1f:e8 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-05-24T03:30:22.255 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-05-24T03:30:22.255 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-05-24T03:30:22.256 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::3066:97ff:fea4:1fe8/64 scope link tentative 2023-05-24T03:30:22.256 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-05-24T03:30:22.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:22.269 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-05-24T03:30:22.356 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-24T03:30:22.356 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-24T03:30:22.357 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2023-05-24T03:30:22.357 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-05-24T03:30:22.357 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2023-05-24T03:30:22.357 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-05-24T03:30:22.357 INFO:teuthology.orchestra.run.smithi146.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-24T03:30:22.357 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 32:66:97:a4:1f:e8 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-05-24T03:30:22.357 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-05-24T03:30:22.358 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-05-24T03:30:22.358 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::3066:97ff:fea4:1fe8/64 scope link 2023-05-24T03:30:22.358 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-05-24T03:30:22.367 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-05-24T03:30:22.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:22.368 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-05-24T03:30:22.369 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-05-24T03:30:22.369 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-05-24T03:30:22.369 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-05-24T03:30:22.369 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-05-24T03:30:22.369 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-05-24T03:30:22.370 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-05-24T03:30:22.370 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-05-24T03:30:22.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:22.562 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-05-24T03:30:22.562 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-05-24T03:30:22.563 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.1 up 2023-05-24T03:30:22.563 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set dev brx.1 master ceph-brx 2023-05-24T03:30:22.563 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-05-24T03:30:22.687 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-24T03:30:22.688 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-05-24T03:30:22.709 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-05-24T03:30:22.709 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-24T03:30:22.710 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-05-24T03:30:22.765 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-05-24T03:30:22.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:22.766 DEBUG:teuthology.orchestra.run.smithi146:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-05-24T03:30:22.851 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-05-24T03:30:22.851 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-05-24T03:30:22.879 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-05-24T03:30:22.880 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-05-24T03:30:22.880 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.151:3300,172.21.15.151:3301" 2023-05-24T03:30:22.880 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: trying mount with new device syntax: 2@11ca0adb-7672-4713-bde7-451e8b743ae9.cephfs=/ 2023-05-24T03:30:22.880 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.146:3300/172.21.15.151:3300/172.21.15.151:3301" will pass to kernel 2023-05-24T03:30:22.880 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: v2 mount support check returned 2 2023-05-24T03:30:22.880 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: kernel does not support v2 syntax 2023-05-24T03:30:22.880 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: switching to using v1 address with old syntax 2023-05-24T03:30:22.910 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-05-24T03:30:22.911 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-05-24T03:30:22.911 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.151:3300,172.21.15.151:3301" 2023-05-24T03:30:22.911 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: trying mount with new device syntax: 2@11ca0adb-7672-4713-bde7-451e8b743ae9.cephfs=/ 2023-05-24T03:30:22.911 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.146:3300/172.21.15.151:3300/172.21.15.151:3301" will pass to kernel 2023-05-24T03:30:22.911 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: v2 mount support check returned 2 2023-05-24T03:30:22.911 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: kernel does not support v2 syntax 2023-05-24T03:30:22.912 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: switching to using v1 address with old syntax 2023-05-24T03:30:22.912 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:6789,172.21.15.151:6789,172.21.15.151:6790" 2023-05-24T03:30:22.912 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.146:6789,172.21.15.151:6789,172.21.15.151:6790:/ 2023-05-24T03:30:22.912 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,key=2,mds_namespace=cephfs,fsid=11ca0adb-7672-4713-bde7-451e8b743ae9" will pass to kernel 2023-05-24T03:30:22.914 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-05-24T03:30:22.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:22.915 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-05-24T03:30:22.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:22.948 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-05-24T03:30:23.020 INFO:teuthology.orchestra.run.smithi146.stdout:client4917 2023-05-24T03:30:23.021 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-05-24T03:30:23.021 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-24T03:30:23.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:23.079 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-05-24T03:30:23.150 INFO:teuthology.orchestra.run.smithi146.stdout:client4917 2023-05-24T03:30:23.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:23.151 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-05-24T03:30:23.223 INFO:teuthology.orchestra.run.smithi146.stdout:client4917 2023-05-24T03:30:23.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:23.224 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/11ca0adb-7672-4713-bde7-451e8b743ae9.client4917/status') 2023-05-24T03:30:23.303 INFO:teuthology.orchestra.run.smithi146.stdout:instance: client.4917 (3)192.168.0.2:0/2128370162 2023-05-24T03:30:23.304 INFO:teuthology.orchestra.run.smithi146.stdout:blocklisted: false 2023-05-24T03:30:23.304 INFO:teuthology.orchestra.run.smithi146.stderr:0+1 records in 2023-05-24T03:30:23.305 INFO:teuthology.orchestra.run.smithi146.stderr:0+1 records out 2023-05-24T03:30:23.305 INFO:teuthology.orchestra.run.smithi146.stderr:69 bytes copied, 5.2849e-05 s, 1.3 MB/s 2023-05-24T03:30:23.305 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-05-24T03:30:23.305 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-05-24T03:30:23.306 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-05-24T03:30:23.306 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-24T03:30:23.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.461+0000 7f1de53e5700 1 Processor -- start 2023-05-24T03:30:23.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.461+0000 7f1de53e5700 1 -- start start 2023-05-24T03:30:23.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.462+0000 7f1de53e5700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1de006bb40 0x7f1de00cfe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:23.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.462+0000 7f1de53e5700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1de00d03a0 0x7f1de00b4c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:23.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.462+0000 7f1de53e5700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1de00cf9d0 con 0x7f1de00b8a50 2023-05-24T03:30:23.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.462+0000 7f1de53e5700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1de00cd790 con 0x7f1de006bb40 2023-05-24T03:30:23.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.462+0000 7f1de53e5700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de00cf400 con 0x7f1de00d03a0 2023-05-24T03:30:23.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.462+0000 7f1dde7fc700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1de006bb40 0x7f1de00cfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:23.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.462+0000 7f1ddf7fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1de00d03a0 0x7f1de00b4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:23.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.463+0000 7f1dde7fc700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1de006bb40 0x7f1de00cfe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:51156/0 (socket says 172.21.15.146:51156) 2023-05-24T03:30:23.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.463+0000 7f1ddf7fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1de00d03a0 0x7f1de00b4c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:52840/0 (socket says 172.21.15.146:52840) 2023-05-24T03:30:23.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.463+0000 7f1dde7fc700 1 -- 172.21.15.146:0/2851927936 learned_addr learned my addr 172.21.15.146:0/2851927936 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:23.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.463+0000 7f1ddeffd700 1 --1- 172.21.15.146:0/2851927936 >> v1:172.21.15.151:6789/0 conn(0x7f1de00b8a50 0x7f1de015daf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:45464/0 (socket says 172.21.15.146:45464) 2023-05-24T03:30:23.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.463+0000 7f1ddf7fe700 1 -- 172.21.15.146:0/2851927936 >> v2:172.21.15.151:3300/0 conn(0x7f1de006bb40 msgr2=0x7f1de00cfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:23.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.463+0000 7f1ddf7fe700 1 --2- 172.21.15.146:0/2851927936 >> v2:172.21.15.151:3300/0 conn(0x7f1de006bb40 0x7f1de00cfe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:23.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.463+0000 7f1ddf7fe700 1 -- 172.21.15.146:0/2851927936 >> v1:172.21.15.151:6789/0 conn(0x7f1de00b8a50 legacy=0x7f1de015daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:23.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.463+0000 7f1ddf7fe700 1 -- 172.21.15.146:0/2851927936 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de00cf6a0 con 0x7f1de00d03a0 2023-05-24T03:30:23.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.463+0000 7f1dde7fc700 1 --2- 172.21.15.146:0/2851927936 >> v2:172.21.15.151:3300/0 conn(0x7f1de006bb40 0x7f1de00cfe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T03:30:23.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.463+0000 7f1ddf7fe700 1 --2- 172.21.15.146:0/2851927936 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1de00d03a0 0x7f1de00b4c50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1dd8009d90 tx=0x7f1dd800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b316b04f60ca6a5f server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:23.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.463+0000 7f1dddffb700 1 -- 172.21.15.146:0/2851927936 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd800e070 con 0x7f1de00d03a0 2023-05-24T03:30:23.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.463+0000 7f1dddffb700 1 -- 172.21.15.146:0/2851927936 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd800bb20 con 0x7f1de00d03a0 2023-05-24T03:30:23.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.463+0000 7f1dddffb700 1 -- 172.21.15.146:0/2851927936 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd8012430 con 0x7f1de00d03a0 2023-05-24T03:30:23.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.464+0000 7f1de53e5700 1 -- 172.21.15.146:0/2851927936 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1de00d03a0 msgr2=0x7f1de00b4c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:23.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.464+0000 7f1de53e5700 1 --2- 172.21.15.146:0/2851927936 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1de00d03a0 0x7f1de00b4c50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1dd8009d90 tx=0x7f1dd800b330 comp rx=0 tx=0).stop 2023-05-24T03:30:23.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.464+0000 7f1de53e5700 1 -- 172.21.15.146:0/2851927936 shutdown_connections 2023-05-24T03:30:23.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.464+0000 7f1de53e5700 1 --2- 172.21.15.146:0/2851927936 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1de00d03a0 0x7f1de00b4c50 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:23.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.464+0000 7f1de53e5700 1 --2- 172.21.15.146:0/2851927936 >> v2:172.21.15.151:3300/0 conn(0x7f1de006bb40 0x7f1de00cfe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:23.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.464+0000 7f1de53e5700 1 -- 172.21.15.146:0/2851927936 >> 172.21.15.146:0/2851927936 conn(0x7f1de006af30 msgr2=0x7f1de006b330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:23.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.464+0000 7f1de53e5700 1 -- 172.21.15.146:0/2851927936 shutdown_connections 2023-05-24T03:30:23.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.464+0000 7f1de53e5700 1 -- 172.21.15.146:0/2851927936 wait complete. 2023-05-24T03:30:23.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.465+0000 7f1de53e5700 1 Processor -- start 2023-05-24T03:30:23.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.466+0000 7f1de53e5700 1 -- start start 2023-05-24T03:30:23.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.466+0000 7f1de53e5700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1de006bb40 0x7f1de00ca210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:23.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.466+0000 7f1de53e5700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1de00b8a50 0x7f1de015e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:23.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.466+0000 7f1de53e5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1de00d03a0 0x7f1de0154660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:23.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.466+0000 7f1de53e5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de00caa10 con 0x7f1de00d03a0 2023-05-24T03:30:23.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.466+0000 7f1de53e5700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de0155670 con 0x7f1de00b8a50 2023-05-24T03:30:23.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.466+0000 7f1de53e5700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de0155950 con 0x7f1de006bb40 2023-05-24T03:30:23.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.467+0000 7f1ddf7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1de00d03a0 0x7f1de0154660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:23.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.467+0000 7f1ddf7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1de00d03a0 0x7f1de0154660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39984/0 (socket says 172.21.15.146:39984) 2023-05-24T03:30:23.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.467+0000 7f1ddf7fe700 1 -- 172.21.15.146:0/3584276584 learned_addr learned my addr 172.21.15.146:0/3584276584 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:23.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.467+0000 7f1dde7fc700 1 --2- 172.21.15.146:0/3584276584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1de00b8a50 0x7f1de015e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:23.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.467+0000 7f1ddeffd700 1 --2- 172.21.15.146:0/3584276584 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1de006bb40 0x7f1de00ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:23.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.467+0000 7f1ddf7fe700 1 -- 172.21.15.146:0/3584276584 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1de006bb40 msgr2=0x7f1de00ca210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:23.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.467+0000 7f1ddf7fe700 1 --2- 172.21.15.146:0/3584276584 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1de006bb40 0x7f1de00ca210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:23.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.467+0000 7f1ddf7fe700 1 -- 172.21.15.146:0/3584276584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1de00b8a50 msgr2=0x7f1de015e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:23.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.467+0000 7f1ddf7fe700 1 --2- 172.21.15.146:0/3584276584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1de00b8a50 0x7f1de015e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:23.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.467+0000 7f1ddf7fe700 1 -- 172.21.15.146:0/3584276584 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd0009550 con 0x7f1de00d03a0 2023-05-24T03:30:23.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.467+0000 7f1ddf7fe700 1 --2- 172.21.15.146:0/3584276584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1de00d03a0 0x7f1de0154660 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1dd8014040 tx=0x7f1dd8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:23.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.467+0000 7f1dc77fe700 1 -- 172.21.15.146:0/3584276584 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd8012430 con 0x7f1de00d03a0 2023-05-24T03:30:23.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.467+0000 7f1dc77fe700 1 -- 172.21.15.146:0/3584276584 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd8020070 con 0x7f1de00d03a0 2023-05-24T03:30:23.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.467+0000 7f1de53e5700 1 -- 172.21.15.146:0/3584276584 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dd8009a70 con 0x7f1de00d03a0 2023-05-24T03:30:23.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.467+0000 7f1dc77fe700 1 -- 172.21.15.146:0/3584276584 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd8003ea0 con 0x7f1de00d03a0 2023-05-24T03:30:23.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.467+0000 7f1de53e5700 1 -- 172.21.15.146:0/3584276584 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1de00cd9a0 con 0x7f1de00d03a0 2023-05-24T03:30:23.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.468+0000 7f1de53e5700 1 -- 172.21.15.146:0/3584276584 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1de00cdf60 con 0x7f1de00d03a0 2023-05-24T03:30:23.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.469+0000 7f1dc77fe700 1 -- 172.21.15.146:0/3584276584 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1dd8004040 con 0x7f1de00d03a0 2023-05-24T03:30:23.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.469+0000 7f1dc77fe700 1 --2- 172.21.15.146:0/3584276584 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f1dcc06ace0 0x7f1dcc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:23.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.469+0000 7f1dc77fe700 1 -- 172.21.15.146:0/3584276584 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1dd8022070 con 0x7f1de00d03a0 2023-05-24T03:30:23.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.469+0000 7f1ddeffd700 1 --2- 172.21.15.146:0/3584276584 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f1dcc06ace0 0x7f1dcc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:23.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.470+0000 7f1ddeffd700 1 --2- 172.21.15.146:0/3584276584 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f1dcc06ace0 0x7f1dcc06d190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1dd4000f60 tx=0x7f1dd4007ed0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:23.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.473+0000 7f1dc77fe700 1 -- 172.21.15.146:0/3584276584 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f1dd80565b0 con 0x7f1de00d03a0 2023-05-24T03:30:23.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.704+0000 7f1de53e5700 1 -- 172.21.15.146:0/3584276584 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1de0072ae0 con 0x7f1de00d03a0 2023-05-24T03:30:23.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.704+0000 7f1dc77fe700 1 -- 172.21.15.146:0/3584276584 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f1dd8059bd0 con 0x7f1de00d03a0 2023-05-24T03:30:23.708 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-05-24T03:30:23.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.706+0000 7f1de53e5700 1 -- 172.21.15.146:0/3584276584 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f1dcc06ace0 msgr2=0x7f1dcc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:23.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.706+0000 7f1de53e5700 1 --2- 172.21.15.146:0/3584276584 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f1dcc06ace0 0x7f1dcc06d190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1dd4000f60 tx=0x7f1dd4007ed0 comp rx=0 tx=0).stop 2023-05-24T03:30:23.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.706+0000 7f1de53e5700 1 -- 172.21.15.146:0/3584276584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1de00d03a0 msgr2=0x7f1de0154660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:23.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.706+0000 7f1de53e5700 1 --2- 172.21.15.146:0/3584276584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1de00d03a0 0x7f1de0154660 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1dd8014040 tx=0x7f1dd8004ad0 comp rx=0 tx=0).stop 2023-05-24T03:30:23.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.706+0000 7f1de53e5700 1 -- 172.21.15.146:0/3584276584 shutdown_connections 2023-05-24T03:30:23.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.706+0000 7f1de53e5700 1 --2- 172.21.15.146:0/3584276584 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f1dcc06ace0 0x7f1dcc06d190 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:23.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.706+0000 7f1de53e5700 1 --2- 172.21.15.146:0/3584276584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1de00d03a0 0x7f1de0154660 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:23.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.706+0000 7f1de53e5700 1 --2- 172.21.15.146:0/3584276584 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1de006bb40 0x7f1de00ca210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:23.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.706+0000 7f1de53e5700 1 --2- 172.21.15.146:0/3584276584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1de00b8a50 0x7f1de015e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:23.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.706+0000 7f1de53e5700 1 -- 172.21.15.146:0/3584276584 >> 172.21.15.146:0/3584276584 conn(0x7f1de006af30 msgr2=0x7f1de00d24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:23.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.706+0000 7f1de53e5700 1 -- 172.21.15.146:0/3584276584 shutdown_connections 2023-05-24T03:30:23.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:23.706+0000 7f1de53e5700 1 -- 172.21.15.146:0/3584276584 wait complete. 2023-05-24T03:30:23.722 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-24T03:30:23.722 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-24T03:30:23.722 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi151.front.sepia.ceph.com 2023-05-24T03:30:23.723 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-05-24T03:30:23.723 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-05-24T03:30:23.723 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-24T03:30:23.724 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-24T03:30:23.724 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-24T03:30:23.724 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-05-24T03:30:23.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:23.726 DEBUG:teuthology.orchestra.run.smithi151:> ip addr 2023-05-24T03:30:23.747 INFO:teuthology.orchestra.run.smithi151.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-24T03:30:23.747 INFO:teuthology.orchestra.run.smithi151.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-24T03:30:23.748 INFO:teuthology.orchestra.run.smithi151.stdout: inet 127.0.0.1/8 scope host lo 2023-05-24T03:30:23.748 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-05-24T03:30:23.748 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 ::1/128 scope host 2023-05-24T03:30:23.748 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-05-24T03:30:23.748 INFO:teuthology.orchestra.run.smithi151.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-24T03:30:23.748 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0c brd ff:ff:ff:ff:ff:ff 2023-05-24T03:30:23.748 INFO:teuthology.orchestra.run.smithi151.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-24T03:30:23.749 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0d brd ff:ff:ff:ff:ff:ff 2023-05-24T03:30:23.749 INFO:teuthology.orchestra.run.smithi151.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-24T03:30:23.749 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:62 brd ff:ff:ff:ff:ff:ff 2023-05-24T03:30:23.749 INFO:teuthology.orchestra.run.smithi151.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-24T03:30:23.749 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:63 brd ff:ff:ff:ff:ff:ff 2023-05-24T03:30:23.749 INFO:teuthology.orchestra.run.smithi151.stdout: inet 172.21.15.151/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-05-24T03:30:23.749 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft 42277sec preferred_lft 42277sec 2023-05-24T03:30:23.750 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::e4e9:2081:e0fe:ca30/64 scope link noprefixroute 2023-05-24T03:30:23.750 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-05-24T03:30:23.750 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-05-24T03:30:23.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:23.750 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-05-24T03:30:23.751 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-05-24T03:30:23.751 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link add name ceph-brx type bridge 2023-05-24T03:30:23.751 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip addr flush dev ceph-brx 2023-05-24T03:30:23.751 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set ceph-brx up 2023-05-24T03:30:23.752 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-05-24T03:30:23.753 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-05-24T03:30:23.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:23.929 DEBUG:teuthology.orchestra.run.smithi151:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-24T03:30:23.957 INFO:teuthology.orchestra.run.smithi151.stdout:1 2023-05-24T03:30:23.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:23.958 DEBUG:teuthology.orchestra.run.smithi151:> route 2023-05-24T03:30:24.046 INFO:teuthology.orchestra.run.smithi151.stdout:Kernel IP routing table 2023-05-24T03:30:24.046 INFO:teuthology.orchestra.run.smithi151.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-24T03:30:24.047 INFO:teuthology.orchestra.run.smithi151.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-05-24T03:30:24.047 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-05-24T03:30:24.047 INFO:teuthology.orchestra.run.smithi151.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-24T03:30:24.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:24.048 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-05-24T03:30:24.048 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-05-24T03:30:24.048 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-05-24T03:30:24.048 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-05-24T03:30:24.049 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-05-24T03:30:24.049 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-05-24T03:30:24.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:24.242 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2023-05-24T03:30:24.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:24.260 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list-id 2023-05-24T03:30:24.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:24.317 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-05-24T03:30:24.318 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-05-24T03:30:24.318 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-05-24T03:30:24.318 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-05-24T03:30:24.318 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-05-24T03:30:24.412 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-05-24T03:30:24.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:24.413 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-05-24T03:30:24.413 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-05-24T03:30:24.413 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-05-24T03:30:24.413 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-05-24T03:30:24.413 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-05-24T03:30:24.414 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-05-24T03:30:24.414 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-05-24T03:30:24.414 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-05-24T03:30:24.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:24.614 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-05-24T03:30:24.615 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-05-24T03:30:24.615 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set brx.0 up 2023-05-24T03:30:24.615 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set dev brx.0 master ceph-brx 2023-05-24T03:30:24.615 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-05-24T03:30:24.718 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-24T03:30:24.719 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-05-24T03:30:24.738 INFO:teuthology.orchestra.run.smithi151.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-05-24T03:30:24.738 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-24T03:30:24.738 DEBUG:teuthology.orchestra.run.smithi151:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-05-24T03:30:24.794 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-05-24T03:30:24.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:24.795 DEBUG:teuthology.orchestra.run.smithi151:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-05-24T03:30:24.886 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-05-24T03:30:24.886 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-05-24T03:30:24.996 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-05-24T03:30:24.997 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-05-24T03:30:24.997 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.151:3300,172.21.15.151:3301" 2023-05-24T03:30:24.997 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: trying mount with new device syntax: 1@11ca0adb-7672-4713-bde7-451e8b743ae9.cephfs=/ 2023-05-24T03:30:24.997 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.146:3300/172.21.15.151:3300/172.21.15.151:3301" will pass to kernel 2023-05-24T03:30:24.997 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: v2 mount support check returned 2 2023-05-24T03:30:24.997 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: kernel does not support v2 syntax 2023-05-24T03:30:24.998 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: switching to using v1 address with old syntax 2023-05-24T03:30:25.026 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-05-24T03:30:25.027 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-05-24T03:30:25.027 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.151:3300,172.21.15.151:3301" 2023-05-24T03:30:25.027 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: trying mount with new device syntax: 1@11ca0adb-7672-4713-bde7-451e8b743ae9.cephfs=/ 2023-05-24T03:30:25.027 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.146:3300/172.21.15.151:3300/172.21.15.151:3301" will pass to kernel 2023-05-24T03:30:25.027 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: v2 mount support check returned 2 2023-05-24T03:30:25.027 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: kernel does not support v2 syntax 2023-05-24T03:30:25.028 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: switching to using v1 address with old syntax 2023-05-24T03:30:25.028 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: resolved to: "172.21.15.146:6789,172.21.15.151:6789,172.21.15.151:6790" 2023-05-24T03:30:25.028 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.146:6789,172.21.15.151:6789,172.21.15.151:6790:/ 2023-05-24T03:30:25.028 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=11ca0adb-7672-4713-bde7-451e8b743ae9" will pass to kernel 2023-05-24T03:30:25.029 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-05-24T03:30:25.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:25.029 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-05-24T03:30:25.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:25.064 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-05-24T03:30:25.135 INFO:teuthology.orchestra.run.smithi151.stdout:client4783 2023-05-24T03:30:25.136 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-24T03:30:25.136 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-24T03:30:25.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:25.193 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-05-24T03:30:25.263 INFO:teuthology.orchestra.run.smithi151.stdout:client4783 2023-05-24T03:30:25.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:25.264 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-05-24T03:30:25.335 INFO:teuthology.orchestra.run.smithi151.stdout:client4783 2023-05-24T03:30:25.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:25.335 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/11ca0adb-7672-4713-bde7-451e8b743ae9.client4783/status') 2023-05-24T03:30:25.415 INFO:teuthology.orchestra.run.smithi151.stdout:instance: client.4783 (3)192.168.0.1:0/3464424172 2023-05-24T03:30:25.415 INFO:teuthology.orchestra.run.smithi151.stdout:blocklisted: false 2023-05-24T03:30:25.416 INFO:teuthology.orchestra.run.smithi151.stderr:0+1 records in 2023-05-24T03:30:25.416 INFO:teuthology.orchestra.run.smithi151.stderr:0+1 records out 2023-05-24T03:30:25.416 INFO:teuthology.orchestra.run.smithi151.stderr:69 bytes copied, 2.1181e-05 s, 3.3 MB/s 2023-05-24T03:30:25.417 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-05-24T03:30:25.417 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-05-24T03:30:25.417 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-05-24T03:30:25.417 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-24T03:30:25.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.549+0000 7fac9c29f700 1 Processor -- start 2023-05-24T03:30:25.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.549+0000 7fac9c29f700 1 -- start start 2023-05-24T03:30:25.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.550+0000 7fac9c29f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac9415ff20 0x7fac9406dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:25.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.550+0000 7fac9c29f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fac940cab70 0x7fac94071820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:25.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.550+0000 7fac9c29f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac940b20b0 con 0x7fac9406e110 2023-05-24T03:30:25.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.550+0000 7fac9c29f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac941602f0 con 0x7fac940cab70 2023-05-24T03:30:25.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.550+0000 7fac9c29f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac940cd090 con 0x7fac9415ff20 2023-05-24T03:30:25.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.550+0000 7fac9a83c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fac940cab70 0x7fac94071820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:25.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.550+0000 7fac9a83c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fac940cab70 0x7fac94071820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39998/0 (socket says 172.21.15.146:39998) 2023-05-24T03:30:25.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.550+0000 7fac9983a700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fac9406e110 0x7fac940ca460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46446/0 (socket says 172.21.15.146:46446) 2023-05-24T03:30:25.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.550+0000 7fac9a83c700 1 -- 172.21.15.146:0/871381894 learned_addr learned my addr 172.21.15.146:0/871381894 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:25.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.550+0000 7fac9a03b700 1 --2- 172.21.15.146:0/871381894 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac9415ff20 0x7fac9406dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:25.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.550+0000 7fac9a83c700 1 -- 172.21.15.146:0/871381894 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac9415ff20 msgr2=0x7fac9406dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:30:25.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.550+0000 7fac9a83c700 1 --2- 172.21.15.146:0/871381894 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac9415ff20 0x7fac9406dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:25.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.550+0000 7fac9a83c700 1 -- 172.21.15.146:0/871381894 >> v1:172.21.15.146:6789/0 conn(0x7fac9406e110 legacy=0x7fac940ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:25.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.550+0000 7fac9a83c700 1 -- 172.21.15.146:0/871381894 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac940cd370 con 0x7fac940cab70 2023-05-24T03:30:25.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.550+0000 7fac99039700 1 -- 172.21.15.146:0/871381894 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2676388247 0 0) 0x7fac940b20b0 con 0x7fac9406e110 2023-05-24T03:30:25.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.551+0000 7fac9a83c700 1 --2- 172.21.15.146:0/871381894 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac940cab70 0x7fac94071820 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fac8c009e50 tx=0x7fac8c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce4f2c7626a930c server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:25.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.551+0000 7fac99039700 1 -- 172.21.15.146:0/871381894 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac8c00e070 con 0x7fac940cab70 2023-05-24T03:30:25.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.551+0000 7fac99039700 1 -- 172.21.15.146:0/871381894 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac8c00b910 con 0x7fac940cab70 2023-05-24T03:30:25.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.551+0000 7fac99039700 1 -- 172.21.15.146:0/871381894 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac8c00bcc0 con 0x7fac940cab70 2023-05-24T03:30:25.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.551+0000 7fac9c29f700 1 -- 172.21.15.146:0/871381894 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac940cab70 msgr2=0x7fac94071820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:25.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.551+0000 7fac9c29f700 1 --2- 172.21.15.146:0/871381894 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac940cab70 0x7fac94071820 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fac8c009e50 tx=0x7fac8c00b330 comp rx=0 tx=0).stop 2023-05-24T03:30:25.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.551+0000 7fac9c29f700 1 -- 172.21.15.146:0/871381894 shutdown_connections 2023-05-24T03:30:25.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.551+0000 7fac9c29f700 1 --2- 172.21.15.146:0/871381894 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac940cab70 0x7fac94071820 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:25.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.551+0000 7fac9c29f700 1 --2- 172.21.15.146:0/871381894 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac9415ff20 0x7fac9406dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:25.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.551+0000 7fac9c29f700 1 -- 172.21.15.146:0/871381894 >> 172.21.15.146:0/871381894 conn(0x7fac9406ebf0 msgr2=0x7fac9406eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:25.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.551+0000 7fac9c29f700 1 -- 172.21.15.146:0/871381894 shutdown_connections 2023-05-24T03:30:25.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.551+0000 7fac9c29f700 1 -- 172.21.15.146:0/871381894 wait complete. 2023-05-24T03:30:25.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.553+0000 7fac9c29f700 1 Processor -- start 2023-05-24T03:30:25.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.553+0000 7fac9c29f700 1 -- start start 2023-05-24T03:30:25.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.553+0000 7fac9c29f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac9406e110 0x7fac940c8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:25.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.553+0000 7fac9c29f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac940cab70 0x7fac940ace50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:25.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.553+0000 7fac9c29f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac9415ff20 0x7fac940c9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:25.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.553+0000 7fac9c29f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac940ad390 con 0x7fac9406e110 2023-05-24T03:30:25.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.553+0000 7fac9c29f700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac940c8970 con 0x7fac940cab70 2023-05-24T03:30:25.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.553+0000 7fac9c29f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac940c8c50 con 0x7fac9415ff20 2023-05-24T03:30:25.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.553+0000 7fac9a03b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac9406e110 0x7fac940c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:25.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.553+0000 7fac9a03b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac9406e110 0x7fac940c8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40000/0 (socket says 172.21.15.146:40000) 2023-05-24T03:30:25.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.553+0000 7fac9a03b700 1 -- 172.21.15.146:0/2656773049 learned_addr learned my addr 172.21.15.146:0/2656773049 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:30:25.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.554+0000 7fac9a83c700 1 --2- 172.21.15.146:0/2656773049 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac9415ff20 0x7fac940c9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:25.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.554+0000 7fac9983a700 1 --2- 172.21.15.146:0/2656773049 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac940cab70 0x7fac940ace50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:25.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.554+0000 7fac9a03b700 1 -- 172.21.15.146:0/2656773049 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac9415ff20 msgr2=0x7fac940c9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:25.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.554+0000 7fac9a03b700 1 --2- 172.21.15.146:0/2656773049 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac9415ff20 0x7fac940c9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:25.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.554+0000 7fac9a03b700 1 -- 172.21.15.146:0/2656773049 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac940cab70 msgr2=0x7fac940ace50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:25.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.554+0000 7fac9a03b700 1 --2- 172.21.15.146:0/2656773049 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac940cab70 0x7fac940ace50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:25.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.554+0000 7fac9a03b700 1 -- 172.21.15.146:0/2656773049 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac8c009b30 con 0x7fac9406e110 2023-05-24T03:30:25.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.554+0000 7fac9a03b700 1 --2- 172.21.15.146:0/2656773049 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac9406e110 0x7fac940c8270 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fac8400e870 tx=0x7fac8400eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:25.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.554+0000 7fac8affd700 1 -- 172.21.15.146:0/2656773049 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac84009590 con 0x7fac9406e110 2023-05-24T03:30:25.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.554+0000 7fac8affd700 1 -- 172.21.15.146:0/2656773049 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac84013680 con 0x7fac9406e110 2023-05-24T03:30:25.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.554+0000 7fac9c29f700 1 -- 172.21.15.146:0/2656773049 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac9406d3d0 con 0x7fac9406e110 2023-05-24T03:30:25.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.554+0000 7fac8affd700 1 -- 172.21.15.146:0/2656773049 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac840139f0 con 0x7fac9406e110 2023-05-24T03:30:25.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.554+0000 7fac9c29f700 1 -- 172.21.15.146:0/2656773049 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac9406d0f0 con 0x7fac9406e110 2023-05-24T03:30:25.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.555+0000 7fac9c29f700 1 -- 172.21.15.146:0/2656773049 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac9406d6b0 con 0x7fac9406e110 2023-05-24T03:30:25.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.555+0000 7fac8affd700 1 -- 172.21.15.146:0/2656773049 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fac84013b50 con 0x7fac9406e110 2023-05-24T03:30:25.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.556+0000 7fac8affd700 1 --2- 172.21.15.146:0/2656773049 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fac7806ace0 0x7fac7806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:30:25.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.556+0000 7fac8affd700 1 -- 172.21.15.146:0/2656773049 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fac84089950 con 0x7fac9406e110 2023-05-24T03:30:25.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.556+0000 7fac9983a700 1 --2- 172.21.15.146:0/2656773049 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fac7806ace0 0x7fac7806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:30:25.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.556+0000 7fac9983a700 1 --2- 172.21.15.146:0/2656773049 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fac7806ace0 0x7fac7806d190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fac94153b60 tx=0x7fac90007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:30:25.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.560+0000 7fac8affd700 1 -- 172.21.15.146:0/2656773049 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fac840581f0 con 0x7fac9406e110 2023-05-24T03:30:25.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.792+0000 7fac9c29f700 1 -- 172.21.15.146:0/2656773049 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fac9404e810 con 0x7fac9406e110 2023-05-24T03:30:25.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.793+0000 7fac8affd700 1 -- 172.21.15.146:0/2656773049 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fac84057d80 con 0x7fac9406e110 2023-05-24T03:30:25.797 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-05-24T03:30:25.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.795+0000 7fac9c29f700 1 -- 172.21.15.146:0/2656773049 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fac7806ace0 msgr2=0x7fac7806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:25.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.795+0000 7fac9c29f700 1 --2- 172.21.15.146:0/2656773049 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fac7806ace0 0x7fac7806d190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fac94153b60 tx=0x7fac90007de0 comp rx=0 tx=0).stop 2023-05-24T03:30:25.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.795+0000 7fac9c29f700 1 -- 172.21.15.146:0/2656773049 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac9406e110 msgr2=0x7fac940c8270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:30:25.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.795+0000 7fac9c29f700 1 --2- 172.21.15.146:0/2656773049 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac9406e110 0x7fac940c8270 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fac8400e870 tx=0x7fac8400eb80 comp rx=0 tx=0).stop 2023-05-24T03:30:25.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.795+0000 7fac9c29f700 1 -- 172.21.15.146:0/2656773049 shutdown_connections 2023-05-24T03:30:25.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.795+0000 7fac9c29f700 1 --2- 172.21.15.146:0/2656773049 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fac7806ace0 0x7fac7806d190 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:25.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.795+0000 7fac9c29f700 1 --2- 172.21.15.146:0/2656773049 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac9415ff20 0x7fac940c9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:25.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.795+0000 7fac9c29f700 1 --2- 172.21.15.146:0/2656773049 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac9406e110 0x7fac940c8270 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:25.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.795+0000 7fac9c29f700 1 --2- 172.21.15.146:0/2656773049 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac940cab70 0x7fac940ace50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:30:25.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.795+0000 7fac9c29f700 1 -- 172.21.15.146:0/2656773049 >> 172.21.15.146:0/2656773049 conn(0x7fac9406ebf0 msgr2=0x7fac940d0840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:30:25.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.795+0000 7fac9c29f700 1 -- 172.21.15.146:0/2656773049 shutdown_connections 2023-05-24T03:30:25.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:30:25.795+0000 7fac9c29f700 1 -- 172.21.15.146:0/2656773049 wait complete. 2023-05-24T03:30:25.811 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-24T03:30:25.811 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-24T03:30:25.811 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi151.front.sepia.ceph.com 2023-05-24T03:30:25.811 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-05-24T03:30:25.812 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-05-24T03:30:25.812 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-24T03:30:25.812 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-24T03:30:25.812 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-24T03:30:25.813 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-05-24T03:30:25.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:25.813 DEBUG:teuthology.orchestra.run.smithi151:> ip addr 2023-05-24T03:30:25.830 INFO:teuthology.orchestra.run.smithi151.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-24T03:30:25.830 INFO:teuthology.orchestra.run.smithi151.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-24T03:30:25.831 INFO:teuthology.orchestra.run.smithi151.stdout: inet 127.0.0.1/8 scope host lo 2023-05-24T03:30:25.831 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-05-24T03:30:25.831 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 ::1/128 scope host 2023-05-24T03:30:25.831 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-05-24T03:30:25.831 INFO:teuthology.orchestra.run.smithi151.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-24T03:30:25.831 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0c brd ff:ff:ff:ff:ff:ff 2023-05-24T03:30:25.832 INFO:teuthology.orchestra.run.smithi151.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-24T03:30:25.832 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0d brd ff:ff:ff:ff:ff:ff 2023-05-24T03:30:25.832 INFO:teuthology.orchestra.run.smithi151.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-24T03:30:25.832 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:62 brd ff:ff:ff:ff:ff:ff 2023-05-24T03:30:25.832 INFO:teuthology.orchestra.run.smithi151.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-24T03:30:25.832 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:63 brd ff:ff:ff:ff:ff:ff 2023-05-24T03:30:25.832 INFO:teuthology.orchestra.run.smithi151.stdout: inet 172.21.15.151/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-05-24T03:30:25.833 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft 42274sec preferred_lft 42274sec 2023-05-24T03:30:25.833 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::e4e9:2081:e0fe:ca30/64 scope link noprefixroute 2023-05-24T03:30:25.833 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-05-24T03:30:25.833 INFO:teuthology.orchestra.run.smithi151.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-24T03:30:25.833 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether ba:c7:57:2c:a2:f2 brd ff:ff:ff:ff:ff:ff 2023-05-24T03:30:25.833 INFO:teuthology.orchestra.run.smithi151.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-05-24T03:30:25.834 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-05-24T03:30:25.834 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::6843:9ff:fe39:7238/64 scope link 2023-05-24T03:30:25.834 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-05-24T03:30:25.834 INFO:teuthology.orchestra.run.smithi151.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-24T03:30:25.834 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether ba:c7:57:2c:a2:f2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-05-24T03:30:25.834 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::b8c7:57ff:fe2c:a2f2/64 scope link tentative 2023-05-24T03:30:25.834 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-05-24T03:30:25.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:25.835 DEBUG:teuthology.orchestra.run.smithi151:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-24T03:30:25.896 INFO:teuthology.orchestra.run.smithi151.stdout:1 2023-05-24T03:30:25.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:25.899 DEBUG:teuthology.orchestra.run.smithi151:> route 2023-05-24T03:30:25.960 INFO:teuthology.orchestra.run.smithi151.stdout:Kernel IP routing table 2023-05-24T03:30:25.960 INFO:teuthology.orchestra.run.smithi151.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-24T03:30:25.960 INFO:teuthology.orchestra.run.smithi151.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-05-24T03:30:25.961 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-05-24T03:30:25.961 INFO:teuthology.orchestra.run.smithi151.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-24T03:30:25.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:25.961 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-05-24T03:30:25.962 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-05-24T03:30:25.962 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-05-24T03:30:25.962 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-05-24T03:30:25.962 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-05-24T03:30:25.962 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-05-24T03:30:26.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:26.066 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2023-05-24T03:30:26.082 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-05-24T03:30:26.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:26.084 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list-id 2023-05-24T03:30:26.139 INFO:teuthology.orchestra.run.smithi151.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-05-24T03:30:26.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:26.140 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-05-24T03:30:26.140 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-05-24T03:30:26.140 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-05-24T03:30:26.141 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-05-24T03:30:26.141 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-05-24T03:30:26.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:26.232 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-05-24T03:30:26.269 INFO:teuthology.orchestra.run.smithi151.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-24T03:30:26.269 INFO:teuthology.orchestra.run.smithi151.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-24T03:30:26.269 INFO:teuthology.orchestra.run.smithi151.stdout: inet 127.0.0.1/8 scope host lo 2023-05-24T03:30:26.270 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-05-24T03:30:26.270 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 ::1/128 scope host 2023-05-24T03:30:26.270 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-05-24T03:30:26.270 INFO:teuthology.orchestra.run.smithi151.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-24T03:30:26.270 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether f6:f3:79:89:d8:ec brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-05-24T03:30:26.270 INFO:teuthology.orchestra.run.smithi151.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-05-24T03:30:26.270 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-05-24T03:30:26.271 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::f4f3:79ff:fe89:d8ec/64 scope link 2023-05-24T03:30:26.271 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-05-24T03:30:26.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:26.292 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-05-24T03:30:26.368 INFO:teuthology.orchestra.run.smithi151.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-24T03:30:26.368 INFO:teuthology.orchestra.run.smithi151.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-24T03:30:26.369 INFO:teuthology.orchestra.run.smithi151.stdout: inet 127.0.0.1/8 scope host lo 2023-05-24T03:30:26.369 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-05-24T03:30:26.369 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 ::1/128 scope host 2023-05-24T03:30:26.369 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-05-24T03:30:26.369 INFO:teuthology.orchestra.run.smithi151.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-24T03:30:26.369 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether f6:f3:79:89:d8:ec brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-05-24T03:30:26.369 INFO:teuthology.orchestra.run.smithi151.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-05-24T03:30:26.369 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-05-24T03:30:26.370 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::f4f3:79ff:fe89:d8ec/64 scope link 2023-05-24T03:30:26.370 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-05-24T03:30:26.379 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-05-24T03:30:26.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:26.380 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-05-24T03:30:26.380 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-05-24T03:30:26.381 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-05-24T03:30:26.381 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-05-24T03:30:26.381 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-05-24T03:30:26.381 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-05-24T03:30:26.382 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-05-24T03:30:26.382 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-05-24T03:30:26.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:26.617 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-05-24T03:30:26.617 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-05-24T03:30:26.618 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set brx.1 up 2023-05-24T03:30:26.618 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set dev brx.1 master ceph-brx 2023-05-24T03:30:26.618 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-05-24T03:30:26.737 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-24T03:30:26.737 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-05-24T03:30:26.758 INFO:teuthology.orchestra.run.smithi151.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-05-24T03:30:26.758 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-24T03:30:26.759 DEBUG:teuthology.orchestra.run.smithi151:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-05-24T03:30:26.815 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-05-24T03:30:26.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:26.816 DEBUG:teuthology.orchestra.run.smithi151:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-05-24T03:30:26.902 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-05-24T03:30:26.903 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-05-24T03:30:26.927 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-05-24T03:30:26.927 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-05-24T03:30:26.928 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.151:3300,172.21.15.151:3301" 2023-05-24T03:30:26.928 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: trying mount with new device syntax: 3@11ca0adb-7672-4713-bde7-451e8b743ae9.cephfs=/ 2023-05-24T03:30:26.928 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.146:3300/172.21.15.151:3300/172.21.15.151:3301" will pass to kernel 2023-05-24T03:30:26.928 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: v2 mount support check returned 2 2023-05-24T03:30:26.928 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: kernel does not support v2 syntax 2023-05-24T03:30:26.928 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: switching to using v1 address with old syntax 2023-05-24T03:30:26.956 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-05-24T03:30:26.956 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-05-24T03:30:26.956 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.151:3300,172.21.15.151:3301" 2023-05-24T03:30:26.957 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: trying mount with new device syntax: 3@11ca0adb-7672-4713-bde7-451e8b743ae9.cephfs=/ 2023-05-24T03:30:26.957 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.146:3300/172.21.15.151:3300/172.21.15.151:3301" will pass to kernel 2023-05-24T03:30:26.957 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: v2 mount support check returned 2 2023-05-24T03:30:26.957 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: kernel does not support v2 syntax 2023-05-24T03:30:26.957 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: switching to using v1 address with old syntax 2023-05-24T03:30:26.957 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: resolved to: "172.21.15.146:6789,172.21.15.151:6789,172.21.15.151:6790" 2023-05-24T03:30:26.957 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.146:6789,172.21.15.151:6789,172.21.15.151:6790:/ 2023-05-24T03:30:26.958 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,key=3,mds_namespace=cephfs,fsid=11ca0adb-7672-4713-bde7-451e8b743ae9" will pass to kernel 2023-05-24T03:30:26.959 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-05-24T03:30:26.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:26.960 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-05-24T03:30:26.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:26.993 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-05-24T03:30:27.066 INFO:teuthology.orchestra.run.smithi151.stdout:client4789 2023-05-24T03:30:27.066 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-24T03:30:27.067 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-24T03:30:27.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:27.126 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-05-24T03:30:27.197 INFO:teuthology.orchestra.run.smithi151.stdout:client4789 2023-05-24T03:30:27.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:27.198 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-05-24T03:30:27.270 INFO:teuthology.orchestra.run.smithi151.stdout:client4789 2023-05-24T03:30:27.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:30:27.271 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/11ca0adb-7672-4713-bde7-451e8b743ae9.client4789/status') 2023-05-24T03:30:27.350 INFO:teuthology.orchestra.run.smithi151.stdout:instance: client.4789 (3)192.168.0.2:0/1352626463 2023-05-24T03:30:27.350 INFO:teuthology.orchestra.run.smithi151.stdout:blocklisted: false 2023-05-24T03:30:27.351 INFO:teuthology.orchestra.run.smithi151.stderr:0+1 records in 2023-05-24T03:30:27.351 INFO:teuthology.orchestra.run.smithi151.stderr:0+1 records out 2023-05-24T03:30:27.351 INFO:teuthology.orchestra.run.smithi151.stderr:69 bytes copied, 3.8241e-05 s, 1.8 MB/s 2023-05-24T03:30:27.352 INFO:teuthology.run_tasks:Running task workunit... 2023-05-24T03:30:27.364 INFO:tasks.workunit:Pulling workunits from ref fa0e62c4a1d8e4a737d9cbe50224f70009b79b28 2023-05-24T03:30:27.364 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-05-24T03:30:27.365 INFO:tasks.workunit:timeout=3h 2023-05-24T03:30:27.365 INFO:tasks.workunit:cleanup=True 2023-05-24T03:30:27.365 DEBUG:teuthology.orchestra.run.smithi146:> stat -- /home/ubuntu/cephtest/mnt.0 2023-05-24T03:30:27.387 INFO:teuthology.orchestra.run.smithi146.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-05-24T03:30:27.387 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2023-05-24T03:30:27.387 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 2eh/46d Inode: 1 Links: 2 2023-05-24T03:30:27.387 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-24T03:30:27.387 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:cephfs_t:s0 2023-05-24T03:30:27.387 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-05-24T03:30:27.388 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2023-05-24 03:29:44.471943219 +0000 2023-05-24T03:30:27.388 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2023-05-24 03:29:53.572537579 +0000 2023-05-24T03:30:27.388 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: 2023-05-24 03:29:44.471943219 +0000 2023-05-24T03:30:27.388 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-05-24T03:30:27.388 DEBUG:teuthology.orchestra.run.smithi146:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-05-24T03:30:27.463 DEBUG:teuthology.orchestra.run.smithi146:> stat -- /home/ubuntu/cephtest/mnt.2 2023-05-24T03:30:27.523 INFO:teuthology.orchestra.run.smithi146.stdout: File: /home/ubuntu/cephtest/mnt.2 2023-05-24T03:30:27.524 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2023-05-24T03:30:27.524 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 30h/48d Inode: 1 Links: 3 2023-05-24T03:30:27.524 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-24T03:30:27.524 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:cephfs_t:s0 2023-05-24T03:30:27.524 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-05-24T03:30:27.524 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2023-05-24 03:30:27.454076076 +0000 2023-05-24T03:30:27.525 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2023-05-24 03:30:27.454076076 +0000 2023-05-24T03:30:27.525 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: 2023-05-24 03:29:44.471943219 +0000 2023-05-24T03:30:27.525 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.2 2023-05-24T03:30:27.525 DEBUG:teuthology.orchestra.run.smithi146:> cd -- /home/ubuntu/cephtest/mnt.2 && sudo install -d -m 0755 --owner=ubuntu -- client.2 2023-05-24T03:30:27.596 DEBUG:teuthology.orchestra.run.smithi151:> stat -- /home/ubuntu/cephtest/mnt.1 2023-05-24T03:30:27.614 INFO:teuthology.orchestra.run.smithi151.stdout: File: /home/ubuntu/cephtest/mnt.1 2023-05-24T03:30:27.615 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 2 Blocks: 0 IO Block: 65536 directory 2023-05-24T03:30:27.615 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 2eh/46d Inode: 1 Links: 4 2023-05-24T03:30:27.615 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-24T03:30:27.615 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:cephfs_t:s0 2023-05-24T03:30:27.615 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-05-24T03:30:27.615 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2023-05-24 03:30:27.588073964 +0000 2023-05-24T03:30:27.616 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2023-05-24 03:30:27.588073964 +0000 2023-05-24T03:30:27.616 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2023-05-24 03:29:44.471943219 +0000 2023-05-24T03:30:27.616 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2023-05-24T03:30:27.616 DEBUG:teuthology.orchestra.run.smithi151:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2023-05-24T03:30:27.685 DEBUG:teuthology.orchestra.run.smithi151:> stat -- /home/ubuntu/cephtest/mnt.3 2023-05-24T03:30:27.744 INFO:teuthology.orchestra.run.smithi151.stdout: File: /home/ubuntu/cephtest/mnt.3 2023-05-24T03:30:27.744 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 3 Blocks: 0 IO Block: 65536 directory 2023-05-24T03:30:27.745 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 30h/48d Inode: 1 Links: 5 2023-05-24T03:30:27.745 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-24T03:30:27.745 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:cephfs_t:s0 2023-05-24T03:30:27.745 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-05-24T03:30:27.745 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2023-05-24 03:30:27.676868085 +0000 2023-05-24T03:30:27.745 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2023-05-24 03:30:27.676868085 +0000 2023-05-24T03:30:27.745 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2023-05-24 03:29:44.471943219 +0000 2023-05-24T03:30:27.746 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.3 2023-05-24T03:30:27.746 DEBUG:teuthology.orchestra.run.smithi151:> cd -- /home/ubuntu/cephtest/mnt.3 && sudo install -d -m 0755 --owner=ubuntu -- client.3 2023-05-24T03:30:27.815 DEBUG:teuthology.orchestra.run.smithi146:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout fa0e62c4a1d8e4a737d9cbe50224f70009b79b28 2023-05-24T03:30:27.816 DEBUG:teuthology.orchestra.run.smithi146:> rm -rf /home/ubuntu/cephtest/clone.client.2 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.2 && cd /home/ubuntu/cephtest/clone.client.2 && git checkout fa0e62c4a1d8e4a737d9cbe50224f70009b79b28 2023-05-24T03:30:27.817 DEBUG:teuthology.orchestra.run.smithi151:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout fa0e62c4a1d8e4a737d9cbe50224f70009b79b28 2023-05-24T03:30:27.817 DEBUG:teuthology.orchestra.run.smithi151:> rm -rf /home/ubuntu/cephtest/clone.client.3 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.3 && cd /home/ubuntu/cephtest/clone.client.3 && git checkout fa0e62c4a1d8e4a737d9cbe50224f70009b79b28 2023-05-24T03:30:27.837 INFO:tasks.workunit.client.0.smithi146.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-05-24T03:30:27.837 INFO:tasks.workunit.client.2.smithi146.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.2'... 2023-05-24T03:30:27.872 INFO:tasks.workunit.client.1.smithi151.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2023-05-24T03:30:27.872 INFO:tasks.workunit.client.3.smithi151.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.3'... 2023-05-24T03:30:43.036 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T03:30:43.039 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T03:31:13.118 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T03:31:13.176 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T03:31:36.193 INFO:tasks.workunit.client.2.smithi146.stderr:Updating files: 84% (9904/11710) Updating files: 85% (9954/11710) Updating files: 86% (10071/11710) Updating files: 87% (10188/11710) Updating files: 88% (10305/11710) Updating files: 89% (10422/11710) Updating files: 90% (10539/11710) Updating files: 91% (10657/11710) Updating files: 92% (10774/11710) Updating files: 93% (10891/11710) Updating files: 94% (11008/11710) Updating files: 95% (11125/11710) Updating files: 96% (11242/11710) Updating files: 97% (11359/11710) Updating files: 98% (11476/11710) Updating files: 99% (11593/11710) Updating files: 100% (11710/11710) Updating files: 100% (11710/11710), done. 2023-05-24T03:31:36.541 INFO:tasks.workunit.client.2.smithi146.stderr:Note: switching to 'fa0e62c4a1d8e4a737d9cbe50224f70009b79b28'. 2023-05-24T03:31:36.541 INFO:tasks.workunit.client.2.smithi146.stderr: 2023-05-24T03:31:36.541 INFO:tasks.workunit.client.2.smithi146.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-05-24T03:31:36.542 INFO:tasks.workunit.client.2.smithi146.stderr:changes and commit them, and you can discard any commits you make in this 2023-05-24T03:31:36.542 INFO:tasks.workunit.client.2.smithi146.stderr:state without impacting any branches by switching back to a branch. 2023-05-24T03:31:36.542 INFO:tasks.workunit.client.2.smithi146.stderr: 2023-05-24T03:31:36.542 INFO:tasks.workunit.client.2.smithi146.stderr:If you want to create a new branch to retain commits you create, you may 2023-05-24T03:31:36.542 INFO:tasks.workunit.client.2.smithi146.stderr:do so (now or later) by using -c with the switch command. Example: 2023-05-24T03:31:36.542 INFO:tasks.workunit.client.2.smithi146.stderr: 2023-05-24T03:31:36.542 INFO:tasks.workunit.client.2.smithi146.stderr: git switch -c 2023-05-24T03:31:36.543 INFO:tasks.workunit.client.2.smithi146.stderr: 2023-05-24T03:31:36.543 INFO:tasks.workunit.client.2.smithi146.stderr:Or undo this operation with: 2023-05-24T03:31:36.543 INFO:tasks.workunit.client.2.smithi146.stderr: 2023-05-24T03:31:36.543 INFO:tasks.workunit.client.2.smithi146.stderr: git switch - 2023-05-24T03:31:36.543 INFO:tasks.workunit.client.2.smithi146.stderr: 2023-05-24T03:31:36.543 INFO:tasks.workunit.client.2.smithi146.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-05-24T03:31:36.543 INFO:tasks.workunit.client.2.smithi146.stderr: 2023-05-24T03:31:36.543 INFO:tasks.workunit.client.2.smithi146.stderr:HEAD is now at fa0e62c4a1d Merge PR #48732 into wip-pdonnell-testing-20230523.134409 2023-05-24T03:31:36.548 DEBUG:teuthology.orchestra.run.smithi146:> cd -- /home/ubuntu/cephtest/clone.client.2/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.2 2023-05-24T03:31:36.569 INFO:tasks.workunit.client.2.smithi146.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-05-24T03:31:36.571 INFO:tasks.workunit.client.2.smithi146.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.2/qa/workunits/direct_io' 2023-05-24T03:31:36.571 INFO:tasks.workunit.client.2.smithi146.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-05-24T03:31:36.678 INFO:tasks.workunit.client.3.smithi151.stderr:Updating files: 98% (11545/11710) Updating files: 99% (11593/11710) Updating files: 100% (11710/11710) Updating files: 100% (11710/11710), done. 2023-05-24T03:31:36.856 INFO:tasks.workunit.client.1.smithi151.stderr:Updating files: 99% (11673/11710) Updating files: 100% (11710/11710) Updating files: 100% (11710/11710), done. 2023-05-24T03:31:37.103 INFO:tasks.workunit.client.2.smithi146.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-05-24T03:31:37.136 INFO:tasks.workunit.client.0.smithi146.stderr:Note: switching to 'fa0e62c4a1d8e4a737d9cbe50224f70009b79b28'. 2023-05-24T03:31:37.136 INFO:tasks.workunit.client.0.smithi146.stderr: 2023-05-24T03:31:37.137 INFO:tasks.workunit.client.0.smithi146.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-05-24T03:31:37.137 INFO:tasks.workunit.client.0.smithi146.stderr:changes and commit them, and you can discard any commits you make in this 2023-05-24T03:31:37.137 INFO:tasks.workunit.client.0.smithi146.stderr:state without impacting any branches by switching back to a branch. 2023-05-24T03:31:37.137 INFO:tasks.workunit.client.0.smithi146.stderr: 2023-05-24T03:31:37.137 INFO:tasks.workunit.client.0.smithi146.stderr:If you want to create a new branch to retain commits you create, you may 2023-05-24T03:31:37.137 INFO:tasks.workunit.client.0.smithi146.stderr:do so (now or later) by using -c with the switch command. Example: 2023-05-24T03:31:37.137 INFO:tasks.workunit.client.0.smithi146.stderr: 2023-05-24T03:31:37.137 INFO:tasks.workunit.client.0.smithi146.stderr: git switch -c 2023-05-24T03:31:37.138 INFO:tasks.workunit.client.0.smithi146.stderr: 2023-05-24T03:31:37.138 INFO:tasks.workunit.client.0.smithi146.stderr:Or undo this operation with: 2023-05-24T03:31:37.138 INFO:tasks.workunit.client.0.smithi146.stderr: 2023-05-24T03:31:37.138 INFO:tasks.workunit.client.0.smithi146.stderr: git switch - 2023-05-24T03:31:37.138 INFO:tasks.workunit.client.0.smithi146.stderr: 2023-05-24T03:31:37.138 INFO:tasks.workunit.client.0.smithi146.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-05-24T03:31:37.138 INFO:tasks.workunit.client.0.smithi146.stderr: 2023-05-24T03:31:37.139 INFO:tasks.workunit.client.0.smithi146.stderr:HEAD is now at fa0e62c4a1d Merge PR #48732 into wip-pdonnell-testing-20230523.134409 2023-05-24T03:31:37.141 DEBUG:teuthology.orchestra.run.smithi146:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-05-24T03:31:37.155 INFO:tasks.workunit.client.2.smithi146.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-05-24T03:31:37.170 INFO:tasks.workunit.client.0.smithi146.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-05-24T03:31:37.172 INFO:tasks.workunit.client.0.smithi146.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-05-24T03:31:37.173 INFO:tasks.workunit.client.0.smithi146.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-05-24T03:31:37.193 INFO:tasks.workunit.client.2.smithi146.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.2/qa/workunits/direct_io' 2023-05-24T03:31:37.195 INFO:tasks.workunit.client.2.smithi146.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.2/qa/workunits/fs' 2023-05-24T03:31:37.195 INFO:tasks.workunit.client.2.smithi146.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-05-24T03:31:37.220 INFO:tasks.workunit.client.0.smithi146.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-05-24T03:31:37.232 INFO:tasks.workunit.client.2.smithi146.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.2/qa/workunits/fs' 2023-05-24T03:31:37.235 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-05-24T03:31:37.236 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/home/ubuntu/cephtest/workunits.list.client.2 of=/dev/stdout 2023-05-24T03:31:37.267 INFO:tasks.workunit.client.0.smithi146.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-05-24T03:31:37.282 INFO:tasks.workunit:Running workunits matching fs/quota on client.2... 2023-05-24T03:31:37.284 INFO:tasks.workunit:Running workunit fs/quota/quota.sh... 2023-05-24T03:31:37.284 DEBUG:teuthology.orchestra.run.smithi146:workunit test fs/quota/quota.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.2/client.2/tmp && cd -- /home/ubuntu/cephtest/mnt.2/client.2/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fa0e62c4a1d8e4a737d9cbe50224f70009b79b28 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="2" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.2 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.2 CEPH_MNT=/home/ubuntu/cephtest/mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.2/qa/workunits/fs/quota/quota.sh 2023-05-24T03:31:37.304 INFO:tasks.workunit.client.0.smithi146.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-05-24T03:31:37.306 INFO:tasks.workunit.client.0.smithi146.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-05-24T03:31:37.306 INFO:tasks.workunit.client.0.smithi146.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-05-24T03:31:37.327 INFO:tasks.workunit.client.2.smithi146.stderr:+ mkdir quota-test 2023-05-24T03:31:37.329 INFO:tasks.workunit.client.2.smithi146.stderr:+ cd quota-test 2023-05-24T03:31:37.329 INFO:tasks.workunit.client.2.smithi146.stderr:+ setfattr . -n ceph.quota.max_bytes -v 100M 2023-05-24T03:31:37.333 INFO:tasks.workunit.client.2.smithi146.stderr:+ expect_false write_file big 1000 2023-05-24T03:31:37.334 INFO:tasks.workunit.client.2.smithi146.stderr:+ set -x 2023-05-24T03:31:37.334 INFO:tasks.workunit.client.2.smithi146.stderr:+ write_file big 1000 2023-05-24T03:31:37.334 INFO:tasks.workunit.client.2.smithi146.stderr:+ set +x 2023-05-24T03:31:37.347 INFO:tasks.workunit.client.0.smithi146.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-05-24T03:31:37.350 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-05-24T03:31:37.350 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-05-24T03:31:37.361 INFO:tasks.workunit.client.3.smithi151.stderr:Note: switching to 'fa0e62c4a1d8e4a737d9cbe50224f70009b79b28'. 2023-05-24T03:31:37.362 INFO:tasks.workunit.client.3.smithi151.stderr: 2023-05-24T03:31:37.362 INFO:tasks.workunit.client.3.smithi151.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-05-24T03:31:37.362 INFO:tasks.workunit.client.3.smithi151.stderr:changes and commit them, and you can discard any commits you make in this 2023-05-24T03:31:37.362 INFO:tasks.workunit.client.3.smithi151.stderr:state without impacting any branches by switching back to a branch. 2023-05-24T03:31:37.362 INFO:tasks.workunit.client.3.smithi151.stderr: 2023-05-24T03:31:37.362 INFO:tasks.workunit.client.3.smithi151.stderr:If you want to create a new branch to retain commits you create, you may 2023-05-24T03:31:37.362 INFO:tasks.workunit.client.3.smithi151.stderr:do so (now or later) by using -c with the switch command. Example: 2023-05-24T03:31:37.363 INFO:tasks.workunit.client.3.smithi151.stderr: 2023-05-24T03:31:37.363 INFO:tasks.workunit.client.3.smithi151.stderr: git switch -c 2023-05-24T03:31:37.363 INFO:tasks.workunit.client.3.smithi151.stderr: 2023-05-24T03:31:37.363 INFO:tasks.workunit.client.3.smithi151.stderr:Or undo this operation with: 2023-05-24T03:31:37.363 INFO:tasks.workunit.client.3.smithi151.stderr: 2023-05-24T03:31:37.363 INFO:tasks.workunit.client.3.smithi151.stderr: git switch - 2023-05-24T03:31:37.363 INFO:tasks.workunit.client.3.smithi151.stderr: 2023-05-24T03:31:37.364 INFO:tasks.workunit.client.3.smithi151.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-05-24T03:31:37.364 INFO:tasks.workunit.client.3.smithi151.stderr: 2023-05-24T03:31:37.364 INFO:tasks.workunit.client.3.smithi151.stderr:HEAD is now at fa0e62c4a1d Merge PR #48732 into wip-pdonnell-testing-20230523.134409 2023-05-24T03:31:37.366 DEBUG:teuthology.orchestra.run.smithi151:> cd -- /home/ubuntu/cephtest/clone.client.3/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.3 2023-05-24T03:31:37.394 INFO:tasks.workunit.client.3.smithi151.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-05-24T03:31:37.397 INFO:tasks.workunit.client.3.smithi151.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.3/qa/workunits/direct_io' 2023-05-24T03:31:37.397 INFO:tasks.workunit.client.3.smithi151.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-05-24T03:31:37.407 INFO:tasks.workunit:Running workunits matching fs/quota on client.0... 2023-05-24T03:31:37.408 INFO:tasks.workunit:Running workunit fs/quota/quota.sh... 2023-05-24T03:31:37.409 DEBUG:teuthology.orchestra.run.smithi146:workunit test fs/quota/quota.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fa0e62c4a1d8e4a737d9cbe50224f70009b79b28 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/quota/quota.sh 2023-05-24T03:31:37.469 INFO:tasks.workunit.client.0.smithi146.stderr:+ mkdir quota-test 2023-05-24T03:31:37.470 INFO:tasks.workunit.client.0.smithi146.stderr:+ cd quota-test 2023-05-24T03:31:37.470 INFO:tasks.workunit.client.0.smithi146.stderr:+ setfattr . -n ceph.quota.max_bytes -v 100M 2023-05-24T03:31:37.474 INFO:tasks.workunit.client.0.smithi146.stderr:+ expect_false write_file big 1000 2023-05-24T03:31:37.474 INFO:tasks.workunit.client.0.smithi146.stderr:+ set -x 2023-05-24T03:31:37.474 INFO:tasks.workunit.client.0.smithi146.stderr:+ write_file big 1000 2023-05-24T03:31:37.475 INFO:tasks.workunit.client.0.smithi146.stderr:+ set +x 2023-05-24T03:31:37.594 INFO:tasks.workunit.client.1.smithi151.stderr:Note: switching to 'fa0e62c4a1d8e4a737d9cbe50224f70009b79b28'. 2023-05-24T03:31:37.595 INFO:tasks.workunit.client.1.smithi151.stderr: 2023-05-24T03:31:37.595 INFO:tasks.workunit.client.1.smithi151.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-05-24T03:31:37.595 INFO:tasks.workunit.client.1.smithi151.stderr:changes and commit them, and you can discard any commits you make in this 2023-05-24T03:31:37.595 INFO:tasks.workunit.client.1.smithi151.stderr:state without impacting any branches by switching back to a branch. 2023-05-24T03:31:37.595 INFO:tasks.workunit.client.1.smithi151.stderr: 2023-05-24T03:31:37.596 INFO:tasks.workunit.client.1.smithi151.stderr:If you want to create a new branch to retain commits you create, you may 2023-05-24T03:31:37.596 INFO:tasks.workunit.client.1.smithi151.stderr:do so (now or later) by using -c with the switch command. Example: 2023-05-24T03:31:37.596 INFO:tasks.workunit.client.1.smithi151.stderr: 2023-05-24T03:31:37.596 INFO:tasks.workunit.client.1.smithi151.stderr: git switch -c 2023-05-24T03:31:37.596 INFO:tasks.workunit.client.1.smithi151.stderr: 2023-05-24T03:31:37.596 INFO:tasks.workunit.client.1.smithi151.stderr:Or undo this operation with: 2023-05-24T03:31:37.596 INFO:tasks.workunit.client.1.smithi151.stderr: 2023-05-24T03:31:37.597 INFO:tasks.workunit.client.1.smithi151.stderr: git switch - 2023-05-24T03:31:37.597 INFO:tasks.workunit.client.1.smithi151.stderr: 2023-05-24T03:31:37.597 INFO:tasks.workunit.client.1.smithi151.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-05-24T03:31:37.597 INFO:tasks.workunit.client.1.smithi151.stderr: 2023-05-24T03:31:37.597 INFO:tasks.workunit.client.1.smithi151.stderr:HEAD is now at fa0e62c4a1d Merge PR #48732 into wip-pdonnell-testing-20230523.134409 2023-05-24T03:31:37.599 DEBUG:teuthology.orchestra.run.smithi151:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2023-05-24T03:31:37.656 INFO:tasks.workunit.client.1.smithi151.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-05-24T03:31:37.658 INFO:tasks.workunit.client.1.smithi151.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2023-05-24T03:31:37.658 INFO:tasks.workunit.client.1.smithi151.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-05-24T03:31:37.971 INFO:tasks.workunit.client.3.smithi151.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-05-24T03:31:37.972 INFO:tasks.workunit.client.1.smithi151.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-05-24T03:31:38.029 INFO:tasks.workunit.client.1.smithi151.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-05-24T03:31:38.030 INFO:tasks.workunit.client.3.smithi151.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-05-24T03:31:38.067 INFO:tasks.workunit.client.1.smithi151.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2023-05-24T03:31:38.068 INFO:tasks.workunit.client.3.smithi151.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.3/qa/workunits/direct_io' 2023-05-24T03:31:38.069 INFO:tasks.workunit.client.1.smithi151.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2023-05-24T03:31:38.069 INFO:tasks.workunit.client.1.smithi151.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-05-24T03:31:38.069 INFO:tasks.workunit.client.3.smithi151.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.3/qa/workunits/fs' 2023-05-24T03:31:38.069 INFO:tasks.workunit.client.3.smithi151.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-05-24T03:31:38.106 INFO:tasks.workunit.client.3.smithi151.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.3/qa/workunits/fs' 2023-05-24T03:31:38.107 INFO:tasks.workunit.client.1.smithi151.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2023-05-24T03:31:38.109 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-24T03:31:38.110 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/home/ubuntu/cephtest/workunits.list.client.3 of=/dev/stdout 2023-05-24T03:31:38.110 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-24T03:31:38.111 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2023-05-24T03:31:38.166 INFO:tasks.workunit:Running workunits matching fs/quota on client.3... 2023-05-24T03:31:38.167 INFO:tasks.workunit:Running workunit fs/quota/quota.sh... 2023-05-24T03:31:38.168 DEBUG:teuthology.orchestra.run.smithi151:workunit test fs/quota/quota.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.3/client.3/tmp && cd -- /home/ubuntu/cephtest/mnt.3/client.3/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fa0e62c4a1d8e4a737d9cbe50224f70009b79b28 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="3" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.3 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.3 CEPH_MNT=/home/ubuntu/cephtest/mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.3/qa/workunits/fs/quota/quota.sh 2023-05-24T03:31:38.169 INFO:tasks.workunit:Running workunits matching fs/quota on client.1... 2023-05-24T03:31:38.170 INFO:tasks.workunit:Running workunit fs/quota/quota.sh... 2023-05-24T03:31:38.170 DEBUG:teuthology.orchestra.run.smithi151:workunit test fs/quota/quota.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fa0e62c4a1d8e4a737d9cbe50224f70009b79b28 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/fs/quota/quota.sh 2023-05-24T03:31:38.229 INFO:tasks.workunit.client.3.smithi151.stderr:+ mkdir quota-test 2023-05-24T03:31:38.230 INFO:tasks.workunit.client.1.smithi151.stderr:+ mkdir quota-test 2023-05-24T03:31:38.231 INFO:tasks.workunit.client.3.smithi151.stderr:+ cd quota-test 2023-05-24T03:31:38.231 INFO:tasks.workunit.client.3.smithi151.stderr:+ setfattr . -n ceph.quota.max_bytes -v 100M 2023-05-24T03:31:38.232 INFO:tasks.workunit.client.1.smithi151.stderr:+ cd quota-test 2023-05-24T03:31:38.232 INFO:tasks.workunit.client.1.smithi151.stderr:+ setfattr . -n ceph.quota.max_bytes -v 100M 2023-05-24T03:31:38.253 INFO:tasks.workunit.client.3.smithi151.stderr:+ expect_false write_file big 1000 2023-05-24T03:31:38.253 INFO:tasks.workunit.client.3.smithi151.stderr:+ set -x 2023-05-24T03:31:38.254 INFO:tasks.workunit.client.3.smithi151.stderr:+ write_file big 1000 2023-05-24T03:31:38.254 INFO:tasks.workunit.client.3.smithi151.stderr:+ set +x 2023-05-24T03:31:38.254 INFO:tasks.workunit.client.1.smithi151.stderr:+ expect_false write_file big 1000 2023-05-24T03:31:38.254 INFO:tasks.workunit.client.1.smithi151.stderr:+ set -x 2023-05-24T03:31:38.255 INFO:tasks.workunit.client.1.smithi151.stderr:+ write_file big 1000 2023-05-24T03:31:38.255 INFO:tasks.workunit.client.1.smithi151.stderr:+ set +x 2023-05-24T03:31:43.047 INFO:tasks.workunit.client.0.smithi146.stdout:Try to write 112197632 2023-05-24T03:31:43.048 INFO:tasks.workunit.client.0.smithi146.stderr:+ return 1 2023-05-24T03:31:43.048 INFO:tasks.workunit.client.0.smithi146.stderr:+ return 0 2023-05-24T03:31:43.048 INFO:tasks.workunit.client.0.smithi146.stderr:+ expect_false write_file second 10 2023-05-24T03:31:43.048 INFO:tasks.workunit.client.0.smithi146.stderr:+ set -x 2023-05-24T03:31:43.049 INFO:tasks.workunit.client.0.smithi146.stderr:+ write_file second 10 2023-05-24T03:31:43.049 INFO:tasks.workunit.client.0.smithi146.stderr:+ set +x 2023-05-24T03:31:43.059 INFO:tasks.workunit.client.0.smithi146.stdout:Try to write 1048576 2023-05-24T03:31:43.060 INFO:tasks.workunit.client.0.smithi146.stderr:+ return 1 2023-05-24T03:31:43.060 INFO:tasks.workunit.client.0.smithi146.stderr:+ return 0 2023-05-24T03:31:43.060 INFO:tasks.workunit.client.0.smithi146.stderr:+ setfattr . -n ceph.quota.max_bytes -v 0 2023-05-24T03:31:43.102 INFO:tasks.workunit.client.0.smithi146.stderr:+ dd if=/dev/zero of=third bs=1M count=10 2023-05-24T03:31:43.115 INFO:tasks.workunit.client.0.smithi146.stderr:10+0 records in 2023-05-24T03:31:43.116 INFO:tasks.workunit.client.0.smithi146.stderr:10+0 records out 2023-05-24T03:31:43.116 INFO:tasks.workunit.client.0.smithi146.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0113065 s, 927 MB/s 2023-05-24T03:31:43.116 INFO:tasks.workunit.client.0.smithi146.stderr:+ dd if=/dev/zero of=big2 bs=1M count=100 2023-05-24T03:31:43.168 INFO:tasks.workunit.client.0.smithi146.stderr:100+0 records in 2023-05-24T03:31:43.168 INFO:tasks.workunit.client.0.smithi146.stderr:100+0 records out 2023-05-24T03:31:43.168 INFO:tasks.workunit.client.0.smithi146.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0499664 s, 2.1 GB/s 2023-05-24T03:31:43.169 INFO:tasks.workunit.client.0.smithi146.stderr:+ rm -rf big big2 second third 2023-05-24T03:31:43.173 INFO:tasks.workunit.client.0.smithi146.stderr:+ setfattr . -n ceph.quota.max_files -v 5 2023-05-24T03:31:43.179 INFO:tasks.workunit.client.0.smithi146.stderr:+ mkdir ok 2023-05-24T03:31:43.180 INFO:tasks.workunit.client.0.smithi146.stderr:+ touch ok/1 2023-05-24T03:31:43.182 INFO:tasks.workunit.client.0.smithi146.stderr:+ touch ok/2 2023-05-24T03:31:43.183 INFO:tasks.workunit.client.0.smithi146.stderr:+ touch 3 2023-05-24T03:31:43.184 INFO:tasks.workunit.client.0.smithi146.stderr:+ expect_false touch shouldbefail 2023-05-24T03:31:43.184 INFO:tasks.workunit.client.0.smithi146.stderr:+ set -x 2023-05-24T03:31:43.185 INFO:tasks.workunit.client.0.smithi146.stderr:+ touch shouldbefail 2023-05-24T03:31:43.186 INFO:tasks.workunit.client.0.smithi146.stderr:touch: cannot touch 'shouldbefail': Disk quota exceeded 2023-05-24T03:31:43.186 INFO:tasks.workunit.client.0.smithi146.stderr:+ return 0 2023-05-24T03:31:43.186 INFO:tasks.workunit.client.0.smithi146.stderr:+ expect_false touch ok/shouldbefail 2023-05-24T03:31:43.186 INFO:tasks.workunit.client.0.smithi146.stderr:+ set -x 2023-05-24T03:31:43.186 INFO:tasks.workunit.client.0.smithi146.stderr:+ touch ok/shouldbefail 2023-05-24T03:31:43.186 INFO:tasks.workunit.client.0.smithi146.stderr:touch: cannot touch 'ok/shouldbefail': Disk quota exceeded 2023-05-24T03:31:43.186 INFO:tasks.workunit.client.0.smithi146.stderr:+ return 0 2023-05-24T03:31:43.187 INFO:tasks.workunit.client.0.smithi146.stderr:+ setfattr . -n ceph.quota.max_files -v 0 2023-05-24T03:31:43.191 INFO:tasks.workunit.client.0.smithi146.stderr:+ touch shouldbecreated 2023-05-24T03:31:43.192 INFO:tasks.workunit.client.0.smithi146.stderr:+ touch shouldbecreated2 2023-05-24T03:31:43.196 INFO:tasks.workunit.client.0.smithi146.stderr:+ rm -rf 3 ok shouldbecreated shouldbecreated2 2023-05-24T03:31:43.208 INFO:tasks.workunit.client.0.smithi146.stderr:+ mkdir bytes bytes/files 2023-05-24T03:31:43.211 INFO:tasks.workunit.client.0.smithi146.stderr:+ setfattr bytes -n ceph.quota.max_bytes -v 10M 2023-05-24T03:31:43.217 INFO:tasks.workunit.client.0.smithi146.stderr:+ setfattr bytes/files -n ceph.quota.max_files -v 5 2023-05-24T03:31:43.220 INFO:tasks.workunit.client.0.smithi146.stderr:+ dd if=/dev/zero of=bytes/files/1 bs=1M count=4 2023-05-24T03:31:43.223 INFO:tasks.workunit.client.0.smithi146.stderr:4+0 records in 2023-05-24T03:31:43.224 INFO:tasks.workunit.client.0.smithi146.stderr:4+0 records out 2023-05-24T03:31:43.224 INFO:tasks.workunit.client.0.smithi146.stderr:4194304 bytes (4.2 MB, 4.0 MiB) copied, 0.00154588 s, 2.7 GB/s 2023-05-24T03:31:43.224 INFO:tasks.workunit.client.0.smithi146.stderr:+ dd if=/dev/zero of=bytes/files/2 bs=1M count=4 2023-05-24T03:31:43.227 INFO:tasks.workunit.client.0.smithi146.stderr:4+0 records in 2023-05-24T03:31:43.227 INFO:tasks.workunit.client.0.smithi146.stderr:4+0 records out 2023-05-24T03:31:43.227 INFO:tasks.workunit.client.0.smithi146.stderr:4194304 bytes (4.2 MB, 4.0 MiB) copied, 0.00148218 s, 2.8 GB/s 2023-05-24T03:31:43.227 INFO:tasks.workunit.client.0.smithi146.stderr:+ expect_false write_file bytes/files/3 1000 2023-05-24T03:31:43.227 INFO:tasks.workunit.client.0.smithi146.stderr:+ set -x 2023-05-24T03:31:43.227 INFO:tasks.workunit.client.0.smithi146.stderr:+ write_file bytes/files/3 1000 2023-05-24T03:31:43.227 INFO:tasks.workunit.client.0.smithi146.stderr:+ set +x 2023-05-24T03:31:43.751 INFO:tasks.workunit.client.1.smithi151.stdout:Try to write 108003328 2023-05-24T03:31:43.752 INFO:tasks.workunit.client.1.smithi151.stderr:+ return 1 2023-05-24T03:31:43.752 INFO:tasks.workunit.client.1.smithi151.stderr:+ return 0 2023-05-24T03:31:43.752 INFO:tasks.workunit.client.1.smithi151.stderr:+ expect_false write_file second 10 2023-05-24T03:31:43.752 INFO:tasks.workunit.client.1.smithi151.stderr:+ set -x 2023-05-24T03:31:43.753 INFO:tasks.workunit.client.1.smithi151.stderr:+ write_file second 10 2023-05-24T03:31:43.753 INFO:tasks.workunit.client.1.smithi151.stderr:+ set +x 2023-05-24T03:31:43.754 INFO:tasks.workunit.client.1.smithi151.stdout:Try to write 1048576 2023-05-24T03:31:43.754 INFO:tasks.workunit.client.1.smithi151.stderr:+ return 1 2023-05-24T03:31:43.754 INFO:tasks.workunit.client.1.smithi151.stderr:+ return 0 2023-05-24T03:31:43.754 INFO:tasks.workunit.client.1.smithi151.stderr:+ setfattr . -n ceph.quota.max_bytes -v 0 2023-05-24T03:31:43.759 INFO:tasks.workunit.client.3.smithi151.stdout:Try to write 108003328 2023-05-24T03:31:43.759 INFO:tasks.workunit.client.3.smithi151.stderr:+ return 1 2023-05-24T03:31:43.760 INFO:tasks.workunit.client.3.smithi151.stderr:+ return 0 2023-05-24T03:31:43.760 INFO:tasks.workunit.client.3.smithi151.stderr:+ expect_false write_file second 10 2023-05-24T03:31:43.760 INFO:tasks.workunit.client.3.smithi151.stderr:+ set -x 2023-05-24T03:31:43.760 INFO:tasks.workunit.client.3.smithi151.stderr:+ write_file second 10 2023-05-24T03:31:43.760 INFO:tasks.workunit.client.3.smithi151.stderr:+ set +x 2023-05-24T03:31:43.761 INFO:tasks.workunit.client.3.smithi151.stdout:Try to write 1048576 2023-05-24T03:31:43.761 INFO:tasks.workunit.client.3.smithi151.stderr:+ return 1 2023-05-24T03:31:43.761 INFO:tasks.workunit.client.3.smithi151.stderr:+ return 0 2023-05-24T03:31:43.762 INFO:tasks.workunit.client.3.smithi151.stderr:+ setfattr . -n ceph.quota.max_bytes -v 0 2023-05-24T03:31:43.819 INFO:tasks.workunit.client.1.smithi151.stderr:+ dd if=/dev/zero of=third bs=1M count=10 2023-05-24T03:31:43.819 INFO:tasks.workunit.client.3.smithi151.stderr:+ dd if=/dev/zero of=third bs=1M count=10 2023-05-24T03:31:43.829 INFO:tasks.workunit.client.1.smithi151.stderr:10+0 records in 2023-05-24T03:31:43.829 INFO:tasks.workunit.client.1.smithi151.stderr:10+0 records out 2023-05-24T03:31:43.829 INFO:tasks.workunit.client.1.smithi151.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00748133 s, 1.4 GB/s 2023-05-24T03:31:43.829 INFO:tasks.workunit.client.1.smithi151.stderr:+ dd if=/dev/zero of=big2 bs=1M count=100 2023-05-24T03:31:43.830 INFO:tasks.workunit.client.3.smithi151.stderr:10+0 records in 2023-05-24T03:31:43.830 INFO:tasks.workunit.client.3.smithi151.stderr:10+0 records out 2023-05-24T03:31:43.830 INFO:tasks.workunit.client.3.smithi151.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00774268 s, 1.4 GB/s 2023-05-24T03:31:43.830 INFO:tasks.workunit.client.3.smithi151.stderr:+ dd if=/dev/zero of=big2 bs=1M count=100 2023-05-24T03:31:43.870 INFO:tasks.workunit.client.1.smithi151.stderr:100+0 records in 2023-05-24T03:31:43.870 INFO:tasks.workunit.client.1.smithi151.stderr:100+0 records out 2023-05-24T03:31:43.870 INFO:tasks.workunit.client.1.smithi151.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.039827 s, 2.6 GB/s 2023-05-24T03:31:43.871 INFO:tasks.workunit.client.1.smithi151.stderr:+ rm -rf big big2 second third 2023-05-24T03:31:43.878 INFO:tasks.workunit.client.1.smithi151.stderr:+ setfattr . -n ceph.quota.max_files -v 5 2023-05-24T03:31:43.881 INFO:tasks.workunit.client.3.smithi151.stderr:100+0 records in 2023-05-24T03:31:43.881 INFO:tasks.workunit.client.3.smithi151.stderr:100+0 records out 2023-05-24T03:31:43.882 INFO:tasks.workunit.client.3.smithi151.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0501319 s, 2.1 GB/s 2023-05-24T03:31:43.882 INFO:tasks.workunit.client.3.smithi151.stderr:+ rm -rf big big2 second third 2023-05-24T03:31:43.889 INFO:tasks.workunit.client.3.smithi151.stderr:+ setfattr . -n ceph.quota.max_files -v 5 2023-05-24T03:31:43.890 INFO:tasks.workunit.client.1.smithi151.stderr:+ mkdir ok 2023-05-24T03:31:43.892 INFO:tasks.workunit.client.1.smithi151.stderr:+ touch ok/1 2023-05-24T03:31:43.893 INFO:tasks.workunit.client.1.smithi151.stderr:+ touch ok/2 2023-05-24T03:31:43.895 INFO:tasks.workunit.client.1.smithi151.stderr:+ touch 3 2023-05-24T03:31:43.895 INFO:tasks.workunit.client.3.smithi151.stderr:+ mkdir ok 2023-05-24T03:31:43.896 INFO:tasks.workunit.client.1.smithi151.stderr:+ expect_false touch shouldbefail 2023-05-24T03:31:43.897 INFO:tasks.workunit.client.1.smithi151.stderr:+ set -x 2023-05-24T03:31:43.897 INFO:tasks.workunit.client.1.smithi151.stderr:+ touch shouldbefail 2023-05-24T03:31:43.897 INFO:tasks.workunit.client.1.smithi151.stderr:touch: cannot touch 'shouldbefail': Disk quota exceeded 2023-05-24T03:31:43.898 INFO:tasks.workunit.client.3.smithi151.stderr:+ touch ok/1 2023-05-24T03:31:43.899 INFO:tasks.workunit.client.1.smithi151.stderr:+ return 0 2023-05-24T03:31:43.899 INFO:tasks.workunit.client.1.smithi151.stderr:+ expect_false touch ok/shouldbefail 2023-05-24T03:31:43.899 INFO:tasks.workunit.client.1.smithi151.stderr:+ set -x 2023-05-24T03:31:43.899 INFO:tasks.workunit.client.1.smithi151.stderr:+ touch ok/shouldbefail 2023-05-24T03:31:43.900 INFO:tasks.workunit.client.1.smithi151.stderr:touch: cannot touch 'ok/shouldbefail': Disk quota exceeded 2023-05-24T03:31:43.900 INFO:tasks.workunit.client.1.smithi151.stderr:+ return 0 2023-05-24T03:31:43.900 INFO:tasks.workunit.client.1.smithi151.stderr:+ setfattr . -n ceph.quota.max_files -v 0 2023-05-24T03:31:43.901 INFO:tasks.workunit.client.3.smithi151.stderr:+ touch ok/2 2023-05-24T03:31:43.901 INFO:tasks.workunit.client.3.smithi151.stderr:+ touch 3 2023-05-24T03:31:43.901 INFO:tasks.workunit.client.3.smithi151.stderr:+ expect_false touch shouldbefail 2023-05-24T03:31:43.901 INFO:tasks.workunit.client.3.smithi151.stderr:+ set -x 2023-05-24T03:31:43.902 INFO:tasks.workunit.client.3.smithi151.stderr:+ touch shouldbefail 2023-05-24T03:31:43.903 INFO:tasks.workunit.client.3.smithi151.stderr:touch: cannot touch 'shouldbefail': Disk quota exceeded 2023-05-24T03:31:43.903 INFO:tasks.workunit.client.3.smithi151.stderr:+ return 0 2023-05-24T03:31:43.903 INFO:tasks.workunit.client.3.smithi151.stderr:+ expect_false touch ok/shouldbefail 2023-05-24T03:31:43.903 INFO:tasks.workunit.client.3.smithi151.stderr:+ set -x 2023-05-24T03:31:43.903 INFO:tasks.workunit.client.3.smithi151.stderr:+ touch ok/shouldbefail 2023-05-24T03:31:43.904 INFO:tasks.workunit.client.3.smithi151.stderr:touch: cannot touch 'ok/shouldbefail': Disk quota exceeded 2023-05-24T03:31:43.904 INFO:tasks.workunit.client.3.smithi151.stderr:+ return 0 2023-05-24T03:31:43.904 INFO:tasks.workunit.client.3.smithi151.stderr:+ setfattr . -n ceph.quota.max_files -v 0 2023-05-24T03:31:43.905 INFO:tasks.workunit.client.1.smithi151.stderr:+ touch shouldbecreated 2023-05-24T03:31:43.906 INFO:tasks.workunit.client.3.smithi151.stderr:+ touch shouldbecreated 2023-05-24T03:31:43.907 INFO:tasks.workunit.client.1.smithi151.stderr:+ touch shouldbecreated2 2023-05-24T03:31:43.908 INFO:tasks.workunit.client.3.smithi151.stderr:+ touch shouldbecreated2 2023-05-24T03:31:43.912 INFO:tasks.workunit.client.1.smithi151.stderr:+ rm -rf 3 ok shouldbecreated shouldbecreated2 2023-05-24T03:31:43.912 INFO:tasks.workunit.client.3.smithi151.stderr:+ rm -rf 3 ok shouldbecreated shouldbecreated2 2023-05-24T03:31:43.930 INFO:tasks.workunit.client.1.smithi151.stderr:+ mkdir bytes bytes/files 2023-05-24T03:31:43.932 INFO:tasks.workunit.client.3.smithi151.stderr:+ mkdir bytes bytes/files 2023-05-24T03:31:43.933 INFO:tasks.workunit.client.1.smithi151.stderr:+ setfattr bytes -n ceph.quota.max_bytes -v 10M 2023-05-24T03:31:43.934 INFO:tasks.workunit.client.3.smithi151.stderr:+ setfattr bytes -n ceph.quota.max_bytes -v 10M 2023-05-24T03:31:43.942 INFO:tasks.workunit.client.1.smithi151.stderr:+ setfattr bytes/files -n ceph.quota.max_files -v 5 2023-05-24T03:31:43.943 INFO:tasks.workunit.client.3.smithi151.stderr:+ setfattr bytes/files -n ceph.quota.max_files -v 5 2023-05-24T03:31:43.945 INFO:tasks.workunit.client.1.smithi151.stderr:+ dd if=/dev/zero of=bytes/files/1 bs=1M count=4 2023-05-24T03:31:43.947 INFO:tasks.workunit.client.3.smithi151.stderr:+ dd if=/dev/zero of=bytes/files/1 bs=1M count=4 2023-05-24T03:31:43.949 INFO:tasks.workunit.client.1.smithi151.stderr:4+0 records in 2023-05-24T03:31:43.949 INFO:tasks.workunit.client.1.smithi151.stderr:4+0 records out 2023-05-24T03:31:43.949 INFO:tasks.workunit.client.1.smithi151.stderr:4194304 bytes (4.2 MB, 4.0 MiB) copied, 0.00150427 s, 2.8 GB/s 2023-05-24T03:31:43.950 INFO:tasks.workunit.client.1.smithi151.stderr:+ dd if=/dev/zero of=bytes/files/2 bs=1M count=4 2023-05-24T03:31:43.950 INFO:tasks.workunit.client.3.smithi151.stderr:4+0 records in 2023-05-24T03:31:43.950 INFO:tasks.workunit.client.3.smithi151.stderr:4+0 records out 2023-05-24T03:31:43.950 INFO:tasks.workunit.client.3.smithi151.stderr:4194304 bytes (4.2 MB, 4.0 MiB) copied, 0.00155559 s, 2.7 GB/s 2023-05-24T03:31:43.951 INFO:tasks.workunit.client.3.smithi151.stderr:+ dd if=/dev/zero of=bytes/files/2 bs=1M count=4 2023-05-24T03:31:43.952 INFO:tasks.workunit.client.1.smithi151.stderr:4+0 records in 2023-05-24T03:31:43.953 INFO:tasks.workunit.client.1.smithi151.stderr:4+0 records out 2023-05-24T03:31:43.953 INFO:tasks.workunit.client.1.smithi151.stderr:4194304 bytes (4.2 MB, 4.0 MiB) copied, 0.00181981 s, 2.3 GB/s 2023-05-24T03:31:43.953 INFO:tasks.workunit.client.1.smithi151.stderr:+ expect_false write_file bytes/files/3 1000 2023-05-24T03:31:43.954 INFO:tasks.workunit.client.3.smithi151.stderr:4+0 records in 2023-05-24T03:31:43.954 INFO:tasks.workunit.client.3.smithi151.stderr:4+0 records out 2023-05-24T03:31:43.954 INFO:tasks.workunit.client.1.smithi151.stderr:+ set -x 2023-05-24T03:31:43.954 INFO:tasks.workunit.client.3.smithi151.stderr:4194304 bytes (4.2 MB, 4.0 MiB) copied, 0.0016886 s, 2.5 GB/s 2023-05-24T03:31:43.955 INFO:tasks.workunit.client.1.smithi151.stderr:+ write_file bytes/files/3 1000 2023-05-24T03:31:43.955 INFO:tasks.workunit.client.1.smithi151.stderr:+ set +x 2023-05-24T03:31:43.955 INFO:tasks.workunit.client.3.smithi151.stderr:+ expect_false write_file bytes/files/3 1000 2023-05-24T03:31:43.956 INFO:tasks.workunit.client.3.smithi151.stderr:+ set -x 2023-05-24T03:31:43.956 INFO:tasks.workunit.client.3.smithi151.stderr:+ write_file bytes/files/3 1000 2023-05-24T03:31:43.956 INFO:tasks.workunit.client.3.smithi151.stderr:+ set +x 2023-05-24T03:31:44.305 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T03:31:44.307 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T03:31:44.648 INFO:tasks.workunit.client.0.smithi146.stdout:Try to write 29360128 2023-05-24T03:31:44.648 INFO:tasks.workunit.client.0.smithi146.stderr:+ return 1 2023-05-24T03:31:44.649 INFO:tasks.workunit.client.0.smithi146.stderr:+ return 0 2023-05-24T03:31:44.649 INFO:tasks.workunit.client.0.smithi146.stderr:+ expect_false write_file bytes/files/4 1000 2023-05-24T03:31:44.649 INFO:tasks.workunit.client.0.smithi146.stderr:+ set -x 2023-05-24T03:31:44.649 INFO:tasks.workunit.client.0.smithi146.stderr:+ write_file bytes/files/4 1000 2023-05-24T03:31:44.649 INFO:tasks.workunit.client.0.smithi146.stderr:+ set +x 2023-05-24T03:31:44.650 INFO:tasks.workunit.client.0.smithi146.stdout:Try to write 1048576 2023-05-24T03:31:44.651 INFO:tasks.workunit.client.0.smithi146.stderr:+ return 1 2023-05-24T03:31:44.651 INFO:tasks.workunit.client.0.smithi146.stderr:+ return 0 2023-05-24T03:31:44.651 INFO:tasks.workunit.client.0.smithi146.stderr:+ expect_false write_file bytes/files/5 1000 2023-05-24T03:31:44.651 INFO:tasks.workunit.client.0.smithi146.stderr:+ set -x 2023-05-24T03:31:44.651 INFO:tasks.workunit.client.0.smithi146.stderr:+ write_file bytes/files/5 1000 2023-05-24T03:31:44.651 INFO:tasks.workunit.client.0.smithi146.stderr:+ set +x 2023-05-24T03:31:44.652 INFO:tasks.workunit.client.0.smithi146.stdout:Try to write 1048576 2023-05-24T03:31:44.652 INFO:tasks.workunit.client.0.smithi146.stderr:+ return 1 2023-05-24T03:31:44.652 INFO:tasks.workunit.client.0.smithi146.stderr:+ return 0 2023-05-24T03:31:44.653 INFO:tasks.workunit.client.0.smithi146.stderr:+ stat '--printf=%n %s\n' bytes/files/1 2023-05-24T03:31:44.653 INFO:tasks.workunit.client.0.smithi146.stdout:bytes/files/1 4194304 2023-05-24T03:31:44.653 INFO:tasks.workunit.client.0.smithi146.stderr:+ stat '--printf=%n %s\n' bytes/files/2 2023-05-24T03:31:44.654 INFO:tasks.workunit.client.0.smithi146.stdout:bytes/files/2 4194304 2023-05-24T03:31:44.654 INFO:tasks.workunit.client.0.smithi146.stderr:+ stat '--printf=%n %s\n' bytes/files/3 2023-05-24T03:31:44.654 INFO:tasks.workunit.client.0.smithi146.stdout:bytes/files/3 28311552 2023-05-24T03:31:44.654 INFO:tasks.workunit.client.0.smithi146.stderr:+ stat '--printf=%n %s\n' bytes/files/4 2023-05-24T03:31:44.655 INFO:tasks.workunit.client.0.smithi146.stdout:bytes/files/4 0 2023-05-24T03:31:44.656 INFO:tasks.workunit.client.0.smithi146.stderr:+ expect_false stat bytes/files/5 2023-05-24T03:31:44.656 INFO:tasks.workunit.client.0.smithi146.stderr:+ set -x 2023-05-24T03:31:44.656 INFO:tasks.workunit.client.0.smithi146.stderr:+ stat bytes/files/5 2023-05-24T03:31:44.656 INFO:tasks.workunit.client.0.smithi146.stderr:stat: cannot statx 'bytes/files/5': No such file or directory 2023-05-24T03:31:44.656 INFO:tasks.workunit.client.0.smithi146.stderr:+ return 0 2023-05-24T03:31:44.656 INFO:tasks.workunit.client.0.smithi146.stderr:+ rm -rf bytes 2023-05-24T03:31:44.672 INFO:tasks.workunit.client.0.smithi146.stderr:+ mkdir files limit 2023-05-24T03:31:44.674 INFO:tasks.workunit.client.0.smithi146.stderr:+ truncate files/file -s 10G 2023-05-24T03:31:44.696 INFO:tasks.workunit.client.0.smithi146.stderr:+ setfattr limit -n ceph.quota.max_bytes -v 1M 2023-05-24T03:31:44.699 INFO:tasks.workunit.client.0.smithi146.stderr:+ expect_false mv files limit/ 2023-05-24T03:31:44.699 INFO:tasks.workunit.client.0.smithi146.stderr:+ set -x 2023-05-24T03:31:44.700 INFO:tasks.workunit.client.0.smithi146.stderr:+ mv files limit/ 2023-05-24T03:31:44.704 INFO:tasks.workunit.client.0.smithi146.stderr:mv: error writing 'limit/files/file': Disk quota exceeded 2023-05-24T03:31:44.709 INFO:tasks.workunit.client.0.smithi146.stderr:+ return 0 2023-05-24T03:31:44.710 INFO:tasks.workunit.client.0.smithi146.stderr:+ rm -rf files limit 2023-05-24T03:31:44.730 INFO:tasks.workunit.client.0.smithi146.stderr:+ mkdir -p ancestor/p1/p2/parent/p3 2023-05-24T03:31:44.734 INFO:tasks.workunit.client.0.smithi146.stderr:+ setfattr ancestor -n ceph.quota.max_bytes -v 1M 2023-05-24T03:31:44.741 INFO:tasks.workunit.client.0.smithi146.stderr:+ setfattr ancestor/p1/p2/parent -n ceph.quota.max_bytes -v 1G 2023-05-24T03:31:44.744 INFO:tasks.workunit.client.0.smithi146.stderr:+ expect_false write_file ancestor/p1/p2/parent/p3/file1 900 2023-05-24T03:31:44.744 INFO:tasks.workunit.client.0.smithi146.stderr:+ set -x 2023-05-24T03:31:44.745 INFO:tasks.workunit.client.0.smithi146.stderr:+ write_file ancestor/p1/p2/parent/p3/file1 900 2023-05-24T03:31:44.745 INFO:tasks.workunit.client.0.smithi146.stderr:+ set +x 2023-05-24T03:31:45.211 INFO:tasks.workunit.client.3.smithi151.stdout:Try to write 26214400 2023-05-24T03:31:45.211 INFO:tasks.workunit.client.3.smithi151.stderr:+ return 1 2023-05-24T03:31:45.212 INFO:tasks.workunit.client.3.smithi151.stderr:+ return 0 2023-05-24T03:31:45.212 INFO:tasks.workunit.client.3.smithi151.stderr:+ expect_false write_file bytes/files/4 1000 2023-05-24T03:31:45.212 INFO:tasks.workunit.client.3.smithi151.stderr:+ set -x 2023-05-24T03:31:45.212 INFO:tasks.workunit.client.3.smithi151.stderr:+ write_file bytes/files/4 1000 2023-05-24T03:31:45.212 INFO:tasks.workunit.client.1.smithi151.stdout:Try to write 26214400 2023-05-24T03:31:45.213 INFO:tasks.workunit.client.1.smithi151.stderr:+ return 1 2023-05-24T03:31:45.213 INFO:tasks.workunit.client.3.smithi151.stderr:+ set +x 2023-05-24T03:31:45.214 INFO:tasks.workunit.client.1.smithi151.stderr:+ return 0 2023-05-24T03:31:45.214 INFO:tasks.workunit.client.1.smithi151.stderr:+ expect_false write_file bytes/files/4 1000 2023-05-24T03:31:45.214 INFO:tasks.workunit.client.1.smithi151.stderr:+ set -x 2023-05-24T03:31:45.214 INFO:tasks.workunit.client.1.smithi151.stderr:+ write_file bytes/files/4 1000 2023-05-24T03:31:45.214 INFO:tasks.workunit.client.1.smithi151.stderr:+ set +x 2023-05-24T03:31:45.214 INFO:tasks.workunit.client.3.smithi151.stdout:Try to write 1048576 2023-05-24T03:31:45.215 INFO:tasks.workunit.client.3.smithi151.stderr:+ return 1 2023-05-24T03:31:45.215 INFO:tasks.workunit.client.3.smithi151.stderr:+ return 0 2023-05-24T03:31:45.215 INFO:tasks.workunit.client.3.smithi151.stderr:+ expect_false write_file bytes/files/5 1000 2023-05-24T03:31:45.216 INFO:tasks.workunit.client.3.smithi151.stderr:+ set -x 2023-05-24T03:31:45.216 INFO:tasks.workunit.client.3.smithi151.stderr:+ write_file bytes/files/5 1000 2023-05-24T03:31:45.216 INFO:tasks.workunit.client.3.smithi151.stderr:+ set +x 2023-05-24T03:31:45.216 INFO:tasks.workunit.client.1.smithi151.stdout:Try to write 1048576 2023-05-24T03:31:45.217 INFO:tasks.workunit.client.1.smithi151.stderr:+ return 1 2023-05-24T03:31:45.217 INFO:tasks.workunit.client.1.smithi151.stderr:+ return 0 2023-05-24T03:31:45.217 INFO:tasks.workunit.client.1.smithi151.stderr:+ expect_false write_file bytes/files/5 1000 2023-05-24T03:31:45.217 INFO:tasks.workunit.client.1.smithi151.stderr:+ set -x 2023-05-24T03:31:45.217 INFO:tasks.workunit.client.1.smithi151.stderr:+ write_file bytes/files/5 1000 2023-05-24T03:31:45.218 INFO:tasks.workunit.client.1.smithi151.stderr:+ set +x 2023-05-24T03:31:45.218 INFO:tasks.workunit.client.3.smithi151.stdout:Try to write 1048576 2023-05-24T03:31:45.218 INFO:tasks.workunit.client.3.smithi151.stderr:+ return 1 2023-05-24T03:31:45.219 INFO:tasks.workunit.client.3.smithi151.stderr:+ return 0 2023-05-24T03:31:45.219 INFO:tasks.workunit.client.3.smithi151.stderr:+ stat '--printf=%n %s\n' bytes/files/1 2023-05-24T03:31:45.219 INFO:tasks.workunit.client.1.smithi151.stdout:Try to write 1048576 2023-05-24T03:31:45.219 INFO:tasks.workunit.client.1.smithi151.stderr:+ return 1 2023-05-24T03:31:45.220 INFO:tasks.workunit.client.1.smithi151.stderr:+ return 0 2023-05-24T03:31:45.220 INFO:tasks.workunit.client.1.smithi151.stderr:+ stat '--printf=%n %s\n' bytes/files/1 2023-05-24T03:31:45.220 INFO:tasks.workunit.client.3.smithi151.stdout:bytes/files/1 4194304 2023-05-24T03:31:45.221 INFO:tasks.workunit.client.3.smithi151.stderr:+ stat '--printf=%n %s\n' bytes/files/2 2023-05-24T03:31:45.221 INFO:tasks.workunit.client.1.smithi151.stdout:bytes/files/1 4194304 2023-05-24T03:31:45.221 INFO:tasks.workunit.client.1.smithi151.stderr:+ stat '--printf=%n %s\n' bytes/files/2 2023-05-24T03:31:45.222 INFO:tasks.workunit.client.3.smithi151.stdout:bytes/files/2 4194304 2023-05-24T03:31:45.222 INFO:tasks.workunit.client.3.smithi151.stderr:+ stat '--printf=%n %s\n' bytes/files/3 2023-05-24T03:31:45.222 INFO:tasks.workunit.client.1.smithi151.stdout:bytes/files/2 4194304 2023-05-24T03:31:45.222 INFO:tasks.workunit.client.1.smithi151.stderr:+ stat '--printf=%n %s\n' bytes/files/3 2023-05-24T03:31:45.223 INFO:tasks.workunit.client.3.smithi151.stdout:bytes/files/3 25165824 2023-05-24T03:31:45.223 INFO:tasks.workunit.client.3.smithi151.stderr:+ stat '--printf=%n %s\n' bytes/files/4 2023-05-24T03:31:45.223 INFO:tasks.workunit.client.1.smithi151.stdout:bytes/files/3 25165824 2023-05-24T03:31:45.224 INFO:tasks.workunit.client.1.smithi151.stderr:+ stat '--printf=%n %s\n' bytes/files/4 2023-05-24T03:31:45.224 INFO:tasks.workunit.client.3.smithi151.stdout:bytes/files/4 0 2023-05-24T03:31:45.225 INFO:tasks.workunit.client.3.smithi151.stderr:+ expect_false stat bytes/files/5 2023-05-24T03:31:45.225 INFO:tasks.workunit.client.3.smithi151.stderr:+ set -x 2023-05-24T03:31:45.225 INFO:tasks.workunit.client.3.smithi151.stderr:+ stat bytes/files/5 2023-05-24T03:31:45.225 INFO:tasks.workunit.client.1.smithi151.stdout:bytes/files/4 0 2023-05-24T03:31:45.226 INFO:tasks.workunit.client.1.smithi151.stderr:+ expect_false stat bytes/files/5 2023-05-24T03:31:45.226 INFO:tasks.workunit.client.1.smithi151.stderr:+ set -x 2023-05-24T03:31:45.226 INFO:tasks.workunit.client.1.smithi151.stderr:+ stat bytes/files/5 2023-05-24T03:31:45.226 INFO:tasks.workunit.client.3.smithi151.stderr:stat: cannot statx 'bytes/files/5': No such file or directory 2023-05-24T03:31:45.227 INFO:tasks.workunit.client.3.smithi151.stderr:+ return 0 2023-05-24T03:31:45.227 INFO:tasks.workunit.client.1.smithi151.stderr:stat: cannot statx 'bytes/files/5': No such file or directory 2023-05-24T03:31:45.227 INFO:tasks.workunit.client.1.smithi151.stderr:+ return 0 2023-05-24T03:31:45.228 INFO:tasks.workunit.client.1.smithi151.stderr:+ rm -rf bytes 2023-05-24T03:31:45.228 INFO:tasks.workunit.client.3.smithi151.stderr:+ rm -rf bytes 2023-05-24T03:31:45.242 INFO:tasks.workunit.client.2.smithi146.stdout:Try to write 158334976 2023-05-24T03:31:45.242 INFO:tasks.workunit.client.2.smithi146.stderr:+ return 1 2023-05-24T03:31:45.243 INFO:tasks.workunit.client.2.smithi146.stderr:+ return 0 2023-05-24T03:31:45.243 INFO:tasks.workunit.client.2.smithi146.stderr:+ expect_false write_file second 10 2023-05-24T03:31:45.243 INFO:tasks.workunit.client.2.smithi146.stderr:+ set -x 2023-05-24T03:31:45.243 INFO:tasks.workunit.client.2.smithi146.stderr:+ write_file second 10 2023-05-24T03:31:45.243 INFO:tasks.workunit.client.2.smithi146.stderr:+ set +x 2023-05-24T03:31:45.244 INFO:tasks.workunit.client.2.smithi146.stdout:Try to write 1048576 2023-05-24T03:31:45.245 INFO:tasks.workunit.client.2.smithi146.stderr:+ return 1 2023-05-24T03:31:45.245 INFO:tasks.workunit.client.2.smithi146.stderr:+ return 0 2023-05-24T03:31:45.245 INFO:tasks.workunit.client.2.smithi146.stderr:+ setfattr . -n ceph.quota.max_bytes -v 0 2023-05-24T03:31:45.246 INFO:tasks.workunit.client.1.smithi151.stderr:+ mkdir files limit 2023-05-24T03:31:45.247 INFO:tasks.workunit.client.3.smithi151.stderr:+ mkdir files limit 2023-05-24T03:31:45.250 INFO:tasks.workunit.client.1.smithi151.stderr:+ truncate files/file -s 10G 2023-05-24T03:31:45.250 INFO:tasks.workunit.client.3.smithi151.stderr:+ truncate files/file -s 10G 2023-05-24T03:31:45.252 INFO:tasks.workunit.client.2.smithi146.stderr:+ dd if=/dev/zero of=third bs=1M count=10 2023-05-24T03:31:45.260 INFO:tasks.workunit.client.3.smithi151.stderr:+ setfattr limit -n ceph.quota.max_bytes -v 1M 2023-05-24T03:31:45.260 INFO:tasks.workunit.client.1.smithi151.stderr:+ setfattr limit -n ceph.quota.max_bytes -v 1M 2023-05-24T03:31:45.261 INFO:tasks.workunit.client.2.smithi146.stderr:10+0 records in 2023-05-24T03:31:45.261 INFO:tasks.workunit.client.2.smithi146.stderr:10+0 records out 2023-05-24T03:31:45.261 INFO:tasks.workunit.client.2.smithi146.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0071706 s, 1.5 GB/s 2023-05-24T03:31:45.261 INFO:tasks.workunit.client.2.smithi146.stderr:+ dd if=/dev/zero of=big2 bs=1M count=100 2023-05-24T03:31:45.264 INFO:tasks.workunit.client.3.smithi151.stderr:+ expect_false mv files limit/ 2023-05-24T03:31:45.265 INFO:tasks.workunit.client.3.smithi151.stderr:+ set -x 2023-05-24T03:31:45.265 INFO:tasks.workunit.client.3.smithi151.stderr:+ mv files limit/ 2023-05-24T03:31:45.266 INFO:tasks.workunit.client.1.smithi151.stderr:+ expect_false mv files limit/ 2023-05-24T03:31:45.266 INFO:tasks.workunit.client.1.smithi151.stderr:+ set -x 2023-05-24T03:31:45.267 INFO:tasks.workunit.client.1.smithi151.stderr:+ mv files limit/ 2023-05-24T03:31:45.272 INFO:tasks.workunit.client.3.smithi151.stderr:mv: error writing 'limit/files/file': Disk quota exceeded 2023-05-24T03:31:45.274 INFO:tasks.workunit.client.1.smithi151.stderr:mv: error writing 'limit/files/file': Disk quota exceeded 2023-05-24T03:31:45.279 INFO:tasks.workunit.client.3.smithi151.stderr:+ return 0 2023-05-24T03:31:45.280 INFO:tasks.workunit.client.1.smithi151.stderr:+ return 0 2023-05-24T03:31:45.280 INFO:tasks.workunit.client.3.smithi151.stderr:+ rm -rf files limit 2023-05-24T03:31:45.281 INFO:tasks.workunit.client.1.smithi151.stderr:+ rm -rf files limit 2023-05-24T03:31:45.315 INFO:tasks.workunit.client.1.smithi151.stderr:+ mkdir -p ancestor/p1/p2/parent/p3 2023-05-24T03:31:45.318 INFO:tasks.workunit.client.2.smithi146.stderr:100+0 records in 2023-05-24T03:31:45.318 INFO:tasks.workunit.client.2.smithi146.stderr:100+0 records out 2023-05-24T03:31:45.318 INFO:tasks.workunit.client.2.smithi146.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0545626 s, 1.9 GB/s 2023-05-24T03:31:45.319 INFO:tasks.workunit.client.3.smithi151.stderr:+ mkdir -p ancestor/p1/p2/parent/p3 2023-05-24T03:31:45.321 INFO:tasks.workunit.client.2.smithi146.stderr:+ rm -rf big big2 second third 2023-05-24T03:31:45.330 INFO:tasks.workunit.client.2.smithi146.stderr:+ setfattr . -n ceph.quota.max_files -v 5 2023-05-24T03:31:45.331 INFO:tasks.workunit.client.1.smithi151.stderr:+ setfattr ancestor -n ceph.quota.max_bytes -v 1M 2023-05-24T03:31:45.333 INFO:tasks.workunit.client.3.smithi151.stderr:+ setfattr ancestor -n ceph.quota.max_bytes -v 1M 2023-05-24T03:31:45.341 INFO:tasks.workunit.client.2.smithi146.stderr:+ mkdir ok 2023-05-24T03:31:45.344 INFO:tasks.workunit.client.2.smithi146.stderr:+ touch ok/1 2023-05-24T03:31:45.344 INFO:tasks.workunit.client.1.smithi151.stderr:+ setfattr ancestor/p1/p2/parent -n ceph.quota.max_bytes -v 1G 2023-05-24T03:31:45.345 INFO:tasks.workunit.client.3.smithi151.stderr:+ setfattr ancestor/p1/p2/parent -n ceph.quota.max_bytes -v 1G 2023-05-24T03:31:45.345 INFO:tasks.workunit.client.2.smithi146.stderr:+ touch ok/2 2023-05-24T03:31:45.347 INFO:tasks.workunit.client.2.smithi146.stderr:+ touch 3 2023-05-24T03:31:45.348 INFO:tasks.workunit.client.2.smithi146.stderr:+ expect_false touch shouldbefail 2023-05-24T03:31:45.349 INFO:tasks.workunit.client.2.smithi146.stderr:+ set -x 2023-05-24T03:31:45.349 INFO:tasks.workunit.client.2.smithi146.stderr:+ touch shouldbefail 2023-05-24T03:31:45.350 INFO:tasks.workunit.client.2.smithi146.stderr:touch: cannot touch 'shouldbefail': Disk quota exceeded 2023-05-24T03:31:45.350 INFO:tasks.workunit.client.2.smithi146.stderr:+ return 0 2023-05-24T03:31:45.350 INFO:tasks.workunit.client.2.smithi146.stderr:+ expect_false touch ok/shouldbefail 2023-05-24T03:31:45.350 INFO:tasks.workunit.client.2.smithi146.stderr:+ set -x 2023-05-24T03:31:45.351 INFO:tasks.workunit.client.2.smithi146.stderr:+ touch ok/shouldbefail 2023-05-24T03:31:45.351 INFO:tasks.workunit.client.2.smithi146.stderr:touch: cannot touch 'ok/shouldbefail': Disk quota exceeded 2023-05-24T03:31:45.351 INFO:tasks.workunit.client.2.smithi146.stderr:+ return 0 2023-05-24T03:31:45.351 INFO:tasks.workunit.client.2.smithi146.stderr:+ setfattr . -n ceph.quota.max_files -v 0 2023-05-24T03:31:45.352 INFO:tasks.workunit.client.1.smithi151.stderr:+ expect_false write_file ancestor/p1/p2/parent/p3/file1 900 2023-05-24T03:31:45.352 INFO:tasks.workunit.client.1.smithi151.stderr:+ set -x 2023-05-24T03:31:45.353 INFO:tasks.workunit.client.1.smithi151.stderr:+ write_file ancestor/p1/p2/parent/p3/file1 900 2023-05-24T03:31:45.353 INFO:tasks.workunit.client.1.smithi151.stderr:+ set +x 2023-05-24T03:31:45.353 INFO:tasks.workunit.client.3.smithi151.stderr:+ expect_false write_file ancestor/p1/p2/parent/p3/file1 900 2023-05-24T03:31:45.353 INFO:tasks.workunit.client.3.smithi151.stderr:+ set -x 2023-05-24T03:31:45.354 INFO:tasks.workunit.client.3.smithi151.stderr:+ write_file ancestor/p1/p2/parent/p3/file1 900 2023-05-24T03:31:45.354 INFO:tasks.workunit.client.3.smithi151.stderr:+ set +x 2023-05-24T03:31:45.356 INFO:tasks.workunit.client.2.smithi146.stderr:+ touch shouldbecreated 2023-05-24T03:31:45.357 INFO:tasks.workunit.client.2.smithi146.stderr:+ touch shouldbecreated2 2023-05-24T03:31:45.362 INFO:tasks.workunit.client.2.smithi146.stderr:+ rm -rf 3 ok shouldbecreated shouldbecreated2 2023-05-24T03:31:45.374 INFO:tasks.workunit.client.2.smithi146.stderr:+ mkdir bytes bytes/files 2023-05-24T03:31:45.376 INFO:tasks.workunit.client.2.smithi146.stderr:+ setfattr bytes -n ceph.quota.max_bytes -v 10M 2023-05-24T03:31:45.386 INFO:tasks.workunit.client.2.smithi146.stderr:+ setfattr bytes/files -n ceph.quota.max_files -v 5 2023-05-24T03:31:45.389 INFO:tasks.workunit.client.2.smithi146.stderr:+ dd if=/dev/zero of=bytes/files/1 bs=1M count=4 2023-05-24T03:31:45.391 INFO:tasks.workunit.client.2.smithi146.stderr:4+0 records in 2023-05-24T03:31:45.392 INFO:tasks.workunit.client.2.smithi146.stderr:4+0 records out 2023-05-24T03:31:45.392 INFO:tasks.workunit.client.2.smithi146.stderr:4194304 bytes (4.2 MB, 4.0 MiB) copied, 0.00145402 s, 2.9 GB/s 2023-05-24T03:31:45.392 INFO:tasks.workunit.client.2.smithi146.stderr:+ dd if=/dev/zero of=bytes/files/2 bs=1M count=4 2023-05-24T03:31:45.395 INFO:tasks.workunit.client.2.smithi146.stderr:4+0 records in 2023-05-24T03:31:45.395 INFO:tasks.workunit.client.2.smithi146.stderr:4+0 records out 2023-05-24T03:31:45.396 INFO:tasks.workunit.client.2.smithi146.stderr:4194304 bytes (4.2 MB, 4.0 MiB) copied, 0.00147199 s, 2.8 GB/s 2023-05-24T03:31:45.396 INFO:tasks.workunit.client.2.smithi146.stderr:+ expect_false write_file bytes/files/3 1000 2023-05-24T03:31:45.396 INFO:tasks.workunit.client.2.smithi146.stderr:+ set -x 2023-05-24T03:31:45.396 INFO:tasks.workunit.client.2.smithi146.stderr:+ write_file bytes/files/3 1000 2023-05-24T03:31:45.396 INFO:tasks.workunit.client.2.smithi146.stderr:+ set +x 2023-05-24T03:31:45.998 INFO:tasks.workunit.client.0.smithi146.stdout:Try to write 26214400 2023-05-24T03:31:45.998 INFO:tasks.workunit.client.0.smithi146.stderr:+ return 1 2023-05-24T03:31:45.999 INFO:tasks.workunit.client.0.smithi146.stderr:+ return 0 2023-05-24T03:31:45.999 INFO:tasks.workunit.client.0.smithi146.stderr:+ stat '--printf=%n %s\n' ancestor/p1/p2/parent/p3/file1 2023-05-24T03:31:45.999 INFO:tasks.workunit.client.0.smithi146.stdout:ancestor/p1/p2/parent/p3/file1 25165824 2023-05-24T03:31:45.999 INFO:tasks.workunit.client.0.smithi146.stderr:+ setfattr -n ceph.quota.max_bytes -v 0 . 2023-05-24T03:31:46.000 INFO:tasks.workunit.client.0.smithi146.stderr:+ setfattr -n ceph.quota.max_bytes -v 1 . 2023-05-24T03:31:46.001 INFO:tasks.workunit.client.0.smithi146.stderr:setfattr: .: Invalid argument 2023-05-24T03:31:46.001 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-24T03:31:46.002 INFO:tasks.workunit:Stopping ['fs/quota'] on client.0... 2023-05-24T03:31:46.002 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-05-24T03:31:46.246 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c6e0984e7e7716eedf6039f15c6a9d1043e0c5f2/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_c6e0984e7e7716eedf6039f15c6a9d1043e0c5f2/teuthology/run_tasks.py", line 84, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph-c_fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_c6e0984e7e7716eedf6039f15c6a9d1043e0c5f2/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_c6e0984e7e7716eedf6039f15c6a9d1043e0c5f2/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_c6e0984e7e7716eedf6039f15c6a9d1043e0c5f2/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_c6e0984e7e7716eedf6039f15c6a9d1043e0c5f2/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_c6e0984e7e7716eedf6039f15c6a9d1043e0c5f2/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_c6e0984e7e7716eedf6039f15c6a9d1043e0c5f2/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_c6e0984e7e7716eedf6039f15c6a9d1043e0c5f2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_c6e0984e7e7716eedf6039f15c6a9d1043e0c5f2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test fs/quota/quota.sh) on smithi146 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fa0e62c4a1d8e4a737d9cbe50224f70009b79b28 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/quota/quota.sh' 2023-05-24T03:31:46.800 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=97380c88b43d4f2e8a0b59a016aa9727 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c6e0984e7e7716eedf6039f15c6a9d1043e0c5f2/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_c6e0984e7e7716eedf6039f15c6a9d1043e0c5f2/teuthology/run_tasks.py", line 84, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph-c_fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_c6e0984e7e7716eedf6039f15c6a9d1043e0c5f2/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_c6e0984e7e7716eedf6039f15c6a9d1043e0c5f2/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_c6e0984e7e7716eedf6039f15c6a9d1043e0c5f2/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_c6e0984e7e7716eedf6039f15c6a9d1043e0c5f2/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_fa0e62c4a1d8e4a737d9cbe50224f70009b79b28/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_c6e0984e7e7716eedf6039f15c6a9d1043e0c5f2/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_c6e0984e7e7716eedf6039f15c6a9d1043e0c5f2/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_c6e0984e7e7716eedf6039f15c6a9d1043e0c5f2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_c6e0984e7e7716eedf6039f15c6a9d1043e0c5f2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test fs/quota/quota.sh) on smithi146 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fa0e62c4a1d8e4a737d9cbe50224f70009b79b28 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/quota/quota.sh' 2023-05-24T03:31:46.803 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-05-24T03:31:46.815 INFO:tasks.kclient:Unmounting kernel clients... 2023-05-24T03:31:46.815 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-05-24T03:31:46.815 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-24T03:31:46.820 INFO:tasks.workunit.client.3.smithi151.stdout:Try to write 26214400 2023-05-24T03:31:46.821 INFO:tasks.workunit.client.2.smithi146.stdout:Try to write 26214400 2023-05-24T03:31:46.821 INFO:tasks.workunit.client.3.smithi151.stderr:+ return 1 2023-05-24T03:31:46.821 INFO:tasks.workunit.client.3.smithi151.stderr:+ return 0 2023-05-24T03:31:46.822 INFO:tasks.workunit.client.1.smithi151.stdout:Try to write 26214400 2023-05-24T03:31:46.823 INFO:tasks.workunit.client.2.smithi146.stderr:+ return 1 2023-05-24T03:31:46.823 INFO:tasks.workunit.client.2.smithi146.stderr:+ return 0 2023-05-24T03:31:46.823 INFO:tasks.workunit.client.2.smithi146.stderr:+ expect_false write_file bytes/files/4 1000 2023-05-24T03:31:46.823 INFO:tasks.workunit.client.2.smithi146.stderr:+ set -x 2023-05-24T03:31:46.823 INFO:tasks.workunit.client.2.smithi146.stderr:+ write_file bytes/files/4 1000 2023-05-24T03:31:46.824 INFO:tasks.workunit.client.2.smithi146.stderr:+ set +x 2023-05-24T03:31:46.824 INFO:tasks.workunit.client.3.smithi151.stderr:+ stat '--printf=%n %s\n' ancestor/p1/p2/parent/p3/file1 2023-05-24T03:31:46.824 INFO:tasks.workunit.client.2.smithi146.stdout:Try to write 1048576 2023-05-24T03:31:46.825 INFO:tasks.workunit.client.1.smithi151.stderr:+ return 1 2023-05-24T03:31:46.825 INFO:tasks.workunit.client.1.smithi151.stderr:+ return 0 2023-05-24T03:31:46.825 INFO:tasks.workunit.client.1.smithi151.stderr:+ stat '--printf=%n %s\n' ancestor/p1/p2/parent/p3/file1 2023-05-24T03:31:46.826 INFO:tasks.workunit.client.3.smithi151.stdout:ancestor/p1/p2/parent/p3/file1 25165824 2023-05-24T03:31:46.826 INFO:tasks.workunit.client.1.smithi151.stdout:ancestor/p1/p2/parent/p3/file1 25165824 2023-05-24T03:31:46.827 INFO:tasks.workunit.client.3.smithi151.stderr:+ setfattr -n ceph.quota.max_bytes -v 0 . 2023-05-24T03:31:46.835 INFO:tasks.workunit.client.1.smithi151.stderr:+ setfattr -n ceph.quota.max_bytes -v 0 . 2023-05-24T03:31:46.836 INFO:tasks.workunit.client.1.smithi151.stderr:+ setfattr -n ceph.quota.max_bytes -v 1 . 2023-05-24T03:31:46.836 INFO:tasks.workunit.client.2.smithi146.stderr:+ return 1 2023-05-24T03:31:46.837 INFO:tasks.workunit.client.2.smithi146.stderr:+ return 0 2023-05-24T03:31:46.837 INFO:tasks.workunit.client.2.smithi146.stderr:+ expect_false write_file bytes/files/5 1000 2023-05-24T03:31:46.837 INFO:tasks.workunit.client.2.smithi146.stderr:+ set -x 2023-05-24T03:31:46.837 INFO:tasks.workunit.client.2.smithi146.stderr:+ write_file bytes/files/5 1000 2023-05-24T03:31:46.837 INFO:tasks.workunit.client.2.smithi146.stderr:+ set +x 2023-05-24T03:31:46.838 INFO:tasks.workunit.client.3.smithi151.stderr:+ setfattr -n ceph.quota.max_bytes -v 1 . 2023-05-24T03:31:46.838 INFO:tasks.workunit.client.2.smithi146.stdout:Try to write 1048576 2023-05-24T03:31:46.839 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-24T03:31:46.840 INFO:tasks.workunit.client.2.smithi146.stderr:+ return 1 2023-05-24T03:31:46.840 INFO:tasks.workunit.client.2.smithi146.stderr:+ return 0 2023-05-24T03:31:46.841 INFO:tasks.workunit.client.2.smithi146.stderr:+ stat '--printf=%n %s\n' bytes/files/1 2023-05-24T03:31:46.842 INFO:tasks.workunit.client.2.smithi146.stdout:bytes/files/1 4194304 2023-05-24T03:31:46.842 INFO:tasks.workunit.client.1.smithi151.stderr:setfattr: .: Invalid argument 2023-05-24T03:31:46.843 INFO:tasks.workunit:Stopping ['fs/quota'] on client.1... 2023-05-24T03:31:46.844 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2023-05-24T03:31:46.846 INFO:tasks.workunit.client.2.smithi146.stderr:+ stat '--printf=%n %s\n' bytes/files/2 2023-05-24T03:31:46.848 INFO:tasks.workunit.client.2.smithi146.stdout:bytes/files/2 4194304 2023-05-24T03:31:46.849 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-24T03:31:46.850 INFO:tasks.workunit.client.2.smithi146.stderr:+ stat '--printf=%n %s\n' bytes/files/3 2023-05-24T03:31:46.850 INFO:tasks.workunit.client.3.smithi151.stderr:setfattr: .: Invalid argument 2023-05-24T03:31:46.851 INFO:tasks.workunit.client.2.smithi146.stdout:bytes/files/3 25165824 2023-05-24T03:31:46.851 INFO:tasks.workunit:Stopping ['fs/quota'] on client.3... 2023-05-24T03:31:46.852 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.3 /home/ubuntu/cephtest/clone.client.3 2023-05-24T03:31:46.852 INFO:tasks.workunit.client.2.smithi146.stderr:+ stat '--printf=%n %s\n' bytes/files/4 2023-05-24T03:31:46.853 INFO:tasks.workunit.client.2.smithi146.stdout:bytes/files/4 0 2023-05-24T03:31:46.856 INFO:tasks.workunit.client.2.smithi146.stderr:+ expect_false stat bytes/files/5 2023-05-24T03:31:46.856 INFO:tasks.workunit.client.2.smithi146.stderr:+ set -x 2023-05-24T03:31:46.857 INFO:tasks.workunit.client.2.smithi146.stderr:+ stat bytes/files/5 2023-05-24T03:31:46.857 INFO:tasks.workunit.client.2.smithi146.stderr:stat: cannot statx 'bytes/files/5': No such file or directory 2023-05-24T03:31:46.858 INFO:tasks.workunit.client.2.smithi146.stderr:+ return 0 2023-05-24T03:31:46.858 INFO:tasks.workunit.client.2.smithi146.stderr:+ rm -rf bytes 2023-05-24T03:31:46.858 INFO:tasks.workunit.client.2.smithi146.stderr:+ mkdir files limit 2023-05-24T03:31:46.858 INFO:tasks.workunit.client.2.smithi146.stderr:+ truncate files/file -s 10G 2023-05-24T03:31:46.858 INFO:tasks.workunit.client.2.smithi146.stderr:+ setfattr limit -n ceph.quota.max_bytes -v 1M 2023-05-24T03:31:46.859 INFO:tasks.workunit.client.2.smithi146.stderr:+ expect_false mv files limit/ 2023-05-24T03:31:46.859 INFO:tasks.workunit.client.2.smithi146.stderr:+ set -x 2023-05-24T03:31:46.859 INFO:tasks.workunit.client.2.smithi146.stderr:+ mv files limit/ 2023-05-24T03:31:46.859 INFO:tasks.workunit.client.2.smithi146.stderr:mv: error writing 'limit/files/file': Disk quota exceeded 2023-05-24T03:31:46.859 INFO:tasks.workunit.client.2.smithi146.stderr:+ return 0 2023-05-24T03:31:46.860 INFO:tasks.workunit.client.2.smithi146.stderr:+ rm -rf files limit 2023-05-24T03:31:46.860 INFO:tasks.workunit.client.2.smithi146.stderr:+ mkdir -p ancestor/p1/p2/parent/p3 2023-05-24T03:31:46.860 INFO:tasks.workunit.client.2.smithi146.stderr:+ setfattr ancestor -n ceph.quota.max_bytes -v 1M 2023-05-24T03:31:46.860 INFO:tasks.workunit.client.2.smithi146.stderr:+ setfattr ancestor/p1/p2/parent -n ceph.quota.max_bytes -v 1G 2023-05-24T03:31:46.860 INFO:tasks.workunit.client.2.smithi146.stderr:+ expect_false write_file ancestor/p1/p2/parent/p3/file1 900 2023-05-24T03:31:46.861 INFO:tasks.workunit.client.2.smithi146.stderr:+ set -x 2023-05-24T03:31:46.861 INFO:tasks.workunit.client.2.smithi146.stderr:+ write_file ancestor/p1/p2/parent/p3/file1 900 2023-05-24T03:31:46.861 INFO:tasks.workunit.client.2.smithi146.stderr:+ set +x 2023-05-24T03:31:46.878 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-05-24T03:31:46.878 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-24T03:31:46.936 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-24T03:31:47.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.094+0000 7f267aeff700 1 Processor -- start 2023-05-24T03:31:47.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.094+0000 7f267aeff700 1 -- start start 2023-05-24T03:31:47.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.095+0000 7f267aeff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f267415cf60 0x7f26740b2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:47.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.095+0000 7f267aeff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f26740d1850 0x7f26740cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:47.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.095+0000 7f267aeff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26740cd110 con 0x7f26740cda40 2023-05-24T03:31:47.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.095+0000 7f267aeff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26740b3240 con 0x7f267415cf60 2023-05-24T03:31:47.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.095+0000 7f267aeff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26740ce420 con 0x7f26740d1850 2023-05-24T03:31:47.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.095+0000 7f2678c9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f267415cf60 0x7f26740b2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:47.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.095+0000 7f2678c9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f267415cf60 0x7f26740b2d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40046/0 (socket says 172.21.15.146:40046) 2023-05-24T03:31:47.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.095+0000 7f2678c9b700 1 -- 172.21.15.146:0/3605937364 learned_addr learned my addr 172.21.15.146:0/3605937364 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:31:47.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.095+0000 7f267949c700 1 --2- 172.21.15.146:0/3605937364 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f26740d1850 0x7f26740cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:47.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.096+0000 7f2678c9b700 1 -- 172.21.15.146:0/3605937364 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f26740d1850 msgr2=0x7f26740cdee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:31:47.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.096+0000 7f2678c9b700 1 --2- 172.21.15.146:0/3605937364 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f26740d1850 0x7f26740cdee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:47.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.096+0000 7f2678c9b700 1 -- 172.21.15.146:0/3605937364 >> v1:172.21.15.151:6789/0 conn(0x7f26740cda40 legacy=0x7f2674160aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:47.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.096+0000 7f2678c9b700 1 -- 172.21.15.146:0/3605937364 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f267415d330 con 0x7f267415cf60 2023-05-24T03:31:47.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.096+0000 7f2678c9b700 1 --2- 172.21.15.146:0/3605937364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f267415cf60 0x7f26740b2d00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f26640098f0 tx=0x7f2664009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83e640d273bcc730 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:47.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.096+0000 7f26737fe700 1 -- 172.21.15.146:0/3605937364 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2664011830 con 0x7f267415cf60 2023-05-24T03:31:47.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.096+0000 7f26737fe700 1 -- 172.21.15.146:0/3605937364 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2664011990 con 0x7f267415cf60 2023-05-24T03:31:47.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.096+0000 7f26737fe700 1 -- 172.21.15.146:0/3605937364 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2664011d20 con 0x7f267415cf60 2023-05-24T03:31:47.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.096+0000 7f267aeff700 1 -- 172.21.15.146:0/3605937364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f267415cf60 msgr2=0x7f26740b2d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:47.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.096+0000 7f267aeff700 1 --2- 172.21.15.146:0/3605937364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f267415cf60 0x7f26740b2d00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f26640098f0 tx=0x7f2664009c00 comp rx=0 tx=0).stop 2023-05-24T03:31:47.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.096+0000 7f267aeff700 1 -- 172.21.15.146:0/3605937364 shutdown_connections 2023-05-24T03:31:47.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.096+0000 7f267aeff700 1 --2- 172.21.15.146:0/3605937364 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f26740d1850 0x7f26740cdee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:47.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.096+0000 7f267aeff700 1 --2- 172.21.15.146:0/3605937364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f267415cf60 0x7f26740b2d00 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:47.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.096+0000 7f267aeff700 1 -- 172.21.15.146:0/3605937364 >> 172.21.15.146:0/3605937364 conn(0x7f267406e2a0 msgr2=0x7f267406e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:31:47.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.097+0000 7f267aeff700 1 -- 172.21.15.146:0/3605937364 shutdown_connections 2023-05-24T03:31:47.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.097+0000 7f267aeff700 1 -- 172.21.15.146:0/3605937364 wait complete. 2023-05-24T03:31:47.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.098+0000 7f267aeff700 1 Processor -- start 2023-05-24T03:31:47.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.098+0000 7f267aeff700 1 -- start start 2023-05-24T03:31:47.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.099+0000 7f267aeff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f26740cda40 0x7f26741f2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:47.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.099+0000 7f267aeff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26740d1850 0x7f267415dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:47.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.099+0000 7f267aeff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f267415cf60 0x7f267415fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:47.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.099+0000 7f267aeff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26741f2aa0 con 0x7f26740d1850 2023-05-24T03:31:47.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.099+0000 7f267aeff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f267415f2d0 con 0x7f267415cf60 2023-05-24T03:31:47.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.099+0000 7f267aeff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f267415ea30 con 0x7f26740cda40 2023-05-24T03:31:47.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.099+0000 7f2673fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26740d1850 0x7f267415dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:47.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.099+0000 7f2678c9b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f26740cda40 0x7f26741f2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:47.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.099+0000 7f2673fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26740d1850 0x7f267415dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40054/0 (socket says 172.21.15.146:40054) 2023-05-24T03:31:47.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.099+0000 7f2673fff700 1 -- 172.21.15.146:0/3641028968 learned_addr learned my addr 172.21.15.146:0/3641028968 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:31:47.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.099+0000 7f267949c700 1 --2- 172.21.15.146:0/3641028968 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f267415cf60 0x7f267415fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:47.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.099+0000 7f2673fff700 1 -- 172.21.15.146:0/3641028968 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f26740cda40 msgr2=0x7f26741f2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:47.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.099+0000 7f2673fff700 1 --2- 172.21.15.146:0/3641028968 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f26740cda40 0x7f26741f2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:47.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.099+0000 7f2673fff700 1 -- 172.21.15.146:0/3641028968 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f267415cf60 msgr2=0x7f267415fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:47.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.099+0000 7f2673fff700 1 --2- 172.21.15.146:0/3641028968 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f267415cf60 0x7f267415fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:47.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.099+0000 7f2673fff700 1 -- 172.21.15.146:0/3641028968 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2664009550 con 0x7f26740d1850 2023-05-24T03:31:47.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.099+0000 7f2673fff700 1 --2- 172.21.15.146:0/3641028968 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26740d1850 0x7f267415dfe0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f265c00c4e0 tx=0x7f265c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:47.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.099+0000 7f26717fa700 1 -- 172.21.15.146:0/3641028968 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265c0052d0 con 0x7f26740d1850 2023-05-24T03:31:47.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.099+0000 7f26717fa700 1 -- 172.21.15.146:0/3641028968 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f265c005430 con 0x7f26740d1850 2023-05-24T03:31:47.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.099+0000 7f267aeff700 1 -- 172.21.15.146:0/3641028968 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f267406c120 con 0x7f26740d1850 2023-05-24T03:31:47.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.099+0000 7f26717fa700 1 -- 172.21.15.146:0/3641028968 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265c0038c0 con 0x7f26740d1850 2023-05-24T03:31:47.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.099+0000 7f267aeff700 1 -- 172.21.15.146:0/3641028968 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f267406d340 con 0x7f26740d1850 2023-05-24T03:31:47.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.100+0000 7f267aeff700 1 -- 172.21.15.146:0/3641028968 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f267406c400 con 0x7f26740d1850 2023-05-24T03:31:47.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.101+0000 7f26717fa700 1 -- 172.21.15.146:0/3641028968 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f265c003a20 con 0x7f26740d1850 2023-05-24T03:31:47.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.101+0000 7f26717fa700 1 --2- 172.21.15.146:0/3641028968 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f265406ace0 0x7f265406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:47.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.102+0000 7f26717fa700 1 -- 172.21.15.146:0/3641028968 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f265c088b50 con 0x7f26740d1850 2023-05-24T03:31:47.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.102+0000 7f2678c9b700 1 --2- 172.21.15.146:0/3641028968 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f265406ace0 0x7f265406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:47.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.102+0000 7f2678c9b700 1 --2- 172.21.15.146:0/3641028968 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f265406ace0 0x7f265406d190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2664014040 tx=0x7f2664008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:47.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.106+0000 7f26717fa700 1 -- 172.21.15.146:0/3641028968 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f265c0538d0 con 0x7f26740d1850 2023-05-24T03:31:47.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.303+0000 7f267aeff700 1 -- 172.21.15.146:0/3641028968 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f267404e810 con 0x7f26740d1850 2023-05-24T03:31:47.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.304+0000 7f26717fa700 1 -- 172.21.15.146:0/3641028968 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20251 (secure 0 0 0) 0x7f265c056ef0 con 0x7f26740d1850 2023-05-24T03:31:47.309 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:31:47.310 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":30,"fsid":"11ca0adb-7672-4713-bde7-451e8b743ae9","created":"2023-05-24T03:29:19.113659+0000","modified":"2023-05-24T03:30:25.932188+0000","last_up_change":"2023-05-24T03:29:30.962339+0000","last_in_change":"2023-05-24T03:29:21.706540+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-24T03:29:32.749984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-24T03:29:37.719623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-24T03:29:42.165379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-24T03:29:43.431615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-24T03:29:46.503075+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f24b319b-fcc8-4385-b0cb-78138fc31417","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6801","nonce":3353593100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6803","nonce":3353593100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6807","nonce":3353593100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6805","nonce":3353593100}]},"public_addr":"172.21.15.146:6801/3353593100","cluster_addr":"172.21.15.146:6803/3353593100","heartbeat_back_addr":"172.21.15.146:6807/3353593100","heartbeat_front_addr":"172.21.15.146:6805/3353593100","state":["exists","up"]},{"osd":1,"uuid":"c9639ea9-8f9b-498e-92c8-aa976edbf1da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6821","nonce":2537488734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6825","nonce":2537488734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6831","nonce":2537488734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6827","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6829","nonce":2537488734}]},"public_addr":"172.21.15.146:6821/2537488734","cluster_addr":"172.21.15.146:6825/2537488734","heartbeat_back_addr":"172.21.15.146:6831/2537488734","heartbeat_front_addr":"172.21.15.146:6829/2537488734","state":["exists","up"]},{"osd":2,"uuid":"7a6cfc6d-b0ca-4cb6-a66d-4001ec184657","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6809","nonce":1800242932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6811","nonce":1800242932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6815","nonce":1800242932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6813","nonce":1800242932}]},"public_addr":"172.21.15.146:6809/1800242932","cluster_addr":"172.21.15.146:6811/1800242932","heartbeat_back_addr":"172.21.15.146:6815/1800242932","heartbeat_front_addr":"172.21.15.146:6813/1800242932","state":["exists","up"]},{"osd":3,"uuid":"401509f7-cecd-44a2-b0ae-22c81a5d93c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6817","nonce":1749783580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6820","nonce":1749783580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6828","nonce":1749783580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6824","nonce":1749783580}]},"public_addr":"172.21.15.146:6817/1749783580","cluster_addr":"172.21.15.146:6820/1749783580","heartbeat_back_addr":"172.21.15.146:6828/1749783580","heartbeat_front_addr":"172.21.15.146:6824/1749783580","state":["exists","up"]},{"osd":4,"uuid":"9d07f440-d125-4f99-a825-411fab894d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6811","nonce":163453435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6814","nonce":163453435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6819","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6821","nonce":163453435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6818","nonce":163453435}]},"public_addr":"172.21.15.151:6811/163453435","cluster_addr":"172.21.15.151:6814/163453435","heartbeat_back_addr":"172.21.15.151:6821/163453435","heartbeat_front_addr":"172.21.15.151:6818/163453435","state":["exists","up"]},{"osd":5,"uuid":"9b2266e2-9e52-4f0e-96da-e703a6c23a6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6801","nonce":3283474903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6803","nonce":3283474903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6807","nonce":3283474903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6805","nonce":3283474903}]},"public_addr":"172.21.15.151:6801/3283474903","cluster_addr":"172.21.15.151:6803/3283474903","heartbeat_back_addr":"172.21.15.151:6807/3283474903","heartbeat_front_addr":"172.21.15.151:6805/3283474903","state":["exists","up"]},{"osd":6,"uuid":"5daedf77-0a83-49e7-b497-d9ed10436972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6825","nonce":3889424178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6827","nonce":3889424178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6831","nonce":3889424178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6829","nonce":3889424178}]},"public_addr":"172.21.15.151:6825/3889424178","cluster_addr":"172.21.15.151:6827/3889424178","heartbeat_back_addr":"172.21.15.151:6831/3889424178","heartbeat_front_addr":"172.21.15.151:6829/3889424178","state":["exists","up"]},{"osd":7,"uuid":"86ae4f7e-c01f-4c3d-a0dd-98160c209309","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6810","nonce":563291208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6815","nonce":563291208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6823","nonce":563291208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6820","nonce":563291208}]},"public_addr":"172.21.15.151:6810/563291208","cluster_addr":"172.21.15.151:6815/563291208","heartbeat_back_addr":"172.21.15.151:6823/563291208","heartbeat_front_addr":"172.21.15.151:6820/563291208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.872472+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.937126+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.877234+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.884793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.881632+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.938293+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.857661+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.945883+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.9","mappings":[{"from":1,"to":5}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-24T03:31:47.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.307+0000 7f267aeff700 1 -- 172.21.15.146:0/3641028968 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f265406ace0 msgr2=0x7f265406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:47.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.307+0000 7f267aeff700 1 --2- 172.21.15.146:0/3641028968 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f265406ace0 0x7f265406d190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2664014040 tx=0x7f2664008030 comp rx=0 tx=0).stop 2023-05-24T03:31:47.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.307+0000 7f267aeff700 1 -- 172.21.15.146:0/3641028968 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26740d1850 msgr2=0x7f267415dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:47.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.307+0000 7f267aeff700 1 --2- 172.21.15.146:0/3641028968 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26740d1850 0x7f267415dfe0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f265c00c4e0 tx=0x7f265c00c7f0 comp rx=0 tx=0).stop 2023-05-24T03:31:47.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.307+0000 7f267aeff700 1 -- 172.21.15.146:0/3641028968 shutdown_connections 2023-05-24T03:31:47.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.307+0000 7f267aeff700 1 --2- 172.21.15.146:0/3641028968 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f265406ace0 0x7f265406d190 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:47.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.307+0000 7f267aeff700 1 --2- 172.21.15.146:0/3641028968 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f267415cf60 0x7f267415fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:47.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.307+0000 7f267aeff700 1 --2- 172.21.15.146:0/3641028968 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f26740cda40 0x7f26741f2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:47.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.307+0000 7f267aeff700 1 --2- 172.21.15.146:0/3641028968 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26740d1850 0x7f267415dfe0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:47.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.307+0000 7f267aeff700 1 -- 172.21.15.146:0/3641028968 >> 172.21.15.146:0/3641028968 conn(0x7f267406e2a0 msgr2=0x7f267406b790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:31:47.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.307+0000 7f267aeff700 1 -- 172.21.15.146:0/3641028968 shutdown_connections 2023-05-24T03:31:47.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.307+0000 7f267aeff700 1 -- 172.21.15.146:0/3641028968 wait complete. 2023-05-24T03:31:47.324 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-24T03:29:32.749984+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-24T03:29:37.719623+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-24T03:29:42.165379+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-24T03:29:43.431615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-24T03:29:46.503075+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-24T03:31:47.325 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-24T03:31:47.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.447+0000 7fc411195700 1 Processor -- start 2023-05-24T03:31:47.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.447+0000 7fc411195700 1 -- start start 2023-05-24T03:31:47.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.447+0000 7fc411195700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc40c06a460 0x7fc40c0cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:47.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.448+0000 7fc411195700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc40c0cfd00 con 0x7fc40c15cd90 2023-05-24T03:31:47.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.448+0000 7fc411195700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc40c072350 con 0x7fc40c0aefd0 2023-05-24T03:31:47.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.448+0000 7fc411195700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc40c0cf460 con 0x7fc40c06a460 2023-05-24T03:31:47.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.448+0000 7fc40a59c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc40c15cd90 0x7fc40c06a830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46516/0 (socket says 172.21.15.146:46516) 2023-05-24T03:31:47.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.448+0000 7fc40a59c700 1 -- 172.21.15.146:0/471213747 learned_addr learned my addr 172.21.15.146:0/471213747 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:31:47.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.448+0000 7fc40ad9d700 1 --2- 172.21.15.146:0/471213747 >> v2:172.21.15.151:3300/0 conn(0x7fc40c06a460 0x7fc40c0cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:47.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.448+0000 7fc409d9b700 1 -- 172.21.15.146:0/471213747 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1503211797 0 0) 0x7fc400001110 con 0x7fc40c15cd90 2023-05-24T03:31:47.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.448+0000 7fc409d9b700 1 -- 172.21.15.146:0/471213747 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3f40035b0 con 0x7fc40c15cd90 2023-05-24T03:31:47.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.448+0000 7fc40ad9d700 1 -- 172.21.15.146:0/471213747 >> v1:172.21.15.151:6789/0 conn(0x7fc40c0aefd0 legacy=0x7fc40c160d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:47.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.448+0000 7fc40ad9d700 1 -- 172.21.15.146:0/471213747 >> v1:172.21.15.146:6789/0 conn(0x7fc40c15cd90 legacy=0x7fc40c06a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:47.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.448+0000 7fc40ad9d700 1 -- 172.21.15.146:0/471213747 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc40c0cf740 con 0x7fc40c06a460 2023-05-24T03:31:47.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.448+0000 7fc40ad9d700 1 --2- 172.21.15.146:0/471213747 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc40c06a460 0x7fc40c0cede0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc009840 tx=0x7fc3fc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e960d9718547b0d5 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:47.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.448+0000 7fc409d9b700 1 -- 172.21.15.146:0/471213747 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc011830 con 0x7fc40c06a460 2023-05-24T03:31:47.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.448+0000 7fc409d9b700 1 -- 172.21.15.146:0/471213747 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3fc011990 con 0x7fc40c06a460 2023-05-24T03:31:47.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.448+0000 7fc409d9b700 1 -- 172.21.15.146:0/471213747 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc011d20 con 0x7fc40c06a460 2023-05-24T03:31:47.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.449+0000 7fc411195700 1 -- 172.21.15.146:0/471213747 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc40c06a460 msgr2=0x7fc40c0cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:47.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.449+0000 7fc411195700 1 --2- 172.21.15.146:0/471213747 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc40c06a460 0x7fc40c0cede0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc009840 tx=0x7fc3fc009b50 comp rx=0 tx=0).stop 2023-05-24T03:31:47.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.449+0000 7fc411195700 1 -- 172.21.15.146:0/471213747 shutdown_connections 2023-05-24T03:31:47.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.449+0000 7fc411195700 1 --2- 172.21.15.146:0/471213747 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc40c06a460 0x7fc40c0cede0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:47.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.449+0000 7fc411195700 1 -- 172.21.15.146:0/471213747 >> 172.21.15.146:0/471213747 conn(0x7fc40c0cfea0 msgr2=0x7fc40c0d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:31:47.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.449+0000 7fc411195700 1 -- 172.21.15.146:0/471213747 shutdown_connections 2023-05-24T03:31:47.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.449+0000 7fc411195700 1 -- 172.21.15.146:0/471213747 wait complete. 2023-05-24T03:31:47.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.451+0000 7fc411195700 1 Processor -- start 2023-05-24T03:31:47.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.451+0000 7fc411195700 1 -- start start 2023-05-24T03:31:47.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.451+0000 7fc411195700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc40c06a460 0x7fc40c0af900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:47.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.451+0000 7fc411195700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc40c0aefd0 0x7fc40c071430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:47.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.451+0000 7fc411195700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc40c15cd90 0x7fc40c148d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:47.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.451+0000 7fc411195700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40c0b0130 con 0x7fc40c06a460 2023-05-24T03:31:47.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.451+0000 7fc411195700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40c0b1810 con 0x7fc40c15cd90 2023-05-24T03:31:47.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.451+0000 7fc411195700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc40c0b1af0 con 0x7fc40c0aefd0 2023-05-24T03:31:47.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.451+0000 7fc40ad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc40c06a460 0x7fc40c0af900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:47.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.451+0000 7fc40ad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc40c06a460 0x7fc40c0af900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40066/0 (socket says 172.21.15.146:40066) 2023-05-24T03:31:47.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.451+0000 7fc40ad9d700 1 -- 172.21.15.146:0/1269231425 learned_addr learned my addr 172.21.15.146:0/1269231425 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:31:47.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.452+0000 7fc40ad9d700 1 -- 172.21.15.146:0/1269231425 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc40c0aefd0 msgr2=0x7fc40c071430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:47.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.452+0000 7fc40a59c700 1 --2- 172.21.15.146:0/1269231425 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc40c0aefd0 0x7fc40c071430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:47.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.452+0000 7fc40ad9d700 1 --2- 172.21.15.146:0/1269231425 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc40c0aefd0 0x7fc40c071430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:47.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.452+0000 7fc40ad9d700 1 -- 172.21.15.146:0/1269231425 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc40c15cd90 msgr2=0x7fc40c148d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:47.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.452+0000 7fc40b59e700 1 --2- 172.21.15.146:0/1269231425 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc40c15cd90 0x7fc40c148d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:47.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.452+0000 7fc40ad9d700 1 --2- 172.21.15.146:0/1269231425 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc40c15cd90 0x7fc40c148d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:47.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.452+0000 7fc40ad9d700 1 -- 172.21.15.146:0/1269231425 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3fc0094a0 con 0x7fc40c06a460 2023-05-24T03:31:47.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.452+0000 7fc40ad9d700 1 --2- 172.21.15.146:0/1269231425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc40c06a460 0x7fc40c0af900 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc009fd0 tx=0x7fc3fc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:47.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.452+0000 7fc3f37fe700 1 -- 172.21.15.146:0/1269231425 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc0038a0 con 0x7fc40c06a460 2023-05-24T03:31:47.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.452+0000 7fc3f37fe700 1 -- 172.21.15.146:0/1269231425 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3fc01f070 con 0x7fc40c06a460 2023-05-24T03:31:47.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.452+0000 7fc411195700 1 -- 172.21.15.146:0/1269231425 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc40c160800 con 0x7fc40c06a460 2023-05-24T03:31:47.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.452+0000 7fc3f37fe700 1 -- 172.21.15.146:0/1269231425 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc003c40 con 0x7fc40c06a460 2023-05-24T03:31:47.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.452+0000 7fc411195700 1 -- 172.21.15.146:0/1269231425 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc40c0cfa20 con 0x7fc40c06a460 2023-05-24T03:31:47.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.454+0000 7fc3f37fe700 1 -- 172.21.15.146:0/1269231425 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc3fc026480 con 0x7fc40c06a460 2023-05-24T03:31:47.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.454+0000 7fc411195700 1 -- 172.21.15.146:0/1269231425 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc40c0af620 con 0x7fc40c06a460 2023-05-24T03:31:47.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.454+0000 7fc3f37fe700 1 --2- 172.21.15.146:0/1269231425 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fc3f806ace0 0x7fc3f806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:47.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.454+0000 7fc3f37fe700 1 -- 172.21.15.146:0/1269231425 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc3fc021070 con 0x7fc40c06a460 2023-05-24T03:31:47.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.454+0000 7fc40a59c700 1 --2- 172.21.15.146:0/1269231425 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fc3f806ace0 0x7fc3f806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:47.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.454+0000 7fc40a59c700 1 --2- 172.21.15.146:0/1269231425 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fc3f806ace0 0x7fc3f806d190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc40c1f5960 tx=0x7fc400009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:47.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.458+0000 7fc3f37fe700 1 -- 172.21.15.146:0/1269231425 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc3fc0bd2d0 con 0x7fc40c06a460 2023-05-24T03:31:47.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.655+0000 7fc411195700 1 -- 172.21.15.146:0/1269231425 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc40c0d0a80 con 0x7fc40c06a460 2023-05-24T03:31:47.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.655+0000 7fc3f37fe700 1 -- 172.21.15.146:0/1269231425 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc3fc055ec0 con 0x7fc40c06a460 2023-05-24T03:31:47.660 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2023-05-24T03:31:47.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.657+0000 7fc411195700 1 -- 172.21.15.146:0/1269231425 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fc3f806ace0 msgr2=0x7fc3f806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:47.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.657+0000 7fc411195700 1 --2- 172.21.15.146:0/1269231425 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fc3f806ace0 0x7fc3f806d190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc40c1f5960 tx=0x7fc400009040 comp rx=0 tx=0).stop 2023-05-24T03:31:47.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.657+0000 7fc411195700 1 -- 172.21.15.146:0/1269231425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc40c06a460 msgr2=0x7fc40c0af900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:47.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.657+0000 7fc411195700 1 --2- 172.21.15.146:0/1269231425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc40c06a460 0x7fc40c0af900 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc009fd0 tx=0x7fc3fc004750 comp rx=0 tx=0).stop 2023-05-24T03:31:47.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.657+0000 7fc411195700 1 -- 172.21.15.146:0/1269231425 shutdown_connections 2023-05-24T03:31:47.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.657+0000 7fc411195700 1 --2- 172.21.15.146:0/1269231425 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fc3f806ace0 0x7fc3f806d190 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:47.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.657+0000 7fc411195700 1 --2- 172.21.15.146:0/1269231425 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc40c15cd90 0x7fc40c148d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:47.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.657+0000 7fc411195700 1 --2- 172.21.15.146:0/1269231425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc40c06a460 0x7fc40c0af900 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:47.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.657+0000 7fc411195700 1 --2- 172.21.15.146:0/1269231425 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc40c0aefd0 0x7fc40c071430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:47.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.657+0000 7fc411195700 1 -- 172.21.15.146:0/1269231425 >> 172.21.15.146:0/1269231425 conn(0x7fc40c0cfea0 msgr2=0x7fc40c0b2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:31:47.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.657+0000 7fc411195700 1 -- 172.21.15.146:0/1269231425 shutdown_connections 2023-05-24T03:31:47.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.657+0000 7fc411195700 1 -- 172.21.15.146:0/1269231425 wait complete. 2023-05-24T03:31:47.675 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-24T03:31:47.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.797+0000 7f4fcea5f700 1 Processor -- start 2023-05-24T03:31:47.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.797+0000 7f4fcea5f700 1 -- start start 2023-05-24T03:31:47.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.798+0000 7f4fcea5f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4fc80d2a30 0x7f4fc806baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:47.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.798+0000 7f4fcea5f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4fc80d0240 0x7f4fc80b80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:47.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.798+0000 7f4fcea5f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc80cd960 con 0x7f4fc80cf530 2023-05-24T03:31:47.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.798+0000 7f4fcea5f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fc81612b0 con 0x7f4fc80d0240 2023-05-24T03:31:47.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.798+0000 7f4fcea5f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc80cdc00 con 0x7f4fc80d2a30 2023-05-24T03:31:47.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.798+0000 7f4fccffc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4fc80d0240 0x7f4fc80b80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:47.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.798+0000 7f4fc77fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f4fc80cf530 0x7f4fc80cfb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46526/0 (socket says 172.21.15.146:46526) 2023-05-24T03:31:47.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.798+0000 7f4fc77fe700 1 -- 172.21.15.146:0/3608882676 learned_addr learned my addr 172.21.15.146:0/3608882676 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:31:47.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.799+0000 7f4fc7fff700 1 --2- 172.21.15.146:0/3608882676 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4fc80d2a30 0x7f4fc806baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:47.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.799+0000 7f4fccffc700 1 -- 172.21.15.146:0/3608882676 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4fc80d2a30 msgr2=0x7f4fc806baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:31:47.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.799+0000 7f4fccffc700 1 --2- 172.21.15.146:0/3608882676 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4fc80d2a30 0x7f4fc806baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:47.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.799+0000 7f4fccffc700 1 -- 172.21.15.146:0/3608882676 >> v1:172.21.15.146:6789/0 conn(0x7f4fc80cf530 legacy=0x7f4fc80cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:47.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.799+0000 7f4fc6ffd700 1 -- 172.21.15.146:0/3608882676 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1373997449 0 0) 0x7f4fc80cd960 con 0x7f4fc80cf530 2023-05-24T03:31:47.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.799+0000 7f4fccffc700 1 -- 172.21.15.146:0/3608882676 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc8161590 con 0x7f4fc80d0240 2023-05-24T03:31:47.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.799+0000 7f4fccffc700 1 --2- 172.21.15.146:0/3608882676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fc80d0240 0x7f4fc80b80e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0009d90 tx=0x7f4fc000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b96c4b6f83eaa81e server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:47.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.799+0000 7f4fc6ffd700 1 -- 172.21.15.146:0/3608882676 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc000e070 con 0x7f4fc80d0240 2023-05-24T03:31:47.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.799+0000 7f4fc6ffd700 1 -- 172.21.15.146:0/3608882676 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc000bbd0 con 0x7f4fc80d0240 2023-05-24T03:31:47.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.799+0000 7f4fc6ffd700 1 -- 172.21.15.146:0/3608882676 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc0012430 con 0x7f4fc80d0240 2023-05-24T03:31:47.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.800+0000 7f4fcea5f700 1 -- 172.21.15.146:0/3608882676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fc80d0240 msgr2=0x7f4fc80b80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:47.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.800+0000 7f4fcea5f700 1 --2- 172.21.15.146:0/3608882676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fc80d0240 0x7f4fc80b80e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0009d90 tx=0x7f4fc000b330 comp rx=0 tx=0).stop 2023-05-24T03:31:47.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.800+0000 7f4fcea5f700 1 -- 172.21.15.146:0/3608882676 shutdown_connections 2023-05-24T03:31:47.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.800+0000 7f4fcea5f700 1 --2- 172.21.15.146:0/3608882676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fc80d0240 0x7f4fc80b80e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:47.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.800+0000 7f4fcea5f700 1 --2- 172.21.15.146:0/3608882676 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4fc80d2a30 0x7f4fc806baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:47.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.800+0000 7f4fcea5f700 1 -- 172.21.15.146:0/3608882676 >> 172.21.15.146:0/3608882676 conn(0x7f4fc80743a0 msgr2=0x7f4fc806af50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:31:47.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.800+0000 7f4fcea5f700 1 -- 172.21.15.146:0/3608882676 shutdown_connections 2023-05-24T03:31:47.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.800+0000 7f4fcea5f700 1 -- 172.21.15.146:0/3608882676 wait complete. 2023-05-24T03:31:47.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.801+0000 7f4fcea5f700 1 Processor -- start 2023-05-24T03:31:47.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.801+0000 7f4fcea5f700 1 -- start start 2023-05-24T03:31:47.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.802+0000 7f4fcea5f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4fc80cf530 0x7f4fc80c6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:47.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.802+0000 7f4fcea5f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fc80d0240 0x7f4fc81e8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:47.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.802+0000 7f4fcea5f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fc80d2a30 0x7f4fc80cc640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:47.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.802+0000 7f4fcea5f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc80b6f70 con 0x7f4fc80d2a30 2023-05-24T03:31:47.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.802+0000 7f4fcea5f700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc80cb230 con 0x7f4fc80d0240 2023-05-24T03:31:47.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.802+0000 7f4fcea5f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc80c72e0 con 0x7f4fc80cf530 2023-05-24T03:31:47.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.802+0000 7f4fccffc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fc80d2a30 0x7f4fc80cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:47.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.802+0000 7f4fccffc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fc80d2a30 0x7f4fc80cc640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40084/0 (socket says 172.21.15.146:40084) 2023-05-24T03:31:47.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.802+0000 7f4fccffc700 1 -- 172.21.15.146:0/253856477 learned_addr learned my addr 172.21.15.146:0/253856477 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:31:47.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.802+0000 7f4fc7fff700 1 --2- 172.21.15.146:0/253856477 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4fc80cf530 0x7f4fc80c6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:47.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.802+0000 7f4fc77fe700 1 --2- 172.21.15.146:0/253856477 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fc80d0240 0x7f4fc81e8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:47.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.802+0000 7f4fccffc700 1 -- 172.21.15.146:0/253856477 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4fc80cf530 msgr2=0x7f4fc80c6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:47.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.802+0000 7f4fccffc700 1 --2- 172.21.15.146:0/253856477 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4fc80cf530 0x7f4fc80c6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:47.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.802+0000 7f4fccffc700 1 -- 172.21.15.146:0/253856477 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fc80d0240 msgr2=0x7f4fc81e8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:47.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.802+0000 7f4fccffc700 1 --2- 172.21.15.146:0/253856477 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fc80d0240 0x7f4fc81e8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:47.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.802+0000 7f4fccffc700 1 -- 172.21.15.146:0/253856477 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc0009a70 con 0x7f4fc80d2a30 2023-05-24T03:31:47.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.802+0000 7f4fc77fe700 1 --2- 172.21.15.146:0/253856477 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fc80d0240 0x7f4fc81e8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:31:47.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.803+0000 7f4fccffc700 1 --2- 172.21.15.146:0/253856477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fc80d2a30 0x7f4fc80cc640 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4fc808c050 tx=0x7f4fc0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:47.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.803+0000 7f4fc4ff9700 1 -- 172.21.15.146:0/253856477 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc0012430 con 0x7f4fc80d2a30 2023-05-24T03:31:47.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.803+0000 7f4fc4ff9700 1 -- 172.21.15.146:0/253856477 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc0020070 con 0x7f4fc80d2a30 2023-05-24T03:31:47.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.803+0000 7f4fcea5f700 1 -- 172.21.15.146:0/253856477 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fc81469e0 con 0x7f4fc80d2a30 2023-05-24T03:31:47.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.803+0000 7f4fc4ff9700 1 -- 172.21.15.146:0/253856477 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc0004280 con 0x7f4fc80d2a30 2023-05-24T03:31:47.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.803+0000 7f4fcea5f700 1 -- 172.21.15.146:0/253856477 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fc8146850 con 0x7f4fc80d2a30 2023-05-24T03:31:47.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.804+0000 7f4fcea5f700 1 -- 172.21.15.146:0/253856477 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fc80b8620 con 0x7f4fc80d2a30 2023-05-24T03:31:47.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.804+0000 7f4fc4ff9700 1 -- 172.21.15.146:0/253856477 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4fc00043e0 con 0x7f4fc80d2a30 2023-05-24T03:31:47.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.804+0000 7f4fc4ff9700 1 --2- 172.21.15.146:0/253856477 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f4fb406ace0 0x7f4fb406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:47.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.805+0000 7f4fc4ff9700 1 -- 172.21.15.146:0/253856477 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4fc0022070 con 0x7f4fc80d2a30 2023-05-24T03:31:47.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.805+0000 7f4fc7fff700 1 --2- 172.21.15.146:0/253856477 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f4fb406ace0 0x7f4fb406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:47.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.805+0000 7f4fc7fff700 1 --2- 172.21.15.146:0/253856477 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f4fb406ace0 0x7f4fb406d190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4fc80b8430 tx=0x7f4fbc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:47.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:47.809+0000 7f4fc4ff9700 1 -- 172.21.15.146:0/253856477 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f4fc00567f0 con 0x7f4fc80d2a30 2023-05-24T03:31:48.002 INFO:tasks.workunit.client.2.smithi146.stdout:Try to write 26214400 2023-05-24T03:31:48.003 INFO:tasks.workunit.client.2.smithi146.stderr:+ return 1 2023-05-24T03:31:48.003 INFO:tasks.workunit.client.2.smithi146.stderr:+ return 0 2023-05-24T03:31:48.003 INFO:tasks.workunit.client.2.smithi146.stderr:+ stat '--printf=%n %s\n' ancestor/p1/p2/parent/p3/file1 2023-05-24T03:31:48.003 INFO:tasks.workunit.client.2.smithi146.stdout:ancestor/p1/p2/parent/p3/file1 25165824 2023-05-24T03:31:48.004 INFO:tasks.workunit.client.2.smithi146.stderr:+ setfattr -n ceph.quota.max_bytes -v 0 . 2023-05-24T03:31:48.004 INFO:tasks.workunit.client.2.smithi146.stderr:+ setfattr -n ceph.quota.max_bytes -v 1 . 2023-05-24T03:31:48.005 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-24T03:31:48.005 INFO:tasks.workunit.client.2.smithi146.stderr:setfattr: .: Invalid argument 2023-05-24T03:31:48.006 INFO:tasks.workunit:Stopping ['fs/quota'] on client.2... 2023-05-24T03:31:48.006 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.2 /home/ubuntu/cephtest/clone.client.2 2023-05-24T03:31:48.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.002+0000 7f4fcea5f700 1 -- 172.21.15.146:0/253856477 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4fc8072ae0 con 0x7f4fc80d2a30 2023-05-24T03:31:48.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.003+0000 7f4fc4ff9700 1 -- 172.21.15.146:0/253856477 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4fc0059e10 con 0x7f4fc80d2a30 2023-05-24T03:31:48.008 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2023-05-24T03:31:48.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.005+0000 7f4fcea5f700 1 -- 172.21.15.146:0/253856477 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f4fb406ace0 msgr2=0x7f4fb406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:48.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.005+0000 7f4fcea5f700 1 --2- 172.21.15.146:0/253856477 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f4fb406ace0 0x7f4fb406d190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4fc80b8430 tx=0x7f4fbc008040 comp rx=0 tx=0).stop 2023-05-24T03:31:48.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.005+0000 7f4fcea5f700 1 -- 172.21.15.146:0/253856477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fc80d2a30 msgr2=0x7f4fc80cc640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:48.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.005+0000 7f4fcea5f700 1 --2- 172.21.15.146:0/253856477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fc80d2a30 0x7f4fc80cc640 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4fc808c050 tx=0x7f4fc0004ad0 comp rx=0 tx=0).stop 2023-05-24T03:31:48.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.005+0000 7f4fcea5f700 1 -- 172.21.15.146:0/253856477 shutdown_connections 2023-05-24T03:31:48.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.005+0000 7f4fcea5f700 1 --2- 172.21.15.146:0/253856477 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f4fb406ace0 0x7f4fb406d190 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:48.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.005+0000 7f4fcea5f700 1 --2- 172.21.15.146:0/253856477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fc80d2a30 0x7f4fc80cc640 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:48.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.005+0000 7f4fcea5f700 1 --2- 172.21.15.146:0/253856477 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4fc80cf530 0x7f4fc80c6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:48.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.005+0000 7f4fcea5f700 1 --2- 172.21.15.146:0/253856477 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fc80d0240 0x7f4fc81e8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:48.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.005+0000 7f4fcea5f700 1 -- 172.21.15.146:0/253856477 >> 172.21.15.146:0/253856477 conn(0x7f4fc80743a0 msgr2=0x7f4fc80b64a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:31:48.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.005+0000 7f4fcea5f700 1 -- 172.21.15.146:0/253856477 shutdown_connections 2023-05-24T03:31:48.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.005+0000 7f4fcea5f700 1 -- 172.21.15.146:0/253856477 wait complete. 2023-05-24T03:31:48.023 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-24T03:31:48.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.187+0000 7ff5b0360700 1 Processor -- start 2023-05-24T03:31:48.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.187+0000 7ff5b0360700 1 -- start start 2023-05-24T03:31:48.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.189+0000 7ff5b0360700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff5a8070fe0 0x7ff5a80b21c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:48.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.189+0000 7ff5b0360700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5a815ad80 con 0x7ff5a80cdfd0 2023-05-24T03:31:48.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.189+0000 7ff5b0360700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5a815a7c0 con 0x7ff5a8159cd0 2023-05-24T03:31:48.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.189+0000 7ff5b0360700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5a815aaa0 con 0x7ff5a8070fe0 2023-05-24T03:31:48.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.189+0000 7ff5ae0fc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff5a80cdfd0 0x7ff5a80ce3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46540/0 (socket says 172.21.15.146:46540) 2023-05-24T03:31:48.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.189+0000 7ff5ae0fc700 1 -- 172.21.15.146:0/1663836588 learned_addr learned my addr 172.21.15.146:0/1663836588 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:31:48.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.189+0000 7ff5ad8fb700 1 --2- 172.21.15.146:0/1663836588 >> v2:172.21.15.151:3300/0 conn(0x7ff5a8070fe0 0x7ff5a80b21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:48.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.189+0000 7ff5ad0fa700 1 -- 172.21.15.146:0/1663836588 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2412127216 0 0) 0x7ff5a815ad80 con 0x7ff5a80cdfd0 2023-05-24T03:31:48.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.189+0000 7ff5ad0fa700 1 -- 172.21.15.146:0/1663836588 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5940035b0 con 0x7ff5a80cdfd0 2023-05-24T03:31:48.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.190+0000 7ff5ad0fa700 1 -- 172.21.15.146:0/1663836588 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3304031355 0 0) 0x7ff5a815a7c0 con 0x7ff5a8159cd0 2023-05-24T03:31:48.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.190+0000 7ff5ad0fa700 1 -- 172.21.15.146:0/1663836588 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5a815ad80 con 0x7ff5a8159cd0 2023-05-24T03:31:48.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.190+0000 7ff5ad0fa700 1 -- 172.21.15.146:0/1663836588 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 526800108 0 0) 0x7ff5940035b0 con 0x7ff5a80cdfd0 2023-05-24T03:31:48.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.190+0000 7ff5ad0fa700 1 -- 172.21.15.146:0/1663836588 >> v2:172.21.15.151:3300/0 conn(0x7ff5a8070fe0 msgr2=0x7ff5a80b21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:31:48.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.190+0000 7ff5ad0fa700 1 --2- 172.21.15.146:0/1663836588 >> v2:172.21.15.151:3300/0 conn(0x7ff5a8070fe0 0x7ff5a80b21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:48.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.190+0000 7ff5ad0fa700 1 -- 172.21.15.146:0/1663836588 >> v1:172.21.15.151:6789/0 conn(0x7ff5a8159cd0 legacy=0x7ff5a806d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:48.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.190+0000 7ff5ad0fa700 1 -- 172.21.15.146:0/1663836588 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a80b19c0 con 0x7ff5a80cdfd0 2023-05-24T03:31:48.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.190+0000 7ff5ad0fa700 1 -- 172.21.15.146:0/1663836588 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1301887351 0 0) 0x7ff5a4001670 con 0x7ff5a80cdfd0 2023-05-24T03:31:48.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.190+0000 7ff5ad0fa700 1 -- 172.21.15.146:0/1663836588 >> v1:172.21.15.146:6789/0 conn(0x7ff5a80cdfd0 legacy=0x7ff5a80ce3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:48.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.190+0000 7ff5ad0fa700 1 --2- 172.21.15.146:0/1663836588 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff594003b90 0x7ff594003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:48.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.190+0000 7ff5ad0fa700 1 --2- 172.21.15.146:0/1663836588 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff594004850 0x7ff594004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:48.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.190+0000 7ff5ad0fa700 1 --2- 172.21.15.146:0/1663836588 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff594005200 0x7ff59400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:48.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.190+0000 7ff5ad0fa700 1 -- 172.21.15.146:0/1663836588 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a815aaa0 con 0x7ff594005200 2023-05-24T03:31:48.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.190+0000 7ff5ad0fa700 1 -- 172.21.15.146:0/1663836588 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59400c060 con 0x7ff594004850 2023-05-24T03:31:48.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.190+0000 7ff5ad0fa700 1 -- 172.21.15.146:0/1663836588 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff59400c220 con 0x7ff594003b90 2023-05-24T03:31:48.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.190+0000 7ff5ad8fb700 1 --2- 172.21.15.146:0/1663836588 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff594004850 0x7ff594004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:48.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.190+0000 7ff5ae0fc700 1 --2- 172.21.15.146:0/1663836588 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff594003b90 0x7ff594003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:48.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.190+0000 7ff5ae8fd700 1 --2- 172.21.15.146:0/1663836588 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff594005200 0x7ff59400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:48.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.190+0000 7ff5ad8fb700 1 -- 172.21.15.146:0/1663836588 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff594003b90 msgr2=0x7ff594003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:31:48.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.190+0000 7ff5ad8fb700 1 --2- 172.21.15.146:0/1663836588 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff594003b90 0x7ff594003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:48.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.190+0000 7ff5ad8fb700 1 -- 172.21.15.146:0/1663836588 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff594005200 msgr2=0x7ff59400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:31:48.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.190+0000 7ff5ad8fb700 1 --2- 172.21.15.146:0/1663836588 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff594005200 0x7ff59400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:48.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.190+0000 7ff5ad8fb700 1 -- 172.21.15.146:0/1663836588 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5940035b0 con 0x7ff594004850 2023-05-24T03:31:48.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.190+0000 7ff5ae8fd700 1 -- 172.21.15.146:0/1663836588 reap_dead start 2023-05-24T03:31:48.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.190+0000 7ff5ad8fb700 1 --2- 172.21.15.146:0/1663836588 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff594004850 0x7ff594004cc0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff598009b60 tx=0x7ff594005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2af850df7d2a6e7b server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:48.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.190+0000 7ff5ad0fa700 1 -- 172.21.15.146:0/1663836588 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59800e6c0 con 0x7ff594004850 2023-05-24T03:31:48.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.191+0000 7ff5ad0fa700 1 -- 172.21.15.146:0/1663836588 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff59800e820 con 0x7ff594004850 2023-05-24T03:31:48.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.191+0000 7ff5ad0fa700 1 -- 172.21.15.146:0/1663836588 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59800eb90 con 0x7ff594004850 2023-05-24T03:31:48.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.191+0000 7ff5b0360700 1 -- 172.21.15.146:0/1663836588 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff594004850 msgr2=0x7ff594004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:48.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.191+0000 7ff5b0360700 1 --2- 172.21.15.146:0/1663836588 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff594004850 0x7ff594004cc0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff598009b60 tx=0x7ff594005880 comp rx=0 tx=0).stop 2023-05-24T03:31:48.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.191+0000 7ff5b0360700 1 -- 172.21.15.146:0/1663836588 shutdown_connections 2023-05-24T03:31:48.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.191+0000 7ff5b0360700 1 --2- 172.21.15.146:0/1663836588 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff594004850 0x7ff594004cc0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:48.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.191+0000 7ff5b0360700 1 -- 172.21.15.146:0/1663836588 >> 172.21.15.146:0/1663836588 conn(0x7ff5a80cfea0 msgr2=0x7ff5a80d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:31:48.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.191+0000 7ff5b0360700 1 -- 172.21.15.146:0/1663836588 shutdown_connections 2023-05-24T03:31:48.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.191+0000 7ff5b0360700 1 -- 172.21.15.146:0/1663836588 wait complete. 2023-05-24T03:31:48.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.192+0000 7ff5b0360700 1 Processor -- start 2023-05-24T03:31:48.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.192+0000 7ff5b0360700 1 -- start start 2023-05-24T03:31:48.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.193+0000 7ff5b0360700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff594004850 0x7ff5a80cedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:48.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.193+0000 7ff5b0360700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5a80c6950 0x7ff5a80cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:48.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.193+0000 7ff5b0360700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5a80c9360 0x7ff5a80c3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:48.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.193+0000 7ff5b0360700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a80cc610 con 0x7ff594004850 2023-05-24T03:31:48.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.193+0000 7ff5b0360700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a80cb630 con 0x7ff5a80c9360 2023-05-24T03:31:48.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.193+0000 7ff5b0360700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a80b4820 con 0x7ff5a80c6950 2023-05-24T03:31:48.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.193+0000 7ff5ae0fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff594004850 0x7ff5a80cedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:48.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.193+0000 7ff5ae0fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff594004850 0x7ff5a80cedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40100/0 (socket says 172.21.15.146:40100) 2023-05-24T03:31:48.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.193+0000 7ff5ae0fc700 1 -- 172.21.15.146:0/2786244416 learned_addr learned my addr 172.21.15.146:0/2786244416 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:31:48.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.194+0000 7ff5ae0fc700 1 -- 172.21.15.146:0/2786244416 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5a80c6950 msgr2=0x7ff5a80cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:48.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.194+0000 7ff5ae0fc700 1 --2- 172.21.15.146:0/2786244416 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5a80c6950 0x7ff5a80cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:48.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.194+0000 7ff5ae0fc700 1 -- 172.21.15.146:0/2786244416 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5a80c9360 msgr2=0x7ff5a80c3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:48.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.194+0000 7ff5ae0fc700 1 --2- 172.21.15.146:0/2786244416 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5a80c9360 0x7ff5a80c3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:48.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.194+0000 7ff5ae0fc700 1 -- 172.21.15.146:0/2786244416 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a815a150 con 0x7ff594004850 2023-05-24T03:31:48.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.194+0000 7ff5ae0fc700 1 --2- 172.21.15.146:0/2786244416 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff594004850 0x7ff5a80cedc0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4007310 tx=0x7ff5a4007620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:48.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.194+0000 7ff59effd700 1 -- 172.21.15.146:0/2786244416 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a4007800 con 0x7ff594004850 2023-05-24T03:31:48.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.194+0000 7ff59effd700 1 -- 172.21.15.146:0/2786244416 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a400f7f0 con 0x7ff594004850 2023-05-24T03:31:48.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.194+0000 7ff5b0360700 1 -- 172.21.15.146:0/2786244416 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a80b1ca0 con 0x7ff594004850 2023-05-24T03:31:48.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.194+0000 7ff59effd700 1 -- 172.21.15.146:0/2786244416 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a400fb80 con 0x7ff594004850 2023-05-24T03:31:48.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.194+0000 7ff5b0360700 1 -- 172.21.15.146:0/2786244416 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a815a2e0 con 0x7ff594004850 2023-05-24T03:31:48.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.195+0000 7ff5b0360700 1 -- 172.21.15.146:0/2786244416 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5a80cb490 con 0x7ff594004850 2023-05-24T03:31:48.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.195+0000 7ff59effd700 1 -- 172.21.15.146:0/2786244416 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff5a400fce0 con 0x7ff594004850 2023-05-24T03:31:48.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.196+0000 7ff59effd700 1 --2- 172.21.15.146:0/2786244416 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7ff58c06ace0 0x7ff58c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:48.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.196+0000 7ff59effd700 1 -- 172.21.15.146:0/2786244416 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff5a40896c0 con 0x7ff594004850 2023-05-24T03:31:48.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.196+0000 7ff5ad8fb700 1 --2- 172.21.15.146:0/2786244416 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7ff58c06ace0 0x7ff58c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:48.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.196+0000 7ff5ad8fb700 1 --2- 172.21.15.146:0/2786244416 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7ff58c06ace0 0x7ff58c06d190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff5a80c6800 tx=0x7ff598013000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:48.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.204+0000 7ff59effd700 1 -- 172.21.15.146:0/2786244416 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ff5a80cb490 con 0x7ff594004850 2023-05-24T03:31:48.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.395+0000 7ff5b0360700 1 -- 172.21.15.146:0/2786244416 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff5a80cb490 con 0x7ff594004850 2023-05-24T03:31:48.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.396+0000 7ff59effd700 1 -- 172.21.15.146:0/2786244416 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff5a80cb490 con 0x7ff594004850 2023-05-24T03:31:48.401 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2023-05-24T03:31:48.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.398+0000 7ff5b0360700 1 -- 172.21.15.146:0/2786244416 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7ff58c06ace0 msgr2=0x7ff58c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:48.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.398+0000 7ff5b0360700 1 --2- 172.21.15.146:0/2786244416 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7ff58c06ace0 0x7ff58c06d190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff5a80c6800 tx=0x7ff598013000 comp rx=0 tx=0).stop 2023-05-24T03:31:48.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.398+0000 7ff5b0360700 1 -- 172.21.15.146:0/2786244416 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff594004850 msgr2=0x7ff5a80cedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:48.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.398+0000 7ff5b0360700 1 --2- 172.21.15.146:0/2786244416 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff594004850 0x7ff5a80cedc0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4007310 tx=0x7ff5a4007620 comp rx=0 tx=0).stop 2023-05-24T03:31:48.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.398+0000 7ff5b0360700 1 -- 172.21.15.146:0/2786244416 shutdown_connections 2023-05-24T03:31:48.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.398+0000 7ff5b0360700 1 --2- 172.21.15.146:0/2786244416 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7ff58c06ace0 0x7ff58c06d190 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:48.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.398+0000 7ff5b0360700 1 --2- 172.21.15.146:0/2786244416 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5a80c9360 0x7ff5a80c3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:48.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.398+0000 7ff5b0360700 1 --2- 172.21.15.146:0/2786244416 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff594004850 0x7ff5a80cedc0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:48.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.398+0000 7ff5b0360700 1 --2- 172.21.15.146:0/2786244416 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5a80c6950 0x7ff5a80cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:48.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.398+0000 7ff5b0360700 1 -- 172.21.15.146:0/2786244416 >> 172.21.15.146:0/2786244416 conn(0x7ff5a80cfea0 msgr2=0x7ff5a806d860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:31:48.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.398+0000 7ff5b0360700 1 -- 172.21.15.146:0/2786244416 shutdown_connections 2023-05-24T03:31:48.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.398+0000 7ff5b0360700 1 -- 172.21.15.146:0/2786244416 wait complete. 2023-05-24T03:31:48.415 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-24T03:31:48.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.536+0000 7fedac613700 1 Processor -- start 2023-05-24T03:31:48.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.536+0000 7fedac613700 1 -- start start 2023-05-24T03:31:48.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.537+0000 7fedac613700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feda4070fe0 0x7feda40b21c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:48.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.537+0000 7fedac613700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7feda4159cd0 0x7feda415a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:48.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.537+0000 7fedac613700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feda415ad80 con 0x7feda40cdfd0 2023-05-24T03:31:48.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.537+0000 7fedac613700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feda415a7c0 con 0x7feda4159cd0 2023-05-24T03:31:48.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.537+0000 7fedac613700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feda415aaa0 con 0x7feda4070fe0 2023-05-24T03:31:48.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.537+0000 7fedaabb0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7feda4159cd0 0x7feda415a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:48.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.537+0000 7fedaabb0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7feda4159cd0 0x7feda415a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40112/0 (socket says 172.21.15.146:40112) 2023-05-24T03:31:48.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.537+0000 7fedaabb0700 1 -- 172.21.15.146:0/356669135 learned_addr learned my addr 172.21.15.146:0/356669135 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:31:48.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.537+0000 7feda9bae700 1 --2- 172.21.15.146:0/356669135 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feda4070fe0 0x7feda40b21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:48.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.537+0000 7fedaabb0700 1 -- 172.21.15.146:0/356669135 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feda4070fe0 msgr2=0x7feda40b21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:31:48.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.537+0000 7fedaabb0700 1 --2- 172.21.15.146:0/356669135 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feda4070fe0 0x7feda40b21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:48.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.537+0000 7fedaabb0700 1 -- 172.21.15.146:0/356669135 >> v1:172.21.15.151:6789/0 conn(0x7feda40cdfd0 legacy=0x7feda40ce3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:48.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.537+0000 7fedaabb0700 1 -- 172.21.15.146:0/356669135 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda40b19c0 con 0x7feda4159cd0 2023-05-24T03:31:48.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.537+0000 7fedaabb0700 1 --2- 172.21.15.146:0/356669135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feda4159cd0 0x7feda415a150 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fed9c00d150 tx=0x7fed9c00d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e12a0e7d9b9621e0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:48.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.538+0000 7feda93ad700 1 -- 172.21.15.146:0/356669135 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9c010070 con 0x7feda4159cd0 2023-05-24T03:31:48.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.538+0000 7feda93ad700 1 -- 172.21.15.146:0/356669135 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed9c00dd10 con 0x7feda4159cd0 2023-05-24T03:31:48.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.538+0000 7feda93ad700 1 -- 172.21.15.146:0/356669135 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9c00b310 con 0x7feda4159cd0 2023-05-24T03:31:48.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.538+0000 7fedac613700 1 -- 172.21.15.146:0/356669135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feda4159cd0 msgr2=0x7feda415a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:48.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.538+0000 7fedac613700 1 --2- 172.21.15.146:0/356669135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feda4159cd0 0x7feda415a150 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fed9c00d150 tx=0x7fed9c00d460 comp rx=0 tx=0).stop 2023-05-24T03:31:48.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.538+0000 7fedac613700 1 -- 172.21.15.146:0/356669135 shutdown_connections 2023-05-24T03:31:48.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.538+0000 7fedac613700 1 --2- 172.21.15.146:0/356669135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feda4159cd0 0x7feda415a150 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:48.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.538+0000 7fedac613700 1 --2- 172.21.15.146:0/356669135 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feda4070fe0 0x7feda40b21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:48.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.538+0000 7fedac613700 1 -- 172.21.15.146:0/356669135 >> 172.21.15.146:0/356669135 conn(0x7feda40cfea0 msgr2=0x7feda40d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:31:48.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.538+0000 7fedac613700 1 -- 172.21.15.146:0/356669135 shutdown_connections 2023-05-24T03:31:48.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.538+0000 7fedac613700 1 -- 172.21.15.146:0/356669135 wait complete. 2023-05-24T03:31:48.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.540+0000 7fedac613700 1 Processor -- start 2023-05-24T03:31:48.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.540+0000 7fedac613700 1 -- start start 2023-05-24T03:31:48.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.541+0000 7fedac613700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feda4070fe0 0x7feda41f15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:48.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.541+0000 7fedac613700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feda40cdfd0 0x7feda41f1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:48.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.541+0000 7fedac613700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feda4159cd0 0x7feda4157410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:48.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.541+0000 7fedac613700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda4158160 con 0x7feda4159cd0 2023-05-24T03:31:48.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.541+0000 7fedac613700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda4158440 con 0x7feda4070fe0 2023-05-24T03:31:48.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.541+0000 7fedac613700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feda4158720 con 0x7feda40cdfd0 2023-05-24T03:31:48.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.541+0000 7fedaabb0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feda4159cd0 0x7feda4157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:48.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.541+0000 7fedaabb0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feda4159cd0 0x7feda4157410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40118/0 (socket says 172.21.15.146:40118) 2023-05-24T03:31:48.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.541+0000 7fedaabb0700 1 -- 172.21.15.146:0/241904547 learned_addr learned my addr 172.21.15.146:0/241904547 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:31:48.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.541+0000 7feda9bae700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feda40cdfd0 0x7feda41f1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:48.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.541+0000 7fedaa3af700 1 --2- 172.21.15.146:0/241904547 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feda4070fe0 0x7feda41f15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:48.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.541+0000 7fedaabb0700 1 -- 172.21.15.146:0/241904547 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feda40cdfd0 msgr2=0x7feda41f1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:48.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.541+0000 7fedaabb0700 1 --2- 172.21.15.146:0/241904547 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feda40cdfd0 0x7feda41f1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:48.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.541+0000 7fedaabb0700 1 -- 172.21.15.146:0/241904547 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feda4070fe0 msgr2=0x7feda41f15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:48.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.541+0000 7fedaabb0700 1 --2- 172.21.15.146:0/241904547 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feda4070fe0 0x7feda41f15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:48.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.541+0000 7fedaabb0700 1 -- 172.21.15.146:0/241904547 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed9c00bd40 con 0x7feda4159cd0 2023-05-24T03:31:48.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.541+0000 7fedaabb0700 1 --2- 172.21.15.146:0/241904547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feda4159cd0 0x7feda4157410 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7feda406ce70 tx=0x7fed9c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:48.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.542+0000 7fed9affd700 1 -- 172.21.15.146:0/241904547 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9c00bbc0 con 0x7feda4159cd0 2023-05-24T03:31:48.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.542+0000 7fed9affd700 1 -- 172.21.15.146:0/241904547 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed9c009e80 con 0x7feda4159cd0 2023-05-24T03:31:48.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.542+0000 7fed9affd700 1 -- 172.21.15.146:0/241904547 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9c004260 con 0x7feda4159cd0 2023-05-24T03:31:48.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.542+0000 7fedac613700 1 -- 172.21.15.146:0/241904547 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feda40b2700 con 0x7feda4159cd0 2023-05-24T03:31:48.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.542+0000 7fedac613700 1 -- 172.21.15.146:0/241904547 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feda40b1ca0 con 0x7feda4159cd0 2023-05-24T03:31:48.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.543+0000 7fedac613700 1 -- 172.21.15.146:0/241904547 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feda40b2890 con 0x7feda4159cd0 2023-05-24T03:31:48.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.543+0000 7fed9affd700 1 -- 172.21.15.146:0/241904547 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fed9c0043c0 con 0x7feda4159cd0 2023-05-24T03:31:48.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.544+0000 7fed9affd700 1 --2- 172.21.15.146:0/241904547 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fed8806ace0 0x7fed8806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:48.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.544+0000 7fed9affd700 1 -- 172.21.15.146:0/241904547 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fed9c08d490 con 0x7feda4159cd0 2023-05-24T03:31:48.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.544+0000 7fedaa3af700 1 --2- 172.21.15.146:0/241904547 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fed8806ace0 0x7fed8806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:48.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.544+0000 7fedaa3af700 1 --2- 172.21.15.146:0/241904547 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fed8806ace0 0x7fed8806d190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7feda0001800 tx=0x7feda0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:48.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.548+0000 7fed9affd700 1 -- 172.21.15.146:0/241904547 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fed9c0582a0 con 0x7feda4159cd0 2023-05-24T03:31:48.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.795+0000 7fedac613700 1 -- 172.21.15.146:0/241904547 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7feda4150e70 con 0x7feda4159cd0 2023-05-24T03:31:48.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.796+0000 7fed9affd700 1 -- 172.21.15.146:0/241904547 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7feda4150e70 con 0x7feda4159cd0 2023-05-24T03:31:48.802 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2023-05-24T03:31:48.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.798+0000 7fedac613700 1 -- 172.21.15.146:0/241904547 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fed8806ace0 msgr2=0x7fed8806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:48.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.798+0000 7fedac613700 1 --2- 172.21.15.146:0/241904547 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fed8806ace0 0x7fed8806d190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7feda0001800 tx=0x7feda0009040 comp rx=0 tx=0).stop 2023-05-24T03:31:48.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.798+0000 7fedac613700 1 -- 172.21.15.146:0/241904547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feda4159cd0 msgr2=0x7feda4157410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:48.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.798+0000 7fedac613700 1 --2- 172.21.15.146:0/241904547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feda4159cd0 0x7feda4157410 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7feda406ce70 tx=0x7fed9c004ad0 comp rx=0 tx=0).stop 2023-05-24T03:31:48.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.799+0000 7fedac613700 1 -- 172.21.15.146:0/241904547 shutdown_connections 2023-05-24T03:31:48.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.799+0000 7fedac613700 1 --2- 172.21.15.146:0/241904547 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fed8806ace0 0x7fed8806d190 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:48.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.799+0000 7fedac613700 1 --2- 172.21.15.146:0/241904547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feda4159cd0 0x7feda4157410 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:48.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.799+0000 7fedac613700 1 --2- 172.21.15.146:0/241904547 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feda4070fe0 0x7feda41f15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:48.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.799+0000 7fedac613700 1 --2- 172.21.15.146:0/241904547 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feda40cdfd0 0x7feda41f1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:48.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.799+0000 7fedac613700 1 -- 172.21.15.146:0/241904547 >> 172.21.15.146:0/241904547 conn(0x7feda40cfea0 msgr2=0x7feda40af900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:31:48.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.799+0000 7fedac613700 1 -- 172.21.15.146:0/241904547 shutdown_connections 2023-05-24T03:31:48.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.799+0000 7fedac613700 1 -- 172.21.15.146:0/241904547 wait complete. 2023-05-24T03:31:48.819 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-24T03:31:48.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.985+0000 7f2afa7dd700 1 Processor -- start 2023-05-24T03:31:48.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.985+0000 7f2afa7dd700 1 -- start start 2023-05-24T03:31:48.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.986+0000 7f2afa7dd700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2af40ae1e0 0x7f2af40ce730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:48.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.986+0000 7f2afa7dd700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2af40cf470 con 0x7f2af415ccc0 2023-05-24T03:31:48.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.986+0000 7f2afa7dd700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2af40cfc80 con 0x7f2af40ce2e0 2023-05-24T03:31:48.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.986+0000 7f2afa7dd700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2af40ccbf0 con 0x7f2af40ae1e0 2023-05-24T03:31:48.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.986+0000 7f2af3fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f2af415ccc0 0x7f2af406c960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46576/0 (socket says 172.21.15.146:46576) 2023-05-24T03:31:48.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.986+0000 7f2af3fff700 1 -- 172.21.15.146:0/282195464 learned_addr learned my addr 172.21.15.146:0/282195464 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:31:48.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.986+0000 7f2af8d7a700 1 --2- 172.21.15.146:0/282195464 >> v2:172.21.15.151:3300/0 conn(0x7f2af40ae1e0 0x7f2af40ce730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:48.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.986+0000 7f2af2ffd700 1 -- 172.21.15.146:0/282195464 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3395908733 0 0) 0x7f2af40cf470 con 0x7f2af415ccc0 2023-05-24T03:31:48.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.986+0000 7f2af2ffd700 1 -- 172.21.15.146:0/282195464 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2adc0035b0 con 0x7f2af415ccc0 2023-05-24T03:31:48.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.987+0000 7f2af2ffd700 1 -- 172.21.15.146:0/282195464 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1243065520 0 0) 0x7f2adc0035b0 con 0x7f2af415ccc0 2023-05-24T03:31:48.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.987+0000 7f2af2ffd700 1 -- 172.21.15.146:0/282195464 >> v2:172.21.15.151:3300/0 conn(0x7f2af40ae1e0 msgr2=0x7f2af40ce730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:31:48.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.987+0000 7f2af2ffd700 1 --2- 172.21.15.146:0/282195464 >> v2:172.21.15.151:3300/0 conn(0x7f2af40ae1e0 0x7f2af40ce730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:48.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.987+0000 7f2af2ffd700 1 -- 172.21.15.146:0/282195464 >> v1:172.21.15.151:6789/0 conn(0x7f2af40ce2e0 legacy=0x7f2af40adad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:48.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.987+0000 7f2af2ffd700 1 -- 172.21.15.146:0/282195464 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af40cf6c0 con 0x7f2af415ccc0 2023-05-24T03:31:48.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.987+0000 7f2af2ffd700 1 -- 172.21.15.146:0/282195464 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1301887351 0 0) 0x7f2aec0019f0 con 0x7f2af415ccc0 2023-05-24T03:31:48.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.987+0000 7f2af2ffd700 1 -- 172.21.15.146:0/282195464 >> v1:172.21.15.146:6789/0 conn(0x7f2af415ccc0 legacy=0x7f2af406c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:48.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.987+0000 7f2af2ffd700 1 --2- 172.21.15.146:0/282195464 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2adc003a00 0x7f2adc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:48.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.987+0000 7f2af2ffd700 1 --2- 172.21.15.146:0/282195464 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2adc004850 0x7f2adc004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:48.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.987+0000 7f2af2ffd700 1 --2- 172.21.15.146:0/282195464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2adc005320 0x7f2adc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:48.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.987+0000 7f2af2ffd700 1 -- 172.21.15.146:0/282195464 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af40ccbf0 con 0x7f2adc005320 2023-05-24T03:31:48.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.987+0000 7f2af2ffd700 1 -- 172.21.15.146:0/282195464 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc00c1e0 con 0x7f2adc003a00 2023-05-24T03:31:48.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.987+0000 7f2af2ffd700 1 -- 172.21.15.146:0/282195464 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc00c3a0 con 0x7f2adc004850 2023-05-24T03:31:48.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.987+0000 7f2af3fff700 1 --2- 172.21.15.146:0/282195464 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2adc003a00 0x7f2adc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:48.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.987+0000 7f2af8d7a700 1 --2- 172.21.15.146:0/282195464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2adc005320 0x7f2adc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:48.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.987+0000 7f2af37fe700 1 --2- 172.21.15.146:0/282195464 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2adc004850 0x7f2adc004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:48.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.988+0000 7f2af3fff700 1 -- 172.21.15.146:0/282195464 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2adc004850 msgr2=0x7f2adc004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:31:48.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.988+0000 7f2af3fff700 1 --2- 172.21.15.146:0/282195464 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2adc004850 0x7f2adc004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:48.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.988+0000 7f2af3fff700 1 -- 172.21.15.146:0/282195464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2adc005320 msgr2=0x7f2adc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:31:48.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.988+0000 7f2af3fff700 1 --2- 172.21.15.146:0/282195464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2adc005320 0x7f2adc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:48.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.988+0000 7f2af3fff700 1 -- 172.21.15.146:0/282195464 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2adc0035b0 con 0x7f2adc003a00 2023-05-24T03:31:48.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.988+0000 7f2af37fe700 1 --2- 172.21.15.146:0/282195464 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2adc004850 0x7f2adc004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T03:31:48.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.988+0000 7f2af8d7a700 1 --2- 172.21.15.146:0/282195464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2adc005320 0x7f2adc00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T03:31:48.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.988+0000 7f2af8d7a700 1 -- 172.21.15.146:0/282195464 reap_dead start 2023-05-24T03:31:49.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.988+0000 7f2af3fff700 1 --2- 172.21.15.146:0/282195464 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2adc003a00 0x7f2adc003e10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2aec014130 tx=0x7f2adc005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e6386ef76d25306 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:49.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.988+0000 7f2af2ffd700 1 -- 172.21.15.146:0/282195464 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aec017070 con 0x7f2adc003a00 2023-05-24T03:31:49.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.988+0000 7f2af2ffd700 1 -- 172.21.15.146:0/282195464 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aec014a70 con 0x7f2adc003a00 2023-05-24T03:31:49.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.988+0000 7f2af2ffd700 1 -- 172.21.15.146:0/282195464 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aec012b90 con 0x7f2adc003a00 2023-05-24T03:31:49.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.989+0000 7f2afa7dd700 1 -- 172.21.15.146:0/282195464 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2adc003a00 msgr2=0x7f2adc003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:49.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.989+0000 7f2afa7dd700 1 --2- 172.21.15.146:0/282195464 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2adc003a00 0x7f2adc003e10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2aec014130 tx=0x7f2adc005880 comp rx=0 tx=0).stop 2023-05-24T03:31:49.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.990+0000 7f2afa7dd700 1 -- 172.21.15.146:0/282195464 shutdown_connections 2023-05-24T03:31:49.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.990+0000 7f2afa7dd700 1 --2- 172.21.15.146:0/282195464 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2adc003a00 0x7f2adc003e10 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:49.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.990+0000 7f2afa7dd700 1 -- 172.21.15.146:0/282195464 >> 172.21.15.146:0/282195464 conn(0x7f2af40cc430 msgr2=0x7f2af40ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:31:49.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.990+0000 7f2afa7dd700 1 -- 172.21.15.146:0/282195464 shutdown_connections 2023-05-24T03:31:49.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.990+0000 7f2afa7dd700 1 -- 172.21.15.146:0/282195464 wait complete. 2023-05-24T03:31:49.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.991+0000 7f2afa7dd700 1 Processor -- start 2023-05-24T03:31:49.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.992+0000 7f2afa7dd700 1 -- start start 2023-05-24T03:31:49.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.993+0000 7f2afa7dd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2adc003a00 0x7f2af40c38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:49.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.993+0000 7f2afa7dd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2af40c4f60 0x7f2af4147d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:49.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.993+0000 7f2afa7dd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2af414afc0 0x7f2af40c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:49.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.993+0000 7f2afa7dd700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af40ae030 con 0x7f2adc003a00 2023-05-24T03:31:49.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.993+0000 7f2afa7dd700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af40c4ad0 con 0x7f2af414afc0 2023-05-24T03:31:49.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.993+0000 7f2afa7dd700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2af41482c0 con 0x7f2af40c4f60 2023-05-24T03:31:49.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.993+0000 7f2af3fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2adc003a00 0x7f2af40c38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:49.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.993+0000 7f2af3fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2adc003a00 0x7f2af40c38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40136/0 (socket says 172.21.15.146:40136) 2023-05-24T03:31:49.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.993+0000 7f2af3fff700 1 -- 172.21.15.146:0/3741113183 learned_addr learned my addr 172.21.15.146:0/3741113183 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:31:49.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.993+0000 7f2af37fe700 1 --2- 172.21.15.146:0/3741113183 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2af40c4f60 0x7f2af4147d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:49.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.993+0000 7f2af8d7a700 1 --2- 172.21.15.146:0/3741113183 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2af414afc0 0x7f2af40c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:49.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.993+0000 7f2af37fe700 1 -- 172.21.15.146:0/3741113183 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2af414afc0 msgr2=0x7f2af40c5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:49.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.993+0000 7f2af37fe700 1 --2- 172.21.15.146:0/3741113183 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2af414afc0 0x7f2af40c5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:49.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.993+0000 7f2af37fe700 1 -- 172.21.15.146:0/3741113183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2adc003a00 msgr2=0x7f2af40c38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:49.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.993+0000 7f2af37fe700 1 --2- 172.21.15.146:0/3741113183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2adc003a00 0x7f2af40c38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:49.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.993+0000 7f2af37fe700 1 -- 172.21.15.146:0/3741113183 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af406c160 con 0x7f2af40c4f60 2023-05-24T03:31:49.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.993+0000 7f2af3fff700 1 --2- 172.21.15.146:0/3741113183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2adc003a00 0x7f2af40c38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T03:31:49.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.994+0000 7f2af37fe700 1 --2- 172.21.15.146:0/3741113183 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2af40c4f60 0x7f2af4147d80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2af4064130 tx=0x7f2ae400fa50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:49.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.994+0000 7f2af0ff9700 1 -- 172.21.15.146:0/3741113183 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae40052e0 con 0x7f2af40c4f60 2023-05-24T03:31:49.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.994+0000 7f2af0ff9700 1 -- 172.21.15.146:0/3741113183 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae4005440 con 0x7f2af40c4f60 2023-05-24T03:31:49.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.994+0000 7f2af0ff9700 1 -- 172.21.15.146:0/3741113183 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae40038c0 con 0x7f2af40c4f60 2023-05-24T03:31:49.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.994+0000 7f2afa7dd700 1 -- 172.21.15.146:0/3741113183 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2af40cf9a0 con 0x7f2af40c4f60 2023-05-24T03:31:49.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.994+0000 7f2afa7dd700 1 -- 172.21.15.146:0/3741113183 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2af406c440 con 0x7f2af40c4f60 2023-05-24T03:31:49.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.996+0000 7f2af0ff9700 1 -- 172.21.15.146:0/3741113183 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2ae4003a20 con 0x7f2af40c4f60 2023-05-24T03:31:49.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.996+0000 7f2afa7dd700 1 -- 172.21.15.146:0/3741113183 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2af4068d00 con 0x7f2af40c4f60 2023-05-24T03:31:49.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.997+0000 7f2af0ff9700 1 --2- 172.21.15.146:0/3741113183 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f2ae006ace0 0x7f2ae006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:49.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.997+0000 7f2af0ff9700 1 -- 172.21.15.146:0/3741113183 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2ae40892f0 con 0x7f2af40c4f60 2023-05-24T03:31:49.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.997+0000 7f2af3fff700 1 --2- 172.21.15.146:0/3741113183 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f2ae006ace0 0x7f2ae006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:49.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:48.997+0000 7f2af3fff700 1 --2- 172.21.15.146:0/3741113183 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f2ae006ace0 0x7f2ae006d190 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2aec014fd0 tx=0x7f2aec018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:49.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.002+0000 7f2af0ff9700 1 -- 172.21.15.146:0/3741113183 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f2ae4054070 con 0x7f2af40c4f60 2023-05-24T03:31:49.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.289+0000 7f2afa7dd700 1 -- 172.21.15.146:0/3741113183 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2af40b4ce0 con 0x7f2af40c4f60 2023-05-24T03:31:49.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.290+0000 7f2af0ff9700 1 -- 172.21.15.146:0/3741113183 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2ae4057690 con 0x7f2af40c4f60 2023-05-24T03:31:49.295 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2023-05-24T03:31:49.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.292+0000 7f2afa7dd700 1 -- 172.21.15.146:0/3741113183 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f2ae006ace0 msgr2=0x7f2ae006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:49.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.292+0000 7f2afa7dd700 1 --2- 172.21.15.146:0/3741113183 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f2ae006ace0 0x7f2ae006d190 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2aec014fd0 tx=0x7f2aec018000 comp rx=0 tx=0).stop 2023-05-24T03:31:49.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.292+0000 7f2afa7dd700 1 -- 172.21.15.146:0/3741113183 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2af40c4f60 msgr2=0x7f2af4147d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:49.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.292+0000 7f2afa7dd700 1 --2- 172.21.15.146:0/3741113183 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2af40c4f60 0x7f2af4147d80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2af4064130 tx=0x7f2ae400fa50 comp rx=0 tx=0).stop 2023-05-24T03:31:49.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.292+0000 7f2afa7dd700 1 -- 172.21.15.146:0/3741113183 shutdown_connections 2023-05-24T03:31:49.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.292+0000 7f2afa7dd700 1 --2- 172.21.15.146:0/3741113183 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f2ae006ace0 0x7f2ae006d190 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:49.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.292+0000 7f2afa7dd700 1 --2- 172.21.15.146:0/3741113183 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2af414afc0 0x7f2af40c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:49.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.292+0000 7f2afa7dd700 1 --2- 172.21.15.146:0/3741113183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2adc003a00 0x7f2af40c38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:49.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.292+0000 7f2afa7dd700 1 --2- 172.21.15.146:0/3741113183 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2af40c4f60 0x7f2af4147d80 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:49.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.292+0000 7f2afa7dd700 1 -- 172.21.15.146:0/3741113183 >> 172.21.15.146:0/3741113183 conn(0x7f2af40cc430 msgr2=0x7f2af40aef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:31:49.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.292+0000 7f2afa7dd700 1 -- 172.21.15.146:0/3741113183 shutdown_connections 2023-05-24T03:31:49.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.292+0000 7f2afa7dd700 1 -- 172.21.15.146:0/3741113183 wait complete. 2023-05-24T03:31:49.314 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-24T03:31:49.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.477+0000 7f12dd5ea700 1 Processor -- start 2023-05-24T03:31:49.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.477+0000 7f12dd5ea700 1 -- start start 2023-05-24T03:31:49.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.478+0000 7f12dd5ea700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12d8070be0 0x7f12d80adc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:49.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.478+0000 7f12dd5ea700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12d80ad0d0 con 0x7f12d80707b0 2023-05-24T03:31:49.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.478+0000 7f12dd5ea700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12d815d200 con 0x7f12d815ce30 2023-05-24T03:31:49.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.478+0000 7f12dd5ea700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12d80ac8b0 con 0x7f12d8070be0 2023-05-24T03:31:49.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.478+0000 7f12cffff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f12d80707b0 0x7f12d80ad560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46598/0 (socket says 172.21.15.146:46598) 2023-05-24T03:31:49.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.478+0000 7f12cffff700 1 -- 172.21.15.146:0/321916427 learned_addr learned my addr 172.21.15.146:0/321916427 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:31:49.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.478+0000 7f12d77fe700 1 --2- 172.21.15.146:0/321916427 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12d8070be0 0x7f12d80adc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:49.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.478+0000 7f12d67fc700 1 -- 172.21.15.146:0/321916427 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 140274624 0 0) 0x7f12d80ad0d0 con 0x7f12d80707b0 2023-05-24T03:31:49.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.478+0000 7f12d67fc700 1 -- 172.21.15.146:0/321916427 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12c40035b0 con 0x7f12d80707b0 2023-05-24T03:31:49.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.478+0000 7f12d67fc700 1 -- 172.21.15.146:0/321916427 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3929520181 0 0) 0x7f12d815d200 con 0x7f12d815ce30 2023-05-24T03:31:49.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.478+0000 7f12d67fc700 1 -- 172.21.15.146:0/321916427 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12d80ad0d0 con 0x7f12d815ce30 2023-05-24T03:31:49.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.478+0000 7f12d77fe700 1 -- 172.21.15.146:0/321916427 >> v1:172.21.15.151:6789/0 conn(0x7f12d815ce30 legacy=0x7f12d80c9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:49.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.478+0000 7f12d77fe700 1 -- 172.21.15.146:0/321916427 >> v1:172.21.15.146:6789/0 conn(0x7f12d80707b0 legacy=0x7f12d80ad560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:49.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.478+0000 7f12d77fe700 1 -- 172.21.15.146:0/321916427 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d80acac0 con 0x7f12d8070be0 2023-05-24T03:31:49.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.478+0000 7f12d77fe700 1 --2- 172.21.15.146:0/321916427 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12d8070be0 0x7f12d80adc70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f12d0009dc0 tx=0x7f12d000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbc2150cb6e2dc9b server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:49.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.479+0000 7f12d67fc700 1 -- 172.21.15.146:0/321916427 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d000e070 con 0x7f12d8070be0 2023-05-24T03:31:49.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.479+0000 7f12d67fc700 1 -- 172.21.15.146:0/321916427 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12d000bb20 con 0x7f12d8070be0 2023-05-24T03:31:49.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.479+0000 7f12d67fc700 1 -- 172.21.15.146:0/321916427 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d0012430 con 0x7f12d8070be0 2023-05-24T03:31:49.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.479+0000 7f12dd5ea700 1 -- 172.21.15.146:0/321916427 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12d8070be0 msgr2=0x7f12d80adc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:49.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.479+0000 7f12dd5ea700 1 --2- 172.21.15.146:0/321916427 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12d8070be0 0x7f12d80adc70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f12d0009dc0 tx=0x7f12d000b330 comp rx=0 tx=0).stop 2023-05-24T03:31:49.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.479+0000 7f12dd5ea700 1 -- 172.21.15.146:0/321916427 shutdown_connections 2023-05-24T03:31:49.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.479+0000 7f12dd5ea700 1 --2- 172.21.15.146:0/321916427 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12d8070be0 0x7f12d80adc70 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:49.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.479+0000 7f12dd5ea700 1 -- 172.21.15.146:0/321916427 >> 172.21.15.146:0/321916427 conn(0x7f12d80cf6c0 msgr2=0x7f12d80cfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:31:49.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.480+0000 7f12dd5ea700 1 -- 172.21.15.146:0/321916427 shutdown_connections 2023-05-24T03:31:49.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.480+0000 7f12dd5ea700 1 -- 172.21.15.146:0/321916427 wait complete. 2023-05-24T03:31:49.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.481+0000 7f12dd5ea700 1 Processor -- start 2023-05-24T03:31:49.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.481+0000 7f12dd5ea700 1 -- start start 2023-05-24T03:31:49.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.482+0000 7f12dd5ea700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12d80707b0 0x7f12d81479b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:49.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.482+0000 7f12dd5ea700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12d8070be0 0x7f12d80ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:49.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.482+0000 7f12dd5ea700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12d815ce30 0x7f12d80cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:49.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.482+0000 7f12dd5ea700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d80b3530 con 0x7f12d815ce30 2023-05-24T03:31:49.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.482+0000 7f12dd5ea700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d80b2920 con 0x7f12d8070be0 2023-05-24T03:31:49.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.482+0000 7f12dd5ea700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12d80b2c00 con 0x7f12d80707b0 2023-05-24T03:31:49.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.482+0000 7f12d77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12d815ce30 0x7f12d80cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:49.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.482+0000 7f12d77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12d815ce30 0x7f12d80cc0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40154/0 (socket says 172.21.15.146:40154) 2023-05-24T03:31:49.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.482+0000 7f12d77fe700 1 -- 172.21.15.146:0/1028829236 learned_addr learned my addr 172.21.15.146:0/1028829236 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:31:49.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.482+0000 7f12d6ffd700 1 --2- 172.21.15.146:0/1028829236 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12d80707b0 0x7f12d81479b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:49.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.482+0000 7f12d77fe700 1 -- 172.21.15.146:0/1028829236 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12d80707b0 msgr2=0x7f12d81479b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:49.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.482+0000 7f12d77fe700 1 --2- 172.21.15.146:0/1028829236 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12d80707b0 0x7f12d81479b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:49.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.482+0000 7f12d77fe700 1 -- 172.21.15.146:0/1028829236 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12d8070be0 msgr2=0x7f12d80ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:49.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.482+0000 7f12d77fe700 1 --2- 172.21.15.146:0/1028829236 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12d8070be0 0x7f12d80ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:49.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.482+0000 7f12d77fe700 1 -- 172.21.15.146:0/1028829236 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d0009a70 con 0x7f12d815ce30 2023-05-24T03:31:49.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.482+0000 7f12d6ffd700 1 --2- 172.21.15.146:0/1028829236 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12d80707b0 0x7f12d81479b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:31:49.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.482+0000 7f12d77fe700 1 --2- 172.21.15.146:0/1028829236 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12d815ce30 0x7f12d80cc0d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f12d000b370 tx=0x7f12d0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:49.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.482+0000 7f12cf7fe700 1 -- 172.21.15.146:0/1028829236 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d001b810 con 0x7f12d815ce30 2023-05-24T03:31:49.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.483+0000 7f12dd5ea700 1 -- 172.21.15.146:0/1028829236 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12d80ca8e0 con 0x7f12d815ce30 2023-05-24T03:31:49.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.483+0000 7f12cf7fe700 1 -- 172.21.15.146:0/1028829236 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12d0020070 con 0x7f12d815ce30 2023-05-24T03:31:49.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.483+0000 7f12cf7fe700 1 -- 172.21.15.146:0/1028829236 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d001bbf0 con 0x7f12d815ce30 2023-05-24T03:31:49.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.483+0000 7f12dd5ea700 1 -- 172.21.15.146:0/1028829236 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12d80ca670 con 0x7f12d815ce30 2023-05-24T03:31:49.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.484+0000 7f12dd5ea700 1 -- 172.21.15.146:0/1028829236 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12d80acd60 con 0x7f12d815ce30 2023-05-24T03:31:49.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.485+0000 7f12cf7fe700 1 -- 172.21.15.146:0/1028829236 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f12d001bd50 con 0x7f12d815ce30 2023-05-24T03:31:49.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.485+0000 7f12cf7fe700 1 --2- 172.21.15.146:0/1028829236 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f12b806ace0 0x7f12b806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:49.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.485+0000 7f12d6ffd700 1 --2- 172.21.15.146:0/1028829236 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f12b806ace0 0x7f12b806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:49.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.486+0000 7f12d6ffd700 1 --2- 172.21.15.146:0/1028829236 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f12b806ace0 0x7f12b806d190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f12c8007fd0 tx=0x7f12c8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:49.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.491+0000 7f12cf7fe700 1 -- 172.21.15.146:0/1028829236 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f12d0022070 con 0x7f12d815ce30 2023-05-24T03:31:49.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.491+0000 7f12cf7fe700 1 -- 172.21.15.146:0/1028829236 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f12d0056960 con 0x7f12d815ce30 2023-05-24T03:31:49.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.800+0000 7f12dd5ea700 1 -- 172.21.15.146:0/1028829236 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f12d804e810 con 0x7f12d815ce30 2023-05-24T03:31:49.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.800+0000 7f12cf7fe700 1 -- 172.21.15.146:0/1028829236 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v30) v1 ==== 80+0+0 (secure 0 0 0) 0x7f12d0059f80 con 0x7f12d815ce30 2023-05-24T03:31:49.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.803+0000 7f12dd5ea700 1 -- 172.21.15.146:0/1028829236 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f12b806ace0 msgr2=0x7f12b806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:49.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.803+0000 7f12dd5ea700 1 --2- 172.21.15.146:0/1028829236 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f12b806ace0 0x7f12b806d190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f12c8007fd0 tx=0x7f12c8009040 comp rx=0 tx=0).stop 2023-05-24T03:31:49.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.803+0000 7f12dd5ea700 1 -- 172.21.15.146:0/1028829236 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12d815ce30 msgr2=0x7f12d80cc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:49.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.803+0000 7f12dd5ea700 1 --2- 172.21.15.146:0/1028829236 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12d815ce30 0x7f12d80cc0d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f12d000b370 tx=0x7f12d0004ad0 comp rx=0 tx=0).stop 2023-05-24T03:31:49.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.803+0000 7f12dd5ea700 1 -- 172.21.15.146:0/1028829236 shutdown_connections 2023-05-24T03:31:49.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.803+0000 7f12dd5ea700 1 --2- 172.21.15.146:0/1028829236 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f12b806ace0 0x7f12b806d190 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:49.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.803+0000 7f12dd5ea700 1 --2- 172.21.15.146:0/1028829236 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12d815ce30 0x7f12d80cc0d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:49.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.803+0000 7f12dd5ea700 1 --2- 172.21.15.146:0/1028829236 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12d80707b0 0x7f12d81479b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:49.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.803+0000 7f12dd5ea700 1 --2- 172.21.15.146:0/1028829236 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12d8070be0 0x7f12d80ce9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:49.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.803+0000 7f12dd5ea700 1 -- 172.21.15.146:0/1028829236 >> 172.21.15.146:0/1028829236 conn(0x7f12d80cf6c0 msgr2=0x7f12d806b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:31:49.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.804+0000 7f12dd5ea700 1 -- 172.21.15.146:0/1028829236 shutdown_connections 2023-05-24T03:31:49.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:49.804+0000 7f12dd5ea700 1 -- 172.21.15.146:0/1028829236 wait complete. 2023-05-24T03:31:49.811 INFO:teuthology.orchestra.run.smithi146.stderr:listed 0 entries 2023-05-24T03:31:49.827 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-05-24T03:31:49.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:31:49.829 DEBUG:teuthology.orchestra.run.smithi146:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-05-24T03:31:50.173 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2023-05-24T03:31:50.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:31:50.174 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-05-24T03:31:50.210 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-05-24T03:31:50.210 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-24T03:31:50.271 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-05-24T03:31:50.271 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-24T03:31:50.333 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-24T03:31:50.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.540+0000 7fcbac390700 1 Processor -- start 2023-05-24T03:31:50.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.540+0000 7fcbac390700 1 -- start start 2023-05-24T03:31:50.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.541+0000 7fcbac390700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcba40b1190 0x7fcba406fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:50.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.541+0000 7fcbac390700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcba40c1c70 0x7fcba40c20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:50.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.541+0000 7fcbac390700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcba4161310 con 0x7fcba4160f40 2023-05-24T03:31:50.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.541+0000 7fcbac390700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcba40c25e0 con 0x7fcba40c1c70 2023-05-24T03:31:50.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.541+0000 7fcbac390700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcba40cb680 con 0x7fcba40b1190 2023-05-24T03:31:50.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.542+0000 7fcbaa92d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcba40c1c70 0x7fcba40c20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:50.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.542+0000 7fcbaa92d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcba40c1c70 0x7fcba40c20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40158/0 (socket says 172.21.15.146:40158) 2023-05-24T03:31:50.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.542+0000 7fcbaa92d700 1 -- 172.21.15.146:0/2580985201 learned_addr learned my addr 172.21.15.146:0/2580985201 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:31:50.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.542+0000 7fcba992b700 1 --2- 172.21.15.146:0/2580985201 >> v2:172.21.15.151:3300/0 conn(0x7fcba40b1190 0x7fcba406fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:50.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.542+0000 7fcbaa92d700 1 -- 172.21.15.146:0/2580985201 >> v2:172.21.15.151:3300/0 conn(0x7fcba40b1190 msgr2=0x7fcba406fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:31:50.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.542+0000 7fcbaa92d700 1 --2- 172.21.15.146:0/2580985201 >> v2:172.21.15.151:3300/0 conn(0x7fcba40b1190 0x7fcba406fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:50.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.542+0000 7fcbaa92d700 1 -- 172.21.15.146:0/2580985201 >> v1:172.21.15.151:6789/0 conn(0x7fcba4160f40 legacy=0x7fcba40b0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:50.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.542+0000 7fcbaa92d700 1 -- 172.21.15.146:0/2580985201 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba40cab00 con 0x7fcba40c1c70 2023-05-24T03:31:50.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.543+0000 7fcbaa92d700 1 --2- 172.21.15.146:0/2580985201 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcba40c1c70 0x7fcba40c20a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fcba406e410 tx=0x7fcb94009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e220a8e813e34526 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:50.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.543+0000 7fcba912a700 1 -- 172.21.15.146:0/2580985201 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb94011830 con 0x7fcba40c1c70 2023-05-24T03:31:50.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.543+0000 7fcba912a700 1 -- 172.21.15.146:0/2580985201 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb94011990 con 0x7fcba40c1c70 2023-05-24T03:31:50.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.543+0000 7fcba912a700 1 -- 172.21.15.146:0/2580985201 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb94011d00 con 0x7fcba40c1c70 2023-05-24T03:31:50.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.544+0000 7fcbac390700 1 -- 172.21.15.146:0/2580985201 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcba40c1c70 msgr2=0x7fcba40c20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:50.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.544+0000 7fcbac390700 1 --2- 172.21.15.146:0/2580985201 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcba40c1c70 0x7fcba40c20a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fcba406e410 tx=0x7fcb94009bd0 comp rx=0 tx=0).stop 2023-05-24T03:31:50.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.544+0000 7fcbac390700 1 -- 172.21.15.146:0/2580985201 shutdown_connections 2023-05-24T03:31:50.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.544+0000 7fcbac390700 1 --2- 172.21.15.146:0/2580985201 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcba40c1c70 0x7fcba40c20a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:50.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.544+0000 7fcbac390700 1 --2- 172.21.15.146:0/2580985201 >> v2:172.21.15.151:3300/0 conn(0x7fcba40b1190 0x7fcba406fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:50.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.545+0000 7fcbac390700 1 -- 172.21.15.146:0/2580985201 >> 172.21.15.146:0/2580985201 conn(0x7fcba406b0b0 msgr2=0x7fcba40cedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:31:50.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.547+0000 7fcbac390700 1 -- 172.21.15.146:0/2580985201 shutdown_connections 2023-05-24T03:31:50.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.548+0000 7fcbac390700 1 -- 172.21.15.146:0/2580985201 wait complete. 2023-05-24T03:31:50.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.549+0000 7fcbac390700 1 Processor -- start 2023-05-24T03:31:50.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.550+0000 7fcbac390700 1 -- start start 2023-05-24T03:31:50.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.551+0000 7fcbac390700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcba40b1190 0x7fcba40c3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:50.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.551+0000 7fcbac390700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcba40c1c70 0x7fcba41f6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:50.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.551+0000 7fcbac390700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcba4160f40 0x7fcba41f5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:50.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.551+0000 7fcbac390700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba41f71a0 con 0x7fcba40b1190 2023-05-24T03:31:50.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.551+0000 7fcbac390700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba41f6030 con 0x7fcba4160f40 2023-05-24T03:31:50.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.551+0000 7fcbac390700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcba40b3bc0 con 0x7fcba40c1c70 2023-05-24T03:31:50.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.551+0000 7fcba992b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcba40c1c70 0x7fcba41f6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:50.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.551+0000 7fcbaa92d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcba4160f40 0x7fcba41f5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:50.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.551+0000 7fcba992b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcba40c1c70 0x7fcba41f6c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:53028/0 (socket says 172.21.15.146:53028) 2023-05-24T03:31:50.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.551+0000 7fcba992b700 1 -- 172.21.15.146:0/247823116 learned_addr learned my addr 172.21.15.146:0/247823116 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:31:50.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.551+0000 7fcbaa12c700 1 --2- 172.21.15.146:0/247823116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcba40b1190 0x7fcba40c3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:50.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.551+0000 7fcbaa12c700 1 -- 172.21.15.146:0/247823116 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcba40c1c70 msgr2=0x7fcba41f6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:50.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.551+0000 7fcbaa12c700 1 --2- 172.21.15.146:0/247823116 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcba40c1c70 0x7fcba41f6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:50.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.551+0000 7fcbaa12c700 1 -- 172.21.15.146:0/247823116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcba4160f40 msgr2=0x7fcba41f5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:50.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.551+0000 7fcbaa12c700 1 --2- 172.21.15.146:0/247823116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcba4160f40 0x7fcba41f5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:50.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.551+0000 7fcbaa12c700 1 -- 172.21.15.146:0/247823116 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb94009550 con 0x7fcba40b1190 2023-05-24T03:31:50.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.552+0000 7fcbaa12c700 1 --2- 172.21.15.146:0/247823116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcba40b1190 0x7fcba40c3c50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fcba0000f60 tx=0x7fcba000c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:50.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.553+0000 7fcb9affd700 1 -- 172.21.15.146:0/247823116 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba00052d0 con 0x7fcba40b1190 2023-05-24T03:31:50.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.553+0000 7fcb9affd700 1 -- 172.21.15.146:0/247823116 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcba0005430 con 0x7fcba40b1190 2023-05-24T03:31:50.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.553+0000 7fcbac390700 1 -- 172.21.15.146:0/247823116 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcba40cb0c0 con 0x7fcba40b1190 2023-05-24T03:31:50.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.553+0000 7fcbac390700 1 -- 172.21.15.146:0/247823116 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcba40cade0 con 0x7fcba40b1190 2023-05-24T03:31:50.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.553+0000 7fcb9affd700 1 -- 172.21.15.146:0/247823116 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba00038c0 con 0x7fcba40b1190 2023-05-24T03:31:50.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.554+0000 7fcbac390700 1 -- 172.21.15.146:0/247823116 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb8c0052f0 con 0x7fcba40b1190 2023-05-24T03:31:50.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.555+0000 7fcb9affd700 1 -- 172.21.15.146:0/247823116 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcba0003a20 con 0x7fcba40b1190 2023-05-24T03:31:50.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.556+0000 7fcb9affd700 1 --2- 172.21.15.146:0/247823116 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fcb8806ace0 0x7fcb8806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:50.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.556+0000 7fcb9affd700 1 -- 172.21.15.146:0/247823116 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fcba0088890 con 0x7fcba40b1190 2023-05-24T03:31:50.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.559+0000 7fcba992b700 1 --2- 172.21.15.146:0/247823116 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fcb8806ace0 0x7fcb8806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:50.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.559+0000 7fcba992b700 1 --2- 172.21.15.146:0/247823116 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fcb8806ace0 0x7fcb8806d190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fcba4156030 tx=0x7fcb9c00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:50.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.562+0000 7fcb9affd700 1 -- 172.21.15.146:0/247823116 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fcba0053600 con 0x7fcba40b1190 2023-05-24T03:31:50.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.934+0000 7fcbac390700 1 -- 172.21.15.146:0/247823116 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcb8c0055a0 con 0x7fcba40b1190 2023-05-24T03:31:50.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.937+0000 7fcb9affd700 1 -- 172.21.15.146:0/247823116 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20251 (secure 0 0 0) 0x7fcba0056c20 con 0x7fcba40b1190 2023-05-24T03:31:50.942 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:31:50.942 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":30,"fsid":"11ca0adb-7672-4713-bde7-451e8b743ae9","created":"2023-05-24T03:29:19.113659+0000","modified":"2023-05-24T03:30:25.932188+0000","last_up_change":"2023-05-24T03:29:30.962339+0000","last_in_change":"2023-05-24T03:29:21.706540+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-24T03:29:32.749984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-24T03:29:37.719623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-24T03:29:42.165379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-24T03:29:43.431615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-24T03:29:46.503075+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f24b319b-fcc8-4385-b0cb-78138fc31417","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6801","nonce":3353593100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6803","nonce":3353593100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6807","nonce":3353593100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6805","nonce":3353593100}]},"public_addr":"172.21.15.146:6801/3353593100","cluster_addr":"172.21.15.146:6803/3353593100","heartbeat_back_addr":"172.21.15.146:6807/3353593100","heartbeat_front_addr":"172.21.15.146:6805/3353593100","state":["exists","up"]},{"osd":1,"uuid":"c9639ea9-8f9b-498e-92c8-aa976edbf1da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6821","nonce":2537488734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6825","nonce":2537488734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6831","nonce":2537488734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6827","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6829","nonce":2537488734}]},"public_addr":"172.21.15.146:6821/2537488734","cluster_addr":"172.21.15.146:6825/2537488734","heartbeat_back_addr":"172.21.15.146:6831/2537488734","heartbeat_front_addr":"172.21.15.146:6829/2537488734","state":["exists","up"]},{"osd":2,"uuid":"7a6cfc6d-b0ca-4cb6-a66d-4001ec184657","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6809","nonce":1800242932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6811","nonce":1800242932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6815","nonce":1800242932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6813","nonce":1800242932}]},"public_addr":"172.21.15.146:6809/1800242932","cluster_addr":"172.21.15.146:6811/1800242932","heartbeat_back_addr":"172.21.15.146:6815/1800242932","heartbeat_front_addr":"172.21.15.146:6813/1800242932","state":["exists","up"]},{"osd":3,"uuid":"401509f7-cecd-44a2-b0ae-22c81a5d93c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6817","nonce":1749783580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6820","nonce":1749783580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6828","nonce":1749783580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6824","nonce":1749783580}]},"public_addr":"172.21.15.146:6817/1749783580","cluster_addr":"172.21.15.146:6820/1749783580","heartbeat_back_addr":"172.21.15.146:6828/1749783580","heartbeat_front_addr":"172.21.15.146:6824/1749783580","state":["exists","up"]},{"osd":4,"uuid":"9d07f440-d125-4f99-a825-411fab894d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6811","nonce":163453435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6814","nonce":163453435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6819","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6821","nonce":163453435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6818","nonce":163453435}]},"public_addr":"172.21.15.151:6811/163453435","cluster_addr":"172.21.15.151:6814/163453435","heartbeat_back_addr":"172.21.15.151:6821/163453435","heartbeat_front_addr":"172.21.15.151:6818/163453435","state":["exists","up"]},{"osd":5,"uuid":"9b2266e2-9e52-4f0e-96da-e703a6c23a6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6801","nonce":3283474903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6803","nonce":3283474903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6807","nonce":3283474903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6805","nonce":3283474903}]},"public_addr":"172.21.15.151:6801/3283474903","cluster_addr":"172.21.15.151:6803/3283474903","heartbeat_back_addr":"172.21.15.151:6807/3283474903","heartbeat_front_addr":"172.21.15.151:6805/3283474903","state":["exists","up"]},{"osd":6,"uuid":"5daedf77-0a83-49e7-b497-d9ed10436972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6825","nonce":3889424178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6827","nonce":3889424178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6831","nonce":3889424178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6829","nonce":3889424178}]},"public_addr":"172.21.15.151:6825/3889424178","cluster_addr":"172.21.15.151:6827/3889424178","heartbeat_back_addr":"172.21.15.151:6831/3889424178","heartbeat_front_addr":"172.21.15.151:6829/3889424178","state":["exists","up"]},{"osd":7,"uuid":"86ae4f7e-c01f-4c3d-a0dd-98160c209309","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6810","nonce":563291208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6815","nonce":563291208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6823","nonce":563291208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6820","nonce":563291208}]},"public_addr":"172.21.15.151:6810/563291208","cluster_addr":"172.21.15.151:6815/563291208","heartbeat_back_addr":"172.21.15.151:6823/563291208","heartbeat_front_addr":"172.21.15.151:6820/563291208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.872472+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.937126+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.877234+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.884793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.881632+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.938293+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.857661+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.945883+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.9","mappings":[{"from":1,"to":5}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-24T03:31:50.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.940+0000 7fcbac390700 1 -- 172.21.15.146:0/247823116 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fcb8806ace0 msgr2=0x7fcb8806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:50.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.940+0000 7fcbac390700 1 --2- 172.21.15.146:0/247823116 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fcb8806ace0 0x7fcb8806d190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fcba4156030 tx=0x7fcb9c00b040 comp rx=0 tx=0).stop 2023-05-24T03:31:50.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.940+0000 7fcbac390700 1 -- 172.21.15.146:0/247823116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcba40b1190 msgr2=0x7fcba40c3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:50.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.940+0000 7fcbac390700 1 --2- 172.21.15.146:0/247823116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcba40b1190 0x7fcba40c3c50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fcba0000f60 tx=0x7fcba000c6e0 comp rx=0 tx=0).stop 2023-05-24T03:31:50.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.941+0000 7fcbac390700 1 -- 172.21.15.146:0/247823116 shutdown_connections 2023-05-24T03:31:50.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.941+0000 7fcbac390700 1 --2- 172.21.15.146:0/247823116 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fcb8806ace0 0x7fcb8806d190 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:50.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.941+0000 7fcbac390700 1 --2- 172.21.15.146:0/247823116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcba4160f40 0x7fcba41f5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:50.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.941+0000 7fcbac390700 1 --2- 172.21.15.146:0/247823116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcba40b1190 0x7fcba40c3c50 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:50.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.941+0000 7fcbac390700 1 --2- 172.21.15.146:0/247823116 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcba40c1c70 0x7fcba41f6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:50.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.941+0000 7fcbac390700 1 -- 172.21.15.146:0/247823116 >> 172.21.15.146:0/247823116 conn(0x7fcba406b0b0 msgr2=0x7fcba41605c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:31:50.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.941+0000 7fcbac390700 1 -- 172.21.15.146:0/247823116 shutdown_connections 2023-05-24T03:31:50.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:50.941+0000 7fcbac390700 1 -- 172.21.15.146:0/247823116 wait complete. 2023-05-24T03:31:50.966 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-24T03:29:32.749984+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-24T03:29:37.719623+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-24T03:29:42.165379+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-24T03:29:43.431615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-24T03:29:46.503075+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-24T03:31:50.968 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-24T03:31:51.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.181+0000 7f287eff8700 1 Processor -- start 2023-05-24T03:31:51.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.181+0000 7f287eff8700 1 -- start start 2023-05-24T03:31:51.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.182+0000 7f287eff8700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f28780aefd0 0x7f28780cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:51.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.182+0000 7f287eff8700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28780cfd00 con 0x7f287815cd90 2023-05-24T03:31:51.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.182+0000 7f287eff8700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2878072350 con 0x7f287806a460 2023-05-24T03:31:51.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.182+0000 7f287eff8700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28780cf460 con 0x7f28780aefd0 2023-05-24T03:31:51.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.182+0000 7f2877fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f287815cd90 0x7f2878160d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46628/0 (socket says 172.21.15.146:46628) 2023-05-24T03:31:51.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.182+0000 7f287cd94700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f287806a460 0x7f287806a830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:45658/0 (socket says 172.21.15.146:45658) 2023-05-24T03:31:51.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.182+0000 7f2877fff700 1 -- 172.21.15.146:0/3386685798 learned_addr learned my addr 172.21.15.146:0/3386685798 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:31:51.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.183+0000 7f287d595700 1 --2- 172.21.15.146:0/3386685798 >> v2:172.21.15.146:3300/0 conn(0x7f28780aefd0 0x7f28780cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:51.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.183+0000 7f28777fe700 1 -- 172.21.15.146:0/3386685798 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3353930759 0 0) 0x7f2878072350 con 0x7f287806a460 2023-05-24T03:31:51.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.183+0000 7f28777fe700 1 -- 172.21.15.146:0/3386685798 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28640035b0 con 0x7f287806a460 2023-05-24T03:31:51.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.183+0000 7f28777fe700 1 -- 172.21.15.146:0/3386685798 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 87141193 0 0) 0x7f2868001110 con 0x7f287815cd90 2023-05-24T03:31:51.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.183+0000 7f28777fe700 1 -- 172.21.15.146:0/3386685798 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2878072350 con 0x7f287815cd90 2023-05-24T03:31:51.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.183+0000 7f28777fe700 1 -- 172.21.15.146:0/3386685798 <== mon.1 v1:172.21.15.151:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 283925837 0 0) 0x7f28640035b0 con 0x7f287806a460 2023-05-24T03:31:51.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.183+0000 7f28777fe700 1 -- 172.21.15.146:0/3386685798 >> v2:172.21.15.146:3300/0 conn(0x7f28780aefd0 msgr2=0x7f28780cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:31:51.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.183+0000 7f28777fe700 1 --2- 172.21.15.146:0/3386685798 >> v2:172.21.15.146:3300/0 conn(0x7f28780aefd0 0x7f28780cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:51.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.183+0000 7f28777fe700 1 -- 172.21.15.146:0/3386685798 >> v1:172.21.15.146:6789/0 conn(0x7f287815cd90 legacy=0x7f2878160d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:51.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.183+0000 7f28777fe700 1 -- 172.21.15.146:0/3386685798 --> v1:172.21.15.151:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28780cf740 con 0x7f287806a460 2023-05-24T03:31:51.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.183+0000 7f28777fe700 1 -- 172.21.15.146:0/3386685798 <== mon.1 v1:172.21.15.151:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1301887351 0 0) 0x7f2860001670 con 0x7f287806a460 2023-05-24T03:31:51.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.183+0000 7f28777fe700 1 -- 172.21.15.146:0/3386685798 >> v1:172.21.15.151:6789/0 conn(0x7f287806a460 legacy=0x7f287806a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:51.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.183+0000 7f28777fe700 1 --2- 172.21.15.146:0/3386685798 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2864004bf0 0x7f2864004fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:51.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.183+0000 7f28777fe700 1 --2- 172.21.15.146:0/3386685798 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28640037f0 0x7f2864003c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:51.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.183+0000 7f28777fe700 1 --2- 172.21.15.146:0/3386685798 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28640041a0 0x7f286400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:51.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.183+0000 7f28777fe700 1 -- 172.21.15.146:0/3386685798 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28780cf460 con 0x7f2864004bf0 2023-05-24T03:31:51.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.183+0000 7f28777fe700 1 -- 172.21.15.146:0/3386685798 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f286400c110 con 0x7f28640041a0 2023-05-24T03:31:51.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.183+0000 7f28777fe700 1 -- 172.21.15.146:0/3386685798 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f286400c2d0 con 0x7f28640037f0 2023-05-24T03:31:51.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.184+0000 7f287cd94700 1 --2- 172.21.15.146:0/3386685798 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2864004bf0 0x7f2864004fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:51.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.184+0000 7f287d595700 1 --2- 172.21.15.146:0/3386685798 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28640041a0 0x7f286400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:51.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.184+0000 7f287cd94700 1 -- 172.21.15.146:0/3386685798 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28640037f0 msgr2=0x7f2864003c60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-05-24T03:31:51.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.184+0000 7f287cd94700 1 --2- 172.21.15.146:0/3386685798 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28640037f0 0x7f2864003c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:51.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.184+0000 7f287cd94700 1 -- 172.21.15.146:0/3386685798 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28640041a0 msgr2=0x7f286400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:31:51.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.184+0000 7f287cd94700 1 --2- 172.21.15.146:0/3386685798 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28640041a0 0x7f286400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:51.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.184+0000 7f287d595700 1 -- 172.21.15.146:0/3386685798 reap_dead start 2023-05-24T03:31:51.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.184+0000 7f287cd94700 1 -- 172.21.15.146:0/3386685798 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28780cf740 con 0x7f2864004bf0 2023-05-24T03:31:51.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.184+0000 7f287cd94700 1 --2- 172.21.15.146:0/3386685798 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2864004bf0 0x7f2864004fe0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f286000c210 tx=0x7f2864005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16fbcc7d7e6dae01 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:51.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.185+0000 7f28777fe700 1 -- 172.21.15.146:0/3386685798 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2860007b70 con 0x7f2864004bf0 2023-05-24T03:31:51.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.185+0000 7f28777fe700 1 -- 172.21.15.146:0/3386685798 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286000cd30 con 0x7f2864004bf0 2023-05-24T03:31:51.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.185+0000 7f28777fe700 1 -- 172.21.15.146:0/3386685798 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286000cea0 con 0x7f2864004bf0 2023-05-24T03:31:51.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.186+0000 7f287eff8700 1 -- 172.21.15.146:0/3386685798 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2864004bf0 msgr2=0x7f2864004fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:51.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.186+0000 7f287eff8700 1 --2- 172.21.15.146:0/3386685798 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2864004bf0 0x7f2864004fe0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f286000c210 tx=0x7f2864005880 comp rx=0 tx=0).stop 2023-05-24T03:31:51.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.186+0000 7f287eff8700 1 -- 172.21.15.146:0/3386685798 shutdown_connections 2023-05-24T03:31:51.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.186+0000 7f287eff8700 1 --2- 172.21.15.146:0/3386685798 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2864004bf0 0x7f2864004fe0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:51.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.186+0000 7f287eff8700 1 -- 172.21.15.146:0/3386685798 >> 172.21.15.146:0/3386685798 conn(0x7f28780cfea0 msgr2=0x7f28780d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:31:51.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.187+0000 7f287eff8700 1 -- 172.21.15.146:0/3386685798 shutdown_connections 2023-05-24T03:31:51.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.187+0000 7f287eff8700 1 -- 172.21.15.146:0/3386685798 wait complete. 2023-05-24T03:31:51.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.189+0000 7f287eff8700 1 Processor -- start 2023-05-24T03:31:51.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.190+0000 7f287eff8700 1 -- start start 2023-05-24T03:31:51.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.191+0000 7f287eff8700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2864004bf0 0x7f2878088c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:51.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.191+0000 7f287eff8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28781459b0 0x7f28781e5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:51.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.191+0000 7f287eff8700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2878145e20 0x7f28781e5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:51.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.191+0000 7f287eff8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28781e8d70 con 0x7f28781459b0 2023-05-24T03:31:51.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.191+0000 7f287eff8700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28781e8a90 con 0x7f2864004bf0 2023-05-24T03:31:51.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.191+0000 7f287eff8700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f287815e2e0 con 0x7f2878145e20 2023-05-24T03:31:51.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.191+0000 7f287cd94700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2864004bf0 0x7f2878088c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:51.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.191+0000 7f287cd94700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2864004bf0 0x7f2878088c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:51366/0 (socket says 172.21.15.146:51366) 2023-05-24T03:31:51.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.191+0000 7f287cd94700 1 -- 172.21.15.146:0/4279201988 learned_addr learned my addr 172.21.15.146:0/4279201988 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:31:51.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.191+0000 7f287d595700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2878145e20 0x7f28781e5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:51.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.191+0000 7f2877fff700 1 --2- 172.21.15.146:0/4279201988 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28781459b0 0x7f28781e5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:51.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.191+0000 7f287cd94700 1 -- 172.21.15.146:0/4279201988 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2878145e20 msgr2=0x7f28781e5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:51.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.191+0000 7f287cd94700 1 --2- 172.21.15.146:0/4279201988 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2878145e20 0x7f28781e5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:51.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.191+0000 7f287cd94700 1 -- 172.21.15.146:0/4279201988 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28781459b0 msgr2=0x7f28781e5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:51.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.191+0000 7f287cd94700 1 --2- 172.21.15.146:0/4279201988 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28781459b0 0x7f28781e5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:51.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.191+0000 7f287cd94700 1 -- 172.21.15.146:0/4279201988 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2878160800 con 0x7f2864004bf0 2023-05-24T03:31:51.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.191+0000 7f287d595700 1 --2- 172.21.15.146:0/4279201988 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2878145e20 0x7f28781e5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T03:31:51.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.192+0000 7f287cd94700 1 --2- 172.21.15.146:0/4279201988 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2864004bf0 0x7f2878088c40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f286000c800 tx=0x7f2860001930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:51.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.192+0000 7f28757fa700 1 -- 172.21.15.146:0/4279201988 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2860001640 con 0x7f2864004bf0 2023-05-24T03:31:51.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.192+0000 7f28757fa700 1 -- 172.21.15.146:0/4279201988 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28600070d0 con 0x7f2864004bf0 2023-05-24T03:31:51.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.192+0000 7f28757fa700 1 -- 172.21.15.146:0/4279201988 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2860007440 con 0x7f2864004bf0 2023-05-24T03:31:51.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.193+0000 7f287eff8700 1 -- 172.21.15.146:0/4279201988 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28780cfa20 con 0x7f2864004bf0 2023-05-24T03:31:51.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.193+0000 7f287eff8700 1 -- 172.21.15.146:0/4279201988 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28780af620 con 0x7f2864004bf0 2023-05-24T03:31:51.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.195+0000 7f287eff8700 1 -- 172.21.15.146:0/4279201988 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f285c0052f0 con 0x7f2864004bf0 2023-05-24T03:31:51.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.195+0000 7f28757fa700 1 -- 172.21.15.146:0/4279201988 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f28600075a0 con 0x7f2864004bf0 2023-05-24T03:31:51.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.196+0000 7f28757fa700 1 --2- 172.21.15.146:0/4279201988 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f285806ace0 0x7f285806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:51.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.196+0000 7f28757fa700 1 -- 172.21.15.146:0/4279201988 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f286008a420 con 0x7f2864004bf0 2023-05-24T03:31:51.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.197+0000 7f2877fff700 1 --2- 172.21.15.146:0/4279201988 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f285806ace0 0x7f285806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:51.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.197+0000 7f2877fff700 1 --2- 172.21.15.146:0/4279201988 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f285806ace0 0x7f285806d190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2868000f60 tx=0x7f2868007d20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:51.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.203+0000 7f28757fa700 1 -- 172.21.15.146:0/4279201988 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f2860055230 con 0x7f2864004bf0 2023-05-24T03:31:51.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.579+0000 7f287eff8700 1 -- 172.21.15.146:0/4279201988 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f285c005b20 con 0x7f2864004bf0 2023-05-24T03:31:51.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.579+0000 7f28757fa700 1 -- 172.21.15.146:0/4279201988 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2860007cd0 con 0x7f2864004bf0 2023-05-24T03:31:51.585 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2023-05-24T03:31:51.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.583+0000 7f287eff8700 1 -- 172.21.15.146:0/4279201988 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f285806ace0 msgr2=0x7f285806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:51.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.583+0000 7f287eff8700 1 --2- 172.21.15.146:0/4279201988 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f285806ace0 0x7f285806d190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2868000f60 tx=0x7f2868007d20 comp rx=0 tx=0).stop 2023-05-24T03:31:51.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.583+0000 7f287eff8700 1 -- 172.21.15.146:0/4279201988 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2864004bf0 msgr2=0x7f2878088c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:51.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.583+0000 7f287eff8700 1 --2- 172.21.15.146:0/4279201988 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2864004bf0 0x7f2878088c40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f286000c800 tx=0x7f2860001930 comp rx=0 tx=0).stop 2023-05-24T03:31:51.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.583+0000 7f287eff8700 1 -- 172.21.15.146:0/4279201988 shutdown_connections 2023-05-24T03:31:51.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.583+0000 7f287eff8700 1 --2- 172.21.15.146:0/4279201988 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f285806ace0 0x7f285806d190 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:51.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.583+0000 7f287eff8700 1 --2- 172.21.15.146:0/4279201988 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2878145e20 0x7f28781e5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:51.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.583+0000 7f287eff8700 1 --2- 172.21.15.146:0/4279201988 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2864004bf0 0x7f2878088c40 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:51.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.583+0000 7f287eff8700 1 --2- 172.21.15.146:0/4279201988 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28781459b0 0x7f28781e5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:51.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.583+0000 7f287eff8700 1 -- 172.21.15.146:0/4279201988 >> 172.21.15.146:0/4279201988 conn(0x7f28780cfea0 msgr2=0x7f28780b2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:31:51.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.583+0000 7f287eff8700 1 -- 172.21.15.146:0/4279201988 shutdown_connections 2023-05-24T03:31:51.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.583+0000 7f287eff8700 1 -- 172.21.15.146:0/4279201988 wait complete. 2023-05-24T03:31:51.609 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-24T03:31:51.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.819+0000 7f7ba3ce7700 1 Processor -- start 2023-05-24T03:31:51.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.819+0000 7f7ba3ce7700 1 -- start start 2023-05-24T03:31:51.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.821+0000 7f7ba3ce7700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b9c1610e0 0x7f7b9c06b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:51.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.821+0000 7f7ba3ce7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7b9c0b8e60 0x7f7b9c0d0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:51.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.821+0000 7f7ba3ce7700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b9c164be0 con 0x7f7b9c0d1380 2023-05-24T03:31:51.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.821+0000 7f7ba3ce7700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b9c0d1800 con 0x7f7b9c0b8e60 2023-05-24T03:31:51.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.821+0000 7f7ba3ce7700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9c164ec0 con 0x7f7b9c1610e0 2023-05-24T03:31:51.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.821+0000 7f7ba1282700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7b9c0b8e60 0x7f7b9c0d0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:51.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.821+0000 7f7ba1282700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7b9c0b8e60 0x7f7b9c0d0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40194/0 (socket says 172.21.15.146:40194) 2023-05-24T03:31:51.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.821+0000 7f7ba1282700 1 -- 172.21.15.146:0/46697467 learned_addr learned my addr 172.21.15.146:0/46697467 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:31:51.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.822+0000 7f7ba1a83700 1 --2- 172.21.15.146:0/46697467 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b9c1610e0 0x7f7b9c06b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:51.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.822+0000 7f7ba0a81700 1 -- 172.21.15.146:0/46697467 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3970801806 0 0) 0x7f7b9c164be0 con 0x7f7b9c0d1380 2023-05-24T03:31:51.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.822+0000 7f7ba0a81700 1 -- 172.21.15.146:0/46697467 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b880035b0 con 0x7f7b9c0d1380 2023-05-24T03:31:51.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.822+0000 7f7ba1a83700 1 -- 172.21.15.146:0/46697467 >> v2:172.21.15.146:3300/0 conn(0x7f7b9c0b8e60 msgr2=0x7f7b9c0d0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:31:51.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.822+0000 7f7ba1a83700 1 --2- 172.21.15.146:0/46697467 >> v2:172.21.15.146:3300/0 conn(0x7f7b9c0b8e60 0x7f7b9c0d0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:51.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.822+0000 7f7ba1a83700 1 -- 172.21.15.146:0/46697467 >> v1:172.21.15.151:6789/0 conn(0x7f7b9c0d1380 legacy=0x7f7b9c0b4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:51.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.822+0000 7f7ba1a83700 1 -- 172.21.15.146:0/46697467 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b9c1651a0 con 0x7f7b9c1610e0 2023-05-24T03:31:51.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.823+0000 7f7ba1a83700 1 --2- 172.21.15.146:0/46697467 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b9c1610e0 0x7f7b9c06b870 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7b98009820 tx=0x7f7b98009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2007b6af34ed5e server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:51.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.823+0000 7f7ba0a81700 1 -- 172.21.15.146:0/46697467 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b98005e30 con 0x7f7b9c1610e0 2023-05-24T03:31:51.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.823+0000 7f7ba0a81700 1 -- 172.21.15.146:0/46697467 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b98006030 con 0x7f7b9c1610e0 2023-05-24T03:31:51.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.823+0000 7f7ba0a81700 1 -- 172.21.15.146:0/46697467 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b980063c0 con 0x7f7b9c1610e0 2023-05-24T03:31:51.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.823+0000 7f7ba1282700 1 --2- 172.21.15.146:0/46697467 >> v2:172.21.15.146:3300/0 conn(0x7f7b9c0b8e60 0x7f7b9c0d0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:31:51.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.824+0000 7f7ba3ce7700 1 -- 172.21.15.146:0/46697467 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b9c1610e0 msgr2=0x7f7b9c06b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:51.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.824+0000 7f7ba3ce7700 1 --2- 172.21.15.146:0/46697467 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b9c1610e0 0x7f7b9c06b870 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7b98009820 tx=0x7f7b98009b30 comp rx=0 tx=0).stop 2023-05-24T03:31:51.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.824+0000 7f7ba3ce7700 1 -- 172.21.15.146:0/46697467 shutdown_connections 2023-05-24T03:31:51.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.824+0000 7f7ba3ce7700 1 --2- 172.21.15.146:0/46697467 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b9c1610e0 0x7f7b9c06b870 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:51.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.824+0000 7f7ba3ce7700 1 --2- 172.21.15.146:0/46697467 >> v2:172.21.15.146:3300/0 conn(0x7f7b9c0b8e60 0x7f7b9c0d0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:51.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.824+0000 7f7ba3ce7700 1 -- 172.21.15.146:0/46697467 >> 172.21.15.146:0/46697467 conn(0x7f7b9c0743a0 msgr2=0x7f7b9c06af50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:31:51.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.825+0000 7f7ba3ce7700 1 -- 172.21.15.146:0/46697467 shutdown_connections 2023-05-24T03:31:51.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.825+0000 7f7ba3ce7700 1 -- 172.21.15.146:0/46697467 wait complete. 2023-05-24T03:31:51.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.827+0000 7f7ba3ce7700 1 Processor -- start 2023-05-24T03:31:51.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.827+0000 7f7ba3ce7700 1 -- start start 2023-05-24T03:31:51.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.828+0000 7f7ba3ce7700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b9c0b8e60 0x7f7b9c1508d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:51.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.828+0000 7f7ba3ce7700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b9c0d1380 0x7f7b9c1f5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:51.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.828+0000 7f7ba3ce7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b9c0c8c10 0x7f7b9c0c6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:51.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.828+0000 7f7ba3ce7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9c0c9d70 con 0x7f7b9c0c8c10 2023-05-24T03:31:51.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.828+0000 7f7ba3ce7700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9c150e10 con 0x7f7b9c0d1380 2023-05-24T03:31:51.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.828+0000 7f7ba3ce7700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9c0c9160 con 0x7f7b9c0b8e60 2023-05-24T03:31:51.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.829+0000 7f7ba1a83700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b9c0b8e60 0x7f7b9c1508d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:51.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.829+0000 7f7ba1a83700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b9c0b8e60 0x7f7b9c1508d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:53064/0 (socket says 172.21.15.146:53064) 2023-05-24T03:31:51.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.829+0000 7f7ba1a83700 1 -- 172.21.15.146:0/3908850433 learned_addr learned my addr 172.21.15.146:0/3908850433 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:31:51.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.829+0000 7f7ba2284700 1 --2- 172.21.15.146:0/3908850433 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b9c0c8c10 0x7f7b9c0c6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:51.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.829+0000 7f7ba1282700 1 --2- 172.21.15.146:0/3908850433 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b9c0d1380 0x7f7b9c1f5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:51.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.829+0000 7f7ba1a83700 1 -- 172.21.15.146:0/3908850433 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b9c0d1380 msgr2=0x7f7b9c1f5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:51.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.829+0000 7f7ba1a83700 1 --2- 172.21.15.146:0/3908850433 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b9c0d1380 0x7f7b9c1f5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:51.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.829+0000 7f7ba1a83700 1 -- 172.21.15.146:0/3908850433 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b9c0c8c10 msgr2=0x7f7b9c0c6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:51.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.829+0000 7f7ba1a83700 1 --2- 172.21.15.146:0/3908850433 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b9c0c8c10 0x7f7b9c0c6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:51.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.829+0000 7f7ba1a83700 1 -- 172.21.15.146:0/3908850433 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b98009430 con 0x7f7b9c0b8e60 2023-05-24T03:31:51.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.829+0000 7f7ba2284700 1 --2- 172.21.15.146:0/3908850433 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b9c0c8c10 0x7f7b9c0c6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T03:31:51.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.830+0000 7f7ba1a83700 1 --2- 172.21.15.146:0/3908850433 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b9c0b8e60 0x7f7b9c1508d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7b98009b70 tx=0x7f7b98004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:51.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.830+0000 7f7b927fc700 1 -- 172.21.15.146:0/3908850433 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b98004030 con 0x7f7b9c0b8e60 2023-05-24T03:31:51.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.830+0000 7f7b927fc700 1 -- 172.21.15.146:0/3908850433 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b980041d0 con 0x7f7b9c0b8e60 2023-05-24T03:31:51.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.830+0000 7f7b927fc700 1 -- 172.21.15.146:0/3908850433 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b98004580 con 0x7f7b9c0b8e60 2023-05-24T03:31:51.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.830+0000 7f7ba3ce7700 1 -- 172.21.15.146:0/3908850433 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b9c165760 con 0x7f7b9c0b8e60 2023-05-24T03:31:51.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.830+0000 7f7ba3ce7700 1 -- 172.21.15.146:0/3908850433 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b9c165480 con 0x7f7b9c0b8e60 2023-05-24T03:31:51.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.832+0000 7f7ba3ce7700 1 -- 172.21.15.146:0/3908850433 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b9c06bdb0 con 0x7f7b9c0b8e60 2023-05-24T03:31:51.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.833+0000 7f7b927fc700 1 -- 172.21.15.146:0/3908850433 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7b98022020 con 0x7f7b9c0b8e60 2023-05-24T03:31:51.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.833+0000 7f7b927fc700 1 --2- 172.21.15.146:0/3908850433 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f7b8006adb0 0x7f7b8006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:51.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.834+0000 7f7b927fc700 1 -- 172.21.15.146:0/3908850433 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7b9808a830 con 0x7f7b9c0b8e60 2023-05-24T03:31:51.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.834+0000 7f7ba1282700 1 --2- 172.21.15.146:0/3908850433 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f7b8006adb0 0x7f7b8006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:51.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.836+0000 7f7ba1282700 1 --2- 172.21.15.146:0/3908850433 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f7b8006adb0 0x7f7b8006d260 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c0cde30 tx=0x7f7b8c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:51.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:51.840+0000 7f7b927fc700 1 -- 172.21.15.146:0/3908850433 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f7b98055620 con 0x7f7b9c0b8e60 2023-05-24T03:31:52.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.214+0000 7f7ba3ce7700 1 -- 172.21.15.146:0/3908850433 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7b9c072ae0 con 0x7f7b9c0b8e60 2023-05-24T03:31:52.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.216+0000 7f7b927fc700 1 -- 172.21.15.146:0/3908850433 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7b98058c40 con 0x7f7b9c0b8e60 2023-05-24T03:31:52.221 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2023-05-24T03:31:52.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.220+0000 7f7ba3ce7700 1 -- 172.21.15.146:0/3908850433 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f7b8006adb0 msgr2=0x7f7b8006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:52.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.220+0000 7f7ba3ce7700 1 --2- 172.21.15.146:0/3908850433 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f7b8006adb0 0x7f7b8006d260 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c0cde30 tx=0x7f7b8c008040 comp rx=0 tx=0).stop 2023-05-24T03:31:52.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.220+0000 7f7ba3ce7700 1 -- 172.21.15.146:0/3908850433 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b9c0b8e60 msgr2=0x7f7b9c1508d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:52.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.220+0000 7f7ba3ce7700 1 --2- 172.21.15.146:0/3908850433 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b9c0b8e60 0x7f7b9c1508d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7b98009b70 tx=0x7f7b98004750 comp rx=0 tx=0).stop 2023-05-24T03:31:52.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.220+0000 7f7ba3ce7700 1 -- 172.21.15.146:0/3908850433 shutdown_connections 2023-05-24T03:31:52.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.220+0000 7f7ba3ce7700 1 --2- 172.21.15.146:0/3908850433 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f7b8006adb0 0x7f7b8006d260 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:52.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.220+0000 7f7ba3ce7700 1 --2- 172.21.15.146:0/3908850433 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b9c0c8c10 0x7f7b9c0c6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:52.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.220+0000 7f7ba3ce7700 1 --2- 172.21.15.146:0/3908850433 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b9c0b8e60 0x7f7b9c1508d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:52.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.220+0000 7f7ba3ce7700 1 --2- 172.21.15.146:0/3908850433 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b9c0d1380 0x7f7b9c1f5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:52.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.220+0000 7f7ba3ce7700 1 -- 172.21.15.146:0/3908850433 >> 172.21.15.146:0/3908850433 conn(0x7f7b9c0743a0 msgr2=0x7f7b9c0b60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:31:52.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.220+0000 7f7ba3ce7700 1 -- 172.21.15.146:0/3908850433 shutdown_connections 2023-05-24T03:31:52.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.220+0000 7f7ba3ce7700 1 -- 172.21.15.146:0/3908850433 wait complete. 2023-05-24T03:31:52.245 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-24T03:31:52.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.466+0000 7f3608b2e700 1 Processor -- start 2023-05-24T03:31:52.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.467+0000 7f3608b2e700 1 -- start start 2023-05-24T03:31:52.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.468+0000 7f3608b2e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f360415c980 0x7f360415ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:52.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.468+0000 7f3608b2e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f36040b3960 0x7f36040b3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:52.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.468+0000 7f3608b2e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f360406d060 con 0x7f3604153640 2023-05-24T03:31:52.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.468+0000 7f3608b2e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f360415d340 con 0x7f360415c980 2023-05-24T03:31:52.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.468+0000 7f3608b2e700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f360406d340 con 0x7f36040b3960 2023-05-24T03:31:52.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.468+0000 7f360259c700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f3604153640 0x7f360406c610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:45692/0 (socket says 172.21.15.146:45692) 2023-05-24T03:31:52.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.468+0000 7f360259c700 1 -- 172.21.15.146:0/2263720279 learned_addr learned my addr 172.21.15.146:0/2263720279 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:31:52.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.468+0000 7f3602d9d700 1 --2- 172.21.15.146:0/2263720279 >> v2:172.21.15.151:3300/0 conn(0x7f36040b3960 0x7f36040b3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:52.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.469+0000 7f360159a700 1 -- 172.21.15.146:0/2263720279 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3989182593 0 0) 0x7f360406d060 con 0x7f3604153640 2023-05-24T03:31:52.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.469+0000 7f360159a700 1 -- 172.21.15.146:0/2263720279 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35ec0035b0 con 0x7f3604153640 2023-05-24T03:31:52.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.469+0000 7f3601d9b700 1 --2- 172.21.15.146:0/2263720279 >> v2:172.21.15.146:3300/0 conn(0x7f360415c980 0x7f360415ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:52.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.469+0000 7f3602d9d700 1 -- 172.21.15.146:0/2263720279 >> v2:172.21.15.146:3300/0 conn(0x7f360415c980 msgr2=0x7f360415ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:31:52.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.469+0000 7f3602d9d700 1 --2- 172.21.15.146:0/2263720279 >> v2:172.21.15.146:3300/0 conn(0x7f360415c980 0x7f360415ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:52.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.469+0000 7f3602d9d700 1 -- 172.21.15.146:0/2263720279 >> v1:172.21.15.151:6789/0 conn(0x7f3604153640 legacy=0x7f360406c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:52.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.469+0000 7f3602d9d700 1 -- 172.21.15.146:0/2263720279 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f360406d620 con 0x7f36040b3960 2023-05-24T03:31:52.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.471+0000 7f3602d9d700 1 --2- 172.21.15.146:0/2263720279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f36040b3960 0x7f36040b3d80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f36040cf560 tx=0x7f35f400bdb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22829ab84eed87e2 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:52.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.472+0000 7f360159a700 1 -- 172.21.15.146:0/2263720279 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f4006d10 con 0x7f36040b3960 2023-05-24T03:31:52.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.472+0000 7f360159a700 1 -- 172.21.15.146:0/2263720279 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f4006e70 con 0x7f36040b3960 2023-05-24T03:31:52.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.472+0000 7f360159a700 1 -- 172.21.15.146:0/2263720279 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f400dc80 con 0x7f36040b3960 2023-05-24T03:31:52.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.473+0000 7f3608b2e700 1 -- 172.21.15.146:0/2263720279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f36040b3960 msgr2=0x7f36040b3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:52.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.473+0000 7f3608b2e700 1 --2- 172.21.15.146:0/2263720279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f36040b3960 0x7f36040b3d80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f36040cf560 tx=0x7f35f400bdb0 comp rx=0 tx=0).stop 2023-05-24T03:31:52.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.473+0000 7f3608b2e700 1 -- 172.21.15.146:0/2263720279 shutdown_connections 2023-05-24T03:31:52.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.473+0000 7f3608b2e700 1 --2- 172.21.15.146:0/2263720279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f36040b3960 0x7f36040b3d80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:52.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.473+0000 7f3608b2e700 1 --2- 172.21.15.146:0/2263720279 >> v2:172.21.15.146:3300/0 conn(0x7f360415c980 0x7f360415ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:52.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.473+0000 7f3608b2e700 1 -- 172.21.15.146:0/2263720279 >> 172.21.15.146:0/2263720279 conn(0x7f36040cf6c0 msgr2=0x7f36040cfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:31:52.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.473+0000 7f3608b2e700 1 -- 172.21.15.146:0/2263720279 shutdown_connections 2023-05-24T03:31:52.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.474+0000 7f3608b2e700 1 -- 172.21.15.146:0/2263720279 wait complete. 2023-05-24T03:31:52.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.476+0000 7f3608b2e700 1 Processor -- start 2023-05-24T03:31:52.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.476+0000 7f3608b2e700 1 -- start start 2023-05-24T03:31:52.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.477+0000 7f3608b2e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36040b3960 0x7f36041501b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:52.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.477+0000 7f3608b2e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3604153640 0x7f36040b0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:52.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.477+0000 7f3608b2e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f360415c980 0x7f36040b09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:52.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.477+0000 7f3608b2e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3604152030 con 0x7f360415c980 2023-05-24T03:31:52.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.477+0000 7f3608b2e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3604151420 con 0x7f3604153640 2023-05-24T03:31:52.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.477+0000 7f3608b2e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3604151700 con 0x7f36040b3960 2023-05-24T03:31:52.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.477+0000 7f3601d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3604153640 0x7f36040b0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:52.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.477+0000 7f3601d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3604153640 0x7f36040b0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:51396/0 (socket says 172.21.15.146:51396) 2023-05-24T03:31:52.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.477+0000 7f3601d9b700 1 -- 172.21.15.146:0/991207524 learned_addr learned my addr 172.21.15.146:0/991207524 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:31:52.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.477+0000 7f360259c700 1 --2- 172.21.15.146:0/991207524 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36040b3960 0x7f36041501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:52.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.478+0000 7f3601d9b700 1 -- 172.21.15.146:0/991207524 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36040b3960 msgr2=0x7f36041501b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:52.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.478+0000 7f3601d9b700 1 --2- 172.21.15.146:0/991207524 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36040b3960 0x7f36041501b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:52.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.478+0000 7f3601d9b700 1 -- 172.21.15.146:0/991207524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f360415c980 msgr2=0x7f36040b09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:52.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.478+0000 7f3601d9b700 1 --2- 172.21.15.146:0/991207524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f360415c980 0x7f36040b09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:52.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.478+0000 7f3601d9b700 1 -- 172.21.15.146:0/991207524 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f400b730 con 0x7f3604153640 2023-05-24T03:31:52.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.478+0000 7f3601d9b700 1 --2- 172.21.15.146:0/991207524 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3604153640 0x7f36040b0460 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f35fc00efc0 tx=0x7f35fc00c0c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:52.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.479+0000 7f35f2ffd700 1 -- 172.21.15.146:0/991207524 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35fc00cc00 con 0x7f3604153640 2023-05-24T03:31:52.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.479+0000 7f35f2ffd700 1 -- 172.21.15.146:0/991207524 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35fc00f040 con 0x7f3604153640 2023-05-24T03:31:52.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.479+0000 7f35f2ffd700 1 -- 172.21.15.146:0/991207524 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35fc014480 con 0x7f3604153640 2023-05-24T03:31:52.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.479+0000 7f3608b2e700 1 -- 172.21.15.146:0/991207524 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f360406cd20 con 0x7f3604153640 2023-05-24T03:31:52.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.480+0000 7f3608b2e700 1 -- 172.21.15.146:0/991207524 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36040b3440 con 0x7f3604153640 2023-05-24T03:31:52.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.481+0000 7f3608b2e700 1 -- 172.21.15.146:0/991207524 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f360406d900 con 0x7f3604153640 2023-05-24T03:31:52.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.482+0000 7f35f2ffd700 1 -- 172.21.15.146:0/991207524 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f35fc0145e0 con 0x7f3604153640 2023-05-24T03:31:52.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.483+0000 7f35f2ffd700 1 --2- 172.21.15.146:0/991207524 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f35e406ad30 0x7f35e406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:52.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.483+0000 7f35f2ffd700 1 -- 172.21.15.146:0/991207524 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f35fc08a1e0 con 0x7f3604153640 2023-05-24T03:31:52.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.484+0000 7f360259c700 1 --2- 172.21.15.146:0/991207524 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f35e406ad30 0x7f35e406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:52.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.485+0000 7f360259c700 1 --2- 172.21.15.146:0/991207524 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f35e406ad30 0x7f35e406d1e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f35f8007fd0 tx=0x7f35f8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:52.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.491+0000 7f35f2ffd700 1 -- 172.21.15.146:0/991207524 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f35fc055040 con 0x7f3604153640 2023-05-24T03:31:52.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.878+0000 7f3608b2e700 1 -- 172.21.15.146:0/991207524 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f36041521a0 con 0x7f3604153640 2023-05-24T03:31:52.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.879+0000 7f35f2ffd700 1 -- 172.21.15.146:0/991207524 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f35fc058660 con 0x7f3604153640 2023-05-24T03:31:52.884 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2023-05-24T03:31:52.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.883+0000 7f3608b2e700 1 -- 172.21.15.146:0/991207524 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f35e406ad30 msgr2=0x7f35e406d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:52.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.883+0000 7f3608b2e700 1 --2- 172.21.15.146:0/991207524 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f35e406ad30 0x7f35e406d1e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f35f8007fd0 tx=0x7f35f8009040 comp rx=0 tx=0).stop 2023-05-24T03:31:52.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.883+0000 7f3608b2e700 1 -- 172.21.15.146:0/991207524 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3604153640 msgr2=0x7f36040b0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:52.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.883+0000 7f3608b2e700 1 --2- 172.21.15.146:0/991207524 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3604153640 0x7f36040b0460 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f35fc00efc0 tx=0x7f35fc00c0c0 comp rx=0 tx=0).stop 2023-05-24T03:31:52.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.883+0000 7f3608b2e700 1 -- 172.21.15.146:0/991207524 shutdown_connections 2023-05-24T03:31:52.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.883+0000 7f3608b2e700 1 --2- 172.21.15.146:0/991207524 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f35e406ad30 0x7f35e406d1e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:52.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.883+0000 7f3608b2e700 1 --2- 172.21.15.146:0/991207524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f360415c980 0x7f36040b09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:52.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.883+0000 7f3608b2e700 1 --2- 172.21.15.146:0/991207524 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36040b3960 0x7f36041501b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:52.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.883+0000 7f3608b2e700 1 --2- 172.21.15.146:0/991207524 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3604153640 0x7f36040b0460 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:52.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.883+0000 7f3608b2e700 1 -- 172.21.15.146:0/991207524 >> 172.21.15.146:0/991207524 conn(0x7f36040cf6c0 msgr2=0x7f360414d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:31:52.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.884+0000 7f3608b2e700 1 -- 172.21.15.146:0/991207524 shutdown_connections 2023-05-24T03:31:52.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:52.884+0000 7f3608b2e700 1 -- 172.21.15.146:0/991207524 wait complete. 2023-05-24T03:31:52.914 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-24T03:31:53.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.120+0000 7f9b5149e700 1 Processor -- start 2023-05-24T03:31:53.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.120+0000 7f9b5149e700 1 -- start start 2023-05-24T03:31:53.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.122+0000 7f9b5149e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9b4c0ca420 0x7f9b4c0afc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:53.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.122+0000 7f9b5149e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9b4c071dc0 0x7f9b4c0b0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:53.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.122+0000 7f9b5149e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b4c159610 con 0x7f9b4c159240 2023-05-24T03:31:53.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.122+0000 7f9b5149e700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b4c070d20 con 0x7f9b4c0ca420 2023-05-24T03:31:53.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.122+0000 7f9b5149e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c071000 con 0x7f9b4c071dc0 2023-05-24T03:31:53.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.122+0000 7f9b4b7fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9b4c071dc0 0x7f9b4c0b0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:53.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.122+0000 7f9b4b7fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9b4c071dc0 0x7f9b4c0b0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:53084/0 (socket says 172.21.15.146:53084) 2023-05-24T03:31:53.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.122+0000 7f9b4b7fe700 1 -- 172.21.15.146:0/1782937273 learned_addr learned my addr 172.21.15.146:0/1782937273 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:31:53.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.122+0000 7f9b4b7fe700 1 -- 172.21.15.146:0/1782937273 >> v2:172.21.15.151:3300/0 conn(0x7f9b4c0ca420 msgr2=0x7f9b4c0afc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:31:53.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.122+0000 7f9b4b7fe700 1 --2- 172.21.15.146:0/1782937273 >> v2:172.21.15.151:3300/0 conn(0x7f9b4c0ca420 0x7f9b4c0afc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:53.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.122+0000 7f9b4b7fe700 1 -- 172.21.15.146:0/1782937273 >> v1:172.21.15.146:6789/0 conn(0x7f9b4c159240 legacy=0x7f9b4c0c9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:31:53.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.122+0000 7f9b4b7fe700 1 -- 172.21.15.146:0/1782937273 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b4c0712e0 con 0x7f9b4c071dc0 2023-05-24T03:31:53.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.123+0000 7f9b4b7fe700 1 --2- 172.21.15.146:0/1782937273 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9b4c071dc0 0x7f9b4c0b0190 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9b4400d150 tx=0x7f9b4400d460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aaa837a1e91ab712 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:53.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.123+0000 7f9b49ffb700 1 -- 172.21.15.146:0/1782937273 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b44010070 con 0x7f9b4c071dc0 2023-05-24T03:31:53.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.123+0000 7f9b49ffb700 1 -- 172.21.15.146:0/1782937273 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4400db70 con 0x7f9b4c071dc0 2023-05-24T03:31:53.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.123+0000 7f9b49ffb700 1 -- 172.21.15.146:0/1782937273 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b44003a20 con 0x7f9b4c071dc0 2023-05-24T03:31:53.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.124+0000 7f9b5149e700 1 -- 172.21.15.146:0/1782937273 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9b4c071dc0 msgr2=0x7f9b4c0b0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:53.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.124+0000 7f9b5149e700 1 --2- 172.21.15.146:0/1782937273 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9b4c071dc0 0x7f9b4c0b0190 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9b4400d150 tx=0x7f9b4400d460 comp rx=0 tx=0).stop 2023-05-24T03:31:53.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.124+0000 7f9b5149e700 1 -- 172.21.15.146:0/1782937273 shutdown_connections 2023-05-24T03:31:53.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.124+0000 7f9b5149e700 1 --2- 172.21.15.146:0/1782937273 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9b4c071dc0 0x7f9b4c0b0190 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:53.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.124+0000 7f9b5149e700 1 --2- 172.21.15.146:0/1782937273 >> v2:172.21.15.151:3300/0 conn(0x7f9b4c0ca420 0x7f9b4c0afc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:53.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.124+0000 7f9b5149e700 1 -- 172.21.15.146:0/1782937273 >> 172.21.15.146:0/1782937273 conn(0x7f9b4c0cf6c0 msgr2=0x7f9b4c0cfa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:31:53.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.124+0000 7f9b5149e700 1 -- 172.21.15.146:0/1782937273 shutdown_connections 2023-05-24T03:31:53.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.124+0000 7f9b5149e700 1 -- 172.21.15.146:0/1782937273 wait complete. 2023-05-24T03:31:53.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.126+0000 7f9b5149e700 1 Processor -- start 2023-05-24T03:31:53.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.127+0000 7f9b5149e700 1 -- start start 2023-05-24T03:31:53.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.128+0000 7f9b5149e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b4c071dc0 0x7f9b4c1568a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:53.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.128+0000 7f9b5149e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b4c0ca420 0x7f9b4c1e1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:53.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.128+0000 7f9b5149e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9b4c159240 0x7f9b4c0cc250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:53.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.128+0000 7f9b5149e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c1e5ca0 con 0x7f9b4c071dc0 2023-05-24T03:31:53.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.128+0000 7f9b5149e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c1e5f80 con 0x7f9b4c0ca420 2023-05-24T03:31:53.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.128+0000 7f9b5149e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c1e6260 con 0x7f9b4c159240 2023-05-24T03:31:53.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.128+0000 7f9b4b7fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9b4c159240 0x7f9b4c0cc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:53.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.128+0000 7f9b4b7fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9b4c159240 0x7f9b4c0cc250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:53094/0 (socket says 172.21.15.146:53094) 2023-05-24T03:31:53.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.128+0000 7f9b4b7fe700 1 -- 172.21.15.146:0/86381258 learned_addr learned my addr 172.21.15.146:0/86381258 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:31:53.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.129+0000 7f9b4affd700 1 --2- 172.21.15.146:0/86381258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b4c071dc0 0x7f9b4c1568a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:53.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.129+0000 7f9b4a7fc700 1 --2- 172.21.15.146:0/86381258 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b4c0ca420 0x7f9b4c1e1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:53.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.129+0000 7f9b4b7fe700 1 -- 172.21.15.146:0/86381258 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b4c0ca420 msgr2=0x7f9b4c1e1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:53.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.129+0000 7f9b4b7fe700 1 --2- 172.21.15.146:0/86381258 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b4c0ca420 0x7f9b4c1e1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:53.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.129+0000 7f9b4b7fe700 1 -- 172.21.15.146:0/86381258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b4c071dc0 msgr2=0x7f9b4c1568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:53.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.129+0000 7f9b4b7fe700 1 --2- 172.21.15.146:0/86381258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b4c071dc0 0x7f9b4c1568a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:53.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.129+0000 7f9b4b7fe700 1 -- 172.21.15.146:0/86381258 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b4400bd40 con 0x7f9b4c159240 2023-05-24T03:31:53.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.129+0000 7f9b4a7fc700 1 --2- 172.21.15.146:0/86381258 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b4c0ca420 0x7f9b4c1e1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:31:53.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.129+0000 7f9b4b7fe700 1 --2- 172.21.15.146:0/86381258 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9b4c159240 0x7f9b4c0cc250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9b4400d4a0 tx=0x7f9b44004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:53.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.130+0000 7f9b337fe700 1 -- 172.21.15.146:0/86381258 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b44004580 con 0x7f9b4c159240 2023-05-24T03:31:53.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.130+0000 7f9b337fe700 1 -- 172.21.15.146:0/86381258 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b44004700 con 0x7f9b4c159240 2023-05-24T03:31:53.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.130+0000 7f9b337fe700 1 -- 172.21.15.146:0/86381258 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b44016440 con 0x7f9b4c159240 2023-05-24T03:31:53.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.130+0000 7f9b5149e700 1 -- 172.21.15.146:0/86381258 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b4c0718a0 con 0x7f9b4c159240 2023-05-24T03:31:53.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.130+0000 7f9b5149e700 1 -- 172.21.15.146:0/86381258 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b4c0715c0 con 0x7f9b4c159240 2023-05-24T03:31:53.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.131+0000 7f9b5149e700 1 -- 172.21.15.146:0/86381258 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b2c0052f0 con 0x7f9b4c159240 2023-05-24T03:31:53.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.132+0000 7f9b337fe700 1 -- 172.21.15.146:0/86381258 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9b4401d070 con 0x7f9b4c159240 2023-05-24T03:31:53.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.133+0000 7f9b337fe700 1 --2- 172.21.15.146:0/86381258 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f9b3806ace0 0x7f9b3806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:53.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.133+0000 7f9b337fe700 1 -- 172.21.15.146:0/86381258 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9b4408b050 con 0x7f9b4c159240 2023-05-24T03:31:53.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.133+0000 7f9b4affd700 1 --2- 172.21.15.146:0/86381258 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f9b3806ace0 0x7f9b3806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:53.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.134+0000 7f9b4affd700 1 --2- 172.21.15.146:0/86381258 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f9b3806ace0 0x7f9b3806d190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c009960 tx=0x7f9b3c0090e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:53.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.144+0000 7f9b337fe700 1 -- 172.21.15.146:0/86381258 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f9b44055de0 con 0x7f9b4c159240 2023-05-24T03:31:53.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.517+0000 7f9b5149e700 1 -- 172.21.15.146:0/86381258 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9b2c005b20 con 0x7f9b4c159240 2023-05-24T03:31:53.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.518+0000 7f9b337fe700 1 -- 172.21.15.146:0/86381258 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9b44059400 con 0x7f9b4c159240 2023-05-24T03:31:53.524 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2023-05-24T03:31:53.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.523+0000 7f9b5149e700 1 -- 172.21.15.146:0/86381258 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f9b3806ace0 msgr2=0x7f9b3806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:53.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.523+0000 7f9b5149e700 1 --2- 172.21.15.146:0/86381258 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f9b3806ace0 0x7f9b3806d190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c009960 tx=0x7f9b3c0090e0 comp rx=0 tx=0).stop 2023-05-24T03:31:53.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.523+0000 7f9b5149e700 1 -- 172.21.15.146:0/86381258 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9b4c159240 msgr2=0x7f9b4c0cc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:53.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.523+0000 7f9b5149e700 1 --2- 172.21.15.146:0/86381258 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9b4c159240 0x7f9b4c0cc250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9b4400d4a0 tx=0x7f9b44004ad0 comp rx=0 tx=0).stop 2023-05-24T03:31:53.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.523+0000 7f9b5149e700 1 -- 172.21.15.146:0/86381258 shutdown_connections 2023-05-24T03:31:53.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.523+0000 7f9b5149e700 1 --2- 172.21.15.146:0/86381258 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f9b3806ace0 0x7f9b3806d190 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:53.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.523+0000 7f9b5149e700 1 --2- 172.21.15.146:0/86381258 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9b4c159240 0x7f9b4c0cc250 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:53.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.523+0000 7f9b5149e700 1 --2- 172.21.15.146:0/86381258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b4c071dc0 0x7f9b4c1568a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:53.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.523+0000 7f9b5149e700 1 --2- 172.21.15.146:0/86381258 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b4c0ca420 0x7f9b4c1e1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:53.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.523+0000 7f9b5149e700 1 -- 172.21.15.146:0/86381258 >> 172.21.15.146:0/86381258 conn(0x7f9b4c0cf6c0 msgr2=0x7f9b4c157840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:31:53.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.526+0000 7f9b5149e700 1 -- 172.21.15.146:0/86381258 shutdown_connections 2023-05-24T03:31:53.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.526+0000 7f9b5149e700 1 -- 172.21.15.146:0/86381258 wait complete. 2023-05-24T03:31:53.557 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-24T03:31:53.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.770+0000 7f26969ad700 1 Processor -- start 2023-05-24T03:31:53.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.770+0000 7f26969ad700 1 -- start start 2023-05-24T03:31:53.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.771+0000 7f26969ad700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f269015cf50 0x7f26900707b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:53.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.771+0000 7f26969ad700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f269006b850 0x7f2690070cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:53.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.771+0000 7f26969ad700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2690072060 con 0x7f269006a460 2023-05-24T03:31:53.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.771+0000 7f26969ad700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26900ca330 con 0x7f269015cf50 2023-05-24T03:31:53.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.772+0000 7f26969ad700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26900ca050 con 0x7f269006b850 2023-05-24T03:31:53.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.772+0000 7f268ffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f269015cf50 0x7f26900707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:53.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.772+0000 7f268ffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f269015cf50 0x7f26900707b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40234/0 (socket says 172.21.15.146:40234) 2023-05-24T03:31:53.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.772+0000 7f268ffff700 1 -- 172.21.15.146:0/2320572051 learned_addr learned my addr 172.21.15.146:0/2320572051 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:31:53.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.772+0000 7f268f7fe700 1 --2- 172.21.15.146:0/2320572051 >> v2:172.21.15.151:3300/0 conn(0x7f269006b850 0x7f2690070cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:53.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.772+0000 7f268ffff700 1 -- 172.21.15.146:0/2320572051 >> v2:172.21.15.151:3300/0 conn(0x7f269006b850 msgr2=0x7f2690070cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:31:53.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.772+0000 7f268ffff700 1 --2- 172.21.15.146:0/2320572051 >> v2:172.21.15.151:3300/0 conn(0x7f269006b850 0x7f2690070cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:53.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.772+0000 7f268ffff700 1 -- 172.21.15.146:0/2320572051 >> v1:172.21.15.151:6789/0 conn(0x7f269006a460 legacy=0x7f269006a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:31:53.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.772+0000 7f268ffff700 1 -- 172.21.15.146:0/2320572051 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26900ca610 con 0x7f269015cf50 2023-05-24T03:31:53.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.772+0000 7f268f7fe700 1 --2- 172.21.15.146:0/2320572051 >> v2:172.21.15.151:3300/0 conn(0x7f269006b850 0x7f2690070cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T03:31:53.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.772+0000 7f268ffff700 1 --2- 172.21.15.146:0/2320572051 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f269015cf50 0x7f26900707b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2690070260 tx=0x7f2678009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b5e3d6882ab8d9d server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:53.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.773+0000 7f268effd700 1 -- 172.21.15.146:0/2320572051 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2678004230 con 0x7f269015cf50 2023-05-24T03:31:53.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.773+0000 7f268effd700 1 -- 172.21.15.146:0/2320572051 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2678004390 con 0x7f269015cf50 2023-05-24T03:31:53.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.773+0000 7f268effd700 1 -- 172.21.15.146:0/2320572051 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26780036a0 con 0x7f269015cf50 2023-05-24T03:31:53.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.773+0000 7f26969ad700 1 -- 172.21.15.146:0/2320572051 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f269015cf50 msgr2=0x7f26900707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:53.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.773+0000 7f26969ad700 1 --2- 172.21.15.146:0/2320572051 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f269015cf50 0x7f26900707b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2690070260 tx=0x7f2678009bd0 comp rx=0 tx=0).stop 2023-05-24T03:31:53.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.774+0000 7f26969ad700 1 -- 172.21.15.146:0/2320572051 shutdown_connections 2023-05-24T03:31:53.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.774+0000 7f26969ad700 1 --2- 172.21.15.146:0/2320572051 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f269015cf50 0x7f26900707b0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:53.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.774+0000 7f26969ad700 1 --2- 172.21.15.146:0/2320572051 >> v2:172.21.15.151:3300/0 conn(0x7f269006b850 0x7f2690070cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:53.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.774+0000 7f26969ad700 1 -- 172.21.15.146:0/2320572051 >> 172.21.15.146:0/2320572051 conn(0x7f26900cf6c0 msgr2=0x7f26900cfa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:31:53.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.779+0000 7f26969ad700 1 -- 172.21.15.146:0/2320572051 shutdown_connections 2023-05-24T03:31:53.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.779+0000 7f26969ad700 1 -- 172.21.15.146:0/2320572051 wait complete. 2023-05-24T03:31:53.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.781+0000 7f26969ad700 1 Processor -- start 2023-05-24T03:31:53.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.781+0000 7f26969ad700 1 -- start start 2023-05-24T03:31:53.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.783+0000 7f26969ad700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f269006a460 0x7f2690156f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:53.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.783+0000 7f26969ad700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f269006b850 0x7f26900c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:53.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.783+0000 7f26969ad700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f269015cf50 0x7f26901f26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:53.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.783+0000 7f26969ad700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26900c6790 con 0x7f269015cf50 2023-05-24T03:31:53.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.783+0000 7f26969ad700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2690157480 con 0x7f269006a460 2023-05-24T03:31:53.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.783+0000 7f26969ad700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26900c69a0 con 0x7f269006b850 2023-05-24T03:31:53.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.783+0000 7f268f7fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f269006b850 0x7f26900c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:53.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.783+0000 7f268f7fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f269006b850 0x7f26900c8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:53104/0 (socket says 172.21.15.146:53104) 2023-05-24T03:31:53.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.783+0000 7f268f7fe700 1 -- 172.21.15.146:0/12515776 learned_addr learned my addr 172.21.15.146:0/12515776 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:31:53.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.783+0000 7f268ffff700 1 --2- 172.21.15.146:0/12515776 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f269006a460 0x7f2690156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:53.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.783+0000 7f2694f4a700 1 --2- 172.21.15.146:0/12515776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f269015cf50 0x7f26901f26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:53.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.784+0000 7f268f7fe700 1 -- 172.21.15.146:0/12515776 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f269006a460 msgr2=0x7f2690156f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:53.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.784+0000 7f268f7fe700 1 --2- 172.21.15.146:0/12515776 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f269006a460 0x7f2690156f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:53.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.784+0000 7f268f7fe700 1 -- 172.21.15.146:0/12515776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f269015cf50 msgr2=0x7f26901f26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:53.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.784+0000 7f268f7fe700 1 --2- 172.21.15.146:0/12515776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f269015cf50 0x7f26901f26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:53.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.784+0000 7f268f7fe700 1 -- 172.21.15.146:0/12515776 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26800094a0 con 0x7f269006b850 2023-05-24T03:31:53.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.784+0000 7f268ffff700 1 --2- 172.21.15.146:0/12515776 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f269006a460 0x7f2690156f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T03:31:53.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.784+0000 7f268f7fe700 1 --2- 172.21.15.146:0/12515776 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f269006b850 0x7f26900c8a30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f268000ebe0 tx=0x7f268000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:53.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.784+0000 7f268cff9700 1 -- 172.21.15.146:0/12515776 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268000c850 con 0x7f269006b850 2023-05-24T03:31:53.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.784+0000 7f268cff9700 1 -- 172.21.15.146:0/12515776 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f268000c9b0 con 0x7f269006b850 2023-05-24T03:31:53.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.784+0000 7f268cff9700 1 -- 172.21.15.146:0/12515776 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268000cd40 con 0x7f269006b850 2023-05-24T03:31:53.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.784+0000 7f26969ad700 1 -- 172.21.15.146:0/12515776 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2678009550 con 0x7f269006b850 2023-05-24T03:31:53.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.785+0000 7f26969ad700 1 -- 172.21.15.146:0/12515776 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2690071ca0 con 0x7f269006b850 2023-05-24T03:31:53.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.786+0000 7f26969ad700 1 -- 172.21.15.146:0/12515776 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26900ca8f0 con 0x7f269006b850 2023-05-24T03:31:53.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.787+0000 7f268cff9700 1 -- 172.21.15.146:0/12515776 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2680013470 con 0x7f269006b850 2023-05-24T03:31:53.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.788+0000 7f268cff9700 1 --2- 172.21.15.146:0/12515776 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f267006adb0 0x7f267006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:53.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.788+0000 7f268cff9700 1 -- 172.21.15.146:0/12515776 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2680089850 con 0x7f269006b850 2023-05-24T03:31:53.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.788+0000 7f268ffff700 1 --2- 172.21.15.146:0/12515776 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f267006adb0 0x7f267006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:53.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.789+0000 7f268ffff700 1 --2- 172.21.15.146:0/12515776 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f267006adb0 0x7f267006d260 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2678009130 tx=0x7f2678010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:53.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:53.795+0000 7f268cff9700 1 -- 172.21.15.146:0/12515776 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f26800545b0 con 0x7f269006b850 2023-05-24T03:31:54.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.167+0000 7f26969ad700 1 -- 172.21.15.146:0/12515776 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2690071e30 con 0x7f269006b850 2023-05-24T03:31:54.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.169+0000 7f268cff9700 1 -- 172.21.15.146:0/12515776 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f268000cea0 con 0x7f269006b850 2023-05-24T03:31:54.177 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2023-05-24T03:31:54.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.174+0000 7f26969ad700 1 -- 172.21.15.146:0/12515776 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f267006adb0 msgr2=0x7f267006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:54.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.174+0000 7f26969ad700 1 --2- 172.21.15.146:0/12515776 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f267006adb0 0x7f267006d260 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2678009130 tx=0x7f2678010000 comp rx=0 tx=0).stop 2023-05-24T03:31:54.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.174+0000 7f26969ad700 1 -- 172.21.15.146:0/12515776 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f269006b850 msgr2=0x7f26900c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:54.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.174+0000 7f26969ad700 1 --2- 172.21.15.146:0/12515776 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f269006b850 0x7f26900c8a30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f268000ebe0 tx=0x7f268000eef0 comp rx=0 tx=0).stop 2023-05-24T03:31:54.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.175+0000 7f26969ad700 1 -- 172.21.15.146:0/12515776 shutdown_connections 2023-05-24T03:31:54.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.175+0000 7f26969ad700 1 --2- 172.21.15.146:0/12515776 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f267006adb0 0x7f267006d260 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:54.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.175+0000 7f26969ad700 1 --2- 172.21.15.146:0/12515776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f269015cf50 0x7f26901f26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:54.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.175+0000 7f26969ad700 1 --2- 172.21.15.146:0/12515776 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f269006a460 0x7f2690156f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:54.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.175+0000 7f26969ad700 1 --2- 172.21.15.146:0/12515776 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f269006b850 0x7f26900c8a30 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:54.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.175+0000 7f26969ad700 1 -- 172.21.15.146:0/12515776 >> 172.21.15.146:0/12515776 conn(0x7f26900cf6c0 msgr2=0x7f2690159c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:31:54.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.175+0000 7f26969ad700 1 -- 172.21.15.146:0/12515776 shutdown_connections 2023-05-24T03:31:54.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.176+0000 7f26969ad700 1 -- 172.21.15.146:0/12515776 wait complete. 2023-05-24T03:31:54.205 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-24T03:31:54.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.410+0000 7f2a84756700 1 Processor -- start 2023-05-24T03:31:54.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.410+0000 7f2a84756700 1 -- start start 2023-05-24T03:31:54.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.412+0000 7f2a84756700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2a7c16c950 0x7f2a7c0ca740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:54.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.412+0000 7f2a84756700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2a7c16cd20 0x7f2a7c0cac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:54.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.412+0000 7f2a84756700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a7c16d340 con 0x7f2a7c16dde0 2023-05-24T03:31:54.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.412+0000 7f2a84756700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a7c0cb2e0 con 0x7f2a7c16c950 2023-05-24T03:31:54.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.412+0000 7f2a84756700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7c16d5e0 con 0x7f2a7c16cd20 2023-05-24T03:31:54.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.412+0000 7f2a81cf1700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2a7c16cd20 0x7f2a7c0cac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:54.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.412+0000 7f2a824f2700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2a7c16c950 0x7f2a7c0ca740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:54.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.412+0000 7f2a81cf1700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2a7c16cd20 0x7f2a7c0cac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:53112/0 (socket says 172.21.15.146:53112) 2023-05-24T03:31:54.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.412+0000 7f2a81cf1700 1 -- 172.21.15.146:0/1345303737 learned_addr learned my addr 172.21.15.146:0/1345303737 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:31:54.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.413+0000 7f2a81cf1700 1 -- 172.21.15.146:0/1345303737 >> v2:172.21.15.151:3300/0 conn(0x7f2a7c16c950 msgr2=0x7f2a7c0ca740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:31:54.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.413+0000 7f2a81cf1700 1 --2- 172.21.15.146:0/1345303737 >> v2:172.21.15.151:3300/0 conn(0x7f2a7c16c950 0x7f2a7c0ca740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:54.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.413+0000 7f2a81cf1700 1 -- 172.21.15.146:0/1345303737 >> v1:172.21.15.146:6789/0 conn(0x7f2a7c16dde0 legacy=0x7f2a7c0cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:31:54.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.413+0000 7f2a81cf1700 1 -- 172.21.15.146:0/1345303737 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a7c16d8c0 con 0x7f2a7c16cd20 2023-05-24T03:31:54.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.414+0000 7f2a81cf1700 1 --2- 172.21.15.146:0/1345303737 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2a7c16cd20 0x7f2a7c0cac80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2a700098f0 tx=0x7f2a70009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42defc576f96c156 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:54.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.414+0000 7f2a814f0700 1 -- 172.21.15.146:0/1345303737 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a70004230 con 0x7f2a7c16cd20 2023-05-24T03:31:54.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.414+0000 7f2a814f0700 1 -- 172.21.15.146:0/1345303737 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a70004390 con 0x7f2a7c16cd20 2023-05-24T03:31:54.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.414+0000 7f2a814f0700 1 -- 172.21.15.146:0/1345303737 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a700036a0 con 0x7f2a7c16cd20 2023-05-24T03:31:54.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.415+0000 7f2a84756700 1 -- 172.21.15.146:0/1345303737 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2a7c16cd20 msgr2=0x7f2a7c0cac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:54.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.415+0000 7f2a84756700 1 --2- 172.21.15.146:0/1345303737 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2a7c16cd20 0x7f2a7c0cac80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2a700098f0 tx=0x7f2a70009c00 comp rx=0 tx=0).stop 2023-05-24T03:31:54.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.415+0000 7f2a84756700 1 -- 172.21.15.146:0/1345303737 shutdown_connections 2023-05-24T03:31:54.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.415+0000 7f2a84756700 1 --2- 172.21.15.146:0/1345303737 >> v2:172.21.15.151:3300/0 conn(0x7f2a7c16c950 0x7f2a7c0ca740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:54.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.415+0000 7f2a84756700 1 --2- 172.21.15.146:0/1345303737 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2a7c16cd20 0x7f2a7c0cac80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:54.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.415+0000 7f2a84756700 1 -- 172.21.15.146:0/1345303737 >> 172.21.15.146:0/1345303737 conn(0x7f2a7c0cedd0 msgr2=0x7f2a7c0cf1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:31:54.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.416+0000 7f2a84756700 1 -- 172.21.15.146:0/1345303737 shutdown_connections 2023-05-24T03:31:54.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.417+0000 7f2a84756700 1 -- 172.21.15.146:0/1345303737 wait complete. 2023-05-24T03:31:54.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.418+0000 7f2a84756700 1 Processor -- start 2023-05-24T03:31:54.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.419+0000 7f2a84756700 1 -- start start 2023-05-24T03:31:54.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.420+0000 7f2a84756700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a7c16c950 0x7f2a7c0c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:54.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.420+0000 7f2a84756700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a7c16cd20 0x7f2a7c070f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:54.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.420+0000 7f2a84756700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2a7c16dde0 0x7f2a7c0714c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:54.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.420+0000 7f2a84756700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7c0b10d0 con 0x7f2a7c16c950 2023-05-24T03:31:54.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.420+0000 7f2a84756700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7c20b390 con 0x7f2a7c16cd20 2023-05-24T03:31:54.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.420+0000 7f2a84756700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7c0b07a0 con 0x7f2a7c16dde0 2023-05-24T03:31:54.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.420+0000 7f2a824f2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a7c16c950 0x7f2a7c0c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:54.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.420+0000 7f2a824f2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a7c16c950 0x7f2a7c0c8bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40254/0 (socket says 172.21.15.146:40254) 2023-05-24T03:31:54.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.420+0000 7f2a824f2700 1 -- 172.21.15.146:0/718137215 learned_addr learned my addr 172.21.15.146:0/718137215 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:31:54.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.420+0000 7f2a82cf3700 1 --2- 172.21.15.146:0/718137215 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2a7c16dde0 0x7f2a7c0714c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:54.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.421+0000 7f2a824f2700 1 -- 172.21.15.146:0/718137215 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2a7c16dde0 msgr2=0x7f2a7c0714c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:54.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.421+0000 7f2a824f2700 1 --2- 172.21.15.146:0/718137215 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2a7c16dde0 0x7f2a7c0714c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:54.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.421+0000 7f2a824f2700 1 -- 172.21.15.146:0/718137215 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a7c16cd20 msgr2=0x7f2a7c070f80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-24T03:31:54.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.421+0000 7f2a824f2700 1 --2- 172.21.15.146:0/718137215 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a7c16cd20 0x7f2a7c070f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:54.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.421+0000 7f2a824f2700 1 -- 172.21.15.146:0/718137215 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a70009550 con 0x7f2a7c16c950 2023-05-24T03:31:54.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.421+0000 7f2a824f2700 1 --2- 172.21.15.146:0/718137215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a7c16c950 0x7f2a7c0c8bf0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c00ce10 tx=0x7f2a6c00a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:54.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.422+0000 7f2a7affd700 1 -- 172.21.15.146:0/718137215 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c003c20 con 0x7f2a7c16c950 2023-05-24T03:31:54.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.422+0000 7f2a7affd700 1 -- 172.21.15.146:0/718137215 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a6c00ae90 con 0x7f2a7c16c950 2023-05-24T03:31:54.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.422+0000 7f2a7affd700 1 -- 172.21.15.146:0/718137215 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c004020 con 0x7f2a7c16c950 2023-05-24T03:31:54.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.422+0000 7f2a84756700 1 -- 172.21.15.146:0/718137215 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a7c0cd020 con 0x7f2a7c16c950 2023-05-24T03:31:54.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.422+0000 7f2a84756700 1 -- 172.21.15.146:0/718137215 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a7c08ac60 con 0x7f2a7c16c950 2023-05-24T03:31:54.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.424+0000 7f2a84756700 1 -- 172.21.15.146:0/718137215 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a7c0cd1b0 con 0x7f2a7c16c950 2023-05-24T03:31:54.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.424+0000 7f2a7affd700 1 -- 172.21.15.146:0/718137215 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2a6c004180 con 0x7f2a7c16c950 2023-05-24T03:31:54.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.424+0000 7f2a7affd700 1 --2- 172.21.15.146:0/718137215 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f2a6806adb0 0x7f2a6806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:54.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.424+0000 7f2a7affd700 1 -- 172.21.15.146:0/718137215 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2a6c012070 con 0x7f2a7c16c950 2023-05-24T03:31:54.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.425+0000 7f2a81cf1700 1 --2- 172.21.15.146:0/718137215 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f2a6806adb0 0x7f2a6806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:54.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.426+0000 7f2a81cf1700 1 --2- 172.21.15.146:0/718137215 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f2a6806adb0 0x7f2a6806d260 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2a700098f0 tx=0x7f2a70008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:54.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.433+0000 7f2a7affd700 1 -- 172.21.15.146:0/718137215 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f2a6c054d90 con 0x7f2a7c16c950 2023-05-24T03:31:54.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.837+0000 7f2a84756700 1 -- 172.21.15.146:0/718137215 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2a7c06c460 con 0x7f2a7c16c950 2023-05-24T03:31:54.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.838+0000 7f2a7affd700 1 -- 172.21.15.146:0/718137215 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v30) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2a6c0583b0 con 0x7f2a7c16c950 2023-05-24T03:31:54.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.842+0000 7f2a84756700 1 -- 172.21.15.146:0/718137215 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f2a6806adb0 msgr2=0x7f2a6806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:54.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.842+0000 7f2a84756700 1 --2- 172.21.15.146:0/718137215 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f2a6806adb0 0x7f2a6806d260 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2a700098f0 tx=0x7f2a70008030 comp rx=0 tx=0).stop 2023-05-24T03:31:54.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.842+0000 7f2a84756700 1 -- 172.21.15.146:0/718137215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a7c16c950 msgr2=0x7f2a7c0c8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:54.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.842+0000 7f2a84756700 1 --2- 172.21.15.146:0/718137215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a7c16c950 0x7f2a7c0c8bf0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c00ce10 tx=0x7f2a6c00a570 comp rx=0 tx=0).stop 2023-05-24T03:31:54.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.842+0000 7f2a84756700 1 -- 172.21.15.146:0/718137215 shutdown_connections 2023-05-24T03:31:54.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.842+0000 7f2a84756700 1 --2- 172.21.15.146:0/718137215 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f2a6806adb0 0x7f2a6806d260 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:54.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.842+0000 7f2a84756700 1 --2- 172.21.15.146:0/718137215 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2a7c16dde0 0x7f2a7c0714c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:54.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.842+0000 7f2a84756700 1 --2- 172.21.15.146:0/718137215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a7c16c950 0x7f2a7c0c8bf0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:54.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.842+0000 7f2a84756700 1 --2- 172.21.15.146:0/718137215 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a7c16cd20 0x7f2a7c070f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:54.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.842+0000 7f2a84756700 1 -- 172.21.15.146:0/718137215 >> 172.21.15.146:0/718137215 conn(0x7f2a7c0cedd0 msgr2=0x7f2a7c06d730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:31:54.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.844+0000 7f2a84756700 1 -- 172.21.15.146:0/718137215 shutdown_connections 2023-05-24T03:31:54.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:54.844+0000 7f2a84756700 1 -- 172.21.15.146:0/718137215 wait complete. 2023-05-24T03:31:54.850 INFO:teuthology.orchestra.run.smithi146.stderr:listed 0 entries 2023-05-24T03:31:54.870 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-05-24T03:31:54.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:31:54.870 DEBUG:teuthology.orchestra.run.smithi146:> sudo umount /home/ubuntu/cephtest/mnt.2 2023-05-24T03:31:55.038 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2023-05-24T03:31:55.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:31:55.039 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-05-24T03:31:55.066 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-24T03:31:55.066 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-24T03:31:55.084 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-24T03:31:55.084 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-24T03:31:55.140 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-24T03:31:55.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.259+0000 7fe97d69d700 1 Processor -- start 2023-05-24T03:31:55.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.259+0000 7fe97d69d700 1 -- start start 2023-05-24T03:31:55.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.260+0000 7fe97d69d700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe9780d2da0 0x7fe9780b60c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:55.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.260+0000 7fe97d69d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe9780d2850 0x7fe9780b6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:55.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.260+0000 7fe97d69d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9780b5b90 con 0x7fe97815cb50 2023-05-24T03:31:55.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.260+0000 7fe97d69d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe97815cf20 con 0x7fe9780d2850 2023-05-24T03:31:55.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.260+0000 7fe97d69d700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9780cd960 con 0x7fe9780d2da0 2023-05-24T03:31:55.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.260+0000 7fe9777fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe9780d2850 0x7fe9780b6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:55.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.260+0000 7fe976ffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe97815cb50 0x7fe9780d1e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46712/0 (socket says 172.21.15.146:46712) 2023-05-24T03:31:55.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.260+0000 7fe976ffd700 1 -- 172.21.15.146:0/923104669 learned_addr learned my addr 172.21.15.146:0/923104669 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:31:55.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.260+0000 7fe9767fc700 1 --2- 172.21.15.146:0/923104669 >> v2:172.21.15.151:3300/0 conn(0x7fe9780d2da0 0x7fe9780b60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:55.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.260+0000 7fe975ffb700 1 -- 172.21.15.146:0/923104669 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2590553529 0 0) 0x7fe9780b5b90 con 0x7fe97815cb50 2023-05-24T03:31:55.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.260+0000 7fe975ffb700 1 -- 172.21.15.146:0/923104669 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9600035b0 con 0x7fe97815cb50 2023-05-24T03:31:55.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.260+0000 7fe9777fe700 1 -- 172.21.15.146:0/923104669 >> v2:172.21.15.151:3300/0 conn(0x7fe9780d2da0 msgr2=0x7fe9780b60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:31:55.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.260+0000 7fe9777fe700 1 --2- 172.21.15.146:0/923104669 >> v2:172.21.15.151:3300/0 conn(0x7fe9780d2da0 0x7fe9780b60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:55.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.260+0000 7fe9777fe700 1 -- 172.21.15.146:0/923104669 >> v1:172.21.15.146:6789/0 conn(0x7fe97815cb50 legacy=0x7fe9780d1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:55.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.260+0000 7fe9777fe700 1 -- 172.21.15.146:0/923104669 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9780cdc40 con 0x7fe9780d2850 2023-05-24T03:31:55.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.260+0000 7fe9777fe700 1 --2- 172.21.15.146:0/923104669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9780d2850 0x7fe9780b6600 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe97806ae20 tx=0x7fe97000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=115c9809e691645a server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:55.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.260+0000 7fe975ffb700 1 -- 172.21.15.146:0/923104669 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97000e070 con 0x7fe9780d2850 2023-05-24T03:31:55.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.260+0000 7fe975ffb700 1 -- 172.21.15.146:0/923104669 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe97000bb20 con 0x7fe9780d2850 2023-05-24T03:31:55.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.260+0000 7fe975ffb700 1 -- 172.21.15.146:0/923104669 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe970012430 con 0x7fe9780d2850 2023-05-24T03:31:55.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.261+0000 7fe97d69d700 1 -- 172.21.15.146:0/923104669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9780d2850 msgr2=0x7fe9780b6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:55.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.261+0000 7fe97d69d700 1 --2- 172.21.15.146:0/923104669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9780d2850 0x7fe9780b6600 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe97806ae20 tx=0x7fe97000b330 comp rx=0 tx=0).stop 2023-05-24T03:31:55.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.261+0000 7fe97d69d700 1 -- 172.21.15.146:0/923104669 shutdown_connections 2023-05-24T03:31:55.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.261+0000 7fe97d69d700 1 --2- 172.21.15.146:0/923104669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9780d2850 0x7fe9780b6600 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:55.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.261+0000 7fe97d69d700 1 --2- 172.21.15.146:0/923104669 >> v2:172.21.15.151:3300/0 conn(0x7fe9780d2da0 0x7fe9780b60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:55.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.261+0000 7fe97d69d700 1 -- 172.21.15.146:0/923104669 >> 172.21.15.146:0/923104669 conn(0x7fe97806af50 msgr2=0x7fe97806b350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:31:55.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.261+0000 7fe97d69d700 1 -- 172.21.15.146:0/923104669 shutdown_connections 2023-05-24T03:31:55.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.261+0000 7fe97d69d700 1 -- 172.21.15.146:0/923104669 wait complete. 2023-05-24T03:31:55.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.262+0000 7fe97d69d700 1 Processor -- start 2023-05-24T03:31:55.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.262+0000 7fe97d69d700 1 -- start start 2023-05-24T03:31:55.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.263+0000 7fe97d69d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9780d2850 0x7fe97814b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:55.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.263+0000 7fe97d69d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9780d2da0 0x7fe9780c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:55.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.263+0000 7fe97d69d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe97815cb50 0x7fe9780c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:55.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.263+0000 7fe97d69d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe97814bc60 con 0x7fe9780d2da0 2023-05-24T03:31:55.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.263+0000 7fe97d69d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9781f2cf0 con 0x7fe97815cb50 2023-05-24T03:31:55.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.263+0000 7fe97d69d700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9781f32b0 con 0x7fe9780d2850 2023-05-24T03:31:55.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.263+0000 7fe9767fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9780d2da0 0x7fe9780c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:55.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.263+0000 7fe9767fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9780d2da0 0x7fe9780c8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40268/0 (socket says 172.21.15.146:40268) 2023-05-24T03:31:55.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.263+0000 7fe9767fc700 1 -- 172.21.15.146:0/35681113 learned_addr learned my addr 172.21.15.146:0/35681113 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:31:55.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.263+0000 7fe976ffd700 1 --2- 172.21.15.146:0/35681113 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9780d2850 0x7fe97814b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:55.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.263+0000 7fe9777fe700 1 --2- 172.21.15.146:0/35681113 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe97815cb50 0x7fe9780c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:55.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.263+0000 7fe9767fc700 1 -- 172.21.15.146:0/35681113 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9780d2850 msgr2=0x7fe97814b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:55.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.263+0000 7fe9767fc700 1 --2- 172.21.15.146:0/35681113 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9780d2850 0x7fe97814b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:55.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.263+0000 7fe9767fc700 1 -- 172.21.15.146:0/35681113 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe97815cb50 msgr2=0x7fe9780c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:55.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.263+0000 7fe9767fc700 1 --2- 172.21.15.146:0/35681113 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe97815cb50 0x7fe9780c92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:55.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.263+0000 7fe9767fc700 1 -- 172.21.15.146:0/35681113 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe970009a70 con 0x7fe9780d2da0 2023-05-24T03:31:55.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.264+0000 7fe9767fc700 1 --2- 172.21.15.146:0/35681113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9780d2da0 0x7fe9780c8db0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe96c00e9e0 tx=0x7fe96c00ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:55.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.264+0000 7fe95f7fe700 1 -- 172.21.15.146:0/35681113 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96c009710 con 0x7fe9780d2da0 2023-05-24T03:31:55.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.264+0000 7fe95f7fe700 1 -- 172.21.15.146:0/35681113 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe96c00ee80 con 0x7fe9780d2da0 2023-05-24T03:31:55.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.264+0000 7fe97d69d700 1 -- 172.21.15.146:0/35681113 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9780d2520 con 0x7fe9780d2da0 2023-05-24T03:31:55.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.264+0000 7fe95f7fe700 1 -- 172.21.15.146:0/35681113 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96c00ca50 con 0x7fe9780d2da0 2023-05-24T03:31:55.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.264+0000 7fe97d69d700 1 -- 172.21.15.146:0/35681113 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9780d18f0 con 0x7fe9780d2da0 2023-05-24T03:31:55.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.265+0000 7fe97d69d700 1 -- 172.21.15.146:0/35681113 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9780cdf20 con 0x7fe9780d2da0 2023-05-24T03:31:55.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.265+0000 7fe95f7fe700 1 -- 172.21.15.146:0/35681113 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe96c00cbb0 con 0x7fe9780d2da0 2023-05-24T03:31:55.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.266+0000 7fe95f7fe700 1 --2- 172.21.15.146:0/35681113 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fe96406ace0 0x7fe96406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:55.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.266+0000 7fe976ffd700 1 --2- 172.21.15.146:0/35681113 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fe96406ace0 0x7fe96406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:55.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.266+0000 7fe95f7fe700 1 -- 172.21.15.146:0/35681113 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe96c0897a0 con 0x7fe9780d2da0 2023-05-24T03:31:55.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.266+0000 7fe976ffd700 1 --2- 172.21.15.146:0/35681113 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fe96406ace0 0x7fe96406d190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe968007fd0 tx=0x7fe968007dc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:55.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.270+0000 7fe95f7fe700 1 -- 172.21.15.146:0/35681113 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fe96c057fb0 con 0x7fe9780d2da0 2023-05-24T03:31:55.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.460+0000 7fe97d69d700 1 -- 172.21.15.146:0/35681113 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe978072ae0 con 0x7fe9780d2da0 2023-05-24T03:31:55.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.462+0000 7fe95f7fe700 1 -- 172.21.15.146:0/35681113 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20251 (secure 0 0 0) 0x7fe96c057b40 con 0x7fe9780d2da0 2023-05-24T03:31:55.467 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:31:55.467 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":30,"fsid":"11ca0adb-7672-4713-bde7-451e8b743ae9","created":"2023-05-24T03:29:19.113659+0000","modified":"2023-05-24T03:30:25.932188+0000","last_up_change":"2023-05-24T03:29:30.962339+0000","last_in_change":"2023-05-24T03:29:21.706540+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-24T03:29:32.749984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-24T03:29:37.719623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-24T03:29:42.165379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-24T03:29:43.431615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-24T03:29:46.503075+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f24b319b-fcc8-4385-b0cb-78138fc31417","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6801","nonce":3353593100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6803","nonce":3353593100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6807","nonce":3353593100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6805","nonce":3353593100}]},"public_addr":"172.21.15.146:6801/3353593100","cluster_addr":"172.21.15.146:6803/3353593100","heartbeat_back_addr":"172.21.15.146:6807/3353593100","heartbeat_front_addr":"172.21.15.146:6805/3353593100","state":["exists","up"]},{"osd":1,"uuid":"c9639ea9-8f9b-498e-92c8-aa976edbf1da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6821","nonce":2537488734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6825","nonce":2537488734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6831","nonce":2537488734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6827","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6829","nonce":2537488734}]},"public_addr":"172.21.15.146:6821/2537488734","cluster_addr":"172.21.15.146:6825/2537488734","heartbeat_back_addr":"172.21.15.146:6831/2537488734","heartbeat_front_addr":"172.21.15.146:6829/2537488734","state":["exists","up"]},{"osd":2,"uuid":"7a6cfc6d-b0ca-4cb6-a66d-4001ec184657","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6809","nonce":1800242932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6811","nonce":1800242932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6815","nonce":1800242932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6813","nonce":1800242932}]},"public_addr":"172.21.15.146:6809/1800242932","cluster_addr":"172.21.15.146:6811/1800242932","heartbeat_back_addr":"172.21.15.146:6815/1800242932","heartbeat_front_addr":"172.21.15.146:6813/1800242932","state":["exists","up"]},{"osd":3,"uuid":"401509f7-cecd-44a2-b0ae-22c81a5d93c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6817","nonce":1749783580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6820","nonce":1749783580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6828","nonce":1749783580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6824","nonce":1749783580}]},"public_addr":"172.21.15.146:6817/1749783580","cluster_addr":"172.21.15.146:6820/1749783580","heartbeat_back_addr":"172.21.15.146:6828/1749783580","heartbeat_front_addr":"172.21.15.146:6824/1749783580","state":["exists","up"]},{"osd":4,"uuid":"9d07f440-d125-4f99-a825-411fab894d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6811","nonce":163453435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6814","nonce":163453435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6819","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6821","nonce":163453435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6818","nonce":163453435}]},"public_addr":"172.21.15.151:6811/163453435","cluster_addr":"172.21.15.151:6814/163453435","heartbeat_back_addr":"172.21.15.151:6821/163453435","heartbeat_front_addr":"172.21.15.151:6818/163453435","state":["exists","up"]},{"osd":5,"uuid":"9b2266e2-9e52-4f0e-96da-e703a6c23a6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6801","nonce":3283474903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6803","nonce":3283474903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6807","nonce":3283474903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6805","nonce":3283474903}]},"public_addr":"172.21.15.151:6801/3283474903","cluster_addr":"172.21.15.151:6803/3283474903","heartbeat_back_addr":"172.21.15.151:6807/3283474903","heartbeat_front_addr":"172.21.15.151:6805/3283474903","state":["exists","up"]},{"osd":6,"uuid":"5daedf77-0a83-49e7-b497-d9ed10436972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6825","nonce":3889424178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6827","nonce":3889424178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6831","nonce":3889424178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6829","nonce":3889424178}]},"public_addr":"172.21.15.151:6825/3889424178","cluster_addr":"172.21.15.151:6827/3889424178","heartbeat_back_addr":"172.21.15.151:6831/3889424178","heartbeat_front_addr":"172.21.15.151:6829/3889424178","state":["exists","up"]},{"osd":7,"uuid":"86ae4f7e-c01f-4c3d-a0dd-98160c209309","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6810","nonce":563291208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6815","nonce":563291208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6823","nonce":563291208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6820","nonce":563291208}]},"public_addr":"172.21.15.151:6810/563291208","cluster_addr":"172.21.15.151:6815/563291208","heartbeat_back_addr":"172.21.15.151:6823/563291208","heartbeat_front_addr":"172.21.15.151:6820/563291208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.872472+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.937126+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.877234+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.884793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.881632+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.938293+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.857661+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.945883+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.9","mappings":[{"from":1,"to":5}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-24T03:31:55.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.464+0000 7fe97d69d700 1 -- 172.21.15.146:0/35681113 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fe96406ace0 msgr2=0x7fe96406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:55.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.464+0000 7fe97d69d700 1 --2- 172.21.15.146:0/35681113 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fe96406ace0 0x7fe96406d190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe968007fd0 tx=0x7fe968007dc0 comp rx=0 tx=0).stop 2023-05-24T03:31:55.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.464+0000 7fe97d69d700 1 -- 172.21.15.146:0/35681113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9780d2da0 msgr2=0x7fe9780c8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:55.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.464+0000 7fe97d69d700 1 --2- 172.21.15.146:0/35681113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9780d2da0 0x7fe9780c8db0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe96c00e9e0 tx=0x7fe96c00ecf0 comp rx=0 tx=0).stop 2023-05-24T03:31:55.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.464+0000 7fe97d69d700 1 -- 172.21.15.146:0/35681113 shutdown_connections 2023-05-24T03:31:55.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.464+0000 7fe97d69d700 1 --2- 172.21.15.146:0/35681113 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fe96406ace0 0x7fe96406d190 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:55.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.464+0000 7fe97d69d700 1 --2- 172.21.15.146:0/35681113 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe97815cb50 0x7fe9780c92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:55.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.464+0000 7fe97d69d700 1 --2- 172.21.15.146:0/35681113 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9780d2850 0x7fe97814b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:55.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.464+0000 7fe97d69d700 1 --2- 172.21.15.146:0/35681113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9780d2da0 0x7fe9780c8db0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:55.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.464+0000 7fe97d69d700 1 -- 172.21.15.146:0/35681113 >> 172.21.15.146:0/35681113 conn(0x7fe97806af50 msgr2=0x7fe9780d1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:31:55.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.464+0000 7fe97d69d700 1 -- 172.21.15.146:0/35681113 shutdown_connections 2023-05-24T03:31:55.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.464+0000 7fe97d69d700 1 -- 172.21.15.146:0/35681113 wait complete. 2023-05-24T03:31:55.481 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-24T03:29:32.749984+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-24T03:29:37.719623+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-24T03:29:42.165379+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-24T03:29:43.431615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-24T03:29:46.503075+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-24T03:31:55.483 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-24T03:31:55.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.602+0000 7f4335638700 1 Processor -- start 2023-05-24T03:31:55.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.602+0000 7f4335638700 1 -- start start 2023-05-24T03:31:55.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.603+0000 7f4335638700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f433015aa90 0x7f43300b3460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:55.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.603+0000 7f4335638700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f433015dee0 0x7f43300cb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:55.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.603+0000 7f4335638700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43300b3a40 con 0x7f43300cd920 2023-05-24T03:31:55.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.603+0000 7f4335638700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43300d06c0 con 0x7f433015aa90 2023-05-24T03:31:55.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.603+0000 7f4335638700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43300d09a0 con 0x7f433015dee0 2023-05-24T03:31:55.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.603+0000 7f432effd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f433015aa90 0x7f43300b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:55.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.603+0000 7f432effd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f433015aa90 0x7f43300b3460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40274/0 (socket says 172.21.15.146:40274) 2023-05-24T03:31:55.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.603+0000 7f432effd700 1 -- 172.21.15.146:0/3351344175 learned_addr learned my addr 172.21.15.146:0/3351344175 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:31:55.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.603+0000 7f432e7fc700 1 --2- 172.21.15.146:0/3351344175 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f433015dee0 0x7f43300cb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:55.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.604+0000 7f432effd700 1 -- 172.21.15.146:0/3351344175 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f433015dee0 msgr2=0x7f43300cb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:31:55.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.604+0000 7f432effd700 1 --2- 172.21.15.146:0/3351344175 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f433015dee0 0x7f43300cb6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:55.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.604+0000 7f432effd700 1 -- 172.21.15.146:0/3351344175 >> v1:172.21.15.151:6789/0 conn(0x7f43300cd920 legacy=0x7f43300d1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:55.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.604+0000 7f432effd700 1 -- 172.21.15.146:0/3351344175 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43300d0c80 con 0x7f433015aa90 2023-05-24T03:31:55.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.604+0000 7f432e7fc700 1 --2- 172.21.15.146:0/3351344175 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f433015dee0 0x7f43300cb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:31:55.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.604+0000 7f432effd700 1 --2- 172.21.15.146:0/3351344175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f433015aa90 0x7f43300b3460 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f43240098f0 tx=0x7f4324009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=462fb22eb1f859f server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:55.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.604+0000 7f432dffb700 1 -- 172.21.15.146:0/3351344175 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432400b8a0 con 0x7f433015aa90 2023-05-24T03:31:55.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.604+0000 7f432dffb700 1 -- 172.21.15.146:0/3351344175 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f432400ba00 con 0x7f433015aa90 2023-05-24T03:31:55.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.604+0000 7f432dffb700 1 -- 172.21.15.146:0/3351344175 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432400bd90 con 0x7f433015aa90 2023-05-24T03:31:55.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.604+0000 7f4335638700 1 -- 172.21.15.146:0/3351344175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f433015aa90 msgr2=0x7f43300b3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:55.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.604+0000 7f4335638700 1 --2- 172.21.15.146:0/3351344175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f433015aa90 0x7f43300b3460 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f43240098f0 tx=0x7f4324009c00 comp rx=0 tx=0).stop 2023-05-24T03:31:55.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.604+0000 7f4335638700 1 -- 172.21.15.146:0/3351344175 shutdown_connections 2023-05-24T03:31:55.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.604+0000 7f4335638700 1 --2- 172.21.15.146:0/3351344175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f433015aa90 0x7f43300b3460 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:55.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.604+0000 7f4335638700 1 --2- 172.21.15.146:0/3351344175 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f433015dee0 0x7f43300cb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:55.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.604+0000 7f4335638700 1 -- 172.21.15.146:0/3351344175 >> 172.21.15.146:0/3351344175 conn(0x7f433006e2a0 msgr2=0x7f433006e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:31:55.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.604+0000 7f4335638700 1 -- 172.21.15.146:0/3351344175 shutdown_connections 2023-05-24T03:31:55.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.604+0000 7f4335638700 1 -- 172.21.15.146:0/3351344175 wait complete. 2023-05-24T03:31:55.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.606+0000 7f4335638700 1 Processor -- start 2023-05-24T03:31:55.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.606+0000 7f4335638700 1 -- start start 2023-05-24T03:31:55.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.606+0000 7f4335638700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43300cd920 0x7f43300c7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:55.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.606+0000 7f4335638700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f433015aa90 0x7f4330149080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:55.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.606+0000 7f4335638700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f433015dee0 0x7f433015fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:55.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.606+0000 7f4335638700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43301471d0 con 0x7f43300cd920 2023-05-24T03:31:55.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.606+0000 7f4335638700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4330146e30 con 0x7f433015dee0 2023-05-24T03:31:55.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.606+0000 7f4335638700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43300c55c0 con 0x7f433015aa90 2023-05-24T03:31:55.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.607+0000 7f432effd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43300cd920 0x7f43300c7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:55.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.607+0000 7f432effd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43300cd920 0x7f43300c7b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40280/0 (socket says 172.21.15.146:40280) 2023-05-24T03:31:55.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.607+0000 7f432effd700 1 -- 172.21.15.146:0/1773100541 learned_addr learned my addr 172.21.15.146:0/1773100541 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:31:55.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.607+0000 7f432e7fc700 1 --2- 172.21.15.146:0/1773100541 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f433015aa90 0x7f4330149080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:55.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.607+0000 7f432f7fe700 1 --2- 172.21.15.146:0/1773100541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f433015dee0 0x7f433015fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:55.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.607+0000 7f432effd700 1 -- 172.21.15.146:0/1773100541 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f433015aa90 msgr2=0x7f4330149080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:55.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.607+0000 7f432effd700 1 --2- 172.21.15.146:0/1773100541 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f433015aa90 0x7f4330149080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:55.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.607+0000 7f432effd700 1 -- 172.21.15.146:0/1773100541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f433015dee0 msgr2=0x7f433015fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:55.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.607+0000 7f432effd700 1 --2- 172.21.15.146:0/1773100541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f433015dee0 0x7f433015fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:55.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.607+0000 7f432effd700 1 -- 172.21.15.146:0/1773100541 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4324009550 con 0x7f43300cd920 2023-05-24T03:31:55.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.607+0000 7f432effd700 1 --2- 172.21.15.146:0/1773100541 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43300cd920 0x7f43300c7b10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4324000c00 tx=0x7f4324004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:55.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.607+0000 7f43177fe700 1 -- 172.21.15.146:0/1773100541 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4324004300 con 0x7f43300cd920 2023-05-24T03:31:55.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.607+0000 7f43177fe700 1 -- 172.21.15.146:0/1773100541 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f432401f070 con 0x7f43300cd920 2023-05-24T03:31:55.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.607+0000 7f43177fe700 1 -- 172.21.15.146:0/1773100541 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43240036a0 con 0x7f43300cd920 2023-05-24T03:31:55.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.607+0000 7f4335638700 1 -- 172.21.15.146:0/1773100541 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f433015ae60 con 0x7f43300cd920 2023-05-24T03:31:55.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.607+0000 7f4335638700 1 -- 172.21.15.146:0/1773100541 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43300d0f60 con 0x7f43300cd920 2023-05-24T03:31:55.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.608+0000 7f4335638700 1 -- 172.21.15.146:0/1773100541 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f433015e350 con 0x7f43300cd920 2023-05-24T03:31:55.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.609+0000 7f43177fe700 1 -- 172.21.15.146:0/1773100541 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4324021030 con 0x7f43300cd920 2023-05-24T03:31:55.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.609+0000 7f43177fe700 1 --2- 172.21.15.146:0/1773100541 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f431c06ad10 0x7f431c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:55.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.609+0000 7f43177fe700 1 -- 172.21.15.146:0/1773100541 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f432408aac0 con 0x7f43300cd920 2023-05-24T03:31:55.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.609+0000 7f432e7fc700 1 --2- 172.21.15.146:0/1773100541 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f431c06ad10 0x7f431c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:55.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.609+0000 7f432e7fc700 1 --2- 172.21.15.146:0/1773100541 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f431c06ad10 0x7f431c06d1c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f43300b0e60 tx=0x7f4320008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:55.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.613+0000 7f43177fe700 1 -- 172.21.15.146:0/1773100541 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f4324055850 con 0x7f43300cd920 2023-05-24T03:31:55.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.819+0000 7f4335638700 1 -- 172.21.15.146:0/1773100541 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4330146c90 con 0x7f43300cd920 2023-05-24T03:31:55.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.819+0000 7f43177fe700 1 -- 172.21.15.146:0/1773100541 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4330146c90 con 0x7f43300cd920 2023-05-24T03:31:55.824 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2023-05-24T03:31:55.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.821+0000 7f4335638700 1 -- 172.21.15.146:0/1773100541 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f431c06ad10 msgr2=0x7f431c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:55.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.821+0000 7f4335638700 1 --2- 172.21.15.146:0/1773100541 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f431c06ad10 0x7f431c06d1c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f43300b0e60 tx=0x7f4320008040 comp rx=0 tx=0).stop 2023-05-24T03:31:55.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.821+0000 7f4335638700 1 -- 172.21.15.146:0/1773100541 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43300cd920 msgr2=0x7f43300c7b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:55.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.821+0000 7f4335638700 1 --2- 172.21.15.146:0/1773100541 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43300cd920 0x7f43300c7b10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4324000c00 tx=0x7f4324004750 comp rx=0 tx=0).stop 2023-05-24T03:31:55.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.821+0000 7f4335638700 1 -- 172.21.15.146:0/1773100541 shutdown_connections 2023-05-24T03:31:55.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.821+0000 7f4335638700 1 --2- 172.21.15.146:0/1773100541 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f431c06ad10 0x7f431c06d1c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:55.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.821+0000 7f4335638700 1 --2- 172.21.15.146:0/1773100541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f433015dee0 0x7f433015fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:55.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.821+0000 7f4335638700 1 --2- 172.21.15.146:0/1773100541 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43300cd920 0x7f43300c7b10 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:55.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.821+0000 7f4335638700 1 --2- 172.21.15.146:0/1773100541 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f433015aa90 0x7f4330149080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:55.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.821+0000 7f4335638700 1 -- 172.21.15.146:0/1773100541 >> 172.21.15.146:0/1773100541 conn(0x7f433006e2a0 msgr2=0x7f433015c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:31:55.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.821+0000 7f4335638700 1 -- 172.21.15.146:0/1773100541 shutdown_connections 2023-05-24T03:31:55.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.821+0000 7f4335638700 1 -- 172.21.15.146:0/1773100541 wait complete. 2023-05-24T03:31:55.838 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-24T03:31:55.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.957+0000 7fd946476700 1 Processor -- start 2023-05-24T03:31:55.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.957+0000 7fd946476700 1 -- start start 2023-05-24T03:31:55.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.958+0000 7fd946476700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd94015af00 0x7fd9400ce110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:55.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.958+0000 7fd946476700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd9400b2d00 0x7fd94015e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:55.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.958+0000 7fd946476700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9400cd950 con 0x7fd9400d0110 2023-05-24T03:31:55.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.958+0000 7fd946476700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9400b36b0 con 0x7fd94015af00 2023-05-24T03:31:55.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.958+0000 7fd946476700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9400b3990 con 0x7fd9400b2d00 2023-05-24T03:31:55.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.958+0000 7fd93ffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd94015af00 0x7fd9400ce110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:55.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.959+0000 7fd93ffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd94015af00 0x7fd9400ce110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40288/0 (socket says 172.21.15.146:40288) 2023-05-24T03:31:55.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.959+0000 7fd93ffff700 1 -- 172.21.15.146:0/808172020 learned_addr learned my addr 172.21.15.146:0/808172020 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:31:55.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.959+0000 7fd93f7fe700 1 --2- 172.21.15.146:0/808172020 >> v2:172.21.15.151:3300/0 conn(0x7fd9400b2d00 0x7fd94015e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:55.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.959+0000 7fd93ffff700 1 -- 172.21.15.146:0/808172020 >> v2:172.21.15.151:3300/0 conn(0x7fd9400b2d00 msgr2=0x7fd94015e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:31:55.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.959+0000 7fd93ffff700 1 --2- 172.21.15.146:0/808172020 >> v2:172.21.15.151:3300/0 conn(0x7fd9400b2d00 0x7fd94015e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:55.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.959+0000 7fd93ffff700 1 -- 172.21.15.146:0/808172020 >> v1:172.21.15.151:6789/0 conn(0x7fd9400d0110 legacy=0x7fd94015ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:31:55.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.959+0000 7fd93ffff700 1 -- 172.21.15.146:0/808172020 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd94015f6b0 con 0x7fd94015af00 2023-05-24T03:31:55.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.959+0000 7fd93ffff700 1 --2- 172.21.15.146:0/808172020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd94015af00 0x7fd9400ce110 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd9400d2120 tx=0x7fd934009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa4c675a52fba9e3 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:55.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.959+0000 7fd93effd700 1 -- 172.21.15.146:0/808172020 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd934004230 con 0x7fd94015af00 2023-05-24T03:31:55.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.959+0000 7fd93effd700 1 -- 172.21.15.146:0/808172020 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd934004390 con 0x7fd94015af00 2023-05-24T03:31:55.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.959+0000 7fd93effd700 1 -- 172.21.15.146:0/808172020 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9340036a0 con 0x7fd94015af00 2023-05-24T03:31:55.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.960+0000 7fd946476700 1 -- 172.21.15.146:0/808172020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd94015af00 msgr2=0x7fd9400ce110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:55.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.960+0000 7fd946476700 1 --2- 172.21.15.146:0/808172020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd94015af00 0x7fd9400ce110 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd9400d2120 tx=0x7fd934009bd0 comp rx=0 tx=0).stop 2023-05-24T03:31:55.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.960+0000 7fd946476700 1 -- 172.21.15.146:0/808172020 shutdown_connections 2023-05-24T03:31:55.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.960+0000 7fd946476700 1 --2- 172.21.15.146:0/808172020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd94015af00 0x7fd9400ce110 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:55.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.960+0000 7fd946476700 1 --2- 172.21.15.146:0/808172020 >> v2:172.21.15.151:3300/0 conn(0x7fd9400b2d00 0x7fd94015e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:55.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.960+0000 7fd946476700 1 -- 172.21.15.146:0/808172020 >> 172.21.15.146:0/808172020 conn(0x7fd94006e2a0 msgr2=0x7fd94006e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:31:55.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.960+0000 7fd946476700 1 -- 172.21.15.146:0/808172020 shutdown_connections 2023-05-24T03:31:55.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.960+0000 7fd946476700 1 -- 172.21.15.146:0/808172020 wait complete. 2023-05-24T03:31:55.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.961+0000 7fd946476700 1 Processor -- start 2023-05-24T03:31:55.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.961+0000 7fd946476700 1 -- start start 2023-05-24T03:31:55.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.962+0000 7fd946476700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9400b2d00 0x7fd940155660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:55.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.962+0000 7fd946476700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd9400d0110 0x7fd9400b1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:55.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.962+0000 7fd946476700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd94015af00 0x7fd94015c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:55.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.962+0000 7fd946476700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9400c8150 con 0x7fd9400b2d00 2023-05-24T03:31:55.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.962+0000 7fd946476700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd940155ba0 con 0x7fd94015af00 2023-05-24T03:31:55.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.962+0000 7fd946476700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd94015b2d0 con 0x7fd9400d0110 2023-05-24T03:31:55.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.962+0000 7fd93ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9400b2d00 0x7fd940155660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:55.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.962+0000 7fd93ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9400b2d00 0x7fd940155660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40294/0 (socket says 172.21.15.146:40294) 2023-05-24T03:31:55.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.962+0000 7fd93ffff700 1 -- 172.21.15.146:0/3834066176 learned_addr learned my addr 172.21.15.146:0/3834066176 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:31:55.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.962+0000 7fd944a13700 1 --2- 172.21.15.146:0/3834066176 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd94015af00 0x7fd94015c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:55.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.962+0000 7fd93ffff700 1 -- 172.21.15.146:0/3834066176 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd9400d0110 msgr2=0x7fd9400b1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:55.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.962+0000 7fd93f7fe700 1 --2- 172.21.15.146:0/3834066176 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd9400d0110 0x7fd9400b1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:55.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.962+0000 7fd93ffff700 1 --2- 172.21.15.146:0/3834066176 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd9400d0110 0x7fd9400b1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:55.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.962+0000 7fd93ffff700 1 -- 172.21.15.146:0/3834066176 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd94015af00 msgr2=0x7fd94015c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:55.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.962+0000 7fd93ffff700 1 --2- 172.21.15.146:0/3834066176 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd94015af00 0x7fd94015c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:55.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.962+0000 7fd93ffff700 1 -- 172.21.15.146:0/3834066176 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd934009550 con 0x7fd9400b2d00 2023-05-24T03:31:55.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.962+0000 7fd93ffff700 1 --2- 172.21.15.146:0/3834066176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9400b2d00 0x7fd940155660 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd934009130 tx=0x7fd934004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:55.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.962+0000 7fd93cff9700 1 -- 172.21.15.146:0/3834066176 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd934003d40 con 0x7fd9400b2d00 2023-05-24T03:31:55.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.962+0000 7fd93cff9700 1 -- 172.21.15.146:0/3834066176 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd93401f070 con 0x7fd9400b2d00 2023-05-24T03:31:55.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.962+0000 7fd946476700 1 -- 172.21.15.146:0/3834066176 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9400cb970 con 0x7fd9400b2d00 2023-05-24T03:31:55.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.962+0000 7fd93cff9700 1 -- 172.21.15.146:0/3834066176 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd934003ea0 con 0x7fd9400b2d00 2023-05-24T03:31:55.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.963+0000 7fd946476700 1 -- 172.21.15.146:0/3834066176 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9400cdbf0 con 0x7fd9400b2d00 2023-05-24T03:31:55.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.963+0000 7fd946476700 1 -- 172.21.15.146:0/3834066176 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9400d0660 con 0x7fd9400b2d00 2023-05-24T03:31:55.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.964+0000 7fd93cff9700 1 -- 172.21.15.146:0/3834066176 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd934021030 con 0x7fd9400b2d00 2023-05-24T03:31:55.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.964+0000 7fd93cff9700 1 --2- 172.21.15.146:0/3834066176 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fd92c06ace0 0x7fd92c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:55.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.964+0000 7fd93cff9700 1 -- 172.21.15.146:0/3834066176 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd93408ad20 con 0x7fd9400b2d00 2023-05-24T03:31:55.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.964+0000 7fd93f7fe700 1 --2- 172.21.15.146:0/3834066176 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fd92c06ace0 0x7fd92c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:55.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.965+0000 7fd93f7fe700 1 --2- 172.21.15.146:0/3834066176 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fd92c06ace0 0x7fd92c06d190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd940159da0 tx=0x7fd930008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:55.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:55.969+0000 7fd93cff9700 1 -- 172.21.15.146:0/3834066176 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fd934055b30 con 0x7fd9400b2d00 2023-05-24T03:31:56.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.155+0000 7fd946476700 1 -- 172.21.15.146:0/3834066176 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd9400cb440 con 0x7fd9400b2d00 2023-05-24T03:31:56.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.155+0000 7fd93cff9700 1 -- 172.21.15.146:0/3834066176 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd934059150 con 0x7fd9400b2d00 2023-05-24T03:31:56.161 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2023-05-24T03:31:56.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.158+0000 7fd946476700 1 -- 172.21.15.146:0/3834066176 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fd92c06ace0 msgr2=0x7fd92c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:56.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.158+0000 7fd946476700 1 --2- 172.21.15.146:0/3834066176 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fd92c06ace0 0x7fd92c06d190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd940159da0 tx=0x7fd930008040 comp rx=0 tx=0).stop 2023-05-24T03:31:56.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.158+0000 7fd946476700 1 -- 172.21.15.146:0/3834066176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9400b2d00 msgr2=0x7fd940155660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:56.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.158+0000 7fd946476700 1 --2- 172.21.15.146:0/3834066176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9400b2d00 0x7fd940155660 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd934009130 tx=0x7fd934004750 comp rx=0 tx=0).stop 2023-05-24T03:31:56.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.158+0000 7fd946476700 1 -- 172.21.15.146:0/3834066176 shutdown_connections 2023-05-24T03:31:56.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.158+0000 7fd946476700 1 --2- 172.21.15.146:0/3834066176 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fd92c06ace0 0x7fd92c06d190 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:56.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.158+0000 7fd946476700 1 --2- 172.21.15.146:0/3834066176 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd94015af00 0x7fd94015c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:56.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.158+0000 7fd946476700 1 --2- 172.21.15.146:0/3834066176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9400b2d00 0x7fd940155660 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:56.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.158+0000 7fd946476700 1 --2- 172.21.15.146:0/3834066176 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd9400d0110 0x7fd9400b1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:56.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.158+0000 7fd946476700 1 -- 172.21.15.146:0/3834066176 >> 172.21.15.146:0/3834066176 conn(0x7fd94006e2a0 msgr2=0x7fd9400cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:31:56.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.158+0000 7fd946476700 1 -- 172.21.15.146:0/3834066176 shutdown_connections 2023-05-24T03:31:56.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.158+0000 7fd946476700 1 -- 172.21.15.146:0/3834066176 wait complete. 2023-05-24T03:31:56.175 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-24T03:31:56.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.296+0000 7f204d9a6700 1 Processor -- start 2023-05-24T03:31:56.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.296+0000 7f204d9a6700 1 -- start start 2023-05-24T03:31:56.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.297+0000 7f204d9a6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f204815af00 0x7f20480ce110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:56.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.297+0000 7f204d9a6700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f20480d0110 0x7f204815efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:56.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.297+0000 7f204d9a6700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20480cd950 con 0x7f20480b2d00 2023-05-24T03:31:56.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.297+0000 7f204d9a6700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20480b36b0 con 0x7f204815af00 2023-05-24T03:31:56.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.297+0000 7f204d9a6700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20480b3990 con 0x7f20480d0110 2023-05-24T03:31:56.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.297+0000 7f2046ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f204815af00 0x7f20480ce110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:56.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.297+0000 7f2046ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f204815af00 0x7f20480ce110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40302/0 (socket says 172.21.15.146:40302) 2023-05-24T03:31:56.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.297+0000 7f2046ffd700 1 -- 172.21.15.146:0/1720598762 learned_addr learned my addr 172.21.15.146:0/1720598762 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:31:56.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.297+0000 7f20477fe700 1 --2- 172.21.15.146:0/1720598762 >> v2:172.21.15.151:3300/0 conn(0x7f20480d0110 0x7f204815efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:56.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.298+0000 7f2046ffd700 1 -- 172.21.15.146:0/1720598762 >> v2:172.21.15.151:3300/0 conn(0x7f20480d0110 msgr2=0x7f204815efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:31:56.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.298+0000 7f2046ffd700 1 --2- 172.21.15.146:0/1720598762 >> v2:172.21.15.151:3300/0 conn(0x7f20480d0110 0x7f204815efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:56.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.298+0000 7f2046ffd700 1 -- 172.21.15.146:0/1720598762 >> v1:172.21.15.151:6789/0 conn(0x7f20480b2d00 legacy=0x7f204815e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:31:56.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.298+0000 7f2046ffd700 1 -- 172.21.15.146:0/1720598762 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f204815f6b0 con 0x7f204815af00 2023-05-24T03:31:56.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.298+0000 7f20477fe700 1 --2- 172.21.15.146:0/1720598762 >> v2:172.21.15.151:3300/0 conn(0x7f20480d0110 0x7f204815efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:31:56.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.298+0000 7f2046ffd700 1 --2- 172.21.15.146:0/1720598762 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f204815af00 0x7f20480ce110 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f204815e7e0 tx=0x7f2038009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=858aa1950ac44898 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:56.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.298+0000 7f2045ffb700 1 -- 172.21.15.146:0/1720598762 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2038004230 con 0x7f204815af00 2023-05-24T03:31:56.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.298+0000 7f2045ffb700 1 -- 172.21.15.146:0/1720598762 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2038004390 con 0x7f204815af00 2023-05-24T03:31:56.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.298+0000 7f2045ffb700 1 -- 172.21.15.146:0/1720598762 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20380036a0 con 0x7f204815af00 2023-05-24T03:31:56.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.298+0000 7f204d9a6700 1 -- 172.21.15.146:0/1720598762 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f204815af00 msgr2=0x7f20480ce110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:56.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.298+0000 7f204d9a6700 1 --2- 172.21.15.146:0/1720598762 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f204815af00 0x7f20480ce110 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f204815e7e0 tx=0x7f2038009bd0 comp rx=0 tx=0).stop 2023-05-24T03:31:56.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.298+0000 7f204d9a6700 1 -- 172.21.15.146:0/1720598762 shutdown_connections 2023-05-24T03:31:56.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.298+0000 7f204d9a6700 1 --2- 172.21.15.146:0/1720598762 >> v2:172.21.15.151:3300/0 conn(0x7f20480d0110 0x7f204815efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:56.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.298+0000 7f204d9a6700 1 --2- 172.21.15.146:0/1720598762 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f204815af00 0x7f20480ce110 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:56.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.298+0000 7f204d9a6700 1 -- 172.21.15.146:0/1720598762 >> 172.21.15.146:0/1720598762 conn(0x7f204806e2a0 msgr2=0x7f204806e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:31:56.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.298+0000 7f204d9a6700 1 -- 172.21.15.146:0/1720598762 shutdown_connections 2023-05-24T03:31:56.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.298+0000 7f204d9a6700 1 -- 172.21.15.146:0/1720598762 wait complete. 2023-05-24T03:31:56.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.300+0000 7f204d9a6700 1 Processor -- start 2023-05-24T03:31:56.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.300+0000 7f204d9a6700 1 -- start start 2023-05-24T03:31:56.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.300+0000 7f204d9a6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20480b2d00 0x7f20480c8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:56.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.300+0000 7f204d9a6700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20480d0110 0x7f20480ca130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:56.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.300+0000 7f204d9a6700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f204815af00 0x7f204814a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:56.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.300+0000 7f204d9a6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20480c89a0 con 0x7f20480b2d00 2023-05-24T03:31:56.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.300+0000 7f204d9a6700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20480cb4c0 con 0x7f204815af00 2023-05-24T03:31:56.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.300+0000 7f204d9a6700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20480cab90 con 0x7f20480d0110 2023-05-24T03:31:56.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.301+0000 7f2046ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20480b2d00 0x7f20480c8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:56.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.301+0000 7f2046ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20480b2d00 0x7f20480c8150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40308/0 (socket says 172.21.15.146:40308) 2023-05-24T03:31:56.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.301+0000 7f2046ffd700 1 -- 172.21.15.146:0/991498059 learned_addr learned my addr 172.21.15.146:0/991498059 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:31:56.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.301+0000 7f20477fe700 1 --2- 172.21.15.146:0/991498059 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f204815af00 0x7f204814a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:56.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.301+0000 7f20467fc700 1 --2- 172.21.15.146:0/991498059 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20480d0110 0x7f20480ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:56.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.301+0000 7f2046ffd700 1 -- 172.21.15.146:0/991498059 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20480d0110 msgr2=0x7f20480ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:56.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.301+0000 7f2046ffd700 1 --2- 172.21.15.146:0/991498059 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20480d0110 0x7f20480ca130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:56.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.301+0000 7f2046ffd700 1 -- 172.21.15.146:0/991498059 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f204815af00 msgr2=0x7f204814a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:56.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.301+0000 7f2046ffd700 1 --2- 172.21.15.146:0/991498059 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f204815af00 0x7f204814a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:56.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.301+0000 7f2046ffd700 1 -- 172.21.15.146:0/991498059 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2038009550 con 0x7f20480b2d00 2023-05-24T03:31:56.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.301+0000 7f2046ffd700 1 --2- 172.21.15.146:0/991498059 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20480b2d00 0x7f20480c8150 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2038009c10 tx=0x7f2038004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:56.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.301+0000 7f202ffff700 1 -- 172.21.15.146:0/991498059 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2038003c10 con 0x7f20480b2d00 2023-05-24T03:31:56.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.301+0000 7f202ffff700 1 -- 172.21.15.146:0/991498059 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f203801f070 con 0x7f20480b2d00 2023-05-24T03:31:56.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.301+0000 7f202ffff700 1 -- 172.21.15.146:0/991498059 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2038011630 con 0x7f20480b2d00 2023-05-24T03:31:56.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.301+0000 7f204d9a6700 1 -- 172.21.15.146:0/991498059 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20480cb970 con 0x7f20480b2d00 2023-05-24T03:31:56.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.301+0000 7f204d9a6700 1 -- 172.21.15.146:0/991498059 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20480cdbf0 con 0x7f20480b2d00 2023-05-24T03:31:56.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.302+0000 7f204d9a6700 1 -- 172.21.15.146:0/991498059 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20480d0660 con 0x7f20480b2d00 2023-05-24T03:31:56.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.303+0000 7f202ffff700 1 -- 172.21.15.146:0/991498059 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2038021030 con 0x7f20480b2d00 2023-05-24T03:31:56.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.303+0000 7f202ffff700 1 --2- 172.21.15.146:0/991498059 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f203406ace0 0x7f203406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:56.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.303+0000 7f202ffff700 1 -- 172.21.15.146:0/991498059 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f203808ace0 con 0x7f20480b2d00 2023-05-24T03:31:56.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.303+0000 7f20467fc700 1 --2- 172.21.15.146:0/991498059 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f203406ace0 0x7f203406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:56.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.303+0000 7f20467fc700 1 --2- 172.21.15.146:0/991498059 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f203406ace0 0x7f203406d190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f20480b17b0 tx=0x7f203c0090e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:56.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.307+0000 7f202ffff700 1 -- 172.21.15.146:0/991498059 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f2038055b20 con 0x7f20480b2d00 2023-05-24T03:31:56.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.496+0000 7f204d9a6700 1 -- 172.21.15.146:0/991498059 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f20480d0660 con 0x7f20480b2d00 2023-05-24T03:31:56.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.497+0000 7f202ffff700 1 -- 172.21.15.146:0/991498059 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2038059140 con 0x7f20480b2d00 2023-05-24T03:31:56.502 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2023-05-24T03:31:56.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.499+0000 7f204d9a6700 1 -- 172.21.15.146:0/991498059 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f203406ace0 msgr2=0x7f203406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:56.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.499+0000 7f204d9a6700 1 --2- 172.21.15.146:0/991498059 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f203406ace0 0x7f203406d190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f20480b17b0 tx=0x7f203c0090e0 comp rx=0 tx=0).stop 2023-05-24T03:31:56.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.499+0000 7f204d9a6700 1 -- 172.21.15.146:0/991498059 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20480b2d00 msgr2=0x7f20480c8150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:56.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.499+0000 7f204d9a6700 1 --2- 172.21.15.146:0/991498059 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20480b2d00 0x7f20480c8150 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2038009c10 tx=0x7f2038004750 comp rx=0 tx=0).stop 2023-05-24T03:31:56.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.499+0000 7f204d9a6700 1 -- 172.21.15.146:0/991498059 shutdown_connections 2023-05-24T03:31:56.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.499+0000 7f204d9a6700 1 --2- 172.21.15.146:0/991498059 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f203406ace0 0x7f203406d190 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:56.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.499+0000 7f204d9a6700 1 --2- 172.21.15.146:0/991498059 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f204815af00 0x7f204814a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:56.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.499+0000 7f204d9a6700 1 --2- 172.21.15.146:0/991498059 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20480b2d00 0x7f20480c8150 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:56.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.499+0000 7f204d9a6700 1 --2- 172.21.15.146:0/991498059 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20480d0110 0x7f20480ca130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:56.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.499+0000 7f204d9a6700 1 -- 172.21.15.146:0/991498059 >> 172.21.15.146:0/991498059 conn(0x7f204806e2a0 msgr2=0x7f2048159520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:31:56.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.499+0000 7f204d9a6700 1 -- 172.21.15.146:0/991498059 shutdown_connections 2023-05-24T03:31:56.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.499+0000 7f204d9a6700 1 -- 172.21.15.146:0/991498059 wait complete. 2023-05-24T03:31:56.516 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-24T03:31:56.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.637+0000 7f6cd8b2b700 1 Processor -- start 2023-05-24T03:31:56.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.638+0000 7f6cd8b2b700 1 -- start start 2023-05-24T03:31:56.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.638+0000 7f6cd8b2b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6cd406a460 0x7f6cd40cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:56.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.638+0000 7f6cd8b2b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6cd40aefd0 0x7f6cd4160d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:56.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.638+0000 7f6cd8b2b700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cd40cfd00 con 0x7f6cd415cd90 2023-05-24T03:31:56.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.638+0000 7f6cd8b2b700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cd4072350 con 0x7f6cd406a460 2023-05-24T03:31:56.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.638+0000 7f6cd8b2b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd40cf460 con 0x7f6cd40aefd0 2023-05-24T03:31:56.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.639+0000 7f6cd259c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6cd406a460 0x7f6cd40cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:56.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.639+0000 7f6cd2d9d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6cd40aefd0 0x7f6cd4160d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:56.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.639+0000 7f6cd259c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6cd406a460 0x7f6cd40cede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:51498/0 (socket says 172.21.15.146:51498) 2023-05-24T03:31:56.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.639+0000 7f6cd259c700 1 -- 172.21.15.146:0/1015816554 learned_addr learned my addr 172.21.15.146:0/1015816554 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:31:56.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.639+0000 7f6cd1d9b700 1 --1- 172.21.15.146:0/1015816554 >> v1:172.21.15.151:6789/0 conn(0x7f6cd415cd90 0x7f6cd406a830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:45802/0 (socket says 172.21.15.146:45802) 2023-05-24T03:31:56.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.639+0000 7f6cd2d9d700 1 -- 172.21.15.146:0/1015816554 >> v2:172.21.15.151:3300/0 conn(0x7f6cd406a460 msgr2=0x7f6cd40cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:31:56.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.639+0000 7f6cd2d9d700 1 --2- 172.21.15.146:0/1015816554 >> v2:172.21.15.151:3300/0 conn(0x7f6cd406a460 0x7f6cd40cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:56.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.639+0000 7f6cd2d9d700 1 -- 172.21.15.146:0/1015816554 >> v1:172.21.15.151:6789/0 conn(0x7f6cd415cd90 legacy=0x7f6cd406a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:56.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.639+0000 7f6cd2d9d700 1 -- 172.21.15.146:0/1015816554 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd40cf740 con 0x7f6cd40aefd0 2023-05-24T03:31:56.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.639+0000 7f6cd259c700 1 --2- 172.21.15.146:0/1015816554 >> v2:172.21.15.151:3300/0 conn(0x7f6cd406a460 0x7f6cd40cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T03:31:56.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.639+0000 7f6cd2d9d700 1 --2- 172.21.15.146:0/1015816554 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6cd40aefd0 0x7f6cd4160d20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc009d90 tx=0x7f6ccc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f2448c751bbe43c server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:56.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.640+0000 7f6cd159a700 1 -- 172.21.15.146:0/1015816554 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc00e070 con 0x7f6cd40aefd0 2023-05-24T03:31:56.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.640+0000 7f6cd159a700 1 -- 172.21.15.146:0/1015816554 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ccc00bb20 con 0x7f6cd40aefd0 2023-05-24T03:31:56.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.640+0000 7f6cd159a700 1 -- 172.21.15.146:0/1015816554 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc012430 con 0x7f6cd40aefd0 2023-05-24T03:31:56.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.640+0000 7f6cd8b2b700 1 -- 172.21.15.146:0/1015816554 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6cd40aefd0 msgr2=0x7f6cd4160d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:56.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.640+0000 7f6cd8b2b700 1 --2- 172.21.15.146:0/1015816554 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6cd40aefd0 0x7f6cd4160d20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc009d90 tx=0x7f6ccc00b330 comp rx=0 tx=0).stop 2023-05-24T03:31:56.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.640+0000 7f6cd8b2b700 1 -- 172.21.15.146:0/1015816554 shutdown_connections 2023-05-24T03:31:56.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.640+0000 7f6cd8b2b700 1 --2- 172.21.15.146:0/1015816554 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6cd40aefd0 0x7f6cd4160d20 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:56.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.640+0000 7f6cd8b2b700 1 --2- 172.21.15.146:0/1015816554 >> v2:172.21.15.151:3300/0 conn(0x7f6cd406a460 0x7f6cd40cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:56.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.640+0000 7f6cd8b2b700 1 -- 172.21.15.146:0/1015816554 >> 172.21.15.146:0/1015816554 conn(0x7f6cd40cfea0 msgr2=0x7f6cd40d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:31:56.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.640+0000 7f6cd8b2b700 1 -- 172.21.15.146:0/1015816554 shutdown_connections 2023-05-24T03:31:56.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.640+0000 7f6cd8b2b700 1 -- 172.21.15.146:0/1015816554 wait complete. 2023-05-24T03:31:56.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.642+0000 7f6cd8b2b700 1 Processor -- start 2023-05-24T03:31:56.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.642+0000 7f6cd8b2b700 1 -- start start 2023-05-24T03:31:56.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.642+0000 7f6cd8b2b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6cd406a460 0x7f6cd415a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:56.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.642+0000 7f6cd8b2b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cd40aefd0 0x7f6cd415dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:56.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.642+0000 7f6cd8b2b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6cd415cd90 0x7f6cd406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:56.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.642+0000 7f6cd8b2b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd4159050 con 0x7f6cd40aefd0 2023-05-24T03:31:56.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.642+0000 7f6cd8b2b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd415ea00 con 0x7f6cd406a460 2023-05-24T03:31:56.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.642+0000 7f6cd8b2b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd4158a20 con 0x7f6cd415cd90 2023-05-24T03:31:56.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.642+0000 7f6cd1d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cd40aefd0 0x7f6cd415dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:56.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.642+0000 7f6cd1d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cd40aefd0 0x7f6cd415dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40324/0 (socket says 172.21.15.146:40324) 2023-05-24T03:31:56.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.642+0000 7f6cd1d9b700 1 -- 172.21.15.146:0/2667472199 learned_addr learned my addr 172.21.15.146:0/2667472199 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:31:56.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.643+0000 7f6cd2d9d700 1 --2- 172.21.15.146:0/2667472199 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6cd415cd90 0x7f6cd406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:56.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.643+0000 7f6cd259c700 1 --2- 172.21.15.146:0/2667472199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6cd406a460 0x7f6cd415a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:56.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.643+0000 7f6cd1d9b700 1 -- 172.21.15.146:0/2667472199 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6cd415cd90 msgr2=0x7f6cd406d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:56.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.643+0000 7f6cd1d9b700 1 --2- 172.21.15.146:0/2667472199 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6cd415cd90 0x7f6cd406d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:56.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.643+0000 7f6cd1d9b700 1 -- 172.21.15.146:0/2667472199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6cd406a460 msgr2=0x7f6cd415a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:56.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.643+0000 7f6cd1d9b700 1 --2- 172.21.15.146:0/2667472199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6cd406a460 0x7f6cd415a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:56.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.643+0000 7f6cd1d9b700 1 -- 172.21.15.146:0/2667472199 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc8009550 con 0x7f6cd40aefd0 2023-05-24T03:31:56.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.643+0000 7f6cd1d9b700 1 --2- 172.21.15.146:0/2667472199 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cd40aefd0 0x7f6cd415dd70 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6cc400c550 tx=0x7f6cc400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:56.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.643+0000 7f6cc2ffd700 1 -- 172.21.15.146:0/2667472199 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc4005cb0 con 0x7f6cd40aefd0 2023-05-24T03:31:56.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.643+0000 7f6cc2ffd700 1 -- 172.21.15.146:0/2667472199 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc4005e10 con 0x7f6cd40aefd0 2023-05-24T03:31:56.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.643+0000 7f6cd8b2b700 1 -- 172.21.15.146:0/2667472199 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ccc009a70 con 0x7f6cd40aefd0 2023-05-24T03:31:56.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.643+0000 7f6cc2ffd700 1 -- 172.21.15.146:0/2667472199 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc40072d0 con 0x7f6cd40aefd0 2023-05-24T03:31:56.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.643+0000 7f6cd8b2b700 1 -- 172.21.15.146:0/2667472199 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cd4160800 con 0x7f6cd40aefd0 2023-05-24T03:31:56.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.644+0000 7f6cd8b2b700 1 -- 172.21.15.146:0/2667472199 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cd40cfa20 con 0x7f6cd40aefd0 2023-05-24T03:31:56.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.644+0000 7f6cc2ffd700 1 -- 172.21.15.146:0/2667472199 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6cc4007430 con 0x7f6cd40aefd0 2023-05-24T03:31:56.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.645+0000 7f6cc2ffd700 1 --2- 172.21.15.146:0/2667472199 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f6cb406ace0 0x7f6cb406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:56.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.645+0000 7f6cc2ffd700 1 -- 172.21.15.146:0/2667472199 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6cc4088870 con 0x7f6cd40aefd0 2023-05-24T03:31:56.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.645+0000 7f6cd259c700 1 --2- 172.21.15.146:0/2667472199 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f6cb406ace0 0x7f6cb406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:56.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.645+0000 7f6cd259c700 1 --2- 172.21.15.146:0/2667472199 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f6cb406ace0 0x7f6cb406d190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8006d30 tx=0x7f6cc80092c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:56.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.649+0000 7f6cc2ffd700 1 -- 172.21.15.146:0/2667472199 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f6cc40536a0 con 0x7f6cd40aefd0 2023-05-24T03:31:56.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.837+0000 7f6cd8b2b700 1 -- 172.21.15.146:0/2667472199 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6cd40af620 con 0x7f6cd40aefd0 2023-05-24T03:31:56.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.837+0000 7f6cc2ffd700 1 -- 172.21.15.146:0/2667472199 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6cc4017020 con 0x7f6cd40aefd0 2023-05-24T03:31:56.843 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2023-05-24T03:31:56.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.840+0000 7f6cd8b2b700 1 -- 172.21.15.146:0/2667472199 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f6cb406ace0 msgr2=0x7f6cb406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:56.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.840+0000 7f6cd8b2b700 1 --2- 172.21.15.146:0/2667472199 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f6cb406ace0 0x7f6cb406d190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8006d30 tx=0x7f6cc80092c0 comp rx=0 tx=0).stop 2023-05-24T03:31:56.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.840+0000 7f6cd8b2b700 1 -- 172.21.15.146:0/2667472199 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cd40aefd0 msgr2=0x7f6cd415dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:56.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.840+0000 7f6cd8b2b700 1 --2- 172.21.15.146:0/2667472199 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cd40aefd0 0x7f6cd415dd70 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6cc400c550 tx=0x7f6cc400c860 comp rx=0 tx=0).stop 2023-05-24T03:31:56.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.840+0000 7f6cd8b2b700 1 -- 172.21.15.146:0/2667472199 shutdown_connections 2023-05-24T03:31:56.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.840+0000 7f6cd8b2b700 1 --2- 172.21.15.146:0/2667472199 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f6cb406ace0 0x7f6cb406d190 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:56.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.840+0000 7f6cd8b2b700 1 --2- 172.21.15.146:0/2667472199 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6cd415cd90 0x7f6cd406d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:56.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.840+0000 7f6cd8b2b700 1 --2- 172.21.15.146:0/2667472199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6cd406a460 0x7f6cd415a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:56.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.840+0000 7f6cd8b2b700 1 --2- 172.21.15.146:0/2667472199 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cd40aefd0 0x7f6cd415dd70 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:56.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.840+0000 7f6cd8b2b700 1 -- 172.21.15.146:0/2667472199 >> 172.21.15.146:0/2667472199 conn(0x7f6cd40cfea0 msgr2=0x7f6cd406a830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:31:56.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.840+0000 7f6cd8b2b700 1 -- 172.21.15.146:0/2667472199 shutdown_connections 2023-05-24T03:31:56.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.840+0000 7f6cd8b2b700 1 -- 172.21.15.146:0/2667472199 wait complete. 2023-05-24T03:31:56.857 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-24T03:31:56.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.978+0000 7efe46937700 1 Processor -- start 2023-05-24T03:31:56.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.978+0000 7efe46937700 1 -- start start 2023-05-24T03:31:56.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.979+0000 7efe46937700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efe400cdfd0 0x7efe400ce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:56.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.979+0000 7efe46937700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe40159cd0 0x7efe4015a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:56.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.979+0000 7efe46937700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe400b28d0 con 0x7efe40070fe0 2023-05-24T03:31:56.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.979+0000 7efe46937700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe4015ad80 con 0x7efe400cdfd0 2023-05-24T03:31:56.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.979+0000 7efe46937700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe4015a7c0 con 0x7efe40159cd0 2023-05-24T03:31:56.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.979+0000 7efe3ffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efe400cdfd0 0x7efe400ce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:56.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.979+0000 7efe3f7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7efe40070fe0 0x7efe400b21c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46784/0 (socket says 172.21.15.146:46784) 2023-05-24T03:31:56.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.979+0000 7efe3f7fe700 1 -- 172.21.15.146:0/2503637807 learned_addr learned my addr 172.21.15.146:0/2503637807 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:31:56.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.979+0000 7efe44ed4700 1 --2- 172.21.15.146:0/2503637807 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe40159cd0 0x7efe4015a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:56.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.979+0000 7efe3ffff700 1 -- 172.21.15.146:0/2503637807 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe40159cd0 msgr2=0x7efe4015a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:31:56.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.979+0000 7efe3ffff700 1 --2- 172.21.15.146:0/2503637807 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe40159cd0 0x7efe4015a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:56.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.979+0000 7efe3ffff700 1 -- 172.21.15.146:0/2503637807 >> v1:172.21.15.146:6789/0 conn(0x7efe40070fe0 legacy=0x7efe400b21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:56.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.979+0000 7efe3ffff700 1 -- 172.21.15.146:0/2503637807 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe4015aaa0 con 0x7efe400cdfd0 2023-05-24T03:31:56.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.979+0000 7efe3effd700 1 -- 172.21.15.146:0/2503637807 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3216089739 0 0) 0x7efe400b28d0 con 0x7efe40070fe0 2023-05-24T03:31:56.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.979+0000 7efe3ffff700 1 --2- 172.21.15.146:0/2503637807 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe400cdfd0 0x7efe400ce3a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7efe3000bae0 tx=0x7efe3000bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d67185ea145b637 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:56.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.979+0000 7efe3effd700 1 -- 172.21.15.146:0/2503637807 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3000dd30 con 0x7efe400cdfd0 2023-05-24T03:31:56.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.979+0000 7efe3effd700 1 -- 172.21.15.146:0/2503637807 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe3000de90 con 0x7efe400cdfd0 2023-05-24T03:31:56.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.979+0000 7efe3effd700 1 -- 172.21.15.146:0/2503637807 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe30010690 con 0x7efe400cdfd0 2023-05-24T03:31:56.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.980+0000 7efe46937700 1 -- 172.21.15.146:0/2503637807 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe400cdfd0 msgr2=0x7efe400ce3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:56.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.980+0000 7efe46937700 1 --2- 172.21.15.146:0/2503637807 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe400cdfd0 0x7efe400ce3a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7efe3000bae0 tx=0x7efe3000bdf0 comp rx=0 tx=0).stop 2023-05-24T03:31:56.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.980+0000 7efe46937700 1 -- 172.21.15.146:0/2503637807 shutdown_connections 2023-05-24T03:31:56.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.980+0000 7efe46937700 1 --2- 172.21.15.146:0/2503637807 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe40159cd0 0x7efe4015a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:56.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.980+0000 7efe46937700 1 --2- 172.21.15.146:0/2503637807 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe400cdfd0 0x7efe400ce3a0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:56.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.980+0000 7efe46937700 1 -- 172.21.15.146:0/2503637807 >> 172.21.15.146:0/2503637807 conn(0x7efe400cfea0 msgr2=0x7efe400d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:31:56.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.980+0000 7efe46937700 1 -- 172.21.15.146:0/2503637807 shutdown_connections 2023-05-24T03:31:56.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.980+0000 7efe46937700 1 -- 172.21.15.146:0/2503637807 wait complete. 2023-05-24T03:31:56.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.981+0000 7efe46937700 1 Processor -- start 2023-05-24T03:31:56.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.981+0000 7efe46937700 1 -- start start 2023-05-24T03:31:56.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.982+0000 7efe46937700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe40070fe0 0x7efe4015d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:56.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.982+0000 7efe46937700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe400cdfd0 0x7efe40153720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:56.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.982+0000 7efe46937700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe40159cd0 0x7efe4015b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:56.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.982+0000 7efe46937700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe4015dd40 con 0x7efe400cdfd0 2023-05-24T03:31:56.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.982+0000 7efe46937700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe401f3120 con 0x7efe40159cd0 2023-05-24T03:31:56.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.982+0000 7efe46937700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe401f25a0 con 0x7efe40070fe0 2023-05-24T03:31:56.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.982+0000 7efe3f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe400cdfd0 0x7efe40153720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:56.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.982+0000 7efe3f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe400cdfd0 0x7efe40153720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40336/0 (socket says 172.21.15.146:40336) 2023-05-24T03:31:56.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.982+0000 7efe3f7fe700 1 -- 172.21.15.146:0/562314724 learned_addr learned my addr 172.21.15.146:0/562314724 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:31:56.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.982+0000 7efe3f7fe700 1 -- 172.21.15.146:0/562314724 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe40070fe0 msgr2=0x7efe4015d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:56.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.982+0000 7efe3f7fe700 1 --2- 172.21.15.146:0/562314724 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe40070fe0 0x7efe4015d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:56.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.982+0000 7efe3f7fe700 1 -- 172.21.15.146:0/562314724 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe40159cd0 msgr2=0x7efe4015b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:56.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.982+0000 7efe3f7fe700 1 --2- 172.21.15.146:0/562314724 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe40159cd0 0x7efe4015b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:56.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.982+0000 7efe3f7fe700 1 -- 172.21.15.146:0/562314724 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe3000b740 con 0x7efe400cdfd0 2023-05-24T03:31:56.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.982+0000 7efe3f7fe700 1 --2- 172.21.15.146:0/562314724 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe400cdfd0 0x7efe40153720 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7efe3400c580 tx=0x7efe3400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:56.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.983+0000 7efe3cff9700 1 -- 172.21.15.146:0/562314724 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe34004c80 con 0x7efe400cdfd0 2023-05-24T03:31:57.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.983+0000 7efe3cff9700 1 -- 172.21.15.146:0/562314724 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe34004e00 con 0x7efe400cdfd0 2023-05-24T03:31:57.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.983+0000 7efe46937700 1 -- 172.21.15.146:0/562314724 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe400b1ca0 con 0x7efe400cdfd0 2023-05-24T03:31:57.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.983+0000 7efe3cff9700 1 -- 172.21.15.146:0/562314724 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe34007310 con 0x7efe400cdfd0 2023-05-24T03:31:57.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.983+0000 7efe46937700 1 -- 172.21.15.146:0/562314724 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe400b19c0 con 0x7efe400cdfd0 2023-05-24T03:31:57.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.984+0000 7efe46937700 1 -- 172.21.15.146:0/562314724 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe400ce8e0 con 0x7efe400cdfd0 2023-05-24T03:31:57.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.984+0000 7efe3cff9700 1 -- 172.21.15.146:0/562314724 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efe34007470 con 0x7efe400cdfd0 2023-05-24T03:31:57.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.985+0000 7efe3cff9700 1 --2- 172.21.15.146:0/562314724 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7efe2c06ace0 0x7efe2c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:57.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.985+0000 7efe3cff9700 1 -- 172.21.15.146:0/562314724 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7efe34089490 con 0x7efe400cdfd0 2023-05-24T03:31:57.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.985+0000 7efe3ffff700 1 --2- 172.21.15.146:0/562314724 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7efe2c06ace0 0x7efe2c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:57.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.985+0000 7efe3ffff700 1 --2- 172.21.15.146:0/562314724 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7efe2c06ace0 0x7efe2c06d190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7efe400cc820 tx=0x7efe30012000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:57.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:56.989+0000 7efe3cff9700 1 -- 172.21.15.146:0/562314724 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7efe34054210 con 0x7efe400cdfd0 2023-05-24T03:31:57.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.182+0000 7efe46937700 1 -- 172.21.15.146:0/562314724 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7efe400cb530 con 0x7efe400cdfd0 2023-05-24T03:31:57.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.182+0000 7efe3cff9700 1 -- 172.21.15.146:0/562314724 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7efe400cb530 con 0x7efe400cdfd0 2023-05-24T03:31:57.188 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2023-05-24T03:31:57.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.184+0000 7efe46937700 1 -- 172.21.15.146:0/562314724 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7efe2c06ace0 msgr2=0x7efe2c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:57.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.184+0000 7efe46937700 1 --2- 172.21.15.146:0/562314724 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7efe2c06ace0 0x7efe2c06d190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7efe400cc820 tx=0x7efe30012000 comp rx=0 tx=0).stop 2023-05-24T03:31:57.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.184+0000 7efe46937700 1 -- 172.21.15.146:0/562314724 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe400cdfd0 msgr2=0x7efe40153720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:57.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.184+0000 7efe46937700 1 --2- 172.21.15.146:0/562314724 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe400cdfd0 0x7efe40153720 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7efe3400c580 tx=0x7efe3400c940 comp rx=0 tx=0).stop 2023-05-24T03:31:57.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.184+0000 7efe46937700 1 -- 172.21.15.146:0/562314724 shutdown_connections 2023-05-24T03:31:57.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.184+0000 7efe46937700 1 --2- 172.21.15.146:0/562314724 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7efe2c06ace0 0x7efe2c06d190 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:57.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.185+0000 7efe46937700 1 --2- 172.21.15.146:0/562314724 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe40159cd0 0x7efe4015b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:57.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.185+0000 7efe46937700 1 --2- 172.21.15.146:0/562314724 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe40070fe0 0x7efe4015d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:57.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.185+0000 7efe46937700 1 --2- 172.21.15.146:0/562314724 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe400cdfd0 0x7efe40153720 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:57.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.185+0000 7efe46937700 1 -- 172.21.15.146:0/562314724 >> 172.21.15.146:0/562314724 conn(0x7efe400cfea0 msgr2=0x7efe40071430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:31:57.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.185+0000 7efe46937700 1 -- 172.21.15.146:0/562314724 shutdown_connections 2023-05-24T03:31:57.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.185+0000 7efe46937700 1 -- 172.21.15.146:0/562314724 wait complete. 2023-05-24T03:31:57.202 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-24T03:31:57.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.320+0000 7f09a7470700 1 Processor -- start 2023-05-24T03:31:57.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.321+0000 7f09a7470700 1 -- start start 2023-05-24T03:31:57.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.321+0000 7f09a7470700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f09a00cdf10 0x7f09a0159c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:57.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.321+0000 7f09a7470700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f09a015dcf0 0x7f09a00ce2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:57.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.321+0000 7f09a7470700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09a0070f50 0x7f09a006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:57.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.321+0000 7f09a7470700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09a015a1c0 con 0x7f09a015dcf0 2023-05-24T03:31:57.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.321+0000 7f09a7470700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09a00ce820 con 0x7f09a00cdf10 2023-05-24T03:31:57.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.321+0000 7f09a7470700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a015a3c0 con 0x7f09a0070f50 2023-05-24T03:31:57.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.321+0000 7f09a4a0b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f09a015dcf0 0x7f09a00ce2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:57.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.321+0000 7f09a4a0b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f09a015dcf0 0x7f09a00ce2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40346/0 (socket says 172.21.15.146:40346) 2023-05-24T03:31:57.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.321+0000 7f09a4a0b700 1 -- 172.21.15.146:0/3275028129 learned_addr learned my addr 172.21.15.146:0/3275028129 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:31:57.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.322+0000 7f09a5a0d700 1 --2- 172.21.15.146:0/3275028129 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09a0070f50 0x7f09a006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:57.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.322+0000 7f09a520c700 1 --2- 172.21.15.146:0/3275028129 >> v2:172.21.15.151:3300/0 conn(0x7f09a00cdf10 0x7f09a0159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:57.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.322+0000 7f09a4a0b700 1 -- 172.21.15.146:0/3275028129 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09a0070f50 msgr2=0x7f09a006d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:31:57.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.322+0000 7f09a4a0b700 1 --2- 172.21.15.146:0/3275028129 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09a0070f50 0x7f09a006d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:57.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.322+0000 7f09a4a0b700 1 -- 172.21.15.146:0/3275028129 >> v2:172.21.15.151:3300/0 conn(0x7f09a00cdf10 msgr2=0x7f09a0159c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:31:57.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.322+0000 7f09a4a0b700 1 --2- 172.21.15.146:0/3275028129 >> v2:172.21.15.151:3300/0 conn(0x7f09a00cdf10 0x7f09a0159c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:57.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.322+0000 7f09a4a0b700 1 -- 172.21.15.146:0/3275028129 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a015a6a0 con 0x7f09a015dcf0 2023-05-24T03:31:57.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.322+0000 7f09a4a0b700 1 --2- 172.21.15.146:0/3275028129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09a015dcf0 0x7f09a00ce2e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f09a0067440 tx=0x7f099c00be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dddd4c145fe9ef7e server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:57.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.322+0000 7f0997fff700 1 -- 172.21.15.146:0/3275028129 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099c00dd30 con 0x7f09a015dcf0 2023-05-24T03:31:57.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.322+0000 7f0997fff700 1 -- 172.21.15.146:0/3275028129 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f099c00de90 con 0x7f09a015dcf0 2023-05-24T03:31:57.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.322+0000 7f0997fff700 1 -- 172.21.15.146:0/3275028129 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099c010690 con 0x7f09a015dcf0 2023-05-24T03:31:57.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.323+0000 7f09a7470700 1 -- 172.21.15.146:0/3275028129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09a015dcf0 msgr2=0x7f09a00ce2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:57.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.323+0000 7f09a7470700 1 --2- 172.21.15.146:0/3275028129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09a015dcf0 0x7f09a00ce2e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f09a0067440 tx=0x7f099c00be70 comp rx=0 tx=0).stop 2023-05-24T03:31:57.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.323+0000 7f09a7470700 1 -- 172.21.15.146:0/3275028129 shutdown_connections 2023-05-24T03:31:57.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.323+0000 7f09a7470700 1 --2- 172.21.15.146:0/3275028129 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09a0070f50 0x7f09a006d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:57.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.323+0000 7f09a7470700 1 --2- 172.21.15.146:0/3275028129 >> v2:172.21.15.151:3300/0 conn(0x7f09a00cdf10 0x7f09a0159c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:57.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.323+0000 7f09a7470700 1 --2- 172.21.15.146:0/3275028129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09a015dcf0 0x7f09a00ce2e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:57.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.323+0000 7f09a7470700 1 -- 172.21.15.146:0/3275028129 >> 172.21.15.146:0/3275028129 conn(0x7f09a00cfea0 msgr2=0x7f09a00d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:31:57.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.323+0000 7f09a7470700 1 -- 172.21.15.146:0/3275028129 shutdown_connections 2023-05-24T03:31:57.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.323+0000 7f09a7470700 1 -- 172.21.15.146:0/3275028129 wait complete. 2023-05-24T03:31:57.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.324+0000 7f09a7470700 1 Processor -- start 2023-05-24T03:31:57.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.324+0000 7f09a7470700 1 -- start start 2023-05-24T03:31:57.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.325+0000 7f09a7470700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09a0070f50 0x7f09a00b0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:57.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.325+0000 7f09a7470700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09a00cdf10 0x7f09a01564a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:57.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.325+0000 7f09a7470700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09a015dcf0 0x7f09a00b1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:57.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.325+0000 7f09a7470700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a00af900 con 0x7f09a0070f50 2023-05-24T03:31:57.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.325+0000 7f09a7470700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a00b07d0 con 0x7f09a015dcf0 2023-05-24T03:31:57.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.325+0000 7f09a7470700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a00afb50 con 0x7f09a00cdf10 2023-05-24T03:31:57.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.325+0000 7f09a520c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09a0070f50 0x7f09a00b0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:57.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.325+0000 7f09a520c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09a0070f50 0x7f09a00b0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40350/0 (socket says 172.21.15.146:40350) 2023-05-24T03:31:57.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.325+0000 7f09a520c700 1 -- 172.21.15.146:0/1215474176 learned_addr learned my addr 172.21.15.146:0/1215474176 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:31:57.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.325+0000 7f09a4a0b700 1 --2- 172.21.15.146:0/1215474176 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09a00cdf10 0x7f09a01564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:57.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.325+0000 7f09a5a0d700 1 --2- 172.21.15.146:0/1215474176 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09a015dcf0 0x7f09a00b1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:57.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.325+0000 7f09a520c700 1 -- 172.21.15.146:0/1215474176 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09a00cdf10 msgr2=0x7f09a01564a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:57.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.325+0000 7f09a520c700 1 --2- 172.21.15.146:0/1215474176 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09a00cdf10 0x7f09a01564a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:57.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.325+0000 7f09a520c700 1 -- 172.21.15.146:0/1215474176 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09a015dcf0 msgr2=0x7f09a00b1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:57.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.325+0000 7f09a520c700 1 --2- 172.21.15.146:0/1215474176 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09a015dcf0 0x7f09a00b1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:57.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.325+0000 7f09a520c700 1 -- 172.21.15.146:0/1215474176 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f099c00b7f0 con 0x7f09a0070f50 2023-05-24T03:31:57.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.325+0000 7f09a520c700 1 --2- 172.21.15.146:0/1215474176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09a0070f50 0x7f09a00b0290 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f099000d830 tx=0x7f099000dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:57.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.325+0000 7f0995ffb700 1 -- 172.21.15.146:0/1215474176 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09900125f0 con 0x7f09a0070f50 2023-05-24T03:31:57.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.325+0000 7f0995ffb700 1 -- 172.21.15.146:0/1215474176 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0990012750 con 0x7f09a0070f50 2023-05-24T03:31:57.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.325+0000 7f0995ffb700 1 -- 172.21.15.146:0/1215474176 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0990012b00 con 0x7f09a0070f50 2023-05-24T03:31:57.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.325+0000 7f09a7470700 1 -- 172.21.15.146:0/1215474176 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09a015ac60 con 0x7f09a0070f50 2023-05-24T03:31:57.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.326+0000 7f09a7470700 1 -- 172.21.15.146:0/1215474176 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09a015a980 con 0x7f09a0070f50 2023-05-24T03:31:57.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.326+0000 7f09a7470700 1 -- 172.21.15.146:0/1215474176 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09a006d190 con 0x7f09a0070f50 2023-05-24T03:31:57.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.327+0000 7f0995ffb700 1 -- 172.21.15.146:0/1215474176 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0990012c60 con 0x7f09a0070f50 2023-05-24T03:31:57.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.327+0000 7f0995ffb700 1 --2- 172.21.15.146:0/1215474176 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f098406ace0 0x7f098406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:57.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.327+0000 7f09a4a0b700 1 --2- 172.21.15.146:0/1215474176 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f098406ace0 0x7f098406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:57.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.327+0000 7f0995ffb700 1 -- 172.21.15.146:0/1215474176 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0990089b30 con 0x7f09a0070f50 2023-05-24T03:31:57.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.328+0000 7f09a4a0b700 1 --2- 172.21.15.146:0/1215474176 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f098406ace0 0x7f098406d190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f099c00beb0 tx=0x7f099c012000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:57.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.332+0000 7f0995ffb700 1 -- 172.21.15.146:0/1215474176 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f0990054940 con 0x7f09a0070f50 2023-05-24T03:31:57.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.538+0000 7f09a7470700 1 -- 172.21.15.146:0/1215474176 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f09a01ef940 con 0x7f09a0070f50 2023-05-24T03:31:57.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.538+0000 7f0995ffb700 1 -- 172.21.15.146:0/1215474176 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v30) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0990057f60 con 0x7f09a0070f50 2023-05-24T03:31:57.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.540+0000 7f09a7470700 1 -- 172.21.15.146:0/1215474176 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f098406ace0 msgr2=0x7f098406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:57.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.540+0000 7f09a7470700 1 --2- 172.21.15.146:0/1215474176 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f098406ace0 0x7f098406d190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f099c00beb0 tx=0x7f099c012000 comp rx=0 tx=0).stop 2023-05-24T03:31:57.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.540+0000 7f09a7470700 1 -- 172.21.15.146:0/1215474176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09a0070f50 msgr2=0x7f09a00b0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:57.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.540+0000 7f09a7470700 1 --2- 172.21.15.146:0/1215474176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09a0070f50 0x7f09a00b0290 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f099000d830 tx=0x7f099000dbf0 comp rx=0 tx=0).stop 2023-05-24T03:31:57.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.540+0000 7f09a7470700 1 -- 172.21.15.146:0/1215474176 shutdown_connections 2023-05-24T03:31:57.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.540+0000 7f09a7470700 1 --2- 172.21.15.146:0/1215474176 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f098406ace0 0x7f098406d190 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:57.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.540+0000 7f09a7470700 1 --2- 172.21.15.146:0/1215474176 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09a015dcf0 0x7f09a00b1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:57.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.540+0000 7f09a7470700 1 --2- 172.21.15.146:0/1215474176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09a0070f50 0x7f09a00b0290 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:57.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.540+0000 7f09a7470700 1 --2- 172.21.15.146:0/1215474176 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09a00cdf10 0x7f09a01564a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:57.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.540+0000 7f09a7470700 1 -- 172.21.15.146:0/1215474176 >> 172.21.15.146:0/1215474176 conn(0x7f09a00cfea0 msgr2=0x7f09a00d0270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:31:57.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.540+0000 7f09a7470700 1 -- 172.21.15.146:0/1215474176 shutdown_connections 2023-05-24T03:31:57.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:57.540+0000 7f09a7470700 1 -- 172.21.15.146:0/1215474176 wait complete. 2023-05-24T03:31:57.548 INFO:teuthology.orchestra.run.smithi146.stderr:listed 0 entries 2023-05-24T03:31:57.557 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-05-24T03:31:57.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:31:57.558 DEBUG:teuthology.orchestra.run.smithi151:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-05-24T03:31:57.875 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-05-24T03:31:57.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:31:57.876 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-05-24T03:31:57.922 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-24T03:31:57.923 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-24T03:31:57.981 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-24T03:31:57.981 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-24T03:31:58.037 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-24T03:31:58.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.155+0000 7f4bb1989700 1 Processor -- start 2023-05-24T03:31:58.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.155+0000 7f4bb1989700 1 -- start start 2023-05-24T03:31:58.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.156+0000 7f4bb1989700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4bac0cc1d0 0x7f4bac0b1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:58.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.156+0000 7f4bb1989700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4bac0cbc90 0x7f4bac06a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:58.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.156+0000 7f4bb1989700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bac0b27e0 con 0x7f4bac0cb8c0 2023-05-24T03:31:58.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.156+0000 7f4bb1989700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bac0b2220 con 0x7f4bac0cc1d0 2023-05-24T03:31:58.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.156+0000 7f4bb1989700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bac0b2500 con 0x7f4bac0cbc90 2023-05-24T03:31:58.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.156+0000 7f4baa7fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4bac0cc1d0 0x7f4bac0b1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:58.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.156+0000 7f4baaffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f4bac0cb8c0 0x7f4bac161030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46810/0 (socket says 172.21.15.146:46810) 2023-05-24T03:31:58.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.156+0000 7f4baaffd700 1 -- 172.21.15.146:0/2801732944 learned_addr learned my addr 172.21.15.146:0/2801732944 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:31:58.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.156+0000 7f4bab7fe700 1 --2- 172.21.15.146:0/2801732944 >> v2:172.21.15.151:3300/0 conn(0x7f4bac0cbc90 0x7f4bac06a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:58.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.156+0000 7f4baa7fc700 1 -- 172.21.15.146:0/2801732944 >> v2:172.21.15.151:3300/0 conn(0x7f4bac0cbc90 msgr2=0x7f4bac06a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:31:58.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.156+0000 7f4baa7fc700 1 --2- 172.21.15.146:0/2801732944 >> v2:172.21.15.151:3300/0 conn(0x7f4bac0cbc90 0x7f4bac06a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:58.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.156+0000 7f4baa7fc700 1 -- 172.21.15.146:0/2801732944 >> v1:172.21.15.146:6789/0 conn(0x7f4bac0cb8c0 legacy=0x7f4bac161030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:58.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.157+0000 7f4baa7fc700 1 -- 172.21.15.146:0/2801732944 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bac160830 con 0x7f4bac0cc1d0 2023-05-24T03:31:58.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.157+0000 7f4baa7fc700 1 --2- 172.21.15.146:0/2801732944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bac0cc1d0 0x7f4bac0b1920 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4bac06b540 tx=0x7f4b9c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26cd372aba8d5ce2 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:58.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.157+0000 7f4ba9ffb700 1 -- 172.21.15.146:0/2801732944 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c011830 con 0x7f4bac0cc1d0 2023-05-24T03:31:58.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.157+0000 7f4ba9ffb700 1 -- 172.21.15.146:0/2801732944 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b9c011990 con 0x7f4bac0cc1d0 2023-05-24T03:31:58.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.157+0000 7f4ba9ffb700 1 -- 172.21.15.146:0/2801732944 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c011d20 con 0x7f4bac0cc1d0 2023-05-24T03:31:58.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.157+0000 7f4bb1989700 1 -- 172.21.15.146:0/2801732944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bac0cc1d0 msgr2=0x7f4bac0b1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:58.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.157+0000 7f4bb1989700 1 --2- 172.21.15.146:0/2801732944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bac0cc1d0 0x7f4bac0b1920 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4bac06b540 tx=0x7f4b9c009b20 comp rx=0 tx=0).stop 2023-05-24T03:31:58.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.157+0000 7f4bb1989700 1 -- 172.21.15.146:0/2801732944 shutdown_connections 2023-05-24T03:31:58.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.157+0000 7f4bb1989700 1 --2- 172.21.15.146:0/2801732944 >> v2:172.21.15.151:3300/0 conn(0x7f4bac0cbc90 0x7f4bac06a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:58.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.157+0000 7f4bb1989700 1 --2- 172.21.15.146:0/2801732944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bac0cc1d0 0x7f4bac0b1920 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:58.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.157+0000 7f4bb1989700 1 -- 172.21.15.146:0/2801732944 >> 172.21.15.146:0/2801732944 conn(0x7f4bac0cfea0 msgr2=0x7f4bac0d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:31:58.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.158+0000 7f4bb1989700 1 -- 172.21.15.146:0/2801732944 shutdown_connections 2023-05-24T03:31:58.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.158+0000 7f4bb1989700 1 -- 172.21.15.146:0/2801732944 wait complete. 2023-05-24T03:31:58.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.159+0000 7f4bb1989700 1 Processor -- start 2023-05-24T03:31:58.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.159+0000 7f4bb1989700 1 -- start start 2023-05-24T03:31:58.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.160+0000 7f4bb1989700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bac0cb8c0 0x7f4bac0ca960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:58.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.160+0000 7f4bb1989700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4bac0cbc90 0x7f4bac0cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:58.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.160+0000 7f4bb1989700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4bac0cc1d0 0x7f4bac157ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:58.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.160+0000 7f4bb1989700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac0c8900 con 0x7f4bac0cb8c0 2023-05-24T03:31:58.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.160+0000 7f4bb1989700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac0cf910 con 0x7f4bac0cc1d0 2023-05-24T03:31:58.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.160+0000 7f4bb1989700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac0c8b50 con 0x7f4bac0cbc90 2023-05-24T03:31:58.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.160+0000 7f4baaffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bac0cb8c0 0x7f4bac0ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:58.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.160+0000 7f4baaffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bac0cb8c0 0x7f4bac0ca960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40364/0 (socket says 172.21.15.146:40364) 2023-05-24T03:31:58.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.160+0000 7f4baaffd700 1 -- 172.21.15.146:0/3792185185 learned_addr learned my addr 172.21.15.146:0/3792185185 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:31:58.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.160+0000 7f4baa7fc700 1 --2- 172.21.15.146:0/3792185185 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4bac0cbc90 0x7f4bac0cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:58.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.160+0000 7f4bab7fe700 1 --2- 172.21.15.146:0/3792185185 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4bac0cc1d0 0x7f4bac157ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:58.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.160+0000 7f4baaffd700 1 -- 172.21.15.146:0/3792185185 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4bac0cbc90 msgr2=0x7f4bac0cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:58.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.160+0000 7f4baaffd700 1 --2- 172.21.15.146:0/3792185185 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4bac0cbc90 0x7f4bac0cf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:58.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.160+0000 7f4baaffd700 1 -- 172.21.15.146:0/3792185185 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4bac0cc1d0 msgr2=0x7f4bac157ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:58.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.160+0000 7f4baaffd700 1 --2- 172.21.15.146:0/3792185185 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4bac0cc1d0 0x7f4bac157ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:58.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.160+0000 7f4baaffd700 1 -- 172.21.15.146:0/3792185185 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b9c0094a0 con 0x7f4bac0cb8c0 2023-05-24T03:31:58.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.160+0000 7f4baaffd700 1 --2- 172.21.15.146:0/3792185185 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bac0cb8c0 0x7f4bac0ca960 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4ba000c490 tx=0x7f4ba000c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:58.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.160+0000 7f4b93fff700 1 -- 172.21.15.146:0/3792185185 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba000cea0 con 0x7f4bac0cb8c0 2023-05-24T03:31:58.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.160+0000 7f4b93fff700 1 -- 172.21.15.146:0/3792185185 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba0005d70 con 0x7f4bac0cb8c0 2023-05-24T03:31:58.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.160+0000 7f4bb1989700 1 -- 172.21.15.146:0/3792185185 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bac0b1e60 con 0x7f4bac0cb8c0 2023-05-24T03:31:58.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.160+0000 7f4b93fff700 1 -- 172.21.15.146:0/3792185185 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba00072f0 con 0x7f4bac0cb8c0 2023-05-24T03:31:58.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.160+0000 7f4bb1989700 1 -- 172.21.15.146:0/3792185185 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bac160b10 con 0x7f4bac0cb8c0 2023-05-24T03:31:58.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.161+0000 7f4bb1989700 1 -- 172.21.15.146:0/3792185185 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bac0b1ff0 con 0x7f4bac0cb8c0 2023-05-24T03:31:58.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.162+0000 7f4b93fff700 1 -- 172.21.15.146:0/3792185185 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4ba0007450 con 0x7f4bac0cb8c0 2023-05-24T03:31:58.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.162+0000 7f4b93fff700 1 --2- 172.21.15.146:0/3792185185 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f4b9806ace0 0x7f4b9806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:58.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.162+0000 7f4b93fff700 1 -- 172.21.15.146:0/3792185185 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4ba0088bc0 con 0x7f4bac0cb8c0 2023-05-24T03:31:58.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.162+0000 7f4baa7fc700 1 --2- 172.21.15.146:0/3792185185 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f4b9806ace0 0x7f4b9806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:58.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.162+0000 7f4baa7fc700 1 --2- 172.21.15.146:0/3792185185 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f4b9806ace0 0x7f4b9806d190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4bac0cc610 tx=0x7f4b9c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:58.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.166+0000 7f4b93fff700 1 -- 172.21.15.146:0/3792185185 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f4ba00538c0 con 0x7f4bac0cb8c0 2023-05-24T03:31:58.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.358+0000 7f4bb1989700 1 -- 172.21.15.146:0/3792185185 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4bac04e810 con 0x7f4bac0cb8c0 2023-05-24T03:31:58.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.360+0000 7f4b93fff700 1 -- 172.21.15.146:0/3792185185 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20251 (secure 0 0 0) 0x7f4ba0056ee0 con 0x7f4bac0cb8c0 2023-05-24T03:31:58.365 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:31:58.365 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":30,"fsid":"11ca0adb-7672-4713-bde7-451e8b743ae9","created":"2023-05-24T03:29:19.113659+0000","modified":"2023-05-24T03:30:25.932188+0000","last_up_change":"2023-05-24T03:29:30.962339+0000","last_in_change":"2023-05-24T03:29:21.706540+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-24T03:29:32.749984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-24T03:29:37.719623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-24T03:29:42.165379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-24T03:29:43.431615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-24T03:29:46.503075+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f24b319b-fcc8-4385-b0cb-78138fc31417","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6801","nonce":3353593100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6803","nonce":3353593100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6807","nonce":3353593100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6805","nonce":3353593100}]},"public_addr":"172.21.15.146:6801/3353593100","cluster_addr":"172.21.15.146:6803/3353593100","heartbeat_back_addr":"172.21.15.146:6807/3353593100","heartbeat_front_addr":"172.21.15.146:6805/3353593100","state":["exists","up"]},{"osd":1,"uuid":"c9639ea9-8f9b-498e-92c8-aa976edbf1da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6821","nonce":2537488734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6825","nonce":2537488734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6831","nonce":2537488734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6827","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6829","nonce":2537488734}]},"public_addr":"172.21.15.146:6821/2537488734","cluster_addr":"172.21.15.146:6825/2537488734","heartbeat_back_addr":"172.21.15.146:6831/2537488734","heartbeat_front_addr":"172.21.15.146:6829/2537488734","state":["exists","up"]},{"osd":2,"uuid":"7a6cfc6d-b0ca-4cb6-a66d-4001ec184657","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6809","nonce":1800242932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6811","nonce":1800242932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6815","nonce":1800242932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6813","nonce":1800242932}]},"public_addr":"172.21.15.146:6809/1800242932","cluster_addr":"172.21.15.146:6811/1800242932","heartbeat_back_addr":"172.21.15.146:6815/1800242932","heartbeat_front_addr":"172.21.15.146:6813/1800242932","state":["exists","up"]},{"osd":3,"uuid":"401509f7-cecd-44a2-b0ae-22c81a5d93c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6817","nonce":1749783580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6820","nonce":1749783580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6828","nonce":1749783580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6824","nonce":1749783580}]},"public_addr":"172.21.15.146:6817/1749783580","cluster_addr":"172.21.15.146:6820/1749783580","heartbeat_back_addr":"172.21.15.146:6828/1749783580","heartbeat_front_addr":"172.21.15.146:6824/1749783580","state":["exists","up"]},{"osd":4,"uuid":"9d07f440-d125-4f99-a825-411fab894d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6811","nonce":163453435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6814","nonce":163453435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6819","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6821","nonce":163453435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6818","nonce":163453435}]},"public_addr":"172.21.15.151:6811/163453435","cluster_addr":"172.21.15.151:6814/163453435","heartbeat_back_addr":"172.21.15.151:6821/163453435","heartbeat_front_addr":"172.21.15.151:6818/163453435","state":["exists","up"]},{"osd":5,"uuid":"9b2266e2-9e52-4f0e-96da-e703a6c23a6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6801","nonce":3283474903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6803","nonce":3283474903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6807","nonce":3283474903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6805","nonce":3283474903}]},"public_addr":"172.21.15.151:6801/3283474903","cluster_addr":"172.21.15.151:6803/3283474903","heartbeat_back_addr":"172.21.15.151:6807/3283474903","heartbeat_front_addr":"172.21.15.151:6805/3283474903","state":["exists","up"]},{"osd":6,"uuid":"5daedf77-0a83-49e7-b497-d9ed10436972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6825","nonce":3889424178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6827","nonce":3889424178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6831","nonce":3889424178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6829","nonce":3889424178}]},"public_addr":"172.21.15.151:6825/3889424178","cluster_addr":"172.21.15.151:6827/3889424178","heartbeat_back_addr":"172.21.15.151:6831/3889424178","heartbeat_front_addr":"172.21.15.151:6829/3889424178","state":["exists","up"]},{"osd":7,"uuid":"86ae4f7e-c01f-4c3d-a0dd-98160c209309","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6810","nonce":563291208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6815","nonce":563291208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6823","nonce":563291208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6820","nonce":563291208}]},"public_addr":"172.21.15.151:6810/563291208","cluster_addr":"172.21.15.151:6815/563291208","heartbeat_back_addr":"172.21.15.151:6823/563291208","heartbeat_front_addr":"172.21.15.151:6820/563291208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.872472+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.937126+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.877234+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.884793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.881632+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.938293+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.857661+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.945883+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.9","mappings":[{"from":1,"to":5}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-24T03:31:58.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.362+0000 7f4bb1989700 1 -- 172.21.15.146:0/3792185185 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f4b9806ace0 msgr2=0x7f4b9806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:58.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.362+0000 7f4bb1989700 1 --2- 172.21.15.146:0/3792185185 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f4b9806ace0 0x7f4b9806d190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4bac0cc610 tx=0x7f4b9c008030 comp rx=0 tx=0).stop 2023-05-24T03:31:58.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.362+0000 7f4bb1989700 1 -- 172.21.15.146:0/3792185185 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bac0cb8c0 msgr2=0x7f4bac0ca960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:58.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.362+0000 7f4bb1989700 1 --2- 172.21.15.146:0/3792185185 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bac0cb8c0 0x7f4bac0ca960 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4ba000c490 tx=0x7f4ba000c7a0 comp rx=0 tx=0).stop 2023-05-24T03:31:58.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.362+0000 7f4bb1989700 1 -- 172.21.15.146:0/3792185185 shutdown_connections 2023-05-24T03:31:58.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.362+0000 7f4bb1989700 1 --2- 172.21.15.146:0/3792185185 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f4b9806ace0 0x7f4b9806d190 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:58.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.362+0000 7f4bb1989700 1 --2- 172.21.15.146:0/3792185185 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4bac0cc1d0 0x7f4bac157ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:58.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.362+0000 7f4bb1989700 1 --2- 172.21.15.146:0/3792185185 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bac0cb8c0 0x7f4bac0ca960 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:58.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.362+0000 7f4bb1989700 1 --2- 172.21.15.146:0/3792185185 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4bac0cbc90 0x7f4bac0cf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:58.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.362+0000 7f4bb1989700 1 -- 172.21.15.146:0/3792185185 >> 172.21.15.146:0/3792185185 conn(0x7f4bac0cfea0 msgr2=0x7f4bac15c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:31:58.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.362+0000 7f4bb1989700 1 -- 172.21.15.146:0/3792185185 shutdown_connections 2023-05-24T03:31:58.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.362+0000 7f4bb1989700 1 -- 172.21.15.146:0/3792185185 wait complete. 2023-05-24T03:31:58.380 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-24T03:29:32.749984+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-24T03:29:37.719623+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-24T03:29:42.165379+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-24T03:29:43.431615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-24T03:29:46.503075+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-24T03:31:58.381 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-24T03:31:58.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.500+0000 7f72a2a1f700 1 Processor -- start 2023-05-24T03:31:58.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.500+0000 7f72a2a1f700 1 -- start start 2023-05-24T03:31:58.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.501+0000 7f72a2a1f700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f729c0d0110 0x7f729c0ce110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:58.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.501+0000 7f72a2a1f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f729c0cd950 con 0x7f729c15af00 2023-05-24T03:31:58.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.501+0000 7f72a2a1f700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f729c0b36b0 con 0x7f729c0b2d00 2023-05-24T03:31:58.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.501+0000 7f72a2a1f700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f729c0b3990 con 0x7f729c0d0110 2023-05-24T03:31:58.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.501+0000 7f729bfff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f729c15af00 0x7f729c15e8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46824/0 (socket says 172.21.15.146:46824) 2023-05-24T03:31:58.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.501+0000 7f729bfff700 1 -- 172.21.15.146:0/974211944 learned_addr learned my addr 172.21.15.146:0/974211944 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:31:58.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.502+0000 7f72a0fbc700 1 --2- 172.21.15.146:0/974211944 >> v2:172.21.15.151:3300/0 conn(0x7f729c0d0110 0x7f729c0ce110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:58.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.502+0000 7f729affd700 1 -- 172.21.15.146:0/974211944 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3422188925 0 0) 0x7f729c0cd950 con 0x7f729c15af00 2023-05-24T03:31:58.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.502+0000 7f729affd700 1 -- 172.21.15.146:0/974211944 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72840035b0 con 0x7f729c15af00 2023-05-24T03:31:58.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.502+0000 7f729affd700 1 -- 172.21.15.146:0/974211944 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 788496376 0 0) 0x7f729c0b36b0 con 0x7f729c0b2d00 2023-05-24T03:31:58.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.502+0000 7f729affd700 1 -- 172.21.15.146:0/974211944 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f729c0cd950 con 0x7f729c0b2d00 2023-05-24T03:31:58.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.502+0000 7f72a0fbc700 1 -- 172.21.15.146:0/974211944 >> v1:172.21.15.151:6789/0 conn(0x7f729c0b2d00 legacy=0x7f729c0d0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:58.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.502+0000 7f72a0fbc700 1 -- 172.21.15.146:0/974211944 >> v1:172.21.15.146:6789/0 conn(0x7f729c15af00 legacy=0x7f729c15e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:58.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.502+0000 7f72a0fbc700 1 -- 172.21.15.146:0/974211944 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f729c15f6b0 con 0x7f729c0d0110 2023-05-24T03:31:58.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.502+0000 7f72a0fbc700 1 --2- 172.21.15.146:0/974211944 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f729c0d0110 0x7f729c0ce110 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7294009d90 tx=0x7f729400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a49d0d83f36393c server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:58.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.502+0000 7f729affd700 1 -- 172.21.15.146:0/974211944 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729400e070 con 0x7f729c0d0110 2023-05-24T03:31:58.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.502+0000 7f729affd700 1 -- 172.21.15.146:0/974211944 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f729400bb20 con 0x7f729c0d0110 2023-05-24T03:31:58.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.502+0000 7f729affd700 1 -- 172.21.15.146:0/974211944 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7294012430 con 0x7f729c0d0110 2023-05-24T03:31:58.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.503+0000 7f72a2a1f700 1 -- 172.21.15.146:0/974211944 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f729c0d0110 msgr2=0x7f729c0ce110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:58.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.503+0000 7f72a2a1f700 1 --2- 172.21.15.146:0/974211944 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f729c0d0110 0x7f729c0ce110 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7294009d90 tx=0x7f729400b330 comp rx=0 tx=0).stop 2023-05-24T03:31:58.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.503+0000 7f72a2a1f700 1 -- 172.21.15.146:0/974211944 shutdown_connections 2023-05-24T03:31:58.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.503+0000 7f72a2a1f700 1 --2- 172.21.15.146:0/974211944 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f729c0d0110 0x7f729c0ce110 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:58.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.503+0000 7f72a2a1f700 1 -- 172.21.15.146:0/974211944 >> 172.21.15.146:0/974211944 conn(0x7f729c06e2a0 msgr2=0x7f729c06e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:31:58.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.503+0000 7f72a2a1f700 1 -- 172.21.15.146:0/974211944 shutdown_connections 2023-05-24T03:31:58.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.503+0000 7f72a2a1f700 1 -- 172.21.15.146:0/974211944 wait complete. 2023-05-24T03:31:58.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.504+0000 7f72a2a1f700 1 Processor -- start 2023-05-24T03:31:58.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.504+0000 7f72a2a1f700 1 -- start start 2023-05-24T03:31:58.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.505+0000 7f72a2a1f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f729c0b2d00 0x7f729c0cce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:58.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.505+0000 7f72a2a1f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f729c0d0110 0x7f729c0cd340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:58.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.505+0000 7f72a2a1f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f729c15af00 0x7f729c149000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:58.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.505+0000 7f72a2a1f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f729c149e20 con 0x7f729c15af00 2023-05-24T03:31:58.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.505+0000 7f72a2a1f700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f729c1f0230 con 0x7f729c0d0110 2023-05-24T03:31:58.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.505+0000 7f72a2a1f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f729c1f1200 con 0x7f729c0b2d00 2023-05-24T03:31:58.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.505+0000 7f72a0fbc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f729c15af00 0x7f729c149000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:58.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.505+0000 7f72a0fbc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f729c15af00 0x7f729c149000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40382/0 (socket says 172.21.15.146:40382) 2023-05-24T03:31:58.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.505+0000 7f72a0fbc700 1 -- 172.21.15.146:0/2789018049 learned_addr learned my addr 172.21.15.146:0/2789018049 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:31:58.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.505+0000 7f729bfff700 1 --2- 172.21.15.146:0/2789018049 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f729c0b2d00 0x7f729c0cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:58.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.505+0000 7f729b7fe700 1 --2- 172.21.15.146:0/2789018049 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f729c0d0110 0x7f729c0cd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:58.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.505+0000 7f72a0fbc700 1 -- 172.21.15.146:0/2789018049 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f729c0b2d00 msgr2=0x7f729c0cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:58.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.505+0000 7f72a0fbc700 1 --2- 172.21.15.146:0/2789018049 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f729c0b2d00 0x7f729c0cce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:58.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.505+0000 7f72a0fbc700 1 -- 172.21.15.146:0/2789018049 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f729c0d0110 msgr2=0x7f729c0cd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:58.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.505+0000 7f72a0fbc700 1 --2- 172.21.15.146:0/2789018049 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f729c0d0110 0x7f729c0cd340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:58.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.505+0000 7f72a0fbc700 1 -- 172.21.15.146:0/2789018049 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7294009a70 con 0x7f729c15af00 2023-05-24T03:31:58.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.506+0000 7f72a0fbc700 1 --2- 172.21.15.146:0/2789018049 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f729c15af00 0x7f729c149000 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f729400b680 tx=0x7f7294004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:58.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.506+0000 7f7298ff9700 1 -- 172.21.15.146:0/2789018049 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729401c810 con 0x7f729c15af00 2023-05-24T03:31:58.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.506+0000 7f7298ff9700 1 -- 172.21.15.146:0/2789018049 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7294020070 con 0x7f729c15af00 2023-05-24T03:31:58.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.506+0000 7f72a2a1f700 1 -- 172.21.15.146:0/2789018049 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f729c0cb970 con 0x7f729c15af00 2023-05-24T03:31:58.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.506+0000 7f7298ff9700 1 -- 172.21.15.146:0/2789018049 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729401cbd0 con 0x7f729c15af00 2023-05-24T03:31:58.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.506+0000 7f72a2a1f700 1 -- 172.21.15.146:0/2789018049 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f729c0cdbf0 con 0x7f729c15af00 2023-05-24T03:31:58.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.507+0000 7f72a2a1f700 1 -- 172.21.15.146:0/2789018049 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f729c15efb0 con 0x7f729c15af00 2023-05-24T03:31:58.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.507+0000 7f7298ff9700 1 -- 172.21.15.146:0/2789018049 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f729401cd30 con 0x7f729c15af00 2023-05-24T03:31:58.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.507+0000 7f7298ff9700 1 --2- 172.21.15.146:0/2789018049 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f728806ace0 0x7f728806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:58.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.508+0000 7f7298ff9700 1 -- 172.21.15.146:0/2789018049 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7294022070 con 0x7f729c15af00 2023-05-24T03:31:58.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.508+0000 7f729bfff700 1 --2- 172.21.15.146:0/2789018049 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f728806ace0 0x7f728806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:58.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.508+0000 7f729bfff700 1 --2- 172.21.15.146:0/2789018049 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f728806ace0 0x7f728806d190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7290000f60 tx=0x7f7290009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:58.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.512+0000 7f7298ff9700 1 -- 172.21.15.146:0/2789018049 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f7294056920 con 0x7f729c15af00 2023-05-24T03:31:58.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.730+0000 7f72a2a1f700 1 -- 172.21.15.146:0/2789018049 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f729c068d00 con 0x7f729c15af00 2023-05-24T03:31:58.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.730+0000 7f7298ff9700 1 -- 172.21.15.146:0/2789018049 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7294059f40 con 0x7f729c15af00 2023-05-24T03:31:58.736 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2023-05-24T03:31:58.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.732+0000 7f72a2a1f700 1 -- 172.21.15.146:0/2789018049 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f728806ace0 msgr2=0x7f728806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:58.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.732+0000 7f72a2a1f700 1 --2- 172.21.15.146:0/2789018049 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f728806ace0 0x7f728806d190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7290000f60 tx=0x7f7290009040 comp rx=0 tx=0).stop 2023-05-24T03:31:58.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.732+0000 7f72a2a1f700 1 -- 172.21.15.146:0/2789018049 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f729c15af00 msgr2=0x7f729c149000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:58.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.732+0000 7f72a2a1f700 1 --2- 172.21.15.146:0/2789018049 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f729c15af00 0x7f729c149000 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f729400b680 tx=0x7f7294004ad0 comp rx=0 tx=0).stop 2023-05-24T03:31:58.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.732+0000 7f72a2a1f700 1 -- 172.21.15.146:0/2789018049 shutdown_connections 2023-05-24T03:31:58.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.732+0000 7f72a2a1f700 1 --2- 172.21.15.146:0/2789018049 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f728806ace0 0x7f728806d190 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:58.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.732+0000 7f72a2a1f700 1 --2- 172.21.15.146:0/2789018049 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f729c15af00 0x7f729c149000 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:58.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.732+0000 7f72a2a1f700 1 --2- 172.21.15.146:0/2789018049 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f729c0b2d00 0x7f729c0cce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:58.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.732+0000 7f72a2a1f700 1 --2- 172.21.15.146:0/2789018049 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f729c0d0110 0x7f729c0cd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:58.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.732+0000 7f72a2a1f700 1 -- 172.21.15.146:0/2789018049 >> 172.21.15.146:0/2789018049 conn(0x7f729c06e2a0 msgr2=0x7f729c0b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:31:58.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.733+0000 7f72a2a1f700 1 -- 172.21.15.146:0/2789018049 shutdown_connections 2023-05-24T03:31:58.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.733+0000 7f72a2a1f700 1 -- 172.21.15.146:0/2789018049 wait complete. 2023-05-24T03:31:58.749 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-24T03:31:58.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.869+0000 7f3aeae33700 1 Processor -- start 2023-05-24T03:31:58.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.869+0000 7f3aeae33700 1 -- start start 2023-05-24T03:31:58.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.870+0000 7f3aeae33700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3ae406a460 0x7f3ae40cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:58.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.870+0000 7f3aeae33700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3ae40aefd0 0x7f3ae4160d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:58.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.870+0000 7f3aeae33700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ae40cfd00 con 0x7f3ae415cd90 2023-05-24T03:31:58.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.870+0000 7f3aeae33700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ae4072350 con 0x7f3ae40aefd0 2023-05-24T03:31:58.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.870+0000 7f3aeae33700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ae40cf460 con 0x7f3ae406a460 2023-05-24T03:31:58.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.870+0000 7f3ae93d0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3ae40aefd0 0x7f3ae4160d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:58.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.870+0000 7f3ae93d0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3ae40aefd0 0x7f3ae4160d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40388/0 (socket says 172.21.15.146:40388) 2023-05-24T03:31:58.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.870+0000 7f3ae93d0700 1 -- 172.21.15.146:0/1458791722 learned_addr learned my addr 172.21.15.146:0/1458791722 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:31:58.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.870+0000 7f3ae8bcf700 1 --2- 172.21.15.146:0/1458791722 >> v2:172.21.15.151:3300/0 conn(0x7f3ae406a460 0x7f3ae40cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:58.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.870+0000 7f3ae93d0700 1 -- 172.21.15.146:0/1458791722 >> v2:172.21.15.151:3300/0 conn(0x7f3ae406a460 msgr2=0x7f3ae40cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:31:58.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.870+0000 7f3ae93d0700 1 --2- 172.21.15.146:0/1458791722 >> v2:172.21.15.151:3300/0 conn(0x7f3ae406a460 0x7f3ae40cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:58.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.870+0000 7f3ae93d0700 1 -- 172.21.15.146:0/1458791722 >> v1:172.21.15.151:6789/0 conn(0x7f3ae415cd90 legacy=0x7f3ae406a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:58.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.870+0000 7f3ae93d0700 1 -- 172.21.15.146:0/1458791722 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae40cf740 con 0x7f3ae40aefd0 2023-05-24T03:31:58.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.871+0000 7f3ae93d0700 1 --2- 172.21.15.146:0/1458791722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ae40aefd0 0x7f3ae4160d20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4066ba0 tx=0x7f3adc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=939cf0f5faadec11 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:58.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.871+0000 7f3ae37fe700 1 -- 172.21.15.146:0/1458791722 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3adc00e070 con 0x7f3ae40aefd0 2023-05-24T03:31:58.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.871+0000 7f3ae37fe700 1 -- 172.21.15.146:0/1458791722 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3adc00b9c0 con 0x7f3ae40aefd0 2023-05-24T03:31:58.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.871+0000 7f3ae37fe700 1 -- 172.21.15.146:0/1458791722 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3adc00bd70 con 0x7f3ae40aefd0 2023-05-24T03:31:58.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.871+0000 7f3aeae33700 1 -- 172.21.15.146:0/1458791722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ae40aefd0 msgr2=0x7f3ae4160d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:58.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.871+0000 7f3aeae33700 1 --2- 172.21.15.146:0/1458791722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ae40aefd0 0x7f3ae4160d20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4066ba0 tx=0x7f3adc00b330 comp rx=0 tx=0).stop 2023-05-24T03:31:58.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.871+0000 7f3aeae33700 1 -- 172.21.15.146:0/1458791722 shutdown_connections 2023-05-24T03:31:58.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.871+0000 7f3aeae33700 1 --2- 172.21.15.146:0/1458791722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ae40aefd0 0x7f3ae4160d20 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:58.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.871+0000 7f3aeae33700 1 --2- 172.21.15.146:0/1458791722 >> v2:172.21.15.151:3300/0 conn(0x7f3ae406a460 0x7f3ae40cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:58.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.871+0000 7f3aeae33700 1 -- 172.21.15.146:0/1458791722 >> 172.21.15.146:0/1458791722 conn(0x7f3ae40cfea0 msgr2=0x7f3ae40d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:31:58.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.871+0000 7f3aeae33700 1 -- 172.21.15.146:0/1458791722 shutdown_connections 2023-05-24T03:31:58.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.871+0000 7f3aeae33700 1 -- 172.21.15.146:0/1458791722 wait complete. 2023-05-24T03:31:58.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.873+0000 7f3aeae33700 1 Processor -- start 2023-05-24T03:31:58.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.873+0000 7f3aeae33700 1 -- start start 2023-05-24T03:31:58.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.874+0000 7f3aeae33700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ae406a460 0x7f3ae4154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:58.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.874+0000 7f3aeae33700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ae40aefd0 0x7f3ae40ad900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:58.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.874+0000 7f3aeae33700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ae415cd90 0x7f3ae40ade40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:58.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.874+0000 7f3aeae33700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae41f59a0 con 0x7f3ae415cd90 2023-05-24T03:31:58.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.874+0000 7f3aeae33700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae41f5bf0 con 0x7f3ae40aefd0 2023-05-24T03:31:58.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.874+0000 7f3aeae33700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae41f5ed0 con 0x7f3ae406a460 2023-05-24T03:31:58.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.874+0000 7f3ae93d0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ae415cd90 0x7f3ae40ade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:58.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.874+0000 7f3ae93d0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ae415cd90 0x7f3ae40ade40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40394/0 (socket says 172.21.15.146:40394) 2023-05-24T03:31:58.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.874+0000 7f3ae93d0700 1 -- 172.21.15.146:0/1253326023 learned_addr learned my addr 172.21.15.146:0/1253326023 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:31:58.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.874+0000 7f3ae3fff700 1 --2- 172.21.15.146:0/1253326023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ae40aefd0 0x7f3ae40ad900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:58.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.874+0000 7f3ae8bcf700 1 --2- 172.21.15.146:0/1253326023 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ae406a460 0x7f3ae4154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:58.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.874+0000 7f3ae93d0700 1 -- 172.21.15.146:0/1253326023 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ae406a460 msgr2=0x7f3ae4154050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:58.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.874+0000 7f3ae93d0700 1 --2- 172.21.15.146:0/1253326023 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ae406a460 0x7f3ae4154050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:58.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.874+0000 7f3ae93d0700 1 -- 172.21.15.146:0/1253326023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ae40aefd0 msgr2=0x7f3ae40ad900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:58.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.874+0000 7f3ae93d0700 1 --2- 172.21.15.146:0/1253326023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ae40aefd0 0x7f3ae40ad900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:58.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.874+0000 7f3ae93d0700 1 -- 172.21.15.146:0/1253326023 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3adc009b30 con 0x7f3ae415cd90 2023-05-24T03:31:58.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.875+0000 7f3ae93d0700 1 --2- 172.21.15.146:0/1253326023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ae415cd90 0x7f3ae40ade40 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3ae40b6010 tx=0x7f3adc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:58.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.875+0000 7f3ae17fa700 1 -- 172.21.15.146:0/1253326023 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3adc004880 con 0x7f3ae415cd90 2023-05-24T03:31:58.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.875+0000 7f3ae17fa700 1 -- 172.21.15.146:0/1253326023 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3adc0099b0 con 0x7f3ae415cd90 2023-05-24T03:31:58.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.875+0000 7f3aeae33700 1 -- 172.21.15.146:0/1253326023 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ae4160800 con 0x7f3ae415cd90 2023-05-24T03:31:58.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.875+0000 7f3ae17fa700 1 -- 172.21.15.146:0/1253326023 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3adc01c680 con 0x7f3ae415cd90 2023-05-24T03:31:58.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.875+0000 7f3aeae33700 1 -- 172.21.15.146:0/1253326023 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ae40cfa20 con 0x7f3ae415cd90 2023-05-24T03:31:58.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.876+0000 7f3aeae33700 1 -- 172.21.15.146:0/1253326023 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ae40af620 con 0x7f3ae415cd90 2023-05-24T03:31:58.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.876+0000 7f3ae17fa700 1 -- 172.21.15.146:0/1253326023 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3adc01c7e0 con 0x7f3ae415cd90 2023-05-24T03:31:58.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.876+0000 7f3ae17fa700 1 --2- 172.21.15.146:0/1253326023 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f3ac806ace0 0x7f3ac806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:58.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.877+0000 7f3ae17fa700 1 -- 172.21.15.146:0/1253326023 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3adc08b2f0 con 0x7f3ae415cd90 2023-05-24T03:31:58.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.877+0000 7f3ae8bcf700 1 --2- 172.21.15.146:0/1253326023 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f3ac806ace0 0x7f3ac806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:58.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.877+0000 7f3ae8bcf700 1 --2- 172.21.15.146:0/1253326023 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f3ac806ace0 0x7f3ac806d190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8006b20 tx=0x7f3ad8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:58.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:58.881+0000 7f3ae17fa700 1 -- 172.21.15.146:0/1253326023 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3adc056100 con 0x7f3ae415cd90 2023-05-24T03:31:59.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.133+0000 7f3aeae33700 1 -- 172.21.15.146:0/1253326023 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3ae4068d00 con 0x7f3ae415cd90 2023-05-24T03:31:59.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.133+0000 7f3ae17fa700 1 -- 172.21.15.146:0/1253326023 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3adc059720 con 0x7f3ae415cd90 2023-05-24T03:31:59.139 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2023-05-24T03:31:59.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.135+0000 7f3aeae33700 1 -- 172.21.15.146:0/1253326023 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f3ac806ace0 msgr2=0x7f3ac806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:59.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.135+0000 7f3aeae33700 1 --2- 172.21.15.146:0/1253326023 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f3ac806ace0 0x7f3ac806d190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8006b20 tx=0x7f3ad8008040 comp rx=0 tx=0).stop 2023-05-24T03:31:59.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.135+0000 7f3aeae33700 1 -- 172.21.15.146:0/1253326023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ae415cd90 msgr2=0x7f3ae40ade40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:59.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.135+0000 7f3aeae33700 1 --2- 172.21.15.146:0/1253326023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ae415cd90 0x7f3ae40ade40 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3ae40b6010 tx=0x7f3adc004ad0 comp rx=0 tx=0).stop 2023-05-24T03:31:59.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.136+0000 7f3aeae33700 1 -- 172.21.15.146:0/1253326023 shutdown_connections 2023-05-24T03:31:59.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.136+0000 7f3aeae33700 1 --2- 172.21.15.146:0/1253326023 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f3ac806ace0 0x7f3ac806d190 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:59.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.136+0000 7f3aeae33700 1 --2- 172.21.15.146:0/1253326023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ae415cd90 0x7f3ae40ade40 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:59.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.136+0000 7f3aeae33700 1 --2- 172.21.15.146:0/1253326023 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ae406a460 0x7f3ae4154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:59.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.136+0000 7f3aeae33700 1 --2- 172.21.15.146:0/1253326023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ae40aefd0 0x7f3ae40ad900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:59.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.136+0000 7f3aeae33700 1 -- 172.21.15.146:0/1253326023 >> 172.21.15.146:0/1253326023 conn(0x7f3ae40cfea0 msgr2=0x7f3ae40b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:31:59.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.136+0000 7f3aeae33700 1 -- 172.21.15.146:0/1253326023 shutdown_connections 2023-05-24T03:31:59.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.136+0000 7f3aeae33700 1 -- 172.21.15.146:0/1253326023 wait complete. 2023-05-24T03:31:59.153 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-24T03:31:59.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.275+0000 7f168ceae700 1 Processor -- start 2023-05-24T03:31:59.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.275+0000 7f168ceae700 1 -- start start 2023-05-24T03:31:59.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.276+0000 7f168ceae700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1688070ec0 0x7f16880ad470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:59.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.276+0000 7f168ceae700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f168806b850 0x7f16880ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:59.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.276+0000 7f168ceae700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1688072060 con 0x7f168815cf50 2023-05-24T03:31:59.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.276+0000 7f168ceae700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16880ca330 con 0x7f168806b850 2023-05-24T03:31:59.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.276+0000 7f168ceae700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16880ca050 con 0x7f1688070ec0 2023-05-24T03:31:59.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.276+0000 7f1685d9b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1688070ec0 0x7f16880ad470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:59.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.276+0000 7f1686d9d700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f168806b850 0x7f16880ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:59.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.276+0000 7f1685d9b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1688070ec0 0x7f16880ad470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:53264/0 (socket says 172.21.15.146:53264) 2023-05-24T03:31:59.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.276+0000 7f1685d9b700 1 -- 172.21.15.146:0/1182961295 learned_addr learned my addr 172.21.15.146:0/1182961295 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:31:59.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.276+0000 7f168659c700 1 --1- 172.21.15.146:0/1182961295 >> v1:172.21.15.151:6789/0 conn(0x7f168815cf50 0x7f16880707b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:45884/0 (socket says 172.21.15.146:45884) 2023-05-24T03:31:59.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.277+0000 7f1685d9b700 1 -- 172.21.15.146:0/1182961295 >> v2:172.21.15.151:3300/0 conn(0x7f168806b850 msgr2=0x7f16880ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:31:59.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.277+0000 7f1685d9b700 1 --2- 172.21.15.146:0/1182961295 >> v2:172.21.15.151:3300/0 conn(0x7f168806b850 0x7f16880ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:59.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.277+0000 7f1685d9b700 1 -- 172.21.15.146:0/1182961295 >> v1:172.21.15.151:6789/0 conn(0x7f168815cf50 legacy=0x7f16880707b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:59.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.277+0000 7f1685d9b700 1 -- 172.21.15.146:0/1182961295 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16880ca610 con 0x7f1688070ec0 2023-05-24T03:31:59.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.277+0000 7f1686d9d700 1 --2- 172.21.15.146:0/1182961295 >> v2:172.21.15.151:3300/0 conn(0x7f168806b850 0x7f16880ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T03:31:59.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.277+0000 7f1685d9b700 1 --2- 172.21.15.146:0/1182961295 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1688070ec0 0x7f16880ad470 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f16780098f0 tx=0x7f1678009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cea19f22ef2a4d8f server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:59.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.277+0000 7f168559a700 1 -- 172.21.15.146:0/1182961295 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1678011830 con 0x7f1688070ec0 2023-05-24T03:31:59.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.277+0000 7f168559a700 1 -- 172.21.15.146:0/1182961295 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1678011990 con 0x7f1688070ec0 2023-05-24T03:31:59.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.277+0000 7f168559a700 1 -- 172.21.15.146:0/1182961295 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1678011d20 con 0x7f1688070ec0 2023-05-24T03:31:59.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.278+0000 7f168ceae700 1 -- 172.21.15.146:0/1182961295 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1688070ec0 msgr2=0x7f16880ad470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:59.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.278+0000 7f168ceae700 1 --2- 172.21.15.146:0/1182961295 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1688070ec0 0x7f16880ad470 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f16780098f0 tx=0x7f1678009c00 comp rx=0 tx=0).stop 2023-05-24T03:31:59.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.278+0000 7f168ceae700 1 -- 172.21.15.146:0/1182961295 shutdown_connections 2023-05-24T03:31:59.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.278+0000 7f168ceae700 1 --2- 172.21.15.146:0/1182961295 >> v2:172.21.15.151:3300/0 conn(0x7f168806b850 0x7f16880ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:59.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.278+0000 7f168ceae700 1 --2- 172.21.15.146:0/1182961295 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1688070ec0 0x7f16880ad470 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:59.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.278+0000 7f168ceae700 1 -- 172.21.15.146:0/1182961295 >> 172.21.15.146:0/1182961295 conn(0x7f16880cf6c0 msgr2=0x7f16880cfa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:31:59.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.278+0000 7f168ceae700 1 -- 172.21.15.146:0/1182961295 shutdown_connections 2023-05-24T03:31:59.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.278+0000 7f168ceae700 1 -- 172.21.15.146:0/1182961295 wait complete. 2023-05-24T03:31:59.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.279+0000 7f168ceae700 1 Processor -- start 2023-05-24T03:31:59.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.279+0000 7f168ceae700 1 -- start start 2023-05-24T03:31:59.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.280+0000 7f168ceae700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f168806b850 0x7f168814bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:59.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.280+0000 7f168ceae700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1688070ec0 0x7f16881f2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:59.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.280+0000 7f168ceae700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f168815cf50 0x7f1688155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:59.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.280+0000 7f168ceae700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168814c040 con 0x7f1688070ec0 2023-05-24T03:31:59.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.280+0000 7f168ceae700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16880b0080 con 0x7f168806b850 2023-05-24T03:31:59.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.280+0000 7f168ceae700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16881f3190 con 0x7f168815cf50 2023-05-24T03:31:59.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.281+0000 7f1685d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1688070ec0 0x7f16881f2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:59.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.281+0000 7f1685d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1688070ec0 0x7f16881f2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40406/0 (socket says 172.21.15.146:40406) 2023-05-24T03:31:59.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.281+0000 7f1685d9b700 1 -- 172.21.15.146:0/3530314572 learned_addr learned my addr 172.21.15.146:0/3530314572 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:31:59.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.281+0000 7f168659c700 1 --2- 172.21.15.146:0/3530314572 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f168806b850 0x7f168814bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:59.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.281+0000 7f1686d9d700 1 --2- 172.21.15.146:0/3530314572 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f168815cf50 0x7f1688155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:59.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.281+0000 7f1685d9b700 1 -- 172.21.15.146:0/3530314572 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f168815cf50 msgr2=0x7f1688155ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:59.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.281+0000 7f1685d9b700 1 --2- 172.21.15.146:0/3530314572 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f168815cf50 0x7f1688155ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:59.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.281+0000 7f1685d9b700 1 -- 172.21.15.146:0/3530314572 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f168806b850 msgr2=0x7f168814bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:59.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.281+0000 7f1685d9b700 1 --2- 172.21.15.146:0/3530314572 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f168806b850 0x7f168814bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:59.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.281+0000 7f1685d9b700 1 -- 172.21.15.146:0/3530314572 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1680009a70 con 0x7f1688070ec0 2023-05-24T03:31:59.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.281+0000 7f168659c700 1 --2- 172.21.15.146:0/3530314572 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f168806b850 0x7f168814bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:31:59.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.281+0000 7f1685d9b700 1 --2- 172.21.15.146:0/3530314572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1688070ec0 0x7f16881f2740 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1678009c40 tx=0x7f1678004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:59.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.281+0000 7f1676ffd700 1 -- 172.21.15.146:0/3530314572 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16780045b0 con 0x7f1688070ec0 2023-05-24T03:31:59.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.281+0000 7f1676ffd700 1 -- 172.21.15.146:0/3530314572 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f167801f070 con 0x7f1688070ec0 2023-05-24T03:31:59.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.281+0000 7f1676ffd700 1 -- 172.21.15.146:0/3530314572 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16780038e0 con 0x7f1688070ec0 2023-05-24T03:31:59.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.281+0000 7f168ceae700 1 -- 172.21.15.146:0/3530314572 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1678009550 con 0x7f1688070ec0 2023-05-24T03:31:59.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.281+0000 7f168ceae700 1 -- 172.21.15.146:0/3530314572 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1688071ca0 con 0x7f1688070ec0 2023-05-24T03:31:59.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.282+0000 7f168ceae700 1 -- 172.21.15.146:0/3530314572 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16880ca8f0 con 0x7f1688070ec0 2023-05-24T03:31:59.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.283+0000 7f1676ffd700 1 -- 172.21.15.146:0/3530314572 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1678021030 con 0x7f1688070ec0 2023-05-24T03:31:59.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.283+0000 7f1676ffd700 1 --2- 172.21.15.146:0/3530314572 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f166806ace0 0x7f166806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:59.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.283+0000 7f1676ffd700 1 -- 172.21.15.146:0/3530314572 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f167808ac60 con 0x7f1688070ec0 2023-05-24T03:31:59.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.283+0000 7f168659c700 1 --2- 172.21.15.146:0/3530314572 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f166806ace0 0x7f166806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:59.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.283+0000 7f168659c700 1 --2- 172.21.15.146:0/3530314572 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f166806ace0 0x7f166806d190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f167c000f60 tx=0x7f167c007df0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:59.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.287+0000 7f1676ffd700 1 -- 172.21.15.146:0/3530314572 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f1678055c40 con 0x7f1688070ec0 2023-05-24T03:31:59.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.476+0000 7f168ceae700 1 -- 172.21.15.146:0/3530314572 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1688071e30 con 0x7f1688070ec0 2023-05-24T03:31:59.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.476+0000 7f1676ffd700 1 -- 172.21.15.146:0/3530314572 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1678059260 con 0x7f1688070ec0 2023-05-24T03:31:59.482 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2023-05-24T03:31:59.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.478+0000 7f168ceae700 1 -- 172.21.15.146:0/3530314572 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f166806ace0 msgr2=0x7f166806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:59.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.478+0000 7f168ceae700 1 --2- 172.21.15.146:0/3530314572 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f166806ace0 0x7f166806d190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f167c000f60 tx=0x7f167c007df0 comp rx=0 tx=0).stop 2023-05-24T03:31:59.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.478+0000 7f168ceae700 1 -- 172.21.15.146:0/3530314572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1688070ec0 msgr2=0x7f16881f2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:59.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.478+0000 7f168ceae700 1 --2- 172.21.15.146:0/3530314572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1688070ec0 0x7f16881f2740 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1678009c40 tx=0x7f1678004750 comp rx=0 tx=0).stop 2023-05-24T03:31:59.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.479+0000 7f168ceae700 1 -- 172.21.15.146:0/3530314572 shutdown_connections 2023-05-24T03:31:59.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.479+0000 7f168ceae700 1 --2- 172.21.15.146:0/3530314572 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f166806ace0 0x7f166806d190 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:59.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.479+0000 7f168ceae700 1 --2- 172.21.15.146:0/3530314572 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f168815cf50 0x7f1688155ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:59.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.479+0000 7f168ceae700 1 --2- 172.21.15.146:0/3530314572 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f168806b850 0x7f168814bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:59.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.479+0000 7f168ceae700 1 --2- 172.21.15.146:0/3530314572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1688070ec0 0x7f16881f2740 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:59.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.479+0000 7f168ceae700 1 -- 172.21.15.146:0/3530314572 >> 172.21.15.146:0/3530314572 conn(0x7f16880cf6c0 msgr2=0x7f16880b4e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:31:59.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.479+0000 7f168ceae700 1 -- 172.21.15.146:0/3530314572 shutdown_connections 2023-05-24T03:31:59.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.479+0000 7f168ceae700 1 -- 172.21.15.146:0/3530314572 wait complete. 2023-05-24T03:31:59.495 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-24T03:31:59.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.615+0000 7fec4fad5700 1 Processor -- start 2023-05-24T03:31:59.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.615+0000 7fec4fad5700 1 -- start start 2023-05-24T03:31:59.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.616+0000 7fec4fad5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fec4806a460 0x7fec480cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:59.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.616+0000 7fec4fad5700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec480aefd0 0x7fec48160d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:59.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.616+0000 7fec4fad5700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec480cfd00 con 0x7fec4815cd90 2023-05-24T03:31:59.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.616+0000 7fec4fad5700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec48072350 con 0x7fec4806a460 2023-05-24T03:31:59.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.616+0000 7fec4fad5700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec480cf460 con 0x7fec480aefd0 2023-05-24T03:31:59.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.616+0000 7fec4d871700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fec4806a460 0x7fec480cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:59.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.616+0000 7fec4d871700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fec4806a460 0x7fec480cede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40412/0 (socket says 172.21.15.146:40412) 2023-05-24T03:31:59.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.616+0000 7fec4d871700 1 -- 172.21.15.146:0/839251212 learned_addr learned my addr 172.21.15.146:0/839251212 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:31:59.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.616+0000 7fec4e072700 1 --2- 172.21.15.146:0/839251212 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec480aefd0 0x7fec48160d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:59.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.616+0000 7fec4d871700 1 -- 172.21.15.146:0/839251212 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec480aefd0 msgr2=0x7fec48160d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:31:59.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.616+0000 7fec4d871700 1 --2- 172.21.15.146:0/839251212 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec480aefd0 0x7fec48160d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:59.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.616+0000 7fec4d871700 1 -- 172.21.15.146:0/839251212 >> v1:172.21.15.151:6789/0 conn(0x7fec4815cd90 legacy=0x7fec4806a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:59.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.616+0000 7fec4d871700 1 -- 172.21.15.146:0/839251212 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec480cf740 con 0x7fec4806a460 2023-05-24T03:31:59.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.617+0000 7fec4d871700 1 --2- 172.21.15.146:0/839251212 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec4806a460 0x7fec480cede0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fec380098f0 tx=0x7fec38009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6d88fdb2c39b0b2 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:59.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.617+0000 7fec4c86f700 1 -- 172.21.15.146:0/839251212 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3800b8a0 con 0x7fec4806a460 2023-05-24T03:31:59.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.617+0000 7fec4c86f700 1 -- 172.21.15.146:0/839251212 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec3800ba00 con 0x7fec4806a460 2023-05-24T03:31:59.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.617+0000 7fec4c86f700 1 -- 172.21.15.146:0/839251212 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3800bd90 con 0x7fec4806a460 2023-05-24T03:31:59.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.617+0000 7fec4fad5700 1 -- 172.21.15.146:0/839251212 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec4806a460 msgr2=0x7fec480cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:59.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.617+0000 7fec4fad5700 1 --2- 172.21.15.146:0/839251212 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec4806a460 0x7fec480cede0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fec380098f0 tx=0x7fec38009c00 comp rx=0 tx=0).stop 2023-05-24T03:31:59.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.617+0000 7fec4fad5700 1 -- 172.21.15.146:0/839251212 shutdown_connections 2023-05-24T03:31:59.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.617+0000 7fec4fad5700 1 --2- 172.21.15.146:0/839251212 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec480aefd0 0x7fec48160d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:59.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.617+0000 7fec4fad5700 1 --2- 172.21.15.146:0/839251212 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec4806a460 0x7fec480cede0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:59.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.617+0000 7fec4fad5700 1 -- 172.21.15.146:0/839251212 >> 172.21.15.146:0/839251212 conn(0x7fec480cfea0 msgr2=0x7fec480d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:31:59.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.617+0000 7fec4fad5700 1 -- 172.21.15.146:0/839251212 shutdown_connections 2023-05-24T03:31:59.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.618+0000 7fec4fad5700 1 -- 172.21.15.146:0/839251212 wait complete. 2023-05-24T03:31:59.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.619+0000 7fec4fad5700 1 Processor -- start 2023-05-24T03:31:59.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.619+0000 7fec4fad5700 1 -- start start 2023-05-24T03:31:59.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.619+0000 7fec4fad5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec4806a460 0x7fec4815bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:59.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.619+0000 7fec4fad5700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec480aefd0 0x7fec4815b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:59.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.619+0000 7fec4fad5700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec4815cd90 0x7fec480b0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:59.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.619+0000 7fec4fad5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec480b09e0 con 0x7fec4806a460 2023-05-24T03:31:59.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.619+0000 7fec4fad5700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec4815ba10 con 0x7fec4815cd90 2023-05-24T03:31:59.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.619+0000 7fec4fad5700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec481e7200 con 0x7fec480aefd0 2023-05-24T03:31:59.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.620+0000 7fec4d871700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec4806a460 0x7fec4815bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:59.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.620+0000 7fec4d871700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec4806a460 0x7fec4815bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40416/0 (socket says 172.21.15.146:40416) 2023-05-24T03:31:59.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.620+0000 7fec4d871700 1 -- 172.21.15.146:0/1958935022 learned_addr learned my addr 172.21.15.146:0/1958935022 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:31:59.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.620+0000 7fec4d070700 1 --2- 172.21.15.146:0/1958935022 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec480aefd0 0x7fec4815b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:59.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.620+0000 7fec4e072700 1 --2- 172.21.15.146:0/1958935022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec4815cd90 0x7fec480b0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:59.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.620+0000 7fec4d871700 1 -- 172.21.15.146:0/1958935022 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec480aefd0 msgr2=0x7fec4815b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:59.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.620+0000 7fec4d871700 1 --2- 172.21.15.146:0/1958935022 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec480aefd0 0x7fec4815b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:59.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.620+0000 7fec4d871700 1 -- 172.21.15.146:0/1958935022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec4815cd90 msgr2=0x7fec480b0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:59.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.620+0000 7fec4d871700 1 --2- 172.21.15.146:0/1958935022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec4815cd90 0x7fec480b0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:59.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.620+0000 7fec4d871700 1 -- 172.21.15.146:0/1958935022 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec38009550 con 0x7fec4806a460 2023-05-24T03:31:59.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.620+0000 7fec4d871700 1 --2- 172.21.15.146:0/1958935022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec4806a460 0x7fec4815bbf0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fec38009c40 tx=0x7fec38004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:59.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.620+0000 7fec3e7fc700 1 -- 172.21.15.146:0/1958935022 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec38004510 con 0x7fec4806a460 2023-05-24T03:31:59.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.620+0000 7fec3e7fc700 1 -- 172.21.15.146:0/1958935022 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec3801e070 con 0x7fec4806a460 2023-05-24T03:31:59.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.620+0000 7fec4fad5700 1 -- 172.21.15.146:0/1958935022 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec48160800 con 0x7fec4806a460 2023-05-24T03:31:59.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.620+0000 7fec3e7fc700 1 -- 172.21.15.146:0/1958935022 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec380038e0 con 0x7fec4806a460 2023-05-24T03:31:59.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.620+0000 7fec4fad5700 1 -- 172.21.15.146:0/1958935022 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec480cfa20 con 0x7fec4806a460 2023-05-24T03:31:59.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.621+0000 7fec4fad5700 1 -- 172.21.15.146:0/1958935022 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec480af620 con 0x7fec4806a460 2023-05-24T03:31:59.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.622+0000 7fec3e7fc700 1 -- 172.21.15.146:0/1958935022 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fec38003a40 con 0x7fec4806a460 2023-05-24T03:31:59.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.622+0000 7fec3e7fc700 1 --2- 172.21.15.146:0/1958935022 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fec2c06ace0 0x7fec2c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:31:59.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.622+0000 7fec3e7fc700 1 -- 172.21.15.146:0/1958935022 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fec38020070 con 0x7fec4806a460 2023-05-24T03:31:59.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.622+0000 7fec4d070700 1 --2- 172.21.15.146:0/1958935022 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fec2c06ace0 0x7fec2c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:31:59.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.623+0000 7fec4d070700 1 --2- 172.21.15.146:0/1958935022 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fec2c06ace0 0x7fec2c06d190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fec481e7630 tx=0x7fec44009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:31:59.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.627+0000 7fec3e7fc700 1 -- 172.21.15.146:0/1958935022 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fec38055950 con 0x7fec4806a460 2023-05-24T03:31:59.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.834+0000 7fec4fad5700 1 -- 172.21.15.146:0/1958935022 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fec480b0cc0 con 0x7fec4806a460 2023-05-24T03:31:59.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.834+0000 7fec3e7fc700 1 -- 172.21.15.146:0/1958935022 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7fec38058f70 con 0x7fec4806a460 2023-05-24T03:31:59.840 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2023-05-24T03:31:59.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.836+0000 7fec4fad5700 1 -- 172.21.15.146:0/1958935022 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fec2c06ace0 msgr2=0x7fec2c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:59.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.836+0000 7fec4fad5700 1 --2- 172.21.15.146:0/1958935022 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fec2c06ace0 0x7fec2c06d190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fec481e7630 tx=0x7fec44009040 comp rx=0 tx=0).stop 2023-05-24T03:31:59.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.836+0000 7fec4fad5700 1 -- 172.21.15.146:0/1958935022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec4806a460 msgr2=0x7fec4815bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:31:59.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.836+0000 7fec4fad5700 1 --2- 172.21.15.146:0/1958935022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec4806a460 0x7fec4815bbf0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fec38009c40 tx=0x7fec38004750 comp rx=0 tx=0).stop 2023-05-24T03:31:59.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.836+0000 7fec4fad5700 1 -- 172.21.15.146:0/1958935022 shutdown_connections 2023-05-24T03:31:59.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.836+0000 7fec4fad5700 1 --2- 172.21.15.146:0/1958935022 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fec2c06ace0 0x7fec2c06d190 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:59.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.836+0000 7fec4fad5700 1 --2- 172.21.15.146:0/1958935022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec4815cd90 0x7fec480b0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:59.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.836+0000 7fec4fad5700 1 --2- 172.21.15.146:0/1958935022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec4806a460 0x7fec4815bbf0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:59.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.836+0000 7fec4fad5700 1 --2- 172.21.15.146:0/1958935022 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec480aefd0 0x7fec4815b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:31:59.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.836+0000 7fec4fad5700 1 -- 172.21.15.146:0/1958935022 >> 172.21.15.146:0/1958935022 conn(0x7fec480cfea0 msgr2=0x7fec480b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:31:59.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.837+0000 7fec4fad5700 1 -- 172.21.15.146:0/1958935022 shutdown_connections 2023-05-24T03:31:59.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.837+0000 7fec4fad5700 1 -- 172.21.15.146:0/1958935022 wait complete. 2023-05-24T03:31:59.853 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-24T03:32:00.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.972+0000 7fbc2d80e700 1 Processor -- start 2023-05-24T03:32:00.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.972+0000 7fbc2d80e700 1 -- start start 2023-05-24T03:32:00.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.973+0000 7fbc2d80e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbc2808aa00 0x7fbc2816dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:00.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.973+0000 7fbc2d80e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc280cf4e0 0x7fbc2806c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:00.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.973+0000 7fbc2d80e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc2816d8c0 con 0x7fbc2806d9e0 2023-05-24T03:32:00.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.973+0000 7fbc2d80e700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc2806cef0 con 0x7fbc2808aa00 2023-05-24T03:32:00.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.973+0000 7fbc2d80e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2808add0 con 0x7fbc280cf4e0 2023-05-24T03:32:00.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.974+0000 7fbc26ffd700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbc2808aa00 0x7fbc2816dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:00.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.974+0000 7fbc267fc700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc280cf4e0 0x7fbc2806c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:00.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.974+0000 7fbc26ffd700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbc2808aa00 0x7fbc2816dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:51606/0 (socket says 172.21.15.146:51606) 2023-05-24T03:32:00.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.974+0000 7fbc26ffd700 1 -- 172.21.15.146:0/3582962410 learned_addr learned my addr 172.21.15.146:0/3582962410 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:32:00.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:31:59.974+0000 7fbc277fe700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fbc2806d9e0 0x7fbc280cc930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:45910/0 (socket says 172.21.15.146:45910) 2023-05-24T03:32:00.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.010+0000 7fbc267fc700 1 -- 172.21.15.146:0/3582962410 >> v2:172.21.15.151:3300/0 conn(0x7fbc2808aa00 msgr2=0x7fbc2816dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:32:00.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.010+0000 7fbc267fc700 1 --2- 172.21.15.146:0/3582962410 >> v2:172.21.15.151:3300/0 conn(0x7fbc2808aa00 0x7fbc2816dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:00.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.010+0000 7fbc267fc700 1 -- 172.21.15.146:0/3582962410 >> v1:172.21.15.151:6789/0 conn(0x7fbc2806d9e0 legacy=0x7fbc280cc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:00.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.010+0000 7fbc267fc700 1 -- 172.21.15.146:0/3582962410 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc2806c930 con 0x7fbc280cf4e0 2023-05-24T03:32:00.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.010+0000 7fbc26ffd700 1 --2- 172.21.15.146:0/3582962410 >> v2:172.21.15.151:3300/0 conn(0x7fbc2808aa00 0x7fbc2816dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T03:32:00.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.010+0000 7fbc267fc700 1 --2- 172.21.15.146:0/3582962410 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc280cf4e0 0x7fbc2806c030 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbc1800b8f0 tx=0x7fbc1800bc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d894b6a2b49675d server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:00.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.011+0000 7fbc25ffb700 1 -- 172.21.15.146:0/3582962410 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc18009030 con 0x7fbc280cf4e0 2023-05-24T03:32:00.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.011+0000 7fbc25ffb700 1 -- 172.21.15.146:0/3582962410 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc1800caf0 con 0x7fbc280cf4e0 2023-05-24T03:32:00.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.011+0000 7fbc25ffb700 1 -- 172.21.15.146:0/3582962410 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1800cea0 con 0x7fbc280cf4e0 2023-05-24T03:32:00.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.011+0000 7fbc2d80e700 1 -- 172.21.15.146:0/3582962410 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc280cf4e0 msgr2=0x7fbc2806c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:00.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.011+0000 7fbc2d80e700 1 --2- 172.21.15.146:0/3582962410 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc280cf4e0 0x7fbc2806c030 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbc1800b8f0 tx=0x7fbc1800bc00 comp rx=0 tx=0).stop 2023-05-24T03:32:00.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.011+0000 7fbc2d80e700 1 -- 172.21.15.146:0/3582962410 shutdown_connections 2023-05-24T03:32:00.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.011+0000 7fbc2d80e700 1 --2- 172.21.15.146:0/3582962410 >> v2:172.21.15.151:3300/0 conn(0x7fbc2808aa00 0x7fbc2816dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:00.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.011+0000 7fbc2d80e700 1 --2- 172.21.15.146:0/3582962410 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc280cf4e0 0x7fbc2806c030 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:00.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.011+0000 7fbc2d80e700 1 -- 172.21.15.146:0/3582962410 >> 172.21.15.146:0/3582962410 conn(0x7fbc280cc430 msgr2=0x7fbc280ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:32:00.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.011+0000 7fbc2d80e700 1 -- 172.21.15.146:0/3582962410 shutdown_connections 2023-05-24T03:32:00.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.011+0000 7fbc2d80e700 1 -- 172.21.15.146:0/3582962410 wait complete. 2023-05-24T03:32:00.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.012+0000 7fbc2d80e700 1 Processor -- start 2023-05-24T03:32:00.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.013+0000 7fbc2d80e700 1 -- start start 2023-05-24T03:32:00.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.013+0000 7fbc2d80e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc2806d9e0 0x7fbc28200260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:00.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.013+0000 7fbc2d80e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc2808aa00 0x7fbc281fe960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:00.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.013+0000 7fbc2d80e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc280cf4e0 0x7fbc280c71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:00.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.013+0000 7fbc2d80e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc280b30b0 con 0x7fbc280cf4e0 2023-05-24T03:32:00.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.013+0000 7fbc2d80e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2816b5b0 con 0x7fbc2808aa00 2023-05-24T03:32:00.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.013+0000 7fbc2d80e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc280b3300 con 0x7fbc2806d9e0 2023-05-24T03:32:00.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.014+0000 7fbc277fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc280cf4e0 0x7fbc280c71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:00.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.014+0000 7fbc26ffd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc2806d9e0 0x7fbc28200260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:00.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.014+0000 7fbc277fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc280cf4e0 0x7fbc280c71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40432/0 (socket says 172.21.15.146:40432) 2023-05-24T03:32:00.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.014+0000 7fbc277fe700 1 -- 172.21.15.146:0/2048542160 learned_addr learned my addr 172.21.15.146:0/2048542160 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:32:00.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.014+0000 7fbc267fc700 1 --2- 172.21.15.146:0/2048542160 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc2808aa00 0x7fbc281fe960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:00.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.014+0000 7fbc26ffd700 1 -- 172.21.15.146:0/2048542160 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc2808aa00 msgr2=0x7fbc281fe960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:00.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.014+0000 7fbc26ffd700 1 --2- 172.21.15.146:0/2048542160 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc2808aa00 0x7fbc281fe960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:00.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.014+0000 7fbc26ffd700 1 -- 172.21.15.146:0/2048542160 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc280cf4e0 msgr2=0x7fbc280c71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:00.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.014+0000 7fbc26ffd700 1 --2- 172.21.15.146:0/2048542160 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc280cf4e0 0x7fbc280c71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:00.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.014+0000 7fbc26ffd700 1 -- 172.21.15.146:0/2048542160 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc1c00d9f0 con 0x7fbc2806d9e0 2023-05-24T03:32:00.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.014+0000 7fbc267fc700 1 --2- 172.21.15.146:0/2048542160 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc2808aa00 0x7fbc281fe960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T03:32:00.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.014+0000 7fbc277fe700 1 --2- 172.21.15.146:0/2048542160 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc280cf4e0 0x7fbc280c71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T03:32:00.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.014+0000 7fbc26ffd700 1 --2- 172.21.15.146:0/2048542160 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc2806d9e0 0x7fbc28200260 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c012fb0 tx=0x7fbc1c0100c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:00.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.014+0000 7fbc0ffff700 1 -- 172.21.15.146:0/2048542160 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1c004230 con 0x7fbc2806d9e0 2023-05-24T03:32:00.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.014+0000 7fbc0ffff700 1 -- 172.21.15.146:0/2048542160 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc1c013040 con 0x7fbc2806d9e0 2023-05-24T03:32:00.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.014+0000 7fbc0ffff700 1 -- 172.21.15.146:0/2048542160 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1c004590 con 0x7fbc2806d9e0 2023-05-24T03:32:00.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.014+0000 7fbc2d80e700 1 -- 172.21.15.146:0/2048542160 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc1800b550 con 0x7fbc2806d9e0 2023-05-24T03:32:00.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.014+0000 7fbc2d80e700 1 -- 172.21.15.146:0/2048542160 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc2816d550 con 0x7fbc2806d9e0 2023-05-24T03:32:00.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.015+0000 7fbc2d80e700 1 -- 172.21.15.146:0/2048542160 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc2806cc10 con 0x7fbc2806d9e0 2023-05-24T03:32:00.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.016+0000 7fbc0ffff700 1 -- 172.21.15.146:0/2048542160 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbc1c010740 con 0x7fbc2806d9e0 2023-05-24T03:32:00.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.016+0000 7fbc0ffff700 1 --2- 172.21.15.146:0/2048542160 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fbc1406ace0 0x7fbc1406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:00.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.016+0000 7fbc0ffff700 1 -- 172.21.15.146:0/2048542160 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbc1c08d620 con 0x7fbc2806d9e0 2023-05-24T03:32:00.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.016+0000 7fbc267fc700 1 --2- 172.21.15.146:0/2048542160 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fbc1406ace0 0x7fbc1406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:00.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.017+0000 7fbc267fc700 1 --2- 172.21.15.146:0/2048542160 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fbc1406ace0 0x7fbc1406d190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbc18018040 tx=0x7fbc18008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:00.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.021+0000 7fbc0ffff700 1 -- 172.21.15.146:0/2048542160 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fbc1c058430 con 0x7fbc2806d9e0 2023-05-24T03:32:00.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.216+0000 7fbc2d80e700 1 -- 172.21.15.146:0/2048542160 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fbc2816e290 con 0x7fbc2806d9e0 2023-05-24T03:32:00.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.217+0000 7fbc0ffff700 1 -- 172.21.15.146:0/2048542160 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7fbc1c05ba50 con 0x7fbc2806d9e0 2023-05-24T03:32:00.222 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2023-05-24T03:32:00.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.219+0000 7fbc2d80e700 1 -- 172.21.15.146:0/2048542160 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fbc1406ace0 msgr2=0x7fbc1406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:00.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.219+0000 7fbc2d80e700 1 --2- 172.21.15.146:0/2048542160 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fbc1406ace0 0x7fbc1406d190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbc18018040 tx=0x7fbc18008040 comp rx=0 tx=0).stop 2023-05-24T03:32:00.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.219+0000 7fbc2d80e700 1 -- 172.21.15.146:0/2048542160 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc2806d9e0 msgr2=0x7fbc28200260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:00.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.219+0000 7fbc2d80e700 1 --2- 172.21.15.146:0/2048542160 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc2806d9e0 0x7fbc28200260 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c012fb0 tx=0x7fbc1c0100c0 comp rx=0 tx=0).stop 2023-05-24T03:32:00.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.219+0000 7fbc2d80e700 1 -- 172.21.15.146:0/2048542160 shutdown_connections 2023-05-24T03:32:00.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.219+0000 7fbc2d80e700 1 --2- 172.21.15.146:0/2048542160 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fbc1406ace0 0x7fbc1406d190 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:00.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.219+0000 7fbc2d80e700 1 --2- 172.21.15.146:0/2048542160 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc280cf4e0 0x7fbc280c71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:00.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.219+0000 7fbc2d80e700 1 --2- 172.21.15.146:0/2048542160 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc2806d9e0 0x7fbc28200260 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:00.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.219+0000 7fbc2d80e700 1 --2- 172.21.15.146:0/2048542160 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc2808aa00 0x7fbc281fe960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:00.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.219+0000 7fbc2d80e700 1 -- 172.21.15.146:0/2048542160 >> 172.21.15.146:0/2048542160 conn(0x7fbc280cc430 msgr2=0x7fbc280ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:32:00.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.219+0000 7fbc2d80e700 1 -- 172.21.15.146:0/2048542160 shutdown_connections 2023-05-24T03:32:00.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.219+0000 7fbc2d80e700 1 -- 172.21.15.146:0/2048542160 wait complete. 2023-05-24T03:32:00.236 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-24T03:32:00.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.354+0000 7fdad3c6a700 1 Processor -- start 2023-05-24T03:32:00.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.354+0000 7fdad3c6a700 1 -- start start 2023-05-24T03:32:00.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.355+0000 7fdad3c6a700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fdacc159310 0x7fdacc06b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:00.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.355+0000 7fdad3c6a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdacc0caeb0 0x7fdacc0afba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:00.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.355+0000 7fdad3c6a700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdacc06a6f0 con 0x7fdacc071bc0 2023-05-24T03:32:00.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.355+0000 7fdad3c6a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdacc06b8c0 con 0x7fdacc0caeb0 2023-05-24T03:32:00.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.355+0000 7fdad3c6a700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdacc070b20 con 0x7fdacc159310 2023-05-24T03:32:00.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.355+0000 7fdad2207700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdacc0caeb0 0x7fdacc0afba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:00.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.355+0000 7fdad2207700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdacc0caeb0 0x7fdacc0afba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40440/0 (socket says 172.21.15.146:40440) 2023-05-24T03:32:00.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.355+0000 7fdad2207700 1 -- 172.21.15.146:0/2447641875 learned_addr learned my addr 172.21.15.146:0/2447641875 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:32:00.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.355+0000 7fdad1a06700 1 --2- 172.21.15.146:0/2447641875 >> v2:172.21.15.151:3300/0 conn(0x7fdacc159310 0x7fdacc06b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:00.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.355+0000 7fdad2207700 1 -- 172.21.15.146:0/2447641875 >> v2:172.21.15.151:3300/0 conn(0x7fdacc159310 msgr2=0x7fdacc06b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:32:00.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.355+0000 7fdad2207700 1 --2- 172.21.15.146:0/2447641875 >> v2:172.21.15.151:3300/0 conn(0x7fdacc159310 0x7fdacc06b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:00.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.355+0000 7fdad2207700 1 -- 172.21.15.146:0/2447641875 >> v1:172.21.15.151:6789/0 conn(0x7fdacc071bc0 legacy=0x7fdacc0ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:32:00.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.355+0000 7fdad2207700 1 -- 172.21.15.146:0/2447641875 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdacc070e00 con 0x7fdacc0caeb0 2023-05-24T03:32:00.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.355+0000 7fdad2207700 1 --2- 172.21.15.146:0/2447641875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdacc0caeb0 0x7fdacc0afba0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fdacc0702b0 tx=0x7fdac400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a0588433a54fee4 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:00.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.355+0000 7fdad0a04700 1 -- 172.21.15.146:0/2447641875 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac400e070 con 0x7fdacc0caeb0 2023-05-24T03:32:00.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.355+0000 7fdad0a04700 1 -- 172.21.15.146:0/2447641875 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac4003a20 con 0x7fdacc0caeb0 2023-05-24T03:32:00.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.356+0000 7fdad0a04700 1 -- 172.21.15.146:0/2447641875 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac4003dd0 con 0x7fdacc0caeb0 2023-05-24T03:32:00.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.356+0000 7fdad3c6a700 1 -- 172.21.15.146:0/2447641875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdacc0caeb0 msgr2=0x7fdacc0afba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:00.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.356+0000 7fdad3c6a700 1 --2- 172.21.15.146:0/2447641875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdacc0caeb0 0x7fdacc0afba0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fdacc0702b0 tx=0x7fdac400b330 comp rx=0 tx=0).stop 2023-05-24T03:32:00.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.356+0000 7fdad3c6a700 1 -- 172.21.15.146:0/2447641875 shutdown_connections 2023-05-24T03:32:00.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.356+0000 7fdad3c6a700 1 --2- 172.21.15.146:0/2447641875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdacc0caeb0 0x7fdacc0afba0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:00.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.356+0000 7fdad3c6a700 1 --2- 172.21.15.146:0/2447641875 >> v2:172.21.15.151:3300/0 conn(0x7fdacc159310 0x7fdacc06b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:00.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.356+0000 7fdad3c6a700 1 -- 172.21.15.146:0/2447641875 >> 172.21.15.146:0/2447641875 conn(0x7fdacc0cf6c0 msgr2=0x7fdacc0cfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:32:00.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.356+0000 7fdad3c6a700 1 -- 172.21.15.146:0/2447641875 shutdown_connections 2023-05-24T03:32:00.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.356+0000 7fdad3c6a700 1 -- 172.21.15.146:0/2447641875 wait complete. 2023-05-24T03:32:00.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.357+0000 7fdad3c6a700 1 Processor -- start 2023-05-24T03:32:00.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.357+0000 7fdad3c6a700 1 -- start start 2023-05-24T03:32:00.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.358+0000 7fdad3c6a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdacc071bc0 0x7fdacc0c71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:00.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.358+0000 7fdad3c6a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdacc0caeb0 0x7fdacc157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:00.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.358+0000 7fdad3c6a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdacc159310 0x7fdacc0c5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:00.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.358+0000 7fdad3c6a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc15b150 con 0x7fdacc0caeb0 2023-05-24T03:32:00.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.358+0000 7fdad3c6a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc0c76e0 con 0x7fdacc071bc0 2023-05-24T03:32:00.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.358+0000 7fdad3c6a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc15ab40 con 0x7fdacc159310 2023-05-24T03:32:00.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.358+0000 7fdad1205700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdacc0caeb0 0x7fdacc157bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:00.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.358+0000 7fdad1205700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdacc0caeb0 0x7fdacc157bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40444/0 (socket says 172.21.15.146:40444) 2023-05-24T03:32:00.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.358+0000 7fdad1205700 1 -- 172.21.15.146:0/2145241111 learned_addr learned my addr 172.21.15.146:0/2145241111 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:32:00.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.358+0000 7fdad1a06700 1 --2- 172.21.15.146:0/2145241111 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdacc071bc0 0x7fdacc0c71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:00.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.358+0000 7fdad2207700 1 --2- 172.21.15.146:0/2145241111 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdacc159310 0x7fdacc0c5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:00.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.358+0000 7fdad1205700 1 -- 172.21.15.146:0/2145241111 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdacc159310 msgr2=0x7fdacc0c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:00.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.358+0000 7fdad1205700 1 --2- 172.21.15.146:0/2145241111 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdacc159310 0x7fdacc0c5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:00.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.358+0000 7fdad1205700 1 -- 172.21.15.146:0/2145241111 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdacc071bc0 msgr2=0x7fdacc0c71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:00.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.358+0000 7fdad1205700 1 --2- 172.21.15.146:0/2145241111 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdacc071bc0 0x7fdacc0c71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:00.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.358+0000 7fdad1205700 1 -- 172.21.15.146:0/2145241111 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac4009b30 con 0x7fdacc0caeb0 2023-05-24T03:32:00.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.358+0000 7fdad1a06700 1 --2- 172.21.15.146:0/2145241111 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdacc071bc0 0x7fdacc0c71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:32:00.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.359+0000 7fdad1205700 1 --2- 172.21.15.146:0/2145241111 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdacc0caeb0 0x7fdacc157bc0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fdabc00c500 tx=0x7fdabc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:00.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.359+0000 7fdac27fc700 1 -- 172.21.15.146:0/2145241111 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdabc011790 con 0x7fdacc0caeb0 2023-05-24T03:32:00.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.359+0000 7fdac27fc700 1 -- 172.21.15.146:0/2145241111 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdabc0118f0 con 0x7fdacc0caeb0 2023-05-24T03:32:00.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.359+0000 7fdac27fc700 1 -- 172.21.15.146:0/2145241111 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdabc011ca0 con 0x7fdacc0caeb0 2023-05-24T03:32:00.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.359+0000 7fdad3c6a700 1 -- 172.21.15.146:0/2145241111 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdacc0713c0 con 0x7fdacc0caeb0 2023-05-24T03:32:00.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.359+0000 7fdad3c6a700 1 -- 172.21.15.146:0/2145241111 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdacc0710e0 con 0x7fdacc0caeb0 2023-05-24T03:32:00.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.360+0000 7fdad3c6a700 1 -- 172.21.15.146:0/2145241111 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdacc0716a0 con 0x7fdacc0caeb0 2023-05-24T03:32:00.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.360+0000 7fdac27fc700 1 -- 172.21.15.146:0/2145241111 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdabc01c460 con 0x7fdacc0caeb0 2023-05-24T03:32:00.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.360+0000 7fdac27fc700 1 --2- 172.21.15.146:0/2145241111 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fdab006ace0 0x7fdab006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:00.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.361+0000 7fdac27fc700 1 -- 172.21.15.146:0/2145241111 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdabc089650 con 0x7fdacc0caeb0 2023-05-24T03:32:00.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.361+0000 7fdad1a06700 1 --2- 172.21.15.146:0/2145241111 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fdab006ace0 0x7fdab006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:00.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.361+0000 7fdad1a06700 1 --2- 172.21.15.146:0/2145241111 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fdab006ace0 0x7fdab006d190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdac8009820 tx=0x7fdac8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:00.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.365+0000 7fdac27fc700 1 -- 172.21.15.146:0/2145241111 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fdabc0543d0 con 0x7fdacc0caeb0 2023-05-24T03:32:00.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.575+0000 7fdad3c6a700 1 -- 172.21.15.146:0/2145241111 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fdacc15b300 con 0x7fdacc0caeb0 2023-05-24T03:32:00.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.575+0000 7fdac27fc700 1 -- 172.21.15.146:0/2145241111 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v30) v1 ==== 80+0+0 (secure 0 0 0) 0x7fdacc15b300 con 0x7fdacc0caeb0 2023-05-24T03:32:00.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.577+0000 7fdad3c6a700 1 -- 172.21.15.146:0/2145241111 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fdab006ace0 msgr2=0x7fdab006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:00.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.577+0000 7fdad3c6a700 1 --2- 172.21.15.146:0/2145241111 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fdab006ace0 0x7fdab006d190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdac8009820 tx=0x7fdac8008040 comp rx=0 tx=0).stop 2023-05-24T03:32:00.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.577+0000 7fdad3c6a700 1 -- 172.21.15.146:0/2145241111 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdacc0caeb0 msgr2=0x7fdacc157bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:00.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.577+0000 7fdad3c6a700 1 --2- 172.21.15.146:0/2145241111 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdacc0caeb0 0x7fdacc157bc0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fdabc00c500 tx=0x7fdabc00c8c0 comp rx=0 tx=0).stop 2023-05-24T03:32:00.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.577+0000 7fdad3c6a700 1 -- 172.21.15.146:0/2145241111 shutdown_connections 2023-05-24T03:32:00.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.577+0000 7fdad3c6a700 1 --2- 172.21.15.146:0/2145241111 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fdab006ace0 0x7fdab006d190 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:00.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.577+0000 7fdad3c6a700 1 --2- 172.21.15.146:0/2145241111 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdacc159310 0x7fdacc0c5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:00.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.577+0000 7fdad3c6a700 1 --2- 172.21.15.146:0/2145241111 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdacc071bc0 0x7fdacc0c71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:00.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.577+0000 7fdad3c6a700 1 --2- 172.21.15.146:0/2145241111 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdacc0caeb0 0x7fdacc157bc0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:00.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.577+0000 7fdad3c6a700 1 -- 172.21.15.146:0/2145241111 >> 172.21.15.146:0/2145241111 conn(0x7fdacc0cf6c0 msgr2=0x7fdacc0cd200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:32:00.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.578+0000 7fdad3c6a700 1 -- 172.21.15.146:0/2145241111 shutdown_connections 2023-05-24T03:32:00.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:00.578+0000 7fdad3c6a700 1 -- 172.21.15.146:0/2145241111 wait complete. 2023-05-24T03:32:00.585 INFO:teuthology.orchestra.run.smithi146.stderr:listed 0 entries 2023-05-24T03:32:00.594 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-05-24T03:32:00.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:32:00.595 DEBUG:teuthology.orchestra.run.smithi151:> sudo umount /home/ubuntu/cephtest/mnt.3 2023-05-24T03:32:00.731 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-05-24T03:32:00.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:32:00.732 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-05-24T03:32:00.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:32:00.765 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2023-05-24T03:32:00.783 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-05-24T03:32:00.783 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-05-24T03:32:00.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:32:00.784 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-05-24T03:32:00.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:32:00.862 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-24T03:32:00.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:32:00.943 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link delete ceph-brx 2023-05-24T03:32:01.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:32:01.094 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2023-05-24T03:32:01.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:32:01.111 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link delete ceph-brx 2023-05-24T03:32:01.181 INFO:teuthology.orchestra.run.smithi146.stderr:Cannot find device "ceph-brx" 2023-05-24T03:32:01.182 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-24T03:32:01.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:32:01.183 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2023-05-24T03:32:01.206 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-05-24T03:32:01.206 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-05-24T03:32:01.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:32:01.208 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-05-24T03:32:01.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:32:01.289 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-05-24T03:32:01.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:32:01.379 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link delete ceph-brx 2023-05-24T03:32:01.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:32:01.489 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2023-05-24T03:32:01.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-24T03:32:01.508 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link delete ceph-brx 2023-05-24T03:32:01.576 INFO:teuthology.orchestra.run.smithi151.stderr:Cannot find device "ceph-brx" 2023-05-24T03:32:01.577 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-24T03:32:01.578 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-05-24T03:32:01.588 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-05-24T03:32:01.589 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-24T03:32:01.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.733+0000 7fb32b114700 1 Processor -- start 2023-05-24T03:32:01.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.733+0000 7fb32b114700 1 -- start start 2023-05-24T03:32:01.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.734+0000 7fb32b114700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb3240b49f0 0x7fb3240710d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:01.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.734+0000 7fb32b114700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb3240b0b80 0x7fb3240ca990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:01.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.734+0000 7fb32b114700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb3240b1020 0x7fb3240caed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:01.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.734+0000 7fb32b114700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3240b4dc0 con 0x7fb3240b0b80 2023-05-24T03:32:01.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.734+0000 7fb32b114700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb32406ce60 con 0x7fb3240b49f0 2023-05-24T03:32:01.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.734+0000 7fb32b114700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb32406c2e0 con 0x7fb3240b1020 2023-05-24T03:32:01.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.734+0000 7fb323fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb3240b0b80 0x7fb3240ca990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:01.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.734+0000 7fb323fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb3240b0b80 0x7fb3240ca990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40450/0 (socket says 172.21.15.146:40450) 2023-05-24T03:32:01.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.734+0000 7fb323fff700 1 -- 172.21.15.146:0/1132725326 learned_addr learned my addr 172.21.15.146:0/1132725326 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:32:01.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.734+0000 7fb328eb0700 1 --2- 172.21.15.146:0/1132725326 >> v2:172.21.15.151:3300/0 conn(0x7fb3240b49f0 0x7fb3240710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:01.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.734+0000 7fb3296b1700 1 --2- 172.21.15.146:0/1132725326 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb3240b1020 0x7fb3240caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:01.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.735+0000 7fb323fff700 1 -- 172.21.15.146:0/1132725326 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb3240b1020 msgr2=0x7fb3240caed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:32:01.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.735+0000 7fb323fff700 1 --2- 172.21.15.146:0/1132725326 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb3240b1020 0x7fb3240caed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:01.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.735+0000 7fb323fff700 1 -- 172.21.15.146:0/1132725326 >> v2:172.21.15.151:3300/0 conn(0x7fb3240b49f0 msgr2=0x7fb3240710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:32:01.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.735+0000 7fb323fff700 1 --2- 172.21.15.146:0/1132725326 >> v2:172.21.15.151:3300/0 conn(0x7fb3240b49f0 0x7fb3240710d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:01.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.735+0000 7fb323fff700 1 -- 172.21.15.146:0/1132725326 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb32406c5c0 con 0x7fb3240b0b80 2023-05-24T03:32:01.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.735+0000 7fb323fff700 1 --2- 172.21.15.146:0/1132725326 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3240b0b80 0x7fb3240ca990 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb3100098f0 tx=0x7fb310009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fec72c72915589b8 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:01.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.735+0000 7fb3237fe700 1 -- 172.21.15.146:0/1132725326 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb310011830 con 0x7fb3240b0b80 2023-05-24T03:32:01.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.735+0000 7fb3237fe700 1 -- 172.21.15.146:0/1132725326 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb310011990 con 0x7fb3240b0b80 2023-05-24T03:32:01.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.735+0000 7fb3237fe700 1 -- 172.21.15.146:0/1132725326 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb310011d20 con 0x7fb3240b0b80 2023-05-24T03:32:01.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.735+0000 7fb32b114700 1 -- 172.21.15.146:0/1132725326 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3240b0b80 msgr2=0x7fb3240ca990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:01.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.735+0000 7fb32b114700 1 --2- 172.21.15.146:0/1132725326 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3240b0b80 0x7fb3240ca990 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb3100098f0 tx=0x7fb310009c00 comp rx=0 tx=0).stop 2023-05-24T03:32:01.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.735+0000 7fb32b114700 1 -- 172.21.15.146:0/1132725326 shutdown_connections 2023-05-24T03:32:01.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.736+0000 7fb32b114700 1 --2- 172.21.15.146:0/1132725326 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb3240b1020 0x7fb3240caed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:01.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.736+0000 7fb32b114700 1 --2- 172.21.15.146:0/1132725326 >> v2:172.21.15.151:3300/0 conn(0x7fb3240b49f0 0x7fb3240710d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:01.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.736+0000 7fb32b114700 1 --2- 172.21.15.146:0/1132725326 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3240b0b80 0x7fb3240ca990 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:01.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.736+0000 7fb32b114700 1 -- 172.21.15.146:0/1132725326 >> 172.21.15.146:0/1132725326 conn(0x7fb32406b0b0 msgr2=0x7fb3240cedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:32:01.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.736+0000 7fb32b114700 1 -- 172.21.15.146:0/1132725326 shutdown_connections 2023-05-24T03:32:01.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.736+0000 7fb32b114700 1 -- 172.21.15.146:0/1132725326 wait complete. 2023-05-24T03:32:01.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.737+0000 7fb32b114700 1 Processor -- start 2023-05-24T03:32:01.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.737+0000 7fb32b114700 1 -- start start 2023-05-24T03:32:01.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.738+0000 7fb32b114700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb3240b0b80 0x7fb3240c6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:01.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.738+0000 7fb32b114700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3240b1020 0x7fb32414d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:01.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.738+0000 7fb32b114700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb3240b49f0 0x7fb3240c9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:01.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.738+0000 7fb32b114700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3240c82a0 con 0x7fb3240b1020 2023-05-24T03:32:01.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.738+0000 7fb32b114700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3240c8730 con 0x7fb3240b0b80 2023-05-24T03:32:01.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.738+0000 7fb32b114700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3240c7690 con 0x7fb3240b49f0 2023-05-24T03:32:01.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.738+0000 7fb323fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3240b1020 0x7fb32414d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:01.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.738+0000 7fb323fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3240b1020 0x7fb32414d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40458/0 (socket says 172.21.15.146:40458) 2023-05-24T03:32:01.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.738+0000 7fb323fff700 1 -- 172.21.15.146:0/188623938 learned_addr learned my addr 172.21.15.146:0/188623938 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:32:01.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.738+0000 7fb3296b1700 1 --2- 172.21.15.146:0/188623938 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb3240b49f0 0x7fb3240c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:01.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.738+0000 7fb328eb0700 1 --2- 172.21.15.146:0/188623938 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb3240b0b80 0x7fb3240c6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:01.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.738+0000 7fb323fff700 1 -- 172.21.15.146:0/188623938 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb3240b49f0 msgr2=0x7fb3240c9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:01.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.738+0000 7fb323fff700 1 --2- 172.21.15.146:0/188623938 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb3240b49f0 0x7fb3240c9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:01.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.738+0000 7fb323fff700 1 -- 172.21.15.146:0/188623938 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb3240b0b80 msgr2=0x7fb3240c6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:01.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.738+0000 7fb323fff700 1 --2- 172.21.15.146:0/188623938 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb3240b0b80 0x7fb3240c6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:01.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.738+0000 7fb323fff700 1 -- 172.21.15.146:0/188623938 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb310009550 con 0x7fb3240b1020 2023-05-24T03:32:01.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.739+0000 7fb323fff700 1 --2- 172.21.15.146:0/188623938 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3240b1020 0x7fb32414d3e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb310009c40 tx=0x7fb310004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:01.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.739+0000 7fb3217fa700 1 -- 172.21.15.146:0/188623938 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb310004450 con 0x7fb3240b1020 2023-05-24T03:32:01.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.739+0000 7fb3217fa700 1 -- 172.21.15.146:0/188623938 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb31001e070 con 0x7fb3240b1020 2023-05-24T03:32:01.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.739+0000 7fb32b114700 1 -- 172.21.15.146:0/188623938 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb32406cb80 con 0x7fb3240b1020 2023-05-24T03:32:01.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.739+0000 7fb3217fa700 1 -- 172.21.15.146:0/188623938 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3100038e0 con 0x7fb3240b1020 2023-05-24T03:32:01.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.739+0000 7fb32b114700 1 -- 172.21.15.146:0/188623938 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb32406c8a0 con 0x7fb3240b1020 2023-05-24T03:32:01.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.740+0000 7fb32b114700 1 -- 172.21.15.146:0/188623938 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb324071610 con 0x7fb3240b1020 2023-05-24T03:32:01.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.740+0000 7fb3217fa700 1 -- 172.21.15.146:0/188623938 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb310003a40 con 0x7fb3240b1020 2023-05-24T03:32:01.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.740+0000 7fb3217fa700 1 --2- 172.21.15.146:0/188623938 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fb30806ace0 0x7fb30806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:01.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.741+0000 7fb3217fa700 1 -- 172.21.15.146:0/188623938 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb31008a4c0 con 0x7fb3240b1020 2023-05-24T03:32:01.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.741+0000 7fb328eb0700 1 --2- 172.21.15.146:0/188623938 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fb30806ace0 0x7fb30806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:01.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.741+0000 7fb328eb0700 1 --2- 172.21.15.146:0/188623938 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fb30806ace0 0x7fb30806d190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb318009be0 tx=0x7fb318009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:01.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.745+0000 7fb3217fa700 1 -- 172.21.15.146:0/188623938 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fb310055240 con 0x7fb3240b1020 2023-05-24T03:32:01.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.930+0000 7fb32b114700 1 -- 172.21.15.146:0/188623938 --> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb3240ca7d0 con 0x7fb30806ace0 2023-05-24T03:32:01.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.941+0000 7fb3217fa700 1 -- 172.21.15.146:0/188623938 <== mgr.4104 v2:172.21.15.146:6832/1985394169 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+391935 (secure 0 0 0) 0x7fb3240ca7d0 con 0x7fb30806ace0 2023-05-24T03:32:01.952 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:32:01.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.945+0000 7fb32b114700 1 -- 172.21.15.146:0/188623938 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fb30806ace0 msgr2=0x7fb30806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:01.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.945+0000 7fb32b114700 1 --2- 172.21.15.146:0/188623938 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fb30806ace0 0x7fb30806d190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb318009be0 tx=0x7fb318009210 comp rx=0 tx=0).stop 2023-05-24T03:32:01.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.945+0000 7fb32b114700 1 -- 172.21.15.146:0/188623938 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3240b1020 msgr2=0x7fb32414d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:01.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.945+0000 7fb32b114700 1 --2- 172.21.15.146:0/188623938 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3240b1020 0x7fb32414d3e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb310009c40 tx=0x7fb310004750 comp rx=0 tx=0).stop 2023-05-24T03:32:01.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.945+0000 7fb32b114700 1 -- 172.21.15.146:0/188623938 shutdown_connections 2023-05-24T03:32:01.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.945+0000 7fb32b114700 1 --2- 172.21.15.146:0/188623938 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fb30806ace0 0x7fb30806d190 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:01.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.945+0000 7fb32b114700 1 --2- 172.21.15.146:0/188623938 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb3240b49f0 0x7fb3240c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:01.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.945+0000 7fb32b114700 1 --2- 172.21.15.146:0/188623938 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb3240b0b80 0x7fb3240c6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:01.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.945+0000 7fb32b114700 1 --2- 172.21.15.146:0/188623938 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3240b1020 0x7fb32414d3e0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:01.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.945+0000 7fb32b114700 1 -- 172.21.15.146:0/188623938 >> 172.21.15.146:0/188623938 conn(0x7fb32406b0b0 msgr2=0x7fb3240b2530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:32:01.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.945+0000 7fb32b114700 1 -- 172.21.15.146:0/188623938 shutdown_connections 2023-05-24T03:32:01.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:01.945+0000 7fb32b114700 1 -- 172.21.15.146:0/188623938 wait complete. 2023-05-24T03:32:01.958 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-05-24T03:32:01.962 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":98,"stamp":"2023-05-24T03:32:00.791562+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":264132012,"num_objects":89,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":126,"num_read_kb":114,"num_write":920,"num_write_kb":816086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16301,"ondisk_log_size":16301,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":717680,"kb_used_data":518512,"kb_used_omap":0,"kb_used_meta":199104,"kb_avail":754257040,"statfs":{"total":773094113280,"available":772359208960,"internally_reserved":0,"allocated":530956288,"data_stored":529374792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":203882496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,1,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-162252769,"num_objects":-40,"num_object_clones":0,"num_object_copies":-160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-40,"num_whiteouts":0,"num_read":7,"num_read_kb":11,"num_write":334,"num_write_kb":397645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003136"},"pg_stats":[{"pgid":"4.3f","version":"30'15","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.039569+0000","last_change":"2023-05-24T03:29:44.490120+0000","last_active":"2023-05-24T03:31:55.039569+0000","last_peered":"2023-05-24T03:31:55.039569+0000","last_clean":"2023-05-24T03:31:55.039569+0000","last_became_active":"2023-05-24T03:29:44.489854+0000","last_became_peered":"2023-05-24T03:29:44.489854+0000","last_unstale":"2023-05-24T03:31:55.039569+0000","last_undegraded":"2023-05-24T03:31:55.039569+0000","last_fullsized":"2023-05-24T03:31:55.039569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:27:13.487917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"30'11","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.032618+0000","last_change":"2023-05-24T03:29:44.495973+0000","last_active":"2023-05-24T03:31:55.032618+0000","last_peered":"2023-05-24T03:31:55.032618+0000","last_clean":"2023-05-24T03:31:55.032618+0000","last_became_active":"2023-05-24T03:29:44.495700+0000","last_became_peered":"2023-05-24T03:29:44.495700+0000","last_unstale":"2023-05-24T03:31:55.032618+0000","last_undegraded":"2023-05-24T03:31:55.032618+0000","last_fullsized":"2023-05-24T03:31:55.032618+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:46:55.999454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"30'22","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.047990+0000","last_change":"2023-05-24T03:29:44.499947+0000","last_active":"2023-05-24T03:31:55.047990+0000","last_peered":"2023-05-24T03:31:55.047990+0000","last_clean":"2023-05-24T03:31:55.047990+0000","last_became_active":"2023-05-24T03:29:44.499663+0000","last_became_peered":"2023-05-24T03:29:44.499663+0000","last_unstale":"2023-05-24T03:31:55.047990+0000","last_undegraded":"2023-05-24T03:31:55.047990+0000","last_fullsized":"2023-05-24T03:31:55.047990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:31:12.011318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"30'14","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.035675+0000","last_change":"2023-05-24T03:29:44.498790+0000","last_active":"2023-05-24T03:31:55.035675+0000","last_peered":"2023-05-24T03:31:55.035675+0000","last_clean":"2023-05-24T03:31:55.035675+0000","last_became_active":"2023-05-24T03:29:44.498528+0000","last_became_peered":"2023-05-24T03:29:44.498528+0000","last_unstale":"2023-05-24T03:31:55.035675+0000","last_undegraded":"2023-05-24T03:31:55.035675+0000","last_fullsized":"2023-05-24T03:31:55.035675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:14:55.806370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"30'14","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.049414+0000","last_change":"2023-05-24T03:29:44.504225+0000","last_active":"2023-05-24T03:31:55.049414+0000","last_peered":"2023-05-24T03:31:55.049414+0000","last_clean":"2023-05-24T03:31:55.049414+0000","last_became_active":"2023-05-24T03:29:44.503998+0000","last_became_peered":"2023-05-24T03:29:44.503998+0000","last_unstale":"2023-05-24T03:31:55.049414+0000","last_undegraded":"2023-05-24T03:31:55.049414+0000","last_fullsized":"2023-05-24T03:31:55.049414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:10:14.605046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"30'20","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.049421+0000","last_change":"2023-05-24T03:29:44.500355+0000","last_active":"2023-05-24T03:31:55.049421+0000","last_peered":"2023-05-24T03:31:55.049421+0000","last_clean":"2023-05-24T03:31:55.049421+0000","last_became_active":"2023-05-24T03:29:44.500065+0000","last_became_peered":"2023-05-24T03:29:44.500065+0000","last_unstale":"2023-05-24T03:31:55.049421+0000","last_undegraded":"2023-05-24T03:31:55.049421+0000","last_fullsized":"2023-05-24T03:31:55.049421+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T03:45:21.255320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"30'12","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.033420+0000","last_change":"2023-05-24T03:29:44.499607+0000","last_active":"2023-05-24T03:31:55.033420+0000","last_peered":"2023-05-24T03:31:55.033420+0000","last_clean":"2023-05-24T03:31:55.033420+0000","last_became_active":"2023-05-24T03:29:44.499324+0000","last_became_peered":"2023-05-24T03:29:44.499324+0000","last_unstale":"2023-05-24T03:31:55.033420+0000","last_undegraded":"2023-05-24T03:31:55.033420+0000","last_fullsized":"2023-05-24T03:31:55.033420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:11:59.800632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"30'18","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.036835+0000","last_change":"2023-05-24T03:29:44.500576+0000","last_active":"2023-05-24T03:31:55.036835+0000","last_peered":"2023-05-24T03:31:55.036835+0000","last_clean":"2023-05-24T03:31:55.036835+0000","last_became_active":"2023-05-24T03:29:44.500260+0000","last_became_peered":"2023-05-24T03:29:44.500260+0000","last_unstale":"2023-05-24T03:31:55.036835+0000","last_undegraded":"2023-05-24T03:31:55.036835+0000","last_fullsized":"2023-05-24T03:31:55.036835+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:52:06.913754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"30'25","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.049023+0000","last_change":"2023-05-24T03:29:44.502655+0000","last_active":"2023-05-24T03:31:55.049023+0000","last_peered":"2023-05-24T03:31:55.049023+0000","last_clean":"2023-05-24T03:31:55.049023+0000","last_became_active":"2023-05-24T03:29:44.502341+0000","last_became_peered":"2023-05-24T03:29:44.502341+0000","last_unstale":"2023-05-24T03:31:55.049023+0000","last_undegraded":"2023-05-24T03:31:55.049023+0000","last_fullsized":"2023-05-24T03:31:55.049023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:28:43.398723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"30'23","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.050363+0000","last_change":"2023-05-24T03:29:44.500505+0000","last_active":"2023-05-24T03:31:55.050363+0000","last_peered":"2023-05-24T03:31:55.050363+0000","last_clean":"2023-05-24T03:31:55.050363+0000","last_became_active":"2023-05-24T03:29:44.500156+0000","last_became_peered":"2023-05-24T03:29:44.500156+0000","last_unstale":"2023-05-24T03:31:55.050363+0000","last_undegraded":"2023-05-24T03:31:55.050363+0000","last_fullsized":"2023-05-24T03:31:55.050363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:34:40.725013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"30'13","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.034757+0000","last_change":"2023-05-24T03:29:44.492850+0000","last_active":"2023-05-24T03:31:55.034757+0000","last_peered":"2023-05-24T03:31:55.034757+0000","last_clean":"2023-05-24T03:31:55.034757+0000","last_became_active":"2023-05-24T03:29:44.492573+0000","last_became_peered":"2023-05-24T03:29:44.492573+0000","last_unstale":"2023-05-24T03:31:55.034757+0000","last_undegraded":"2023-05-24T03:31:55.034757+0000","last_fullsized":"2023-05-24T03:31:55.034757+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:25:03.563573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"30'13","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.038097+0000","last_change":"2023-05-24T03:29:44.501565+0000","last_active":"2023-05-24T03:31:55.038097+0000","last_peered":"2023-05-24T03:31:55.038097+0000","last_clean":"2023-05-24T03:31:55.038097+0000","last_became_active":"2023-05-24T03:29:44.501371+0000","last_became_peered":"2023-05-24T03:29:44.501371+0000","last_unstale":"2023-05-24T03:31:55.038097+0000","last_undegraded":"2023-05-24T03:31:55.038097+0000","last_fullsized":"2023-05-24T03:31:55.038097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:31:52.511256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"30'23","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.042174+0000","last_change":"2023-05-24T03:29:44.490972+0000","last_active":"2023-05-24T03:31:55.042174+0000","last_peered":"2023-05-24T03:31:55.042174+0000","last_clean":"2023-05-24T03:31:55.042174+0000","last_became_active":"2023-05-24T03:29:44.490411+0000","last_became_peered":"2023-05-24T03:29:44.490411+0000","last_unstale":"2023-05-24T03:31:55.042174+0000","last_undegraded":"2023-05-24T03:31:55.042174+0000","last_fullsized":"2023-05-24T03:31:55.042174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:20:09.308993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"30'16","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.040913+0000","last_change":"2023-05-24T03:29:44.495213+0000","last_active":"2023-05-24T03:31:55.040913+0000","last_peered":"2023-05-24T03:31:55.040913+0000","last_clean":"2023-05-24T03:31:55.040913+0000","last_became_active":"2023-05-24T03:29:44.494879+0000","last_became_peered":"2023-05-24T03:29:44.494879+0000","last_unstale":"2023-05-24T03:31:55.040913+0000","last_undegraded":"2023-05-24T03:31:55.040913+0000","last_fullsized":"2023-05-24T03:31:55.040913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:21:01.901695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"30'16","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.033525+0000","last_change":"2023-05-24T03:29:44.499673+0000","last_active":"2023-05-24T03:31:55.033525+0000","last_peered":"2023-05-24T03:31:55.033525+0000","last_clean":"2023-05-24T03:31:55.033525+0000","last_became_active":"2023-05-24T03:29:44.499393+0000","last_became_peered":"2023-05-24T03:29:44.499393+0000","last_unstale":"2023-05-24T03:31:55.033525+0000","last_undegraded":"2023-05-24T03:31:55.033525+0000","last_fullsized":"2023-05-24T03:31:55.033525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:36:39.587451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"30'19","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.046546+0000","last_change":"2023-05-24T03:29:44.501101+0000","last_active":"2023-05-24T03:31:55.046546+0000","last_peered":"2023-05-24T03:31:55.046546+0000","last_clean":"2023-05-24T03:31:55.046546+0000","last_became_active":"2023-05-24T03:29:44.500818+0000","last_became_peered":"2023-05-24T03:29:44.500818+0000","last_unstale":"2023-05-24T03:31:55.046546+0000","last_undegraded":"2023-05-24T03:31:55.046546+0000","last_fullsized":"2023-05-24T03:31:55.046546+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:13:18.627969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"30'18","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.049373+0000","last_change":"2023-05-24T03:29:44.500209+0000","last_active":"2023-05-24T03:31:55.049373+0000","last_peered":"2023-05-24T03:31:55.049373+0000","last_clean":"2023-05-24T03:31:55.049373+0000","last_became_active":"2023-05-24T03:29:44.499543+0000","last_became_peered":"2023-05-24T03:29:44.499543+0000","last_unstale":"2023-05-24T03:31:55.049373+0000","last_undegraded":"2023-05-24T03:31:55.049373+0000","last_fullsized":"2023-05-24T03:31:55.049373+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:29:00.326985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"30'17","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.038410+0000","last_change":"2023-05-24T03:29:44.492545+0000","last_active":"2023-05-24T03:31:55.038410+0000","last_peered":"2023-05-24T03:31:55.038410+0000","last_clean":"2023-05-24T03:31:55.038410+0000","last_became_active":"2023-05-24T03:29:44.492109+0000","last_became_peered":"2023-05-24T03:29:44.492109+0000","last_unstale":"2023-05-24T03:31:55.038410+0000","last_undegraded":"2023-05-24T03:31:55.038410+0000","last_fullsized":"2023-05-24T03:31:55.038410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:22:07.073049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"30'16","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.037665+0000","last_change":"2023-05-24T03:29:44.480834+0000","last_active":"2023-05-24T03:31:55.037665+0000","last_peered":"2023-05-24T03:31:55.037665+0000","last_clean":"2023-05-24T03:31:55.037665+0000","last_became_active":"2023-05-24T03:29:44.480597+0000","last_became_peered":"2023-05-24T03:29:44.480597+0000","last_unstale":"2023-05-24T03:31:55.037665+0000","last_undegraded":"2023-05-24T03:31:55.037665+0000","last_fullsized":"2023-05-24T03:31:55.037665+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:44:17.635928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"30'17","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.035390+0000","last_change":"2023-05-24T03:29:44.501003+0000","last_active":"2023-05-24T03:31:55.035390+0000","last_peered":"2023-05-24T03:31:55.035390+0000","last_clean":"2023-05-24T03:31:55.035390+0000","last_became_active":"2023-05-24T03:29:44.499405+0000","last_became_peered":"2023-05-24T03:29:44.499405+0000","last_unstale":"2023-05-24T03:31:55.035390+0000","last_undegraded":"2023-05-24T03:31:55.035390+0000","last_fullsized":"2023-05-24T03:31:55.035390+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:32:47.250786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"30'25","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.039028+0000","last_change":"2023-05-24T03:30:26.106086+0000","last_active":"2023-05-24T03:31:55.039028+0000","last_peered":"2023-05-24T03:31:55.039028+0000","last_clean":"2023-05-24T03:31:55.039028+0000","last_became_active":"2023-05-24T03:30:26.105858+0000","last_became_peered":"2023-05-24T03:30:26.105858+0000","last_unstale":"2023-05-24T03:31:55.039028+0000","last_undegraded":"2023-05-24T03:31:55.039028+0000","last_fullsized":"2023-05-24T03:31:55.039028+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:03:29.813763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"30'16","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.047093+0000","last_change":"2023-05-24T03:29:44.498675+0000","last_active":"2023-05-24T03:31:55.047093+0000","last_peered":"2023-05-24T03:31:55.047093+0000","last_clean":"2023-05-24T03:31:55.047093+0000","last_became_active":"2023-05-24T03:29:44.498463+0000","last_became_peered":"2023-05-24T03:29:44.498463+0000","last_unstale":"2023-05-24T03:31:55.047093+0000","last_undegraded":"2023-05-24T03:31:55.047093+0000","last_fullsized":"2023-05-24T03:31:55.047093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:36:39.587451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"30'21","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.049431+0000","last_change":"2023-05-24T03:29:44.500169+0000","last_active":"2023-05-24T03:31:55.049431+0000","last_peered":"2023-05-24T03:31:55.049431+0000","last_clean":"2023-05-24T03:31:55.049431+0000","last_became_active":"2023-05-24T03:29:44.499960+0000","last_became_peered":"2023-05-24T03:29:44.499960+0000","last_unstale":"2023-05-24T03:31:55.049431+0000","last_undegraded":"2023-05-24T03:31:55.049431+0000","last_fullsized":"2023-05-24T03:31:55.049431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:06:19.223766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"30'12","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.038999+0000","last_change":"2023-05-24T03:29:44.499015+0000","last_active":"2023-05-24T03:31:55.038999+0000","last_peered":"2023-05-24T03:31:55.038999+0000","last_clean":"2023-05-24T03:31:55.038999+0000","last_became_active":"2023-05-24T03:29:44.498437+0000","last_became_peered":"2023-05-24T03:29:44.498437+0000","last_unstale":"2023-05-24T03:31:55.038999+0000","last_undegraded":"2023-05-24T03:31:55.038999+0000","last_fullsized":"2023-05-24T03:31:55.038999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:00:20.978451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"30'8","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.031323+0000","last_change":"2023-05-24T03:29:44.481162+0000","last_active":"2023-05-24T03:31:55.031323+0000","last_peered":"2023-05-24T03:31:55.031323+0000","last_clean":"2023-05-24T03:31:55.031323+0000","last_became_active":"2023-05-24T03:29:44.481004+0000","last_became_peered":"2023-05-24T03:29:44.481004+0000","last_unstale":"2023-05-24T03:31:55.031323+0000","last_undegraded":"2023-05-24T03:31:55.031323+0000","last_fullsized":"2023-05-24T03:31:55.031323+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:36:39.587451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"30'26","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.038979+0000","last_change":"2023-05-24T03:29:44.481942+0000","last_active":"2023-05-24T03:31:55.038979+0000","last_peered":"2023-05-24T03:31:55.038979+0000","last_clean":"2023-05-24T03:31:55.038979+0000","last_became_active":"2023-05-24T03:29:44.481686+0000","last_became_peered":"2023-05-24T03:29:44.481686+0000","last_unstale":"2023-05-24T03:31:55.038979+0000","last_undegraded":"2023-05-24T03:31:55.038979+0000","last_fullsized":"2023-05-24T03:31:55.038979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:24:47.939385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"30'9","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.032829+0000","last_change":"2023-05-24T03:29:44.502948+0000","last_active":"2023-05-24T03:31:55.032829+0000","last_peered":"2023-05-24T03:31:55.032829+0000","last_clean":"2023-05-24T03:31:55.032829+0000","last_became_active":"2023-05-24T03:29:44.502669+0000","last_became_peered":"2023-05-24T03:29:44.502669+0000","last_unstale":"2023-05-24T03:31:55.032829+0000","last_undegraded":"2023-05-24T03:31:55.032829+0000","last_fullsized":"2023-05-24T03:31:55.032829+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:03:29.813763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"30'471","reported_seq":488,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.910749+0000","last_change":"2023-05-24T03:29:48.523138+0000","last_active":"2023-05-24T03:31:54.910749+0000","last_peered":"2023-05-24T03:31:54.910749+0000","last_clean":"2023-05-24T03:31:54.910749+0000","last_became_active":"2023-05-24T03:29:48.522749+0000","last_became_peered":"2023-05-24T03:29:48.522749+0000","last_unstale":"2023-05-24T03:31:54.910749+0000","last_undegraded":"2023-05-24T03:31:54.910749+0000","last_fullsized":"2023-05-24T03:31:54.910749+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:02:45.564369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.945993+0000","last_change":"2023-05-24T03:29:44.086543+0000","last_active":"2023-05-24T03:30:25.945993+0000","last_peered":"2023-05-24T03:30:25.945993+0000","last_clean":"2023-05-24T03:30:25.945993+0000","last_became_active":"2023-05-24T03:29:44.086143+0000","last_became_peered":"2023-05-24T03:29:44.086143+0000","last_unstale":"2023-05-24T03:30:25.945993+0000","last_undegraded":"2023-05-24T03:30:25.945993+0000","last_fullsized":"2023-05-24T03:30:25.945993+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:45:41.681638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'25","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.039276+0000","last_change":"2023-05-24T03:29:44.491005+0000","last_active":"2023-05-24T03:31:55.039276+0000","last_peered":"2023-05-24T03:31:55.039276+0000","last_clean":"2023-05-24T03:31:55.039276+0000","last_became_active":"2023-05-24T03:29:44.490772+0000","last_became_peered":"2023-05-24T03:29:44.490772+0000","last_unstale":"2023-05-24T03:31:55.039276+0000","last_undegraded":"2023-05-24T03:31:55.039276+0000","last_fullsized":"2023-05-24T03:31:55.039276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:52:06.913754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"30'438","reported_seq":456,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.899992+0000","last_change":"2023-05-24T03:29:48.523521+0000","last_active":"2023-05-24T03:31:54.899992+0000","last_peered":"2023-05-24T03:31:54.899992+0000","last_clean":"2023-05-24T03:31:54.899992+0000","last_became_active":"2023-05-24T03:29:48.523125+0000","last_became_peered":"2023-05-24T03:29:48.523125+0000","last_unstale":"2023-05-24T03:31:54.899992+0000","last_undegraded":"2023-05-24T03:31:54.899992+0000","last_fullsized":"2023-05-24T03:31:54.899992+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:55:49.240935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":21504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.945583+0000","last_change":"2023-05-24T03:29:44.084408+0000","last_active":"2023-05-24T03:30:25.945583+0000","last_peered":"2023-05-24T03:30:25.945583+0000","last_clean":"2023-05-24T03:30:25.945583+0000","last_became_active":"2023-05-24T03:29:44.084099+0000","last_became_peered":"2023-05-24T03:29:44.084099+0000","last_unstale":"2023-05-24T03:30:25.945583+0000","last_undegraded":"2023-05-24T03:30:25.945583+0000","last_fullsized":"2023-05-24T03:30:25.945583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:55:17.269834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"30'10","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.049187+0000","last_change":"2023-05-24T03:29:44.503346+0000","last_active":"2023-05-24T03:31:55.049187+0000","last_peered":"2023-05-24T03:31:55.049187+0000","last_clean":"2023-05-24T03:31:55.049187+0000","last_became_active":"2023-05-24T03:29:44.503039+0000","last_became_peered":"2023-05-24T03:29:44.503039+0000","last_unstale":"2023-05-24T03:31:55.049187+0000","last_undegraded":"2023-05-24T03:31:55.049187+0000","last_fullsized":"2023-05-24T03:31:55.049187+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:06:19.223766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"30'450","reported_seq":468,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.631735+0000","last_change":"2023-05-24T03:29:48.529615+0000","last_active":"2023-05-24T03:31:55.631735+0000","last_peered":"2023-05-24T03:31:55.631735+0000","last_clean":"2023-05-24T03:31:55.631735+0000","last_became_active":"2023-05-24T03:29:48.529142+0000","last_became_peered":"2023-05-24T03:29:48.529142+0000","last_unstale":"2023-05-24T03:31:55.631735+0000","last_undegraded":"2023-05-24T03:31:55.631735+0000","last_fullsized":"2023-05-24T03:31:55.631735+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:09:06.504119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"30'1","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:26.804992+0000","last_change":"2023-05-24T03:29:44.085410+0000","last_active":"2023-05-24T03:30:26.804992+0000","last_peered":"2023-05-24T03:30:26.804992+0000","last_clean":"2023-05-24T03:30:26.804992+0000","last_became_active":"2023-05-24T03:29:44.084907+0000","last_became_peered":"2023-05-24T03:29:44.084907+0000","last_unstale":"2023-05-24T03:30:26.804992+0000","last_undegraded":"2023-05-24T03:30:26.804992+0000","last_fullsized":"2023-05-24T03:30:26.804992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:46:54.993008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"30'14","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.030034+0000","last_change":"2023-05-24T03:29:44.497128+0000","last_active":"2023-05-24T03:31:55.030034+0000","last_peered":"2023-05-24T03:31:55.030034+0000","last_clean":"2023-05-24T03:31:55.030034+0000","last_became_active":"2023-05-24T03:29:44.496746+0000","last_became_peered":"2023-05-24T03:29:44.496746+0000","last_unstale":"2023-05-24T03:31:55.030034+0000","last_undegraded":"2023-05-24T03:31:55.030034+0000","last_fullsized":"2023-05-24T03:31:55.030034+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:27:24.810532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"30'463","reported_seq":480,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.867946+0000","last_change":"2023-05-24T03:29:48.520693+0000","last_active":"2023-05-24T03:31:54.867946+0000","last_peered":"2023-05-24T03:31:54.867946+0000","last_clean":"2023-05-24T03:31:54.867946+0000","last_became_active":"2023-05-24T03:29:48.520319+0000","last_became_peered":"2023-05-24T03:29:48.520319+0000","last_unstale":"2023-05-24T03:31:54.867946+0000","last_undegraded":"2023-05-24T03:31:54.867946+0000","last_fullsized":"2023-05-24T03:31:54.867946+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:32:35.981956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"30'1","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:26.131959+0000","last_change":"2023-05-24T03:29:44.088769+0000","last_active":"2023-05-24T03:30:26.131959+0000","last_peered":"2023-05-24T03:30:26.131959+0000","last_clean":"2023-05-24T03:30:26.131959+0000","last_became_active":"2023-05-24T03:29:44.088267+0000","last_became_peered":"2023-05-24T03:29:44.088267+0000","last_unstale":"2023-05-24T03:30:26.131959+0000","last_undegraded":"2023-05-24T03:30:26.131959+0000","last_fullsized":"2023-05-24T03:30:26.131959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:46:54.993008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"30'15","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.040917+0000","last_change":"2023-05-24T03:29:44.489309+0000","last_active":"2023-05-24T03:31:55.040917+0000","last_peered":"2023-05-24T03:31:55.040917+0000","last_clean":"2023-05-24T03:31:55.040917+0000","last_became_active":"2023-05-24T03:29:44.488666+0000","last_became_peered":"2023-05-24T03:29:44.488666+0000","last_unstale":"2023-05-24T03:31:55.040917+0000","last_undegraded":"2023-05-24T03:31:55.040917+0000","last_fullsized":"2023-05-24T03:31:55.040917+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:29:00.326985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"30'437","reported_seq":454,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.635512+0000","last_change":"2023-05-24T03:29:48.518108+0000","last_active":"2023-05-24T03:31:55.635512+0000","last_peered":"2023-05-24T03:31:55.635512+0000","last_clean":"2023-05-24T03:31:55.635512+0000","last_became_active":"2023-05-24T03:29:48.517771+0000","last_became_peered":"2023-05-24T03:29:48.517771+0000","last_unstale":"2023-05-24T03:31:55.635512+0000","last_undegraded":"2023-05-24T03:31:55.635512+0000","last_fullsized":"2023-05-24T03:31:55.635512+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:53:39.929296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.948014+0000","last_change":"2023-05-24T03:29:44.087910+0000","last_active":"2023-05-24T03:30:25.948014+0000","last_peered":"2023-05-24T03:30:25.948014+0000","last_clean":"2023-05-24T03:30:25.948014+0000","last_became_active":"2023-05-24T03:29:44.087601+0000","last_became_peered":"2023-05-24T03:29:44.087601+0000","last_unstale":"2023-05-24T03:30:25.948014+0000","last_undegraded":"2023-05-24T03:30:25.948014+0000","last_fullsized":"2023-05-24T03:30:25.948014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:47:02.508699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"30'16","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.042465+0000","last_change":"2023-05-24T03:29:44.496020+0000","last_active":"2023-05-24T03:31:55.042465+0000","last_peered":"2023-05-24T03:31:55.042465+0000","last_clean":"2023-05-24T03:31:55.042465+0000","last_became_active":"2023-05-24T03:29:44.495752+0000","last_became_peered":"2023-05-24T03:29:44.495752+0000","last_unstale":"2023-05-24T03:31:55.042465+0000","last_undegraded":"2023-05-24T03:31:55.042465+0000","last_fullsized":"2023-05-24T03:31:55.042465+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:28:24.448757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"30'477","reported_seq":494,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.996996+0000","last_change":"2023-05-24T03:29:48.529893+0000","last_active":"2023-05-24T03:31:54.996996+0000","last_peered":"2023-05-24T03:31:54.996996+0000","last_clean":"2023-05-24T03:31:54.996996+0000","last_became_active":"2023-05-24T03:29:48.529514+0000","last_became_peered":"2023-05-24T03:29:48.529514+0000","last_unstale":"2023-05-24T03:31:54.996996+0000","last_undegraded":"2023-05-24T03:31:54.996996+0000","last_fullsized":"2023-05-24T03:31:54.996996+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:17:12.538446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"30'9","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.919514+0000","last_change":"2023-05-24T03:29:44.091648+0000","last_active":"2023-05-24T03:31:54.919514+0000","last_peered":"2023-05-24T03:31:54.919514+0000","last_clean":"2023-05-24T03:31:54.919514+0000","last_became_active":"2023-05-24T03:29:44.091390+0000","last_became_peered":"2023-05-24T03:29:44.091390+0000","last_unstale":"2023-05-24T03:31:54.919514+0000","last_undegraded":"2023-05-24T03:31:54.919514+0000","last_fullsized":"2023-05-24T03:31:54.919514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:28:23.442311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"30'19","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.038705+0000","last_change":"2023-05-24T03:29:44.481629+0000","last_active":"2023-05-24T03:31:55.038705+0000","last_peered":"2023-05-24T03:31:55.038705+0000","last_clean":"2023-05-24T03:31:55.038705+0000","last_became_active":"2023-05-24T03:29:44.481385+0000","last_became_peered":"2023-05-24T03:29:44.481385+0000","last_unstale":"2023-05-24T03:31:55.038705+0000","last_undegraded":"2023-05-24T03:31:55.038705+0000","last_fullsized":"2023-05-24T03:31:55.038705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:15:01.553262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"30'463","reported_seq":480,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.862948+0000","last_change":"2023-05-24T03:29:48.524712+0000","last_active":"2023-05-24T03:31:54.862948+0000","last_peered":"2023-05-24T03:31:54.862948+0000","last_clean":"2023-05-24T03:31:54.862948+0000","last_became_active":"2023-05-24T03:29:48.524312+0000","last_became_peered":"2023-05-24T03:29:48.524312+0000","last_unstale":"2023-05-24T03:31:54.862948+0000","last_undegraded":"2023-05-24T03:31:54.862948+0000","last_fullsized":"2023-05-24T03:31:54.862948+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:09:53.803718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"30'350","reported_seq":375,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.007236+0000","last_change":"2023-05-24T03:29:44.079067+0000","last_active":"2023-05-24T03:31:55.007236+0000","last_peered":"2023-05-24T03:31:55.007236+0000","last_clean":"2023-05-24T03:31:55.007236+0000","last_became_active":"2023-05-24T03:29:44.078785+0000","last_became_peered":"2023-05-24T03:29:44.078785+0000","last_unstale":"2023-05-24T03:31:55.007236+0000","last_undegraded":"2023-05-24T03:31:55.007236+0000","last_fullsized":"2023-05-24T03:31:55.007236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:07:01.888999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1390402,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":349,"num_write_kb":1595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"30'24","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.035065+0000","last_change":"2023-05-24T03:29:44.497603+0000","last_active":"2023-05-24T03:31:55.035065+0000","last_peered":"2023-05-24T03:31:55.035065+0000","last_clean":"2023-05-24T03:31:55.035065+0000","last_became_active":"2023-05-24T03:29:44.497120+0000","last_became_peered":"2023-05-24T03:29:44.497120+0000","last_unstale":"2023-05-24T03:31:55.035065+0000","last_undegraded":"2023-05-24T03:31:55.035065+0000","last_fullsized":"2023-05-24T03:31:55.035065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:29:14.482310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"30'435","reported_seq":452,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.998980+0000","last_change":"2023-05-24T03:29:48.531846+0000","last_active":"2023-05-24T03:31:54.998980+0000","last_peered":"2023-05-24T03:31:54.998980+0000","last_clean":"2023-05-24T03:31:54.998980+0000","last_became_active":"2023-05-24T03:29:48.531538+0000","last_became_peered":"2023-05-24T03:29:48.531538+0000","last_unstale":"2023-05-24T03:31:54.998980+0000","last_undegraded":"2023-05-24T03:31:54.998980+0000","last_fullsized":"2023-05-24T03:31:54.998980+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:26:45.584372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"30'3","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.949502+0000","last_change":"2023-05-24T03:29:44.087315+0000","last_active":"2023-05-24T03:30:25.949502+0000","last_peered":"2023-05-24T03:30:25.949502+0000","last_clean":"2023-05-24T03:30:25.949502+0000","last_became_active":"2023-05-24T03:29:44.086997+0000","last_became_peered":"2023-05-24T03:29:44.086997+0000","last_unstale":"2023-05-24T03:30:25.949502+0000","last_undegraded":"2023-05-24T03:30:25.949502+0000","last_fullsized":"2023-05-24T03:30:25.949502+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:28:59.320540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"30'17","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.041562+0000","last_change":"2023-05-24T03:29:44.487497+0000","last_active":"2023-05-24T03:31:55.041562+0000","last_peered":"2023-05-24T03:31:55.041562+0000","last_clean":"2023-05-24T03:31:55.041562+0000","last_became_active":"2023-05-24T03:29:44.487257+0000","last_became_peered":"2023-05-24T03:29:44.487257+0000","last_unstale":"2023-05-24T03:31:55.041562+0000","last_undegraded":"2023-05-24T03:31:55.041562+0000","last_fullsized":"2023-05-24T03:31:55.041562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:34:40.725013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"30'462","reported_seq":479,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.836747+0000","last_change":"2023-05-24T03:29:48.526115+0000","last_active":"2023-05-24T03:31:54.836747+0000","last_peered":"2023-05-24T03:31:54.836747+0000","last_clean":"2023-05-24T03:31:54.836747+0000","last_became_active":"2023-05-24T03:29:48.525726+0000","last_became_peered":"2023-05-24T03:29:48.525726+0000","last_unstale":"2023-05-24T03:31:54.836747+0000","last_undegraded":"2023-05-24T03:31:54.836747+0000","last_fullsized":"2023-05-24T03:31:54.836747+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:15:16.805837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:26.131470+0000","last_change":"2023-05-24T03:29:44.084599+0000","last_active":"2023-05-24T03:30:26.131470+0000","last_peered":"2023-05-24T03:30:26.131470+0000","last_clean":"2023-05-24T03:30:26.131470+0000","last_became_active":"2023-05-24T03:29:44.084278+0000","last_became_peered":"2023-05-24T03:29:44.084278+0000","last_unstale":"2023-05-24T03:30:26.131470+0000","last_undegraded":"2023-05-24T03:30:26.131470+0000","last_fullsized":"2023-05-24T03:30:26.131470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:00:19.972006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"30'15","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.032638+0000","last_change":"2023-05-24T03:29:44.498378+0000","last_active":"2023-05-24T03:31:55.032638+0000","last_peered":"2023-05-24T03:31:55.032638+0000","last_clean":"2023-05-24T03:31:55.032638+0000","last_became_active":"2023-05-24T03:29:44.498097+0000","last_became_peered":"2023-05-24T03:29:44.498097+0000","last_unstale":"2023-05-24T03:31:55.032638+0000","last_undegraded":"2023-05-24T03:31:55.032638+0000","last_fullsized":"2023-05-24T03:31:55.032638+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:28:43.398723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"30'445","reported_seq":462,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.859517+0000","last_change":"2023-05-24T03:29:48.525018+0000","last_active":"2023-05-24T03:31:54.859517+0000","last_peered":"2023-05-24T03:31:54.859517+0000","last_clean":"2023-05-24T03:31:54.859517+0000","last_became_active":"2023-05-24T03:29:48.524602+0000","last_became_peered":"2023-05-24T03:29:48.524602+0000","last_unstale":"2023-05-24T03:31:54.859517+0000","last_undegraded":"2023-05-24T03:31:54.859517+0000","last_fullsized":"2023-05-24T03:31:54.859517+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:32:16.657149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"30'1","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.948925+0000","last_change":"2023-05-24T03:29:44.085212+0000","last_active":"2023-05-24T03:30:25.948925+0000","last_peered":"2023-05-24T03:30:25.948925+0000","last_clean":"2023-05-24T03:30:25.948925+0000","last_became_active":"2023-05-24T03:29:44.085001+0000","last_became_peered":"2023-05-24T03:29:44.085001+0000","last_unstale":"2023-05-24T03:30:25.948925+0000","last_undegraded":"2023-05-24T03:30:25.948925+0000","last_fullsized":"2023-05-24T03:30:25.948925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:57:48.715216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"30'22","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.050448+0000","last_change":"2023-05-24T03:29:44.500883+0000","last_active":"2023-05-24T03:31:55.050448+0000","last_peered":"2023-05-24T03:31:55.050448+0000","last_clean":"2023-05-24T03:31:55.050448+0000","last_became_active":"2023-05-24T03:29:44.500631+0000","last_became_peered":"2023-05-24T03:29:44.500631+0000","last_unstale":"2023-05-24T03:31:55.050448+0000","last_undegraded":"2023-05-24T03:31:55.050448+0000","last_fullsized":"2023-05-24T03:31:55.050448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:03:29.813763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"30'480","reported_seq":497,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.914788+0000","last_change":"2023-05-24T03:29:48.523523+0000","last_active":"2023-05-24T03:31:54.914788+0000","last_peered":"2023-05-24T03:31:54.914788+0000","last_clean":"2023-05-24T03:31:54.914788+0000","last_became_active":"2023-05-24T03:29:48.523138+0000","last_became_peered":"2023-05-24T03:29:48.523138+0000","last_unstale":"2023-05-24T03:31:54.914788+0000","last_undegraded":"2023-05-24T03:31:54.914788+0000","last_fullsized":"2023-05-24T03:31:54.914788+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:06:22.646046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:26.804069+0000","last_change":"2023-05-24T03:29:44.085229+0000","last_active":"2023-05-24T03:30:26.804069+0000","last_peered":"2023-05-24T03:30:26.804069+0000","last_clean":"2023-05-24T03:30:26.804069+0000","last_became_active":"2023-05-24T03:29:44.084914+0000","last_became_peered":"2023-05-24T03:29:44.084914+0000","last_unstale":"2023-05-24T03:30:26.804069+0000","last_undegraded":"2023-05-24T03:30:26.804069+0000","last_fullsized":"2023-05-24T03:30:26.804069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:26:25.494471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"30'19","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.037939+0000","last_change":"2023-05-24T03:29:44.496038+0000","last_active":"2023-05-24T03:31:55.037939+0000","last_peered":"2023-05-24T03:31:55.037939+0000","last_clean":"2023-05-24T03:31:55.037939+0000","last_became_active":"2023-05-24T03:29:44.495795+0000","last_became_peered":"2023-05-24T03:29:44.495795+0000","last_unstale":"2023-05-24T03:31:55.037939+0000","last_undegraded":"2023-05-24T03:31:55.037939+0000","last_fullsized":"2023-05-24T03:31:55.037939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:01:21.417593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"30'434","reported_seq":451,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.848942+0000","last_change":"2023-05-24T03:29:48.518930+0000","last_active":"2023-05-24T03:31:54.848942+0000","last_peered":"2023-05-24T03:31:54.848942+0000","last_clean":"2023-05-24T03:31:54.848942+0000","last_became_active":"2023-05-24T03:29:48.518531+0000","last_became_peered":"2023-05-24T03:29:48.518531+0000","last_unstale":"2023-05-24T03:31:54.848942+0000","last_undegraded":"2023-05-24T03:31:54.848942+0000","last_fullsized":"2023-05-24T03:31:54.848942+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:37:48.684803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.949768+0000","last_change":"2023-05-24T03:29:44.089650+0000","last_active":"2023-05-24T03:30:25.949768+0000","last_peered":"2023-05-24T03:30:25.949768+0000","last_clean":"2023-05-24T03:30:25.949768+0000","last_became_active":"2023-05-24T03:29:44.089340+0000","last_became_peered":"2023-05-24T03:29:44.089340+0000","last_unstale":"2023-05-24T03:30:25.949768+0000","last_undegraded":"2023-05-24T03:30:25.949768+0000","last_fullsized":"2023-05-24T03:30:25.949768+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:46:54.993008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"30'14","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.032179+0000","last_change":"2023-05-24T03:29:44.498089+0000","last_active":"2023-05-24T03:31:55.032179+0000","last_peered":"2023-05-24T03:31:55.032179+0000","last_clean":"2023-05-24T03:31:55.032179+0000","last_became_active":"2023-05-24T03:29:44.497795+0000","last_became_peered":"2023-05-24T03:29:44.497795+0000","last_unstale":"2023-05-24T03:31:55.032179+0000","last_undegraded":"2023-05-24T03:31:55.032179+0000","last_fullsized":"2023-05-24T03:31:55.032179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:11:59.800632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"30'409","reported_seq":426,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.996067+0000","last_change":"2023-05-24T03:29:48.521349+0000","last_active":"2023-05-24T03:31:54.996067+0000","last_peered":"2023-05-24T03:31:54.996067+0000","last_clean":"2023-05-24T03:31:54.996067+0000","last_became_active":"2023-05-24T03:29:48.520899+0000","last_became_peered":"2023-05-24T03:29:48.520899+0000","last_unstale":"2023-05-24T03:31:54.996067+0000","last_undegraded":"2023-05-24T03:31:54.996067+0000","last_fullsized":"2023-05-24T03:31:54.996067+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:59:08.584090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.949203+0000","last_change":"2023-05-24T03:29:44.086355+0000","last_active":"2023-05-24T03:30:25.949203+0000","last_peered":"2023-05-24T03:30:25.949203+0000","last_clean":"2023-05-24T03:30:25.949203+0000","last_became_active":"2023-05-24T03:29:44.086054+0000","last_became_peered":"2023-05-24T03:29:44.086054+0000","last_unstale":"2023-05-24T03:30:25.949203+0000","last_undegraded":"2023-05-24T03:30:25.949203+0000","last_fullsized":"2023-05-24T03:30:25.949203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:56:15.394098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"30'10","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.036553+0000","last_change":"2023-05-24T03:30:25.949869+0000","last_active":"2023-05-24T03:31:55.036553+0000","last_peered":"2023-05-24T03:31:55.036553+0000","last_clean":"2023-05-24T03:31:55.036553+0000","last_became_active":"2023-05-24T03:30:25.949461+0000","last_became_peered":"2023-05-24T03:30:25.949461+0000","last_unstale":"2023-05-24T03:31:55.036553+0000","last_undegraded":"2023-05-24T03:31:55.036553+0000","last_fullsized":"2023-05-24T03:31:55.036553+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:59:01.497346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"30'452","reported_seq":469,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.995617+0000","last_change":"2023-05-24T03:29:48.522128+0000","last_active":"2023-05-24T03:31:54.995617+0000","last_peered":"2023-05-24T03:31:54.995617+0000","last_clean":"2023-05-24T03:31:54.995617+0000","last_became_active":"2023-05-24T03:29:48.521729+0000","last_became_peered":"2023-05-24T03:29:48.521729+0000","last_unstale":"2023-05-24T03:31:54.995617+0000","last_undegraded":"2023-05-24T03:31:54.995617+0000","last_fullsized":"2023-05-24T03:31:54.995617+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:43:08.142518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.949540+0000","last_change":"2023-05-24T03:29:44.088761+0000","last_active":"2023-05-24T03:30:25.949540+0000","last_peered":"2023-05-24T03:30:25.949540+0000","last_clean":"2023-05-24T03:30:25.949540+0000","last_became_active":"2023-05-24T03:29:44.088459+0000","last_became_peered":"2023-05-24T03:29:44.088459+0000","last_unstale":"2023-05-24T03:30:25.949540+0000","last_undegraded":"2023-05-24T03:30:25.949540+0000","last_fullsized":"2023-05-24T03:30:25.949540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:28:42.392277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"30'9","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.032605+0000","last_change":"2023-05-24T03:29:44.490252+0000","last_active":"2023-05-24T03:31:55.032605+0000","last_peered":"2023-05-24T03:31:55.032605+0000","last_clean":"2023-05-24T03:31:55.032605+0000","last_became_active":"2023-05-24T03:29:44.489975+0000","last_became_peered":"2023-05-24T03:29:44.489975+0000","last_unstale":"2023-05-24T03:31:55.032605+0000","last_undegraded":"2023-05-24T03:31:55.032605+0000","last_fullsized":"2023-05-24T03:31:55.032605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:27:13.487917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"30'477","reported_seq":494,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.850746+0000","last_change":"2023-05-24T03:29:48.523911+0000","last_active":"2023-05-24T03:31:54.850746+0000","last_peered":"2023-05-24T03:31:54.850746+0000","last_clean":"2023-05-24T03:31:54.850746+0000","last_became_active":"2023-05-24T03:29:48.523545+0000","last_became_peered":"2023-05-24T03:29:48.523545+0000","last_unstale":"2023-05-24T03:31:54.850746+0000","last_undegraded":"2023-05-24T03:31:54.850746+0000","last_fullsized":"2023-05-24T03:31:54.850746+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:10:18.150623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"30'1","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.947808+0000","last_change":"2023-05-24T03:29:44.091185+0000","last_active":"2023-05-24T03:30:25.947808+0000","last_peered":"2023-05-24T03:30:25.947808+0000","last_clean":"2023-05-24T03:30:25.947808+0000","last_became_active":"2023-05-24T03:29:44.090887+0000","last_became_peered":"2023-05-24T03:29:44.090887+0000","last_unstale":"2023-05-24T03:30:25.947808+0000","last_undegraded":"2023-05-24T03:30:25.947808+0000","last_fullsized":"2023-05-24T03:30:25.947808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:28:59.320540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"30'14","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.049637+0000","last_change":"2023-05-24T03:29:44.502570+0000","last_active":"2023-05-24T03:31:55.049637+0000","last_peered":"2023-05-24T03:31:55.049637+0000","last_clean":"2023-05-24T03:31:55.049637+0000","last_became_active":"2023-05-24T03:29:44.502286+0000","last_became_peered":"2023-05-24T03:29:44.502286+0000","last_unstale":"2023-05-24T03:31:55.049637+0000","last_undegraded":"2023-05-24T03:31:55.049637+0000","last_fullsized":"2023-05-24T03:31:55.049637+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:56:16.400543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"30'459","reported_seq":476,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.905929+0000","last_change":"2023-05-24T03:29:48.521750+0000","last_active":"2023-05-24T03:31:54.905929+0000","last_peered":"2023-05-24T03:31:54.905929+0000","last_clean":"2023-05-24T03:31:54.905929+0000","last_became_active":"2023-05-24T03:29:48.520960+0000","last_became_peered":"2023-05-24T03:29:48.520960+0000","last_unstale":"2023-05-24T03:31:54.905929+0000","last_undegraded":"2023-05-24T03:31:54.905929+0000","last_fullsized":"2023-05-24T03:31:54.905929+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:18:50.657657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"30'4","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:43.731151+0000","last_change":"2023-05-24T03:29:44.088157+0000","last_active":"2023-05-24T03:31:43.731151+0000","last_peered":"2023-05-24T03:31:43.731151+0000","last_clean":"2023-05-24T03:31:43.731151+0000","last_became_active":"2023-05-24T03:29:44.087869+0000","last_became_peered":"2023-05-24T03:29:44.087869+0000","last_unstale":"2023-05-24T03:31:43.731151+0000","last_undegraded":"2023-05-24T03:31:43.731151+0000","last_fullsized":"2023-05-24T03:31:43.731151+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:30:53.298174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"30'11","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.043058+0000","last_change":"2023-05-24T03:29:44.501176+0000","last_active":"2023-05-24T03:31:55.043058+0000","last_peered":"2023-05-24T03:31:55.043058+0000","last_clean":"2023-05-24T03:31:55.043058+0000","last_became_active":"2023-05-24T03:29:44.499700+0000","last_became_peered":"2023-05-24T03:29:44.499700+0000","last_unstale":"2023-05-24T03:31:55.043058+0000","last_undegraded":"2023-05-24T03:31:55.043058+0000","last_fullsized":"2023-05-24T03:31:55.043058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:08:22.507011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"30'447","reported_seq":464,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.855461+0000","last_change":"2023-05-24T03:29:48.522778+0000","last_active":"2023-05-24T03:31:54.855461+0000","last_peered":"2023-05-24T03:31:54.855461+0000","last_clean":"2023-05-24T03:31:54.855461+0000","last_became_active":"2023-05-24T03:29:48.522104+0000","last_became_peered":"2023-05-24T03:29:48.522104+0000","last_unstale":"2023-05-24T03:31:54.855461+0000","last_undegraded":"2023-05-24T03:31:54.855461+0000","last_fullsized":"2023-05-24T03:31:54.855461+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:25:58.928535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"30'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:52.027142+0000","last_change":"2023-05-24T03:29:44.085211+0000","last_active":"2023-05-24T03:31:52.027142+0000","last_peered":"2023-05-24T03:31:52.027142+0000","last_clean":"2023-05-24T03:31:52.027142+0000","last_became_active":"2023-05-24T03:29:44.084894+0000","last_became_peered":"2023-05-24T03:29:44.084894+0000","last_unstale":"2023-05-24T03:31:52.027142+0000","last_undegraded":"2023-05-24T03:31:52.027142+0000","last_fullsized":"2023-05-24T03:31:52.027142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T03:40:04.765492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"30'15","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.042450+0000","last_change":"2023-05-24T03:29:44.492807+0000","last_active":"2023-05-24T03:31:55.042450+0000","last_peered":"2023-05-24T03:31:55.042450+0000","last_clean":"2023-05-24T03:31:55.042450+0000","last_became_active":"2023-05-24T03:29:44.492462+0000","last_became_peered":"2023-05-24T03:29:44.492462+0000","last_unstale":"2023-05-24T03:31:55.042450+0000","last_undegraded":"2023-05-24T03:31:55.042450+0000","last_fullsized":"2023-05-24T03:31:55.042450+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T03:34:42.017206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'477","reported_seq":494,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.639266+0000","last_change":"2023-05-24T03:29:48.524960+0000","last_active":"2023-05-24T03:31:55.639266+0000","last_peered":"2023-05-24T03:31:55.639266+0000","last_clean":"2023-05-24T03:31:55.639266+0000","last_became_active":"2023-05-24T03:29:48.524023+0000","last_became_peered":"2023-05-24T03:29:48.524023+0000","last_unstale":"2023-05-24T03:31:55.639266+0000","last_undegraded":"2023-05-24T03:31:55.639266+0000","last_fullsized":"2023-05-24T03:31:55.639266+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:17:12.538446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.945352+0000","last_change":"2023-05-24T03:29:44.082700+0000","last_active":"2023-05-24T03:30:25.945352+0000","last_peered":"2023-05-24T03:30:25.945352+0000","last_clean":"2023-05-24T03:30:25.945352+0000","last_became_active":"2023-05-24T03:29:44.082382+0000","last_became_peered":"2023-05-24T03:29:44.082382+0000","last_unstale":"2023-05-24T03:30:25.945352+0000","last_undegraded":"2023-05-24T03:30:25.945352+0000","last_fullsized":"2023-05-24T03:30:25.945352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:32:47.076800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"30'9","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.035186+0000","last_change":"2023-05-24T03:29:44.501409+0000","last_active":"2023-05-24T03:31:55.035186+0000","last_peered":"2023-05-24T03:31:55.035186+0000","last_clean":"2023-05-24T03:31:55.035186+0000","last_became_active":"2023-05-24T03:29:44.501080+0000","last_became_peered":"2023-05-24T03:29:44.501080+0000","last_unstale":"2023-05-24T03:31:55.035186+0000","last_undegraded":"2023-05-24T03:31:55.035186+0000","last_fullsized":"2023-05-24T03:31:55.035186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:32:22.255614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"30'488","reported_seq":505,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.909741+0000","last_change":"2023-05-24T03:29:48.519383+0000","last_active":"2023-05-24T03:31:54.909741+0000","last_peered":"2023-05-24T03:31:54.909741+0000","last_clean":"2023-05-24T03:31:54.909741+0000","last_became_active":"2023-05-24T03:29:48.519046+0000","last_became_peered":"2023-05-24T03:29:48.519046+0000","last_unstale":"2023-05-24T03:31:54.909741+0000","last_undegraded":"2023-05-24T03:31:54.909741+0000","last_fullsized":"2023-05-24T03:31:54.909741+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:02:44.132422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:26.804947+0000","last_change":"2023-05-24T03:29:44.085771+0000","last_active":"2023-05-24T03:30:26.804947+0000","last_peered":"2023-05-24T03:30:26.804947+0000","last_clean":"2023-05-24T03:30:26.804947+0000","last_became_active":"2023-05-24T03:29:44.085420+0000","last_became_peered":"2023-05-24T03:29:44.085420+0000","last_unstale":"2023-05-24T03:30:26.804947+0000","last_undegraded":"2023-05-24T03:30:26.804947+0000","last_fullsized":"2023-05-24T03:30:26.804947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:26:41.155647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"30'17","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.039969+0000","last_change":"2023-05-24T03:29:44.491345+0000","last_active":"2023-05-24T03:31:55.039969+0000","last_peered":"2023-05-24T03:31:55.039969+0000","last_clean":"2023-05-24T03:31:55.039969+0000","last_became_active":"2023-05-24T03:29:44.491089+0000","last_became_peered":"2023-05-24T03:29:44.491089+0000","last_unstale":"2023-05-24T03:31:55.039969+0000","last_undegraded":"2023-05-24T03:31:55.039969+0000","last_fullsized":"2023-05-24T03:31:55.039969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:11:59.800632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"30'492","reported_seq":510,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.647405+0000","last_change":"2023-05-24T03:29:48.530105+0000","last_active":"2023-05-24T03:31:55.647405+0000","last_peered":"2023-05-24T03:31:55.647405+0000","last_clean":"2023-05-24T03:31:55.647405+0000","last_became_active":"2023-05-24T03:29:48.529157+0000","last_became_peered":"2023-05-24T03:29:48.529157+0000","last_unstale":"2023-05-24T03:31:55.647405+0000","last_undegraded":"2023-05-24T03:31:55.647405+0000","last_fullsized":"2023-05-24T03:31:55.647405+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:57:53.143941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.946193+0000","last_change":"2023-05-24T03:29:39.143199+0000","last_active":"2023-05-24T03:30:25.946193+0000","last_peered":"2023-05-24T03:30:25.946193+0000","last_clean":"2023-05-24T03:30:25.946193+0000","last_became_active":"2023-05-24T03:29:39.142867+0000","last_became_peered":"2023-05-24T03:29:39.142867+0000","last_unstale":"2023-05-24T03:30:25.946193+0000","last_undegraded":"2023-05-24T03:30:25.946193+0000","last_fullsized":"2023-05-24T03:30:25.946193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:53:30.482418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"30'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:51.927110+0000","last_change":"2023-05-24T03:29:44.087790+0000","last_active":"2023-05-24T03:31:51.927110+0000","last_peered":"2023-05-24T03:31:51.927110+0000","last_clean":"2023-05-24T03:31:51.927110+0000","last_became_active":"2023-05-24T03:29:44.087475+0000","last_became_peered":"2023-05-24T03:29:44.087475+0000","last_unstale":"2023-05-24T03:31:51.927110+0000","last_undegraded":"2023-05-24T03:31:51.927110+0000","last_fullsized":"2023-05-24T03:31:51.927110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:56:15.394098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"30'16","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.035838+0000","last_change":"2023-05-24T03:29:44.497235+0000","last_active":"2023-05-24T03:31:55.035838+0000","last_peered":"2023-05-24T03:31:55.035838+0000","last_clean":"2023-05-24T03:31:55.035838+0000","last_became_active":"2023-05-24T03:29:44.497015+0000","last_became_peered":"2023-05-24T03:29:44.497015+0000","last_unstale":"2023-05-24T03:31:55.035838+0000","last_undegraded":"2023-05-24T03:31:55.035838+0000","last_fullsized":"2023-05-24T03:31:55.035838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:34:36.957340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"30'438","reported_seq":456,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.876773+0000","last_change":"2023-05-24T03:29:48.527805+0000","last_active":"2023-05-24T03:31:54.876773+0000","last_peered":"2023-05-24T03:31:54.876773+0000","last_clean":"2023-05-24T03:31:54.876773+0000","last_became_active":"2023-05-24T03:29:48.527010+0000","last_became_peered":"2023-05-24T03:29:48.527010+0000","last_unstale":"2023-05-24T03:31:54.876773+0000","last_undegraded":"2023-05-24T03:31:54.876773+0000","last_fullsized":"2023-05-24T03:31:54.876773+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:24:51.361665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.947589+0000","last_change":"2023-05-24T03:29:39.048516+0000","last_active":"2023-05-24T03:30:25.947589+0000","last_peered":"2023-05-24T03:30:25.947589+0000","last_clean":"2023-05-24T03:30:25.947589+0000","last_became_active":"2023-05-24T03:29:39.048141+0000","last_became_peered":"2023-05-24T03:29:39.048141+0000","last_unstale":"2023-05-24T03:30:25.947589+0000","last_undegraded":"2023-05-24T03:30:25.947589+0000","last_fullsized":"2023-05-24T03:30:25.947589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:37:39.237924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.945952+0000","last_change":"2023-05-24T03:29:44.085282+0000","last_active":"2023-05-24T03:30:25.945952+0000","last_peered":"2023-05-24T03:30:25.945952+0000","last_clean":"2023-05-24T03:30:25.945952+0000","last_became_active":"2023-05-24T03:29:44.084944+0000","last_became_peered":"2023-05-24T03:29:44.084944+0000","last_unstale":"2023-05-24T03:30:25.945952+0000","last_undegraded":"2023-05-24T03:30:25.945952+0000","last_fullsized":"2023-05-24T03:30:25.945952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:06:01.227379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"30'15","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.039882+0000","last_change":"2023-05-24T03:29:44.483553+0000","last_active":"2023-05-24T03:31:55.039882+0000","last_peered":"2023-05-24T03:31:55.039882+0000","last_clean":"2023-05-24T03:31:55.039882+0000","last_became_active":"2023-05-24T03:29:44.483134+0000","last_became_peered":"2023-05-24T03:29:44.483134+0000","last_unstale":"2023-05-24T03:31:55.039882+0000","last_undegraded":"2023-05-24T03:31:55.039882+0000","last_fullsized":"2023-05-24T03:31:55.039882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:00:20.978451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'470","reported_seq":487,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.996091+0000","last_change":"2023-05-24T03:29:48.519249+0000","last_active":"2023-05-24T03:31:54.996091+0000","last_peered":"2023-05-24T03:31:54.996091+0000","last_clean":"2023-05-24T03:31:54.996091+0000","last_became_active":"2023-05-24T03:29:48.518546+0000","last_became_peered":"2023-05-24T03:29:48.518546+0000","last_unstale":"2023-05-24T03:31:54.996091+0000","last_undegraded":"2023-05-24T03:31:54.996091+0000","last_fullsized":"2023-05-24T03:31:54.996091+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:26:29.923197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:26.105101+0000","last_change":"2023-05-24T03:29:39.310351+0000","last_active":"2023-05-24T03:30:26.105101+0000","last_peered":"2023-05-24T03:30:26.105101+0000","last_clean":"2023-05-24T03:30:26.105101+0000","last_became_active":"2023-05-24T03:29:39.310070+0000","last_became_peered":"2023-05-24T03:29:39.310070+0000","last_unstale":"2023-05-24T03:30:26.105101+0000","last_undegraded":"2023-05-24T03:30:26.105101+0000","last_fullsized":"2023-05-24T03:30:26.105101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:21:55.168531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.945636+0000","last_change":"2023-05-24T03:29:44.075504+0000","last_active":"2023-05-24T03:30:25.945636+0000","last_peered":"2023-05-24T03:30:25.945636+0000","last_clean":"2023-05-24T03:30:25.945636+0000","last_became_active":"2023-05-24T03:29:44.074551+0000","last_became_peered":"2023-05-24T03:29:44.074551+0000","last_unstale":"2023-05-24T03:30:25.945636+0000","last_undegraded":"2023-05-24T03:30:25.945636+0000","last_fullsized":"2023-05-24T03:30:25.945636+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:12:11.445050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"30'14","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.033247+0000","last_change":"2023-05-24T03:29:44.496225+0000","last_active":"2023-05-24T03:31:55.033247+0000","last_peered":"2023-05-24T03:31:55.033247+0000","last_clean":"2023-05-24T03:31:55.033247+0000","last_became_active":"2023-05-24T03:29:44.496030+0000","last_became_peered":"2023-05-24T03:29:44.496030+0000","last_unstale":"2023-05-24T03:31:55.033247+0000","last_undegraded":"2023-05-24T03:31:55.033247+0000","last_fullsized":"2023-05-24T03:31:55.033247+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:53:00.715123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"30'465","reported_seq":483,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.638847+0000","last_change":"2023-05-24T03:29:48.523816+0000","last_active":"2023-05-24T03:31:55.638847+0000","last_peered":"2023-05-24T03:31:55.638847+0000","last_clean":"2023-05-24T03:31:55.638847+0000","last_became_active":"2023-05-24T03:29:48.523380+0000","last_became_peered":"2023-05-24T03:29:48.523380+0000","last_unstale":"2023-05-24T03:31:55.638847+0000","last_undegraded":"2023-05-24T03:31:55.638847+0000","last_fullsized":"2023-05-24T03:31:55.638847+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:24:51.361665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.948180+0000","last_change":"2023-05-24T03:29:39.051113+0000","last_active":"2023-05-24T03:30:25.948180+0000","last_peered":"2023-05-24T03:30:25.948180+0000","last_clean":"2023-05-24T03:30:25.948180+0000","last_became_active":"2023-05-24T03:29:39.050751+0000","last_became_peered":"2023-05-24T03:29:39.050751+0000","last_unstale":"2023-05-24T03:30:25.948180+0000","last_undegraded":"2023-05-24T03:30:25.948180+0000","last_fullsized":"2023-05-24T03:30:25.948180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:30:48.280021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":188,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.948889+0000","last_change":"2023-05-24T03:29:34.025679+0000","last_active":"2023-05-24T03:30:25.948889+0000","last_peered":"2023-05-24T03:30:25.948889+0000","last_clean":"2023-05-24T03:30:25.948889+0000","last_became_active":"2023-05-24T03:29:34.024728+0000","last_became_peered":"2023-05-24T03:29:34.024728+0000","last_unstale":"2023-05-24T03:30:25.948889+0000","last_undegraded":"2023-05-24T03:30:25.948889+0000","last_fullsized":"2023-05-24T03:30:25.948889+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:32.968348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:32.968348+0000","last_clean_scrub_stamp":"2023-05-24T03:29:32.968348+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:52:49.623148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:26.804884+0000","last_change":"2023-05-24T03:29:44.086373+0000","last_active":"2023-05-24T03:30:26.804884+0000","last_peered":"2023-05-24T03:30:26.804884+0000","last_clean":"2023-05-24T03:30:26.804884+0000","last_became_active":"2023-05-24T03:29:44.086125+0000","last_became_peered":"2023-05-24T03:29:44.086125+0000","last_unstale":"2023-05-24T03:30:26.804884+0000","last_undegraded":"2023-05-24T03:30:26.804884+0000","last_fullsized":"2023-05-24T03:30:26.804884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:03:28.807318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"30'15","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.033691+0000","last_change":"2023-05-24T03:29:44.492654+0000","last_active":"2023-05-24T03:31:55.033691+0000","last_peered":"2023-05-24T03:31:55.033691+0000","last_clean":"2023-05-24T03:31:55.033691+0000","last_became_active":"2023-05-24T03:29:44.492375+0000","last_became_peered":"2023-05-24T03:29:44.492375+0000","last_unstale":"2023-05-24T03:31:55.033691+0000","last_undegraded":"2023-05-24T03:31:55.033691+0000","last_fullsized":"2023-05-24T03:31:55.033691+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:14:30.274935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"30'436","reported_seq":453,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.876352+0000","last_change":"2023-05-24T03:29:48.525206+0000","last_active":"2023-05-24T03:31:54.876352+0000","last_peered":"2023-05-24T03:31:54.876352+0000","last_clean":"2023-05-24T03:31:54.876352+0000","last_became_active":"2023-05-24T03:29:48.524615+0000","last_became_peered":"2023-05-24T03:29:48.524615+0000","last_unstale":"2023-05-24T03:31:54.876352+0000","last_undegraded":"2023-05-24T03:31:54.876352+0000","last_fullsized":"2023-05-24T03:31:54.876352+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:15:16.805837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.949105+0000","last_change":"2023-05-24T03:29:39.054117+0000","last_active":"2023-05-24T03:30:25.949105+0000","last_peered":"2023-05-24T03:30:25.949105+0000","last_clean":"2023-05-24T03:30:25.949105+0000","last_became_active":"2023-05-24T03:29:39.053813+0000","last_became_peered":"2023-05-24T03:29:39.053813+0000","last_unstale":"2023-05-24T03:30:25.949105+0000","last_undegraded":"2023-05-24T03:30:25.949105+0000","last_fullsized":"2023-05-24T03:30:25.949105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:20:55.877097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"30'11","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.627272+0000","last_change":"2023-05-24T03:29:44.090147+0000","last_active":"2023-05-24T03:31:55.627272+0000","last_peered":"2023-05-24T03:31:55.627272+0000","last_clean":"2023-05-24T03:31:55.627272+0000","last_became_active":"2023-05-24T03:29:44.089943+0000","last_became_peered":"2023-05-24T03:29:44.089943+0000","last_unstale":"2023-05-24T03:31:55.627272+0000","last_undegraded":"2023-05-24T03:31:55.627272+0000","last_fullsized":"2023-05-24T03:31:55.627272+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:52:59.708678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6444,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":10,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"30'18","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.051202+0000","last_change":"2023-05-24T03:29:44.498467+0000","last_active":"2023-05-24T03:31:55.051202+0000","last_peered":"2023-05-24T03:31:55.051202+0000","last_clean":"2023-05-24T03:31:55.051202+0000","last_became_active":"2023-05-24T03:29:44.498130+0000","last_became_peered":"2023-05-24T03:29:44.498130+0000","last_unstale":"2023-05-24T03:31:55.051202+0000","last_undegraded":"2023-05-24T03:31:55.051202+0000","last_fullsized":"2023-05-24T03:31:55.051202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:37:45.262523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"30'488","reported_seq":506,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.649800+0000","last_change":"2023-05-24T03:29:48.520034+0000","last_active":"2023-05-24T03:31:55.649800+0000","last_peered":"2023-05-24T03:31:55.649800+0000","last_clean":"2023-05-24T03:31:55.649800+0000","last_became_active":"2023-05-24T03:29:48.519673+0000","last_became_peered":"2023-05-24T03:29:48.519673+0000","last_unstale":"2023-05-24T03:31:55.649800+0000","last_undegraded":"2023-05-24T03:31:55.649800+0000","last_fullsized":"2023-05-24T03:31:55.649800+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:17:11.019561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.949461+0000","last_change":"2023-05-24T03:29:39.143215+0000","last_active":"2023-05-24T03:30:25.949461+0000","last_peered":"2023-05-24T03:30:25.949461+0000","last_clean":"2023-05-24T03:30:25.949461+0000","last_became_active":"2023-05-24T03:29:39.142949+0000","last_became_peered":"2023-05-24T03:29:39.142949+0000","last_unstale":"2023-05-24T03:30:25.949461+0000","last_undegraded":"2023-05-24T03:30:25.949461+0000","last_fullsized":"2023-05-24T03:30:25.949461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:06:13.199168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"30'2","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:51.960970+0000","last_change":"2023-05-24T03:29:44.074869+0000","last_active":"2023-05-24T03:31:51.960970+0000","last_peered":"2023-05-24T03:31:51.960970+0000","last_clean":"2023-05-24T03:31:51.960970+0000","last_became_active":"2023-05-24T03:29:44.074374+0000","last_became_peered":"2023-05-24T03:29:44.074374+0000","last_unstale":"2023-05-24T03:31:51.960970+0000","last_undegraded":"2023-05-24T03:31:51.960970+0000","last_fullsized":"2023-05-24T03:31:51.960970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:37:44.256077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"30'16","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.049875+0000","last_change":"2023-05-24T03:29:44.499979+0000","last_active":"2023-05-24T03:31:55.049875+0000","last_peered":"2023-05-24T03:31:55.049875+0000","last_clean":"2023-05-24T03:31:55.049875+0000","last_became_active":"2023-05-24T03:29:44.499768+0000","last_became_peered":"2023-05-24T03:29:44.499768+0000","last_unstale":"2023-05-24T03:31:55.049875+0000","last_undegraded":"2023-05-24T03:31:55.049875+0000","last_fullsized":"2023-05-24T03:31:55.049875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:11:59.800632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"30'478","reported_seq":496,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.634562+0000","last_change":"2023-05-24T03:29:48.530781+0000","last_active":"2023-05-24T03:31:55.634562+0000","last_peered":"2023-05-24T03:31:55.634562+0000","last_clean":"2023-05-24T03:31:55.634562+0000","last_became_active":"2023-05-24T03:29:48.530401+0000","last_became_peered":"2023-05-24T03:29:48.530401+0000","last_unstale":"2023-05-24T03:31:55.634562+0000","last_undegraded":"2023-05-24T03:31:55.634562+0000","last_fullsized":"2023-05-24T03:31:55.634562+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:28:34.171252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"30'3","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:52.027244+0000","last_change":"2023-05-24T03:29:44.084278+0000","last_active":"2023-05-24T03:31:52.027244+0000","last_peered":"2023-05-24T03:31:52.027244+0000","last_clean":"2023-05-24T03:31:52.027244+0000","last_became_active":"2023-05-24T03:29:44.083929+0000","last_became_peered":"2023-05-24T03:29:44.083929+0000","last_unstale":"2023-05-24T03:31:52.027244+0000","last_undegraded":"2023-05-24T03:31:52.027244+0000","last_fullsized":"2023-05-24T03:31:52.027244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:08:29.969550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.946231+0000","last_change":"2023-05-24T03:29:39.045821+0000","last_active":"2023-05-24T03:30:25.946231+0000","last_peered":"2023-05-24T03:30:25.946231+0000","last_clean":"2023-05-24T03:30:25.946231+0000","last_became_active":"2023-05-24T03:29:39.045543+0000","last_became_peered":"2023-05-24T03:29:39.045543+0000","last_unstale":"2023-05-24T03:30:25.946231+0000","last_undegraded":"2023-05-24T03:30:25.946231+0000","last_fullsized":"2023-05-24T03:30:25.946231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:57:43.697063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"30'16","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.040363+0000","last_change":"2023-05-24T03:29:44.496106+0000","last_active":"2023-05-24T03:31:55.040363+0000","last_peered":"2023-05-24T03:31:55.040363+0000","last_clean":"2023-05-24T03:31:55.040363+0000","last_became_active":"2023-05-24T03:29:44.495816+0000","last_became_peered":"2023-05-24T03:29:44.495816+0000","last_unstale":"2023-05-24T03:31:55.040363+0000","last_undegraded":"2023-05-24T03:31:55.040363+0000","last_fullsized":"2023-05-24T03:31:55.040363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:56:16.400543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"30'438","reported_seq":456,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.998273+0000","last_change":"2023-05-24T03:29:48.527602+0000","last_active":"2023-05-24T03:31:54.998273+0000","last_peered":"2023-05-24T03:31:54.998273+0000","last_clean":"2023-05-24T03:31:54.998273+0000","last_became_active":"2023-05-24T03:29:48.527196+0000","last_became_peered":"2023-05-24T03:29:48.527196+0000","last_unstale":"2023-05-24T03:31:54.998273+0000","last_undegraded":"2023-05-24T03:31:54.998273+0000","last_fullsized":"2023-05-24T03:31:54.998273+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:37:48.684803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13631488,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":31744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:26.804512+0000","last_change":"2023-05-24T03:29:39.046445+0000","last_active":"2023-05-24T03:30:26.804512+0000","last_peered":"2023-05-24T03:30:26.804512+0000","last_clean":"2023-05-24T03:30:26.804512+0000","last_became_active":"2023-05-24T03:29:39.046149+0000","last_became_peered":"2023-05-24T03:29:39.046149+0000","last_unstale":"2023-05-24T03:30:26.804512+0000","last_undegraded":"2023-05-24T03:30:26.804512+0000","last_fullsized":"2023-05-24T03:30:26.804512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:09:38.768895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"30'9","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.185381+0000","last_change":"2023-05-24T03:29:44.088780+0000","last_active":"2023-05-24T03:31:54.185381+0000","last_peered":"2023-05-24T03:31:54.185381+0000","last_clean":"2023-05-24T03:31:54.185381+0000","last_became_active":"2023-05-24T03:29:44.088495+0000","last_became_peered":"2023-05-24T03:29:44.088495+0000","last_unstale":"2023-05-24T03:31:54.185381+0000","last_undegraded":"2023-05-24T03:31:54.185381+0000","last_fullsized":"2023-05-24T03:31:54.185381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:28:23.442311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"30'8","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.031293+0000","last_change":"2023-05-24T03:29:44.496966+0000","last_active":"2023-05-24T03:31:55.031293+0000","last_peered":"2023-05-24T03:31:55.031293+0000","last_clean":"2023-05-24T03:31:55.031293+0000","last_became_active":"2023-05-24T03:29:44.496597+0000","last_became_peered":"2023-05-24T03:29:44.496597+0000","last_unstale":"2023-05-24T03:31:55.031293+0000","last_undegraded":"2023-05-24T03:31:55.031293+0000","last_fullsized":"2023-05-24T03:31:55.031293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:32:09.391394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"30'462","reported_seq":479,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.890055+0000","last_change":"2023-05-24T03:29:48.524541+0000","last_active":"2023-05-24T03:31:54.890055+0000","last_peered":"2023-05-24T03:31:54.890055+0000","last_clean":"2023-05-24T03:31:54.890055+0000","last_became_active":"2023-05-24T03:29:48.524170+0000","last_became_peered":"2023-05-24T03:29:48.524170+0000","last_unstale":"2023-05-24T03:31:54.890055+0000","last_undegraded":"2023-05-24T03:31:54.890055+0000","last_fullsized":"2023-05-24T03:31:54.890055+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:21:05.323975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:26.131668+0000","last_change":"2023-05-24T03:29:44.090259+0000","last_active":"2023-05-24T03:30:26.131668+0000","last_peered":"2023-05-24T03:30:26.131668+0000","last_clean":"2023-05-24T03:30:26.131668+0000","last_became_active":"2023-05-24T03:29:44.089993+0000","last_became_peered":"2023-05-24T03:29:44.089993+0000","last_unstale":"2023-05-24T03:30:26.131668+0000","last_undegraded":"2023-05-24T03:30:26.131668+0000","last_fullsized":"2023-05-24T03:30:26.131668+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:21:00.895250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"30'17","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.038326+0000","last_change":"2023-05-24T03:29:44.481933+0000","last_active":"2023-05-24T03:31:55.038326+0000","last_peered":"2023-05-24T03:31:55.038326+0000","last_clean":"2023-05-24T03:31:55.038326+0000","last_became_active":"2023-05-24T03:29:44.481655+0000","last_became_peered":"2023-05-24T03:29:44.481655+0000","last_unstale":"2023-05-24T03:31:55.038326+0000","last_undegraded":"2023-05-24T03:31:55.038326+0000","last_fullsized":"2023-05-24T03:31:55.038326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:32:32.559676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"30'471","reported_seq":488,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.643022+0000","last_change":"2023-05-24T03:29:48.516800+0000","last_active":"2023-05-24T03:31:55.643022+0000","last_peered":"2023-05-24T03:31:55.643022+0000","last_clean":"2023-05-24T03:31:55.643022+0000","last_became_active":"2023-05-24T03:29:48.516366+0000","last_became_peered":"2023-05-24T03:29:48.516366+0000","last_unstale":"2023-05-24T03:31:55.643022+0000","last_undegraded":"2023-05-24T03:31:55.643022+0000","last_fullsized":"2023-05-24T03:31:55.643022+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:10:18.027326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.947901+0000","last_change":"2023-05-24T03:29:44.094179+0000","last_active":"2023-05-24T03:30:25.947901+0000","last_peered":"2023-05-24T03:30:25.947901+0000","last_clean":"2023-05-24T03:30:25.947901+0000","last_became_active":"2023-05-24T03:29:44.093909+0000","last_became_peered":"2023-05-24T03:29:44.093909+0000","last_unstale":"2023-05-24T03:30:25.947901+0000","last_undegraded":"2023-05-24T03:30:25.947901+0000","last_fullsized":"2023-05-24T03:30:25.947901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:09:02.075394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"30'13","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.043652+0000","last_change":"2023-05-24T03:29:44.497379+0000","last_active":"2023-05-24T03:31:55.043652+0000","last_peered":"2023-05-24T03:31:55.043652+0000","last_clean":"2023-05-24T03:31:55.043652+0000","last_became_active":"2023-05-24T03:29:44.496679+0000","last_became_peered":"2023-05-24T03:29:44.496679+0000","last_unstale":"2023-05-24T03:31:55.043652+0000","last_undegraded":"2023-05-24T03:31:55.043652+0000","last_fullsized":"2023-05-24T03:31:55.043652+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:14:25.131724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"30'454","reported_seq":471,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.891571+0000","last_change":"2023-05-24T03:29:48.529231+0000","last_active":"2023-05-24T03:31:54.891571+0000","last_peered":"2023-05-24T03:31:54.891571+0000","last_clean":"2023-05-24T03:31:54.891571+0000","last_became_active":"2023-05-24T03:29:48.528862+0000","last_became_peered":"2023-05-24T03:29:48.528862+0000","last_unstale":"2023-05-24T03:31:54.891571+0000","last_undegraded":"2023-05-24T03:31:54.891571+0000","last_fullsized":"2023-05-24T03:31:54.891571+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:28:27.871037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"30'3","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.947544+0000","last_change":"2023-05-24T03:29:44.090289+0000","last_active":"2023-05-24T03:30:25.947544+0000","last_peered":"2023-05-24T03:30:25.947544+0000","last_clean":"2023-05-24T03:30:25.947544+0000","last_became_active":"2023-05-24T03:29:44.089949+0000","last_became_peered":"2023-05-24T03:29:44.089949+0000","last_unstale":"2023-05-24T03:30:25.947544+0000","last_undegraded":"2023-05-24T03:30:25.947544+0000","last_fullsized":"2023-05-24T03:30:25.947544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:24:46.932939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'12","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.042240+0000","last_change":"2023-05-24T03:29:44.498632+0000","last_active":"2023-05-24T03:31:55.042240+0000","last_peered":"2023-05-24T03:31:55.042240+0000","last_clean":"2023-05-24T03:31:55.042240+0000","last_became_active":"2023-05-24T03:29:44.498350+0000","last_became_peered":"2023-05-24T03:29:44.498350+0000","last_unstale":"2023-05-24T03:31:55.042240+0000","last_undegraded":"2023-05-24T03:31:55.042240+0000","last_fullsized":"2023-05-24T03:31:55.042240+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:22:26.333903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"30'476","reported_seq":493,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.635369+0000","last_change":"2023-05-24T03:29:48.523434+0000","last_active":"2023-05-24T03:31:55.635369+0000","last_peered":"2023-05-24T03:31:55.635369+0000","last_clean":"2023-05-24T03:31:55.635369+0000","last_became_active":"2023-05-24T03:29:48.522228+0000","last_became_peered":"2023-05-24T03:29:48.522228+0000","last_unstale":"2023-05-24T03:31:55.635369+0000","last_undegraded":"2023-05-24T03:31:55.635369+0000","last_fullsized":"2023-05-24T03:31:55.635369+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:40:50.804869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:26.805353+0000","last_change":"2023-05-24T03:29:44.083178+0000","last_active":"2023-05-24T03:30:26.805353+0000","last_peered":"2023-05-24T03:30:26.805353+0000","last_clean":"2023-05-24T03:30:26.805353+0000","last_became_active":"2023-05-24T03:29:44.082903+0000","last_became_peered":"2023-05-24T03:29:44.082903+0000","last_unstale":"2023-05-24T03:30:26.805353+0000","last_undegraded":"2023-05-24T03:30:26.805353+0000","last_fullsized":"2023-05-24T03:30:26.805353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:56:27.514130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"30'19","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.043523+0000","last_change":"2023-05-24T03:29:44.488206+0000","last_active":"2023-05-24T03:31:55.043523+0000","last_peered":"2023-05-24T03:31:55.043523+0000","last_clean":"2023-05-24T03:31:55.043523+0000","last_became_active":"2023-05-24T03:29:44.487925+0000","last_became_peered":"2023-05-24T03:29:44.487925+0000","last_unstale":"2023-05-24T03:31:55.043523+0000","last_undegraded":"2023-05-24T03:31:55.043523+0000","last_fullsized":"2023-05-24T03:31:55.043523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:28:43.398723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"30'482","reported_seq":499,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.819538+0000","last_change":"2023-05-24T03:29:48.519899+0000","last_active":"2023-05-24T03:31:54.819538+0000","last_peered":"2023-05-24T03:31:54.819538+0000","last_clean":"2023-05-24T03:31:54.819538+0000","last_became_active":"2023-05-24T03:29:48.519517+0000","last_became_peered":"2023-05-24T03:29:48.519517+0000","last_unstale":"2023-05-24T03:31:54.819538+0000","last_undegraded":"2023-05-24T03:31:54.819538+0000","last_fullsized":"2023-05-24T03:31:54.819538+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:21:09.342432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"30'5","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:51.943205+0000","last_change":"2023-05-24T03:29:44.088545+0000","last_active":"2023-05-24T03:31:51.943205+0000","last_peered":"2023-05-24T03:31:51.943205+0000","last_clean":"2023-05-24T03:31:51.943205+0000","last_became_active":"2023-05-24T03:29:44.087891+0000","last_became_peered":"2023-05-24T03:29:44.087891+0000","last_unstale":"2023-05-24T03:31:51.943205+0000","last_undegraded":"2023-05-24T03:31:51.943205+0000","last_fullsized":"2023-05-24T03:31:51.943205+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:26:41.155647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"30'23","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.037013+0000","last_change":"2023-05-24T03:29:44.493246+0000","last_active":"2023-05-24T03:31:55.037013+0000","last_peered":"2023-05-24T03:31:55.037013+0000","last_clean":"2023-05-24T03:31:55.037013+0000","last_became_active":"2023-05-24T03:29:44.492923+0000","last_became_peered":"2023-05-24T03:29:44.492923+0000","last_unstale":"2023-05-24T03:31:55.037013+0000","last_undegraded":"2023-05-24T03:31:55.037013+0000","last_fullsized":"2023-05-24T03:31:55.037013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:11:24.300717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"30'27","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.039268+0000","last_change":"2023-05-24T03:29:44.486961+0000","last_active":"2023-05-24T03:31:55.039268+0000","last_peered":"2023-05-24T03:31:55.039268+0000","last_clean":"2023-05-24T03:31:55.039268+0000","last_became_active":"2023-05-24T03:29:44.483898+0000","last_became_peered":"2023-05-24T03:29:44.483898+0000","last_unstale":"2023-05-24T03:31:55.039268+0000","last_undegraded":"2023-05-24T03:31:55.039268+0000","last_fullsized":"2023-05-24T03:31:55.039268+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:58:20.689097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"30'20","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.035003+0000","last_change":"2023-05-24T03:29:44.494451+0000","last_active":"2023-05-24T03:31:55.035003+0000","last_peered":"2023-05-24T03:31:55.035003+0000","last_clean":"2023-05-24T03:31:55.035003+0000","last_became_active":"2023-05-24T03:29:44.494073+0000","last_became_peered":"2023-05-24T03:29:44.494073+0000","last_unstale":"2023-05-24T03:31:55.035003+0000","last_undegraded":"2023-05-24T03:31:55.035003+0000","last_fullsized":"2023-05-24T03:31:55.035003+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:09:03.081839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"30'18","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.037312+0000","last_change":"2023-05-24T03:29:44.498119+0000","last_active":"2023-05-24T03:31:55.037312+0000","last_peered":"2023-05-24T03:31:55.037312+0000","last_clean":"2023-05-24T03:31:55.037312+0000","last_became_active":"2023-05-24T03:29:44.497832+0000","last_became_peered":"2023-05-24T03:29:44.497832+0000","last_unstale":"2023-05-24T03:31:55.037312+0000","last_undegraded":"2023-05-24T03:31:55.037312+0000","last_fullsized":"2023-05-24T03:31:55.037312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:29:45.352536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"30'15","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.042561+0000","last_change":"2023-05-24T03:29:44.496468+0000","last_active":"2023-05-24T03:31:55.042561+0000","last_peered":"2023-05-24T03:31:55.042561+0000","last_clean":"2023-05-24T03:31:55.042561+0000","last_became_active":"2023-05-24T03:29:44.496197+0000","last_became_peered":"2023-05-24T03:29:44.496197+0000","last_unstale":"2023-05-24T03:31:55.042561+0000","last_undegraded":"2023-05-24T03:31:55.042561+0000","last_fullsized":"2023-05-24T03:31:55.042561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:47:03.515144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"30'12","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.034205+0000","last_change":"2023-05-24T03:29:44.495194+0000","last_active":"2023-05-24T03:31:55.034205+0000","last_peered":"2023-05-24T03:31:55.034205+0000","last_clean":"2023-05-24T03:31:55.034205+0000","last_became_active":"2023-05-24T03:29:44.494928+0000","last_became_peered":"2023-05-24T03:29:44.494928+0000","last_unstale":"2023-05-24T03:31:55.034205+0000","last_undegraded":"2023-05-24T03:31:55.034205+0000","last_fullsized":"2023-05-24T03:31:55.034205+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:10:14.605046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":262144000,"num_objects":64,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":342,"num_write_kb":812032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":524288000,"data_stored":524288000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14714,"ondisk_log_size":14714,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1048,"ondisk_log_size":1048,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1397644,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":419,"num_write_kb":1638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2859008,"data_stored":2795288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":422,"ondisk_log_size":422,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99380,"kb_used_data":68332,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94272460,"statfs":{"total":96636764160,"available":96534999040,"internally_reserved":0,"allocated":69971968,"data_stored":69752984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":4.7569999999999997,"5min":1.3480000000000001,"15min":0.78000000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":14.757999999999999,"5min":14.757999999999999,"15min":14.757999999999999},"last":0.29899999999999999},{"interface":"front","average":{"1min":6.2599999999999998,"5min":1.663,"15min":0.89700000000000002},"min":{"1min":0.307,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":17.954000000000001,"5min":17.954000000000001,"15min":17.954000000000001},"last":0.45700000000000002}]},{"osd":1,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":4.8380000000000001,"5min":1.3740000000000001,"15min":0.79600000000000004},"min":{"1min":0.35599999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":16.939,"5min":16.939,"15min":16.939},"last":0.36799999999999999},{"interface":"front","average":{"1min":6.6909999999999998,"5min":1.766,"15min":0.94499999999999995},"min":{"1min":0.35599999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":17.981999999999999,"5min":17.981999999999999,"15min":17.981999999999999},"last":0.504}]},{"osd":2,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":6.1429999999999998,"5min":1.641,"15min":0.89100000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":14.720000000000001,"5min":14.720000000000001,"15min":14.720000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":5.6150000000000002,"5min":1.5469999999999999,"15min":0.86899999999999999},"min":{"1min":0.40799999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":14.814,"5min":14.814,"15min":14.814},"last":0.59399999999999997}]},{"osd":3,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":6.3620000000000001,"5min":1.7150000000000001,"15min":0.94099999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":22.977,"5min":22.977,"15min":22.977},"last":0.54500000000000004},{"interface":"front","average":{"1min":4.742,"5min":1.3779999999999999,"15min":0.81699999999999995},"min":{"1min":0.47099999999999997,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":14.836,"5min":14.836,"15min":14.836},"last":0.628}]},{"osd":4,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":4.8449999999999998,"5min":1.345,"15min":0.76200000000000001},"min":{"1min":0.35099999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":18.027000000000001,"5min":18.027000000000001,"15min":18.027000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":3.347,"5min":1.077,"15min":0.69899999999999995},"min":{"1min":0.36299999999999999,"5min":0.307,"15min":0.307},"max":{"1min":22.922000000000001,"5min":22.922000000000001,"15min":22.922000000000001},"last":0.51500000000000001}]},{"osd":5,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":3.512,"5min":1.1579999999999999,"15min":0.76600000000000001},"min":{"1min":0.39700000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":17.925999999999998,"5min":17.925999999999998,"15min":17.925999999999998},"last":0.56200000000000006},{"interface":"front","average":{"1min":3.79,"5min":1.206,"15min":0.77600000000000002},"min":{"1min":0.42099999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":18.004999999999999,"5min":18.004999999999999,"15min":18.004999999999999},"last":0.55500000000000005}]},{"osd":6,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":5.5069999999999997,"5min":1.5609999999999999,"15min":0.90300000000000002},"min":{"1min":0.45900000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":23.933,"5min":23.933,"15min":23.933},"last":0.53200000000000003},{"interface":"front","average":{"1min":5.3019999999999996,"5min":1.534,"15min":0.90600000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":22.954000000000001,"5min":22.954000000000001,"15min":22.954000000000001},"last":0.58199999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574881,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84296,"kb_used_data":62272,"kb_used_omap":0,"kb_used_meta":22016,"kb_avail":94287544,"statfs":{"total":96636764160,"available":96550445056,"internally_reserved":0,"allocated":63766528,"data_stored":63577694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22544384},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":8.5820000000000007,"5min":2.4780000000000002,"15min":1.46},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":22.922999999999998,"5min":22.922999999999998,"15min":22.922999999999998},"last":0.35499999999999998},{"interface":"front","average":{"1min":7.4909999999999997,"5min":1.952,"15min":1.0289999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":28.870000000000001,"5min":28.870000000000001,"15min":28.870000000000001},"last":0.47599999999999998}]},{"osd":1,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":7.5229999999999997,"5min":2.3090000000000002,"15min":1.4399999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":22.984999999999999,"5min":22.984999999999999,"15min":22.984999999999999},"last":0.496},{"interface":"front","average":{"1min":6.492,"5min":2.0910000000000002,"15min":1.357},"min":{"1min":0.434,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":21.984999999999999,"5min":21.984999999999999,"15min":21.984999999999999},"last":0.33000000000000002}]},{"osd":2,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":5.6580000000000004,"5min":1.6020000000000001,"15min":0.92600000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":22.649999999999999,"5min":22.649999999999999,"15min":22.649999999999999},"last":0.36299999999999999},{"interface":"front","average":{"1min":7.5709999999999997,"5min":2.3199999999999998,"15min":1.4450000000000001},"min":{"1min":0.40100000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":23.035,"5min":23.035,"15min":23.035},"last":0.38400000000000001}]},{"osd":3,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":6.4699999999999998,"5min":1.8380000000000001,"15min":1.0660000000000001},"min":{"1min":0.42699999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":18.056000000000001,"5min":18.056000000000001,"15min":18.056000000000001},"last":0.377},{"interface":"front","average":{"1min":6.2069999999999999,"5min":1.7749999999999999,"15min":1.036},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":19.963999999999999,"5min":19.963999999999999,"15min":19.963999999999999},"last":0.40799999999999997}]},{"osd":4,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":5.3230000000000004,"5min":1.4830000000000001,"15min":0.84299999999999997},"min":{"1min":0.372,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":18.056000000000001,"5min":18.056000000000001,"15min":18.056000000000001},"last":0.313},{"interface":"front","average":{"1min":5.1360000000000001,"5min":1.476,"15min":0.86599999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":21.943999999999999,"5min":21.943999999999999,"15min":21.943999999999999},"last":0.42199999999999999}]},{"osd":5,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":4.7370000000000001,"5min":1.3799999999999999,"15min":0.81999999999999995},"min":{"1min":0.36599999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":11.976000000000001,"5min":11.976000000000001,"15min":11.976000000000001},"last":0.435},{"interface":"front","average":{"1min":7.032,"5min":1.9119999999999999,"15min":1.0589999999999999},"min":{"1min":0.44600000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":23.010999999999999,"5min":23.010999999999999,"15min":23.010999999999999},"last":0.44}]},{"osd":7,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":5.8639999999999999,"5min":1.6479999999999999,"15min":0.94599999999999995},"min":{"1min":0.48699999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":11.989000000000001,"5min":11.989000000000001,"15min":11.989000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":5.157,"5min":1.528,"15min":0.92300000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":21.042000000000002,"5min":21.042000000000002,"15min":21.042000000000002},"last":0.46700000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574881,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98632,"kb_used_data":76608,"kb_used_omap":0,"kb_used_meta":22016,"kb_avail":94273208,"statfs":{"total":96636764160,"available":96535764992,"internally_reserved":0,"allocated":78446592,"data_stored":78257758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22544384},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:31:32 2023","interfaces":[{"interface":"back","average":{"1min":5.5410000000000004,"5min":1.452,"15min":0.77000000000000002},"min":{"1min":0.24199999999999999,"5min":0.223,"15min":0.223},"max":{"1min":18.954000000000001,"5min":18.954000000000001,"15min":18.954000000000001},"last":0.23499999999999999},{"interface":"front","average":{"1min":6.6689999999999996,"5min":1.8400000000000001,"15min":1.0349999999999999},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":21.981999999999999,"5min":21.981999999999999,"15min":21.981999999999999},"last":0.221}]},{"osd":2,"last update":"Wed May 24 03:31:32 2023","interfaces":[{"interface":"back","average":{"1min":4.258,"5min":1.151,"15min":0.63300000000000001},"min":{"1min":0.255,"5min":0.221,"15min":0.221},"max":{"1min":15.004,"5min":15.004,"15min":15.004},"last":0.25600000000000001},{"interface":"front","average":{"1min":6.0179999999999998,"5min":1.5680000000000001,"15min":0.82599999999999996},"min":{"1min":0.29399999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":21.885000000000002,"5min":21.885000000000002,"15min":21.885000000000002},"last":0.26800000000000002}]},{"osd":3,"last update":"Wed May 24 03:31:32 2023","interfaces":[{"interface":"back","average":{"1min":4.5700000000000003,"5min":1.3160000000000001,"15min":0.77400000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":18.167000000000002,"5min":18.167000000000002,"15min":18.167000000000002},"last":0.32700000000000001},{"interface":"front","average":{"1min":3.7869999999999999,"5min":1.089,"15min":0.63900000000000001},"min":{"1min":0.33200000000000002,"5min":0.254,"15min":0.254},"max":{"1min":11.935,"5min":11.935,"15min":11.935},"last":0.30599999999999999}]},{"osd":4,"last update":"Wed May 24 03:31:32 2023","interfaces":[{"interface":"back","average":{"1min":7.3700000000000001,"5min":1.9259999999999999,"15min":1.018},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":28.891999999999999,"5min":28.891999999999999,"15min":28.891999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":7.6630000000000003,"5min":2.044,"15min":1.1080000000000001},"min":{"1min":0.376,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":21.954999999999998,"5min":21.954999999999998,"15min":21.954999999999998},"last":0.40899999999999997}]},{"osd":5,"last update":"Wed May 24 03:31:32 2023","interfaces":[{"interface":"back","average":{"1min":8.9190000000000005,"5min":2.323,"15min":1.2230000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":21.928000000000001,"5min":21.928000000000001,"15min":21.928000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":7.6909999999999998,"5min":2.0720000000000001,"15min":1.1359999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":19.757999999999999,"5min":19.757999999999999,"15min":19.757999999999999},"last":0.49199999999999999}]},{"osd":6,"last update":"Wed May 24 03:31:32 2023","interfaces":[{"interface":"back","average":{"1min":6.984,"5min":1.9039999999999999,"15min":1.0580000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":22.033999999999999,"5min":22.033999999999999,"15min":22.033999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":7.6849999999999996,"5min":2.0339999999999998,"15min":1.0920000000000001},"min":{"1min":0.40200000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":19.734999999999999,"5min":19.734999999999999,"15min":19.734999999999999},"last":0.51600000000000001}]},{"osd":7,"last update":"Wed May 24 03:31:32 2023","interfaces":[{"interface":"back","average":{"1min":8.1940000000000008,"5min":2.2130000000000001,"15min":1.216},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":21.994,"5min":21.994,"15min":21.994},"last":0.46999999999999997},{"interface":"front","average":{"1min":7.8959999999999999,"5min":2.109,"15min":1.145},"min":{"1min":0.47999999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":21.957999999999998,"5min":21.957999999999998,"15min":21.957999999999998},"last":0.502}]}]},{"osd":0,"up_from":13,"seq":55834574881,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98008,"kb_used_data":66960,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94273832,"statfs":{"total":96636764160,"available":96536403968,"internally_reserved":0,"allocated":68567040,"data_stored":68369392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":5.6539999999999999,"5min":1.4419999999999999,"15min":0.73999999999999999},"min":{"1min":0.29099999999999998,"5min":0.253,"15min":0.253},"max":{"1min":21.216000000000001,"5min":21.216000000000001,"15min":21.216000000000001},"last":0.30599999999999999},{"interface":"front","average":{"1min":6.9509999999999996,"5min":1.6930000000000001,"15min":0.81699999999999995},"min":{"1min":0.247,"5min":0.185,"15min":0.185},"max":{"1min":29.925000000000001,"5min":29.925000000000001,"15min":29.925000000000001},"last":0.26300000000000001}]},{"osd":2,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":5.431,"5min":1.403,"15min":0.73199999999999998},"min":{"1min":0.29099999999999998,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":19.018999999999998,"5min":19.018999999999998,"15min":19.018999999999998},"last":0.88800000000000001},{"interface":"front","average":{"1min":7.6340000000000003,"5min":1.861,"15min":0.89900000000000002},"min":{"1min":0.32700000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":21.945,"5min":21.945,"15min":21.945},"last":0.378}]},{"osd":3,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":5.6120000000000001,"5min":1.4630000000000001,"15min":0.77100000000000002},"min":{"1min":0.30599999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":25.381,"5min":25.381,"15min":25.381},"last":0.47699999999999998},{"interface":"front","average":{"1min":8.2040000000000006,"5min":2.0129999999999999,"15min":0.98099999999999998},"min":{"1min":0.38900000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":21.209,"5min":21.209,"15min":21.209},"last":0.51700000000000002}]},{"osd":4,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":8.1859999999999999,"5min":2.1680000000000001,"15min":1.165},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":22.030000000000001,"5min":22.030000000000001,"15min":22.030000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":7.9889999999999999,"5min":2.113,"15min":1.1339999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":25.279,"5min":25.279,"15min":25.279},"last":0.83199999999999996}]},{"osd":5,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":7.1589999999999998,"5min":1.9690000000000001,"15min":1.1040000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":25.329999999999998,"5min":25.329999999999998,"15min":25.329999999999998},"last":0.94799999999999995},{"interface":"front","average":{"1min":7.4630000000000001,"5min":2.0110000000000001,"15min":1.103},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":28.928000000000001,"5min":28.928000000000001,"15min":28.928000000000001},"last":0.86099999999999999}]},{"osd":6,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":6.9420000000000002,"5min":1.8899999999999999,"15min":1.048},"min":{"1min":0.376,"5min":0.37,"15min":0.37},"max":{"1min":21.132000000000001,"5min":21.132000000000001,"15min":21.132000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":7.8250000000000002,"5min":2.0550000000000002,"15min":1.093},"min":{"1min":0.44400000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":22.007000000000001,"5min":22.007000000000001,"15min":22.007000000000001},"last":0.68400000000000005}]},{"osd":7,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":9.327,"5min":2.3700000000000001,"15min":1.21},"min":{"1min":0.47799999999999998,"5min":0.437,"15min":0.437},"max":{"1min":21.983000000000001,"5min":21.983000000000001,"15min":21.983000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":7.0700000000000003,"5min":1.9359999999999999,"15min":1.0800000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":25.356000000000002,"5min":25.356000000000002,"15min":25.356000000000002},"last":0.79600000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574881,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73544,"kb_used_data":55616,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94298296,"statfs":{"total":96636764160,"available":96561455104,"internally_reserved":0,"allocated":56950784,"data_stored":56761950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":2.8090000000000002,"5min":0.83899999999999997,"15min":0.51100000000000001},"min":{"1min":0.26400000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":10.821999999999999,"5min":10.821999999999999,"15min":10.821999999999999},"last":0.24199999999999999},{"interface":"front","average":{"1min":2.762,"5min":0.96099999999999997,"15min":0.66100000000000003},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":11.743,"5min":11.743,"15min":11.743},"last":0.32400000000000001}]},{"osd":1,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":2.4900000000000002,"5min":0.80600000000000005,"15min":0.52500000000000002},"min":{"1min":0.316,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":12.079000000000001,"5min":12.079000000000001,"15min":12.079000000000001},"last":0.27800000000000002},{"interface":"front","average":{"1min":3.9860000000000002,"5min":1.234,"15min":0.77600000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":19.954000000000001,"5min":19.954000000000001,"15min":19.954000000000001},"last":0.35599999999999998}]},{"osd":3,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":4.5510000000000002,"5min":1.214,"15min":0.65800000000000003},"min":{"1min":0.313,"5min":0.255,"15min":0.255},"max":{"1min":21.611000000000001,"5min":21.611000000000001,"15min":21.611000000000001},"last":0.26200000000000001},{"interface":"front","average":{"1min":3.4460000000000002,"5min":1.034,"15min":0.63200000000000001},"min":{"1min":0.34999999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":21.055,"5min":21.055,"15min":21.055},"last":0.308}]},{"osd":4,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":4.8609999999999998,"5min":1.4690000000000001,"15min":0.90400000000000003},"min":{"1min":0.39600000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":16.657,"5min":16.657,"15min":16.657},"last":0.52700000000000002},{"interface":"front","average":{"1min":4.1879999999999997,"5min":1.4319999999999999,"15min":0.97299999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":17.116,"5min":17.116,"15min":17.116},"last":0.51300000000000001}]},{"osd":5,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":5.6180000000000003,"5min":1.6100000000000001,"15min":0.94199999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":21.655000000000001,"5min":21.655000000000001,"15min":21.655000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":3.903,"5min":1.3,"15min":0.86599999999999999},"min":{"1min":0.42099999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":14.045999999999999,"5min":14.045999999999999,"15min":14.045999999999999},"last":0.46800000000000003}]},{"osd":6,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":4.8600000000000003,"5min":1.595,"15min":1.0509999999999999},"min":{"1min":0.48299999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":20.966999999999999,"5min":20.966999999999999,"15min":20.966999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":3.9710000000000001,"5min":1.2909999999999999,"15min":0.84499999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":15.119,"5min":15.119,"15min":15.119},"last":0.53900000000000003}]},{"osd":7,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":5.2690000000000001,"5min":1.6890000000000001,"15min":1.093},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":17.035,"5min":17.035,"15min":17.035},"last":0.47899999999999998},{"interface":"front","average":{"1min":5.0380000000000003,"5min":1.502,"15min":0.91200000000000003},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":18.611999999999998,"5min":18.611999999999998,"15min":18.611999999999998},"last":0.501}]}]},{"osd":3,"up_from":13,"seq":55834574880,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76620,"kb_used_data":58692,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94295220,"statfs":{"total":96636764160,"available":96558305280,"internally_reserved":0,"allocated":60100608,"data_stored":59907768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":4.7919999999999998,"5min":1.7130000000000001,"15min":1.2},"min":{"1min":0.25800000000000001,"5min":0.224,"15min":0.224},"max":{"1min":22.969000000000001,"5min":22.969000000000001,"15min":22.969000000000001},"last":0.317},{"interface":"front","average":{"1min":3.7040000000000002,"5min":1.4510000000000001,"15min":1.075},"min":{"1min":0.31,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":15.933999999999999,"5min":15.933999999999999,"15min":15.933999999999999},"last":0.28000000000000003}]},{"osd":1,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":3.2229999999999999,"5min":1.246,"15min":0.91600000000000004},"min":{"1min":0.28499999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":19.882000000000001,"5min":19.882000000000001,"15min":19.882000000000001},"last":0.29499999999999998},{"interface":"front","average":{"1min":3.5920000000000001,"5min":1.0569999999999999,"15min":0.63500000000000001},"min":{"1min":0.379,"5min":0.251,"15min":0.251},"max":{"1min":18.792000000000002,"5min":18.792000000000002,"15min":18.792000000000002},"last":0.22900000000000001}]},{"osd":2,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":5.7619999999999996,"5min":1.7709999999999999,"15min":1.1060000000000001},"min":{"1min":0.27200000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":22.922999999999998,"5min":22.922999999999998,"15min":22.922999999999998},"last":0.36399999999999999},{"interface":"front","average":{"1min":3.8540000000000001,"5min":2.3860000000000001,"15min":2.1419999999999999},"min":{"1min":0.318,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":19.645,"5min":22.919,"15min":22.919},"last":0.26200000000000001}]},{"osd":4,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":5.016,"5min":1.5069999999999999,"15min":0.92200000000000004},"min":{"1min":0.37,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":18.952000000000002,"5min":18.952000000000002,"15min":18.952000000000002},"last":0.48299999999999998},{"interface":"front","average":{"1min":6.4580000000000002,"5min":2.0539999999999998,"15min":1.3200000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":24.933,"5min":24.933,"15min":24.933},"last":0.49299999999999999}]},{"osd":5,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":5.4980000000000002,"5min":2.0209999999999999,"15min":1.4410000000000001},"min":{"1min":0.47699999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":20.056000000000001,"5min":20.056000000000001,"15min":20.056000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":5.3170000000000002,"5min":1.5649999999999999,"15min":0.93999999999999995},"min":{"1min":0.42399999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":16.013000000000002,"5min":16.013000000000002,"15min":16.013000000000002},"last":0.442}]},{"osd":6,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":4.3959999999999999,"5min":1.6759999999999999,"15min":1.222},"min":{"1min":0.433,"5min":0.379,"15min":0.379},"max":{"1min":13.986000000000001,"5min":13.986000000000001,"15min":13.986000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":4.9909999999999997,"5min":1.923,"15min":1.4119999999999999},"min":{"1min":0.43099999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":20.088000000000001,"5min":20.088000000000001,"15min":20.088000000000001},"last":0.40799999999999997}]},{"osd":7,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":5.7279999999999998,"5min":1.6639999999999999,"15min":0.98699999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":21.571000000000002,"5min":21.571000000000002,"15min":21.571000000000002},"last":0.39900000000000002},{"interface":"front","average":{"1min":4.6029999999999998,"5min":1.724,"15min":1.244},"min":{"1min":0.44400000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":13.922000000000001,"5min":13.922000000000001,"15min":13.922000000000001},"last":0.51000000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574881,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":103408,"kb_used_data":68264,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94268432,"statfs":{"total":96636764160,"available":96530874368,"internally_reserved":0,"allocated":69902336,"data_stored":69693188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:31:33 2023","interfaces":[{"interface":"back","average":{"1min":6.3440000000000003,"5min":1.663,"15min":0.88300000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":17.794,"5min":17.794,"15min":17.794},"last":0.438},{"interface":"front","average":{"1min":5.2089999999999996,"5min":1.448,"15min":0.82099999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":16.597999999999999,"5min":16.597999999999999,"15min":16.597999999999999},"last":0.504}]},{"osd":1,"last update":"Wed May 24 03:31:33 2023","interfaces":[{"interface":"back","average":{"1min":6.2549999999999999,"5min":1.6619999999999999,"15min":0.89600000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":22.933,"5min":22.933,"15min":22.933},"last":0.47699999999999998},{"interface":"front","average":{"1min":5.0650000000000004,"5min":1.4399999999999999,"15min":0.83599999999999997},"min":{"1min":0.35499999999999998,"5min":0.309,"15min":0.309},"max":{"1min":16.196000000000002,"5min":16.196000000000002,"15min":16.196000000000002},"last":0.55700000000000005}]},{"osd":2,"last update":"Wed May 24 03:31:33 2023","interfaces":[{"interface":"back","average":{"1min":5.0049999999999999,"5min":1.4119999999999999,"15min":0.81299999999999994},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":18.919,"5min":18.919,"15min":18.919},"last":0.40899999999999997},{"interface":"front","average":{"1min":5.391,"5min":1.4990000000000001,"15min":0.84999999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":16.277999999999999,"5min":16.277999999999999,"15min":16.277999999999999},"last":0.52600000000000002}]},{"osd":3,"last update":"Wed May 24 03:31:33 2023","interfaces":[{"interface":"back","average":{"1min":4.633,"5min":1.3169999999999999,"15min":0.76400000000000001},"min":{"1min":0.32000000000000001,"5min":0.312,"15min":0.312},"max":{"1min":18.956,"5min":18.956,"15min":18.956},"last":0.56999999999999995},{"interface":"front","average":{"1min":6.0899999999999999,"5min":1.651,"15min":0.91100000000000003},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":22.960000000000001,"5min":22.960000000000001,"15min":22.960000000000001},"last":0.42799999999999999}]},{"osd":5,"last update":"Wed May 24 03:31:33 2023","interfaces":[{"interface":"back","average":{"1min":4.0069999999999997,"5min":1.2230000000000001,"15min":0.75900000000000001},"min":{"1min":0.36199999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":16.231999999999999,"5min":16.231999999999999,"15min":16.231999999999999},"last":0.38900000000000001},{"interface":"front","average":{"1min":3.1560000000000001,"5min":1.0940000000000001,"15min":0.75},"min":{"1min":0.42399999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":11.904999999999999,"5min":11.904999999999999,"15min":11.904999999999999},"last":0.46100000000000002}]},{"osd":6,"last update":"Wed May 24 03:31:33 2023","interfaces":[{"interface":"back","average":{"1min":5.4790000000000001,"5min":1.492,"15min":0.82799999999999996},"min":{"1min":0.33400000000000002,"5min":0.315,"15min":0.315},"max":{"1min":22.983000000000001,"5min":22.983000000000001,"15min":22.983000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":3.2970000000000002,"5min":1.1100000000000001,"15min":0.746},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":12.367000000000001,"5min":12.367000000000001,"15min":12.367000000000001},"last":0.48699999999999999}]},{"osd":7,"last update":"Wed May 24 03:31:33 2023","interfaces":[{"interface":"back","average":{"1min":3.2090000000000001,"5min":1.085,"15min":0.73099999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":16.576000000000001,"5min":16.576000000000001,"15min":16.576000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":5.5149999999999997,"5min":1.5820000000000001,"15min":0.92600000000000005},"min":{"1min":0.432,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":22.882000000000001,"5min":22.882000000000001,"15min":22.882000000000001},"last":0.45200000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574880,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":83792,"kb_used_data":61768,"kb_used_omap":0,"kb_used_meta":22016,"kb_avail":94288048,"statfs":{"total":96636764160,"available":96550961152,"internally_reserved":0,"allocated":63250432,"data_stored":63054058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22544384},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,1,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:31:35 2023","interfaces":[{"interface":"back","average":{"1min":7.0830000000000002,"5min":1.831,"15min":0.95599999999999996},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":20.137,"5min":20.137,"15min":20.137},"last":0.93999999999999995},{"interface":"front","average":{"1min":6.6159999999999997,"5min":1.9019999999999999,"15min":1.1160000000000001},"min":{"1min":0.30499999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":25.988,"5min":25.988,"15min":25.988},"last":0.49199999999999999}]},{"osd":1,"last update":"Wed May 24 03:31:35 2023","interfaces":[{"interface":"back","average":{"1min":6.5759999999999996,"5min":1.748,"15min":0.94399999999999995},"min":{"1min":0.42799999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":22.765999999999998,"5min":22.765999999999998,"15min":22.765999999999998},"last":0.318},{"interface":"front","average":{"1min":7.2190000000000003,"5min":2.044,"15min":1.1819999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":20.161999999999999,"5min":20.161999999999999,"15min":20.161999999999999},"last":0.72999999999999998}]},{"osd":2,"last update":"Wed May 24 03:31:35 2023","interfaces":[{"interface":"back","average":{"1min":7.4820000000000002,"5min":1.929,"15min":1.0029999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":25.946000000000002,"5min":25.946000000000002,"15min":25.946000000000002},"last":0.71899999999999997},{"interface":"front","average":{"1min":5.6459999999999999,"5min":1.7490000000000001,"15min":1.099},"min":{"1min":0.45900000000000002,"5min":0.437,"15min":0.437},"max":{"1min":22.800000000000001,"5min":22.800000000000001,"15min":22.800000000000001},"last":1.0469999999999999}]},{"osd":3,"last update":"Wed May 24 03:31:35 2023","interfaces":[{"interface":"back","average":{"1min":6.093,"5min":1.9059999999999999,"15min":1.208},"min":{"1min":0.38600000000000001,"5min":0.375,"15min":0.375},"max":{"1min":26.013999999999999,"5min":26.013999999999999,"15min":26.013999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":6.2140000000000004,"5min":1.8959999999999999,"15min":1.1759999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":22.687999999999999,"5min":22.687999999999999,"15min":22.687999999999999},"last":0.42099999999999999}]},{"osd":4,"last update":"Wed May 24 03:31:35 2023","interfaces":[{"interface":"back","average":{"1min":5.6379999999999999,"5min":1.5289999999999999,"15min":0.84399999999999997},"min":{"1min":0.33500000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":19.998000000000001,"5min":19.998000000000001,"15min":19.998000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":4.3520000000000003,"5min":1.2929999999999999,"15min":0.78300000000000003},"min":{"1min":0.38800000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":17.628,"5min":17.628,"15min":17.628},"last":0.52500000000000002}]},{"osd":6,"last update":"Wed May 24 03:31:35 2023","interfaces":[{"interface":"back","average":{"1min":4.516,"5min":1.3420000000000001,"15min":0.81299999999999994},"min":{"1min":0.39600000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":19.969000000000001,"5min":19.969000000000001,"15min":19.969000000000001},"last":0.34899999999999998},{"interface":"front","average":{"1min":5.2229999999999999,"5min":1.4970000000000001,"15min":0.876},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":19.913,"5min":19.913,"15min":19.913},"last":1.117}]},{"osd":7,"last update":"Wed May 24 03:31:35 2023","interfaces":[{"interface":"back","average":{"1min":3.9180000000000001,"5min":1.274,"15min":0.83399999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":17.731000000000002,"5min":17.731000000000002,"15min":17.731000000000002},"last":0.55300000000000005},{"interface":"front","average":{"1min":4.2949999999999999,"5min":1.3620000000000001,"15min":0.873},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":20.099,"5min":20.099,"15min":20.099},"last":0.374}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":7026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1417216,"data_stored":1396902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1417216,"data_stored":1390618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":67633152,"data_stored":67633152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":78118912,"data_stored":78118912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":56623104,"data_stored":56623104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":59768832,"data_stored":59768832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":68157440,"data_stored":68157440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":62914560,"data_stored":62914560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":63438848,"data_stored":63438848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":67633152,"data_stored":67633152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-24T03:32:01.973 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-24T03:32:02.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.119+0000 7f7371ba5700 1 Processor -- start 2023-05-24T03:32:02.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.119+0000 7f7371ba5700 1 -- start start 2023-05-24T03:32:02.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.120+0000 7f7371ba5700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f736c15d140 0x7f736c15d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:02.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.120+0000 7f7371ba5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f736c071a10 0x7f736c071e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:02.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.120+0000 7f7371ba5700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f736c072370 con 0x7f736c1595f0 2023-05-24T03:32:02.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.120+0000 7f7371ba5700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f736c070f50 con 0x7f736c071a10 2023-05-24T03:32:02.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.120+0000 7f7371ba5700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f736c06db30 con 0x7f736c15d140 2023-05-24T03:32:02.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.120+0000 7f736bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f736c071a10 0x7f736c071e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:02.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.120+0000 7f736b7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f736c1595f0 0x7f736c0ca460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46918/0 (socket says 172.21.15.146:46918) 2023-05-24T03:32:02.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.120+0000 7f736b7fe700 1 -- 172.21.15.146:0/1372573487 learned_addr learned my addr 172.21.15.146:0/1372573487 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:32:02.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.120+0000 7f736bfff700 1 -- 172.21.15.146:0/1372573487 >> v2:172.21.15.151:3300/0 conn(0x7f736c15d140 msgr2=0x7f736c15d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:32:02.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.120+0000 7f736affd700 1 --2- 172.21.15.146:0/1372573487 >> v2:172.21.15.151:3300/0 conn(0x7f736c15d140 0x7f736c15d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:02.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.120+0000 7f736bfff700 1 --2- 172.21.15.146:0/1372573487 >> v2:172.21.15.151:3300/0 conn(0x7f736c15d140 0x7f736c15d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:02.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.120+0000 7f736bfff700 1 -- 172.21.15.146:0/1372573487 >> v1:172.21.15.146:6789/0 conn(0x7f736c1595f0 legacy=0x7f736c0ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:02.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.120+0000 7f736bfff700 1 -- 172.21.15.146:0/1372573487 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f736c15dc90 con 0x7f736c071a10 2023-05-24T03:32:02.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.120+0000 7f736a7fc700 1 -- 172.21.15.146:0/1372573487 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3240877215 0 0) 0x7f736c072370 con 0x7f736c1595f0 2023-05-24T03:32:02.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.121+0000 7f736bfff700 1 --2- 172.21.15.146:0/1372573487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f736c071a10 0x7f736c071e30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f736c06dfa0 tx=0x7f736400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=976d43f12f5c9f2e server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:02.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.121+0000 7f736a7fc700 1 -- 172.21.15.146:0/1372573487 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736400e070 con 0x7f736c071a10 2023-05-24T03:32:02.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.121+0000 7f736a7fc700 1 -- 172.21.15.146:0/1372573487 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f736400bbd0 con 0x7f736c071a10 2023-05-24T03:32:02.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.121+0000 7f736a7fc700 1 -- 172.21.15.146:0/1372573487 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7364012430 con 0x7f736c071a10 2023-05-24T03:32:02.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.121+0000 7f7371ba5700 1 -- 172.21.15.146:0/1372573487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f736c071a10 msgr2=0x7f736c071e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:02.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.121+0000 7f7371ba5700 1 --2- 172.21.15.146:0/1372573487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f736c071a10 0x7f736c071e30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f736c06dfa0 tx=0x7f736400b330 comp rx=0 tx=0).stop 2023-05-24T03:32:02.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.121+0000 7f7371ba5700 1 -- 172.21.15.146:0/1372573487 shutdown_connections 2023-05-24T03:32:02.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.121+0000 7f7371ba5700 1 --2- 172.21.15.146:0/1372573487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f736c071a10 0x7f736c071e30 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:02.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.121+0000 7f7371ba5700 1 --2- 172.21.15.146:0/1372573487 >> v2:172.21.15.151:3300/0 conn(0x7f736c15d140 0x7f736c15d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:02.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.121+0000 7f7371ba5700 1 -- 172.21.15.146:0/1372573487 >> 172.21.15.146:0/1372573487 conn(0x7f736c06ebf0 msgr2=0x7f736c06eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:32:02.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.121+0000 7f7371ba5700 1 -- 172.21.15.146:0/1372573487 shutdown_connections 2023-05-24T03:32:02.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.121+0000 7f7371ba5700 1 -- 172.21.15.146:0/1372573487 wait complete. 2023-05-24T03:32:02.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.123+0000 7f7371ba5700 1 Processor -- start 2023-05-24T03:32:02.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.123+0000 7f7371ba5700 1 -- start start 2023-05-24T03:32:02.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.124+0000 7f7371ba5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f736c071a10 0x7f736c06ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:02.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.124+0000 7f7371ba5700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f736c1595f0 0x7f736c14d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:02.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.124+0000 7f7371ba5700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f736c15d140 0x7f736c14bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:02.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.124+0000 7f7371ba5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f736c14ce00 con 0x7f736c071a10 2023-05-24T03:32:02.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.124+0000 7f7371ba5700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f736c06b340 con 0x7f736c1595f0 2023-05-24T03:32:02.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.124+0000 7f7371ba5700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f736c14c840 con 0x7f736c15d140 2023-05-24T03:32:02.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.124+0000 7f736b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f736c071a10 0x7f736c06ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:02.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.124+0000 7f736b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f736c071a10 0x7f736c06ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40468/0 (socket says 172.21.15.146:40468) 2023-05-24T03:32:02.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.124+0000 7f736b7fe700 1 -- 172.21.15.146:0/1222641277 learned_addr learned my addr 172.21.15.146:0/1222641277 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:32:02.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.124+0000 7f736affd700 1 --2- 172.21.15.146:0/1222641277 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f736c1595f0 0x7f736c14d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:02.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.124+0000 7f736bfff700 1 --2- 172.21.15.146:0/1222641277 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f736c15d140 0x7f736c14bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:02.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.124+0000 7f736b7fe700 1 -- 172.21.15.146:0/1222641277 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f736c15d140 msgr2=0x7f736c14bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:02.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.124+0000 7f736b7fe700 1 --2- 172.21.15.146:0/1222641277 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f736c15d140 0x7f736c14bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:02.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.124+0000 7f736b7fe700 1 -- 172.21.15.146:0/1222641277 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f736c1595f0 msgr2=0x7f736c14d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:02.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.124+0000 7f736b7fe700 1 --2- 172.21.15.146:0/1222641277 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f736c1595f0 0x7f736c14d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:02.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.125+0000 7f736b7fe700 1 -- 172.21.15.146:0/1222641277 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7364009a70 con 0x7f736c071a10 2023-05-24T03:32:02.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.125+0000 7f736bfff700 1 --2- 172.21.15.146:0/1222641277 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f736c15d140 0x7f736c14bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:32:02.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.125+0000 7f736affd700 1 --2- 172.21.15.146:0/1222641277 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f736c1595f0 0x7f736c14d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:32:02.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.125+0000 7f736b7fe700 1 --2- 172.21.15.146:0/1222641277 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f736c071a10 0x7f736c06ae00 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f73600011e0 tx=0x7f736000cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:02.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.125+0000 7f7353fff700 1 -- 172.21.15.146:0/1222641277 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7360004c80 con 0x7f736c071a10 2023-05-24T03:32:02.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.125+0000 7f7353fff700 1 -- 172.21.15.146:0/1222641277 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7360004e00 con 0x7f736c071a10 2023-05-24T03:32:02.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.125+0000 7f7371ba5700 1 -- 172.21.15.146:0/1222641277 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f736c071210 con 0x7f736c071a10 2023-05-24T03:32:02.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.125+0000 7f7353fff700 1 -- 172.21.15.146:0/1222641277 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7360007310 con 0x7f736c071a10 2023-05-24T03:32:02.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.125+0000 7f7371ba5700 1 -- 172.21.15.146:0/1222641277 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f736c15df70 con 0x7f736c071a10 2023-05-24T03:32:02.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.126+0000 7f7371ba5700 1 -- 172.21.15.146:0/1222641277 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f736c0714f0 con 0x7f736c071a10 2023-05-24T03:32:02.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.126+0000 7f7353fff700 1 -- 172.21.15.146:0/1222641277 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7360007470 con 0x7f736c071a10 2023-05-24T03:32:02.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.127+0000 7f7353fff700 1 --2- 172.21.15.146:0/1222641277 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f735806ace0 0x7f735806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:02.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.127+0000 7f736affd700 1 --2- 172.21.15.146:0/1222641277 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f735806ace0 0x7f735806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:02.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.127+0000 7f7353fff700 1 -- 172.21.15.146:0/1222641277 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7360089510 con 0x7f736c071a10 2023-05-24T03:32:02.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.127+0000 7f736affd700 1 --2- 172.21.15.146:0/1222641277 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f735806ace0 0x7f735806d190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f736c14cf70 tx=0x7f735c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:02.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.131+0000 7f7353fff700 1 -- 172.21.15.146:0/1222641277 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f7360054320 con 0x7f736c071a10 2023-05-24T03:32:02.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.317+0000 7f7371ba5700 1 -- 172.21.15.146:0/1222641277 --> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f736c04e810 con 0x7f735806ace0 2023-05-24T03:32:02.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.327+0000 7f7353fff700 1 -- 172.21.15.146:0/1222641277 <== mgr.4104 v2:172.21.15.146:6832/1985394169 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+391935 (secure 0 0 0) 0x7f736c04e810 con 0x7f735806ace0 2023-05-24T03:32:02.336 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:32:02.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.331+0000 7f7371ba5700 1 -- 172.21.15.146:0/1222641277 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f735806ace0 msgr2=0x7f735806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:02.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.331+0000 7f7371ba5700 1 --2- 172.21.15.146:0/1222641277 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f735806ace0 0x7f735806d190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f736c14cf70 tx=0x7f735c008040 comp rx=0 tx=0).stop 2023-05-24T03:32:02.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.331+0000 7f7371ba5700 1 -- 172.21.15.146:0/1222641277 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f736c071a10 msgr2=0x7f736c06ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:02.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.331+0000 7f7371ba5700 1 --2- 172.21.15.146:0/1222641277 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f736c071a10 0x7f736c06ae00 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f73600011e0 tx=0x7f736000cae0 comp rx=0 tx=0).stop 2023-05-24T03:32:02.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.331+0000 7f7371ba5700 1 -- 172.21.15.146:0/1222641277 shutdown_connections 2023-05-24T03:32:02.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.331+0000 7f7371ba5700 1 --2- 172.21.15.146:0/1222641277 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f735806ace0 0x7f735806d190 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:02.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.331+0000 7f7371ba5700 1 --2- 172.21.15.146:0/1222641277 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f736c15d140 0x7f736c14bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:02.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.331+0000 7f7371ba5700 1 --2- 172.21.15.146:0/1222641277 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f736c071a10 0x7f736c06ae00 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:02.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.331+0000 7f7371ba5700 1 --2- 172.21.15.146:0/1222641277 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f736c1595f0 0x7f736c14d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:02.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.331+0000 7f7371ba5700 1 -- 172.21.15.146:0/1222641277 >> 172.21.15.146:0/1222641277 conn(0x7f736c06ebf0 msgr2=0x7f736c071de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:32:02.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.331+0000 7f7371ba5700 1 -- 172.21.15.146:0/1222641277 shutdown_connections 2023-05-24T03:32:02.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.331+0000 7f7371ba5700 1 -- 172.21.15.146:0/1222641277 wait complete. 2023-05-24T03:32:02.341 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-05-24T03:32:02.348 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":98,"stamp":"2023-05-24T03:32:00.791562+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":264132012,"num_objects":89,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":126,"num_read_kb":114,"num_write":920,"num_write_kb":816086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16301,"ondisk_log_size":16301,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":717680,"kb_used_data":518512,"kb_used_omap":0,"kb_used_meta":199104,"kb_avail":754257040,"statfs":{"total":773094113280,"available":772359208960,"internally_reserved":0,"allocated":530956288,"data_stored":529374792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":203882496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,1,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-162252769,"num_objects":-40,"num_object_clones":0,"num_object_copies":-160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-40,"num_whiteouts":0,"num_read":7,"num_read_kb":11,"num_write":334,"num_write_kb":397645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003136"},"pg_stats":[{"pgid":"4.3f","version":"30'15","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.039569+0000","last_change":"2023-05-24T03:29:44.490120+0000","last_active":"2023-05-24T03:31:55.039569+0000","last_peered":"2023-05-24T03:31:55.039569+0000","last_clean":"2023-05-24T03:31:55.039569+0000","last_became_active":"2023-05-24T03:29:44.489854+0000","last_became_peered":"2023-05-24T03:29:44.489854+0000","last_unstale":"2023-05-24T03:31:55.039569+0000","last_undegraded":"2023-05-24T03:31:55.039569+0000","last_fullsized":"2023-05-24T03:31:55.039569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:27:13.487917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"30'11","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.032618+0000","last_change":"2023-05-24T03:29:44.495973+0000","last_active":"2023-05-24T03:31:55.032618+0000","last_peered":"2023-05-24T03:31:55.032618+0000","last_clean":"2023-05-24T03:31:55.032618+0000","last_became_active":"2023-05-24T03:29:44.495700+0000","last_became_peered":"2023-05-24T03:29:44.495700+0000","last_unstale":"2023-05-24T03:31:55.032618+0000","last_undegraded":"2023-05-24T03:31:55.032618+0000","last_fullsized":"2023-05-24T03:31:55.032618+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:46:55.999454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"30'22","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.047990+0000","last_change":"2023-05-24T03:29:44.499947+0000","last_active":"2023-05-24T03:31:55.047990+0000","last_peered":"2023-05-24T03:31:55.047990+0000","last_clean":"2023-05-24T03:31:55.047990+0000","last_became_active":"2023-05-24T03:29:44.499663+0000","last_became_peered":"2023-05-24T03:29:44.499663+0000","last_unstale":"2023-05-24T03:31:55.047990+0000","last_undegraded":"2023-05-24T03:31:55.047990+0000","last_fullsized":"2023-05-24T03:31:55.047990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:31:12.011318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"30'14","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.035675+0000","last_change":"2023-05-24T03:29:44.498790+0000","last_active":"2023-05-24T03:31:55.035675+0000","last_peered":"2023-05-24T03:31:55.035675+0000","last_clean":"2023-05-24T03:31:55.035675+0000","last_became_active":"2023-05-24T03:29:44.498528+0000","last_became_peered":"2023-05-24T03:29:44.498528+0000","last_unstale":"2023-05-24T03:31:55.035675+0000","last_undegraded":"2023-05-24T03:31:55.035675+0000","last_fullsized":"2023-05-24T03:31:55.035675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:14:55.806370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"30'14","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.049414+0000","last_change":"2023-05-24T03:29:44.504225+0000","last_active":"2023-05-24T03:31:55.049414+0000","last_peered":"2023-05-24T03:31:55.049414+0000","last_clean":"2023-05-24T03:31:55.049414+0000","last_became_active":"2023-05-24T03:29:44.503998+0000","last_became_peered":"2023-05-24T03:29:44.503998+0000","last_unstale":"2023-05-24T03:31:55.049414+0000","last_undegraded":"2023-05-24T03:31:55.049414+0000","last_fullsized":"2023-05-24T03:31:55.049414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:10:14.605046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"30'20","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.049421+0000","last_change":"2023-05-24T03:29:44.500355+0000","last_active":"2023-05-24T03:31:55.049421+0000","last_peered":"2023-05-24T03:31:55.049421+0000","last_clean":"2023-05-24T03:31:55.049421+0000","last_became_active":"2023-05-24T03:29:44.500065+0000","last_became_peered":"2023-05-24T03:29:44.500065+0000","last_unstale":"2023-05-24T03:31:55.049421+0000","last_undegraded":"2023-05-24T03:31:55.049421+0000","last_fullsized":"2023-05-24T03:31:55.049421+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T03:45:21.255320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"30'12","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.033420+0000","last_change":"2023-05-24T03:29:44.499607+0000","last_active":"2023-05-24T03:31:55.033420+0000","last_peered":"2023-05-24T03:31:55.033420+0000","last_clean":"2023-05-24T03:31:55.033420+0000","last_became_active":"2023-05-24T03:29:44.499324+0000","last_became_peered":"2023-05-24T03:29:44.499324+0000","last_unstale":"2023-05-24T03:31:55.033420+0000","last_undegraded":"2023-05-24T03:31:55.033420+0000","last_fullsized":"2023-05-24T03:31:55.033420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:11:59.800632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"30'18","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.036835+0000","last_change":"2023-05-24T03:29:44.500576+0000","last_active":"2023-05-24T03:31:55.036835+0000","last_peered":"2023-05-24T03:31:55.036835+0000","last_clean":"2023-05-24T03:31:55.036835+0000","last_became_active":"2023-05-24T03:29:44.500260+0000","last_became_peered":"2023-05-24T03:29:44.500260+0000","last_unstale":"2023-05-24T03:31:55.036835+0000","last_undegraded":"2023-05-24T03:31:55.036835+0000","last_fullsized":"2023-05-24T03:31:55.036835+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:52:06.913754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"30'25","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.049023+0000","last_change":"2023-05-24T03:29:44.502655+0000","last_active":"2023-05-24T03:31:55.049023+0000","last_peered":"2023-05-24T03:31:55.049023+0000","last_clean":"2023-05-24T03:31:55.049023+0000","last_became_active":"2023-05-24T03:29:44.502341+0000","last_became_peered":"2023-05-24T03:29:44.502341+0000","last_unstale":"2023-05-24T03:31:55.049023+0000","last_undegraded":"2023-05-24T03:31:55.049023+0000","last_fullsized":"2023-05-24T03:31:55.049023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:28:43.398723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"30'23","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.050363+0000","last_change":"2023-05-24T03:29:44.500505+0000","last_active":"2023-05-24T03:31:55.050363+0000","last_peered":"2023-05-24T03:31:55.050363+0000","last_clean":"2023-05-24T03:31:55.050363+0000","last_became_active":"2023-05-24T03:29:44.500156+0000","last_became_peered":"2023-05-24T03:29:44.500156+0000","last_unstale":"2023-05-24T03:31:55.050363+0000","last_undegraded":"2023-05-24T03:31:55.050363+0000","last_fullsized":"2023-05-24T03:31:55.050363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:34:40.725013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"30'13","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.034757+0000","last_change":"2023-05-24T03:29:44.492850+0000","last_active":"2023-05-24T03:31:55.034757+0000","last_peered":"2023-05-24T03:31:55.034757+0000","last_clean":"2023-05-24T03:31:55.034757+0000","last_became_active":"2023-05-24T03:29:44.492573+0000","last_became_peered":"2023-05-24T03:29:44.492573+0000","last_unstale":"2023-05-24T03:31:55.034757+0000","last_undegraded":"2023-05-24T03:31:55.034757+0000","last_fullsized":"2023-05-24T03:31:55.034757+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:25:03.563573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"30'13","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.038097+0000","last_change":"2023-05-24T03:29:44.501565+0000","last_active":"2023-05-24T03:31:55.038097+0000","last_peered":"2023-05-24T03:31:55.038097+0000","last_clean":"2023-05-24T03:31:55.038097+0000","last_became_active":"2023-05-24T03:29:44.501371+0000","last_became_peered":"2023-05-24T03:29:44.501371+0000","last_unstale":"2023-05-24T03:31:55.038097+0000","last_undegraded":"2023-05-24T03:31:55.038097+0000","last_fullsized":"2023-05-24T03:31:55.038097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:31:52.511256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"30'23","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.042174+0000","last_change":"2023-05-24T03:29:44.490972+0000","last_active":"2023-05-24T03:31:55.042174+0000","last_peered":"2023-05-24T03:31:55.042174+0000","last_clean":"2023-05-24T03:31:55.042174+0000","last_became_active":"2023-05-24T03:29:44.490411+0000","last_became_peered":"2023-05-24T03:29:44.490411+0000","last_unstale":"2023-05-24T03:31:55.042174+0000","last_undegraded":"2023-05-24T03:31:55.042174+0000","last_fullsized":"2023-05-24T03:31:55.042174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:20:09.308993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"30'16","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.040913+0000","last_change":"2023-05-24T03:29:44.495213+0000","last_active":"2023-05-24T03:31:55.040913+0000","last_peered":"2023-05-24T03:31:55.040913+0000","last_clean":"2023-05-24T03:31:55.040913+0000","last_became_active":"2023-05-24T03:29:44.494879+0000","last_became_peered":"2023-05-24T03:29:44.494879+0000","last_unstale":"2023-05-24T03:31:55.040913+0000","last_undegraded":"2023-05-24T03:31:55.040913+0000","last_fullsized":"2023-05-24T03:31:55.040913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:21:01.901695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"30'16","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.033525+0000","last_change":"2023-05-24T03:29:44.499673+0000","last_active":"2023-05-24T03:31:55.033525+0000","last_peered":"2023-05-24T03:31:55.033525+0000","last_clean":"2023-05-24T03:31:55.033525+0000","last_became_active":"2023-05-24T03:29:44.499393+0000","last_became_peered":"2023-05-24T03:29:44.499393+0000","last_unstale":"2023-05-24T03:31:55.033525+0000","last_undegraded":"2023-05-24T03:31:55.033525+0000","last_fullsized":"2023-05-24T03:31:55.033525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:36:39.587451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"30'19","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.046546+0000","last_change":"2023-05-24T03:29:44.501101+0000","last_active":"2023-05-24T03:31:55.046546+0000","last_peered":"2023-05-24T03:31:55.046546+0000","last_clean":"2023-05-24T03:31:55.046546+0000","last_became_active":"2023-05-24T03:29:44.500818+0000","last_became_peered":"2023-05-24T03:29:44.500818+0000","last_unstale":"2023-05-24T03:31:55.046546+0000","last_undegraded":"2023-05-24T03:31:55.046546+0000","last_fullsized":"2023-05-24T03:31:55.046546+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:13:18.627969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"30'18","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.049373+0000","last_change":"2023-05-24T03:29:44.500209+0000","last_active":"2023-05-24T03:31:55.049373+0000","last_peered":"2023-05-24T03:31:55.049373+0000","last_clean":"2023-05-24T03:31:55.049373+0000","last_became_active":"2023-05-24T03:29:44.499543+0000","last_became_peered":"2023-05-24T03:29:44.499543+0000","last_unstale":"2023-05-24T03:31:55.049373+0000","last_undegraded":"2023-05-24T03:31:55.049373+0000","last_fullsized":"2023-05-24T03:31:55.049373+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:29:00.326985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"30'17","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.038410+0000","last_change":"2023-05-24T03:29:44.492545+0000","last_active":"2023-05-24T03:31:55.038410+0000","last_peered":"2023-05-24T03:31:55.038410+0000","last_clean":"2023-05-24T03:31:55.038410+0000","last_became_active":"2023-05-24T03:29:44.492109+0000","last_became_peered":"2023-05-24T03:29:44.492109+0000","last_unstale":"2023-05-24T03:31:55.038410+0000","last_undegraded":"2023-05-24T03:31:55.038410+0000","last_fullsized":"2023-05-24T03:31:55.038410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:22:07.073049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"30'16","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.037665+0000","last_change":"2023-05-24T03:29:44.480834+0000","last_active":"2023-05-24T03:31:55.037665+0000","last_peered":"2023-05-24T03:31:55.037665+0000","last_clean":"2023-05-24T03:31:55.037665+0000","last_became_active":"2023-05-24T03:29:44.480597+0000","last_became_peered":"2023-05-24T03:29:44.480597+0000","last_unstale":"2023-05-24T03:31:55.037665+0000","last_undegraded":"2023-05-24T03:31:55.037665+0000","last_fullsized":"2023-05-24T03:31:55.037665+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:44:17.635928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"30'17","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.035390+0000","last_change":"2023-05-24T03:29:44.501003+0000","last_active":"2023-05-24T03:31:55.035390+0000","last_peered":"2023-05-24T03:31:55.035390+0000","last_clean":"2023-05-24T03:31:55.035390+0000","last_became_active":"2023-05-24T03:29:44.499405+0000","last_became_peered":"2023-05-24T03:29:44.499405+0000","last_unstale":"2023-05-24T03:31:55.035390+0000","last_undegraded":"2023-05-24T03:31:55.035390+0000","last_fullsized":"2023-05-24T03:31:55.035390+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:32:47.250786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"30'25","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.039028+0000","last_change":"2023-05-24T03:30:26.106086+0000","last_active":"2023-05-24T03:31:55.039028+0000","last_peered":"2023-05-24T03:31:55.039028+0000","last_clean":"2023-05-24T03:31:55.039028+0000","last_became_active":"2023-05-24T03:30:26.105858+0000","last_became_peered":"2023-05-24T03:30:26.105858+0000","last_unstale":"2023-05-24T03:31:55.039028+0000","last_undegraded":"2023-05-24T03:31:55.039028+0000","last_fullsized":"2023-05-24T03:31:55.039028+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:03:29.813763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"30'16","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.047093+0000","last_change":"2023-05-24T03:29:44.498675+0000","last_active":"2023-05-24T03:31:55.047093+0000","last_peered":"2023-05-24T03:31:55.047093+0000","last_clean":"2023-05-24T03:31:55.047093+0000","last_became_active":"2023-05-24T03:29:44.498463+0000","last_became_peered":"2023-05-24T03:29:44.498463+0000","last_unstale":"2023-05-24T03:31:55.047093+0000","last_undegraded":"2023-05-24T03:31:55.047093+0000","last_fullsized":"2023-05-24T03:31:55.047093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:36:39.587451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"30'21","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.049431+0000","last_change":"2023-05-24T03:29:44.500169+0000","last_active":"2023-05-24T03:31:55.049431+0000","last_peered":"2023-05-24T03:31:55.049431+0000","last_clean":"2023-05-24T03:31:55.049431+0000","last_became_active":"2023-05-24T03:29:44.499960+0000","last_became_peered":"2023-05-24T03:29:44.499960+0000","last_unstale":"2023-05-24T03:31:55.049431+0000","last_undegraded":"2023-05-24T03:31:55.049431+0000","last_fullsized":"2023-05-24T03:31:55.049431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:06:19.223766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"30'12","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.038999+0000","last_change":"2023-05-24T03:29:44.499015+0000","last_active":"2023-05-24T03:31:55.038999+0000","last_peered":"2023-05-24T03:31:55.038999+0000","last_clean":"2023-05-24T03:31:55.038999+0000","last_became_active":"2023-05-24T03:29:44.498437+0000","last_became_peered":"2023-05-24T03:29:44.498437+0000","last_unstale":"2023-05-24T03:31:55.038999+0000","last_undegraded":"2023-05-24T03:31:55.038999+0000","last_fullsized":"2023-05-24T03:31:55.038999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:00:20.978451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"30'8","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.031323+0000","last_change":"2023-05-24T03:29:44.481162+0000","last_active":"2023-05-24T03:31:55.031323+0000","last_peered":"2023-05-24T03:31:55.031323+0000","last_clean":"2023-05-24T03:31:55.031323+0000","last_became_active":"2023-05-24T03:29:44.481004+0000","last_became_peered":"2023-05-24T03:29:44.481004+0000","last_unstale":"2023-05-24T03:31:55.031323+0000","last_undegraded":"2023-05-24T03:31:55.031323+0000","last_fullsized":"2023-05-24T03:31:55.031323+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:36:39.587451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"30'26","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.038979+0000","last_change":"2023-05-24T03:29:44.481942+0000","last_active":"2023-05-24T03:31:55.038979+0000","last_peered":"2023-05-24T03:31:55.038979+0000","last_clean":"2023-05-24T03:31:55.038979+0000","last_became_active":"2023-05-24T03:29:44.481686+0000","last_became_peered":"2023-05-24T03:29:44.481686+0000","last_unstale":"2023-05-24T03:31:55.038979+0000","last_undegraded":"2023-05-24T03:31:55.038979+0000","last_fullsized":"2023-05-24T03:31:55.038979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:24:47.939385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"30'9","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.032829+0000","last_change":"2023-05-24T03:29:44.502948+0000","last_active":"2023-05-24T03:31:55.032829+0000","last_peered":"2023-05-24T03:31:55.032829+0000","last_clean":"2023-05-24T03:31:55.032829+0000","last_became_active":"2023-05-24T03:29:44.502669+0000","last_became_peered":"2023-05-24T03:29:44.502669+0000","last_unstale":"2023-05-24T03:31:55.032829+0000","last_undegraded":"2023-05-24T03:31:55.032829+0000","last_fullsized":"2023-05-24T03:31:55.032829+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:03:29.813763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"30'471","reported_seq":488,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.910749+0000","last_change":"2023-05-24T03:29:48.523138+0000","last_active":"2023-05-24T03:31:54.910749+0000","last_peered":"2023-05-24T03:31:54.910749+0000","last_clean":"2023-05-24T03:31:54.910749+0000","last_became_active":"2023-05-24T03:29:48.522749+0000","last_became_peered":"2023-05-24T03:29:48.522749+0000","last_unstale":"2023-05-24T03:31:54.910749+0000","last_undegraded":"2023-05-24T03:31:54.910749+0000","last_fullsized":"2023-05-24T03:31:54.910749+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:02:45.564369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.945993+0000","last_change":"2023-05-24T03:29:44.086543+0000","last_active":"2023-05-24T03:30:25.945993+0000","last_peered":"2023-05-24T03:30:25.945993+0000","last_clean":"2023-05-24T03:30:25.945993+0000","last_became_active":"2023-05-24T03:29:44.086143+0000","last_became_peered":"2023-05-24T03:29:44.086143+0000","last_unstale":"2023-05-24T03:30:25.945993+0000","last_undegraded":"2023-05-24T03:30:25.945993+0000","last_fullsized":"2023-05-24T03:30:25.945993+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:45:41.681638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'25","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.039276+0000","last_change":"2023-05-24T03:29:44.491005+0000","last_active":"2023-05-24T03:31:55.039276+0000","last_peered":"2023-05-24T03:31:55.039276+0000","last_clean":"2023-05-24T03:31:55.039276+0000","last_became_active":"2023-05-24T03:29:44.490772+0000","last_became_peered":"2023-05-24T03:29:44.490772+0000","last_unstale":"2023-05-24T03:31:55.039276+0000","last_undegraded":"2023-05-24T03:31:55.039276+0000","last_fullsized":"2023-05-24T03:31:55.039276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:52:06.913754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"30'438","reported_seq":456,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.899992+0000","last_change":"2023-05-24T03:29:48.523521+0000","last_active":"2023-05-24T03:31:54.899992+0000","last_peered":"2023-05-24T03:31:54.899992+0000","last_clean":"2023-05-24T03:31:54.899992+0000","last_became_active":"2023-05-24T03:29:48.523125+0000","last_became_peered":"2023-05-24T03:29:48.523125+0000","last_unstale":"2023-05-24T03:31:54.899992+0000","last_undegraded":"2023-05-24T03:31:54.899992+0000","last_fullsized":"2023-05-24T03:31:54.899992+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:55:49.240935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":21504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.945583+0000","last_change":"2023-05-24T03:29:44.084408+0000","last_active":"2023-05-24T03:30:25.945583+0000","last_peered":"2023-05-24T03:30:25.945583+0000","last_clean":"2023-05-24T03:30:25.945583+0000","last_became_active":"2023-05-24T03:29:44.084099+0000","last_became_peered":"2023-05-24T03:29:44.084099+0000","last_unstale":"2023-05-24T03:30:25.945583+0000","last_undegraded":"2023-05-24T03:30:25.945583+0000","last_fullsized":"2023-05-24T03:30:25.945583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:55:17.269834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"30'10","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.049187+0000","last_change":"2023-05-24T03:29:44.503346+0000","last_active":"2023-05-24T03:31:55.049187+0000","last_peered":"2023-05-24T03:31:55.049187+0000","last_clean":"2023-05-24T03:31:55.049187+0000","last_became_active":"2023-05-24T03:29:44.503039+0000","last_became_peered":"2023-05-24T03:29:44.503039+0000","last_unstale":"2023-05-24T03:31:55.049187+0000","last_undegraded":"2023-05-24T03:31:55.049187+0000","last_fullsized":"2023-05-24T03:31:55.049187+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:06:19.223766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"30'450","reported_seq":468,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.631735+0000","last_change":"2023-05-24T03:29:48.529615+0000","last_active":"2023-05-24T03:31:55.631735+0000","last_peered":"2023-05-24T03:31:55.631735+0000","last_clean":"2023-05-24T03:31:55.631735+0000","last_became_active":"2023-05-24T03:29:48.529142+0000","last_became_peered":"2023-05-24T03:29:48.529142+0000","last_unstale":"2023-05-24T03:31:55.631735+0000","last_undegraded":"2023-05-24T03:31:55.631735+0000","last_fullsized":"2023-05-24T03:31:55.631735+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:09:06.504119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"30'1","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:26.804992+0000","last_change":"2023-05-24T03:29:44.085410+0000","last_active":"2023-05-24T03:30:26.804992+0000","last_peered":"2023-05-24T03:30:26.804992+0000","last_clean":"2023-05-24T03:30:26.804992+0000","last_became_active":"2023-05-24T03:29:44.084907+0000","last_became_peered":"2023-05-24T03:29:44.084907+0000","last_unstale":"2023-05-24T03:30:26.804992+0000","last_undegraded":"2023-05-24T03:30:26.804992+0000","last_fullsized":"2023-05-24T03:30:26.804992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:46:54.993008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"30'14","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.030034+0000","last_change":"2023-05-24T03:29:44.497128+0000","last_active":"2023-05-24T03:31:55.030034+0000","last_peered":"2023-05-24T03:31:55.030034+0000","last_clean":"2023-05-24T03:31:55.030034+0000","last_became_active":"2023-05-24T03:29:44.496746+0000","last_became_peered":"2023-05-24T03:29:44.496746+0000","last_unstale":"2023-05-24T03:31:55.030034+0000","last_undegraded":"2023-05-24T03:31:55.030034+0000","last_fullsized":"2023-05-24T03:31:55.030034+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:27:24.810532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"30'463","reported_seq":480,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.867946+0000","last_change":"2023-05-24T03:29:48.520693+0000","last_active":"2023-05-24T03:31:54.867946+0000","last_peered":"2023-05-24T03:31:54.867946+0000","last_clean":"2023-05-24T03:31:54.867946+0000","last_became_active":"2023-05-24T03:29:48.520319+0000","last_became_peered":"2023-05-24T03:29:48.520319+0000","last_unstale":"2023-05-24T03:31:54.867946+0000","last_undegraded":"2023-05-24T03:31:54.867946+0000","last_fullsized":"2023-05-24T03:31:54.867946+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:32:35.981956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"30'1","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:26.131959+0000","last_change":"2023-05-24T03:29:44.088769+0000","last_active":"2023-05-24T03:30:26.131959+0000","last_peered":"2023-05-24T03:30:26.131959+0000","last_clean":"2023-05-24T03:30:26.131959+0000","last_became_active":"2023-05-24T03:29:44.088267+0000","last_became_peered":"2023-05-24T03:29:44.088267+0000","last_unstale":"2023-05-24T03:30:26.131959+0000","last_undegraded":"2023-05-24T03:30:26.131959+0000","last_fullsized":"2023-05-24T03:30:26.131959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:46:54.993008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"30'15","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.040917+0000","last_change":"2023-05-24T03:29:44.489309+0000","last_active":"2023-05-24T03:31:55.040917+0000","last_peered":"2023-05-24T03:31:55.040917+0000","last_clean":"2023-05-24T03:31:55.040917+0000","last_became_active":"2023-05-24T03:29:44.488666+0000","last_became_peered":"2023-05-24T03:29:44.488666+0000","last_unstale":"2023-05-24T03:31:55.040917+0000","last_undegraded":"2023-05-24T03:31:55.040917+0000","last_fullsized":"2023-05-24T03:31:55.040917+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:29:00.326985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"30'437","reported_seq":454,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.635512+0000","last_change":"2023-05-24T03:29:48.518108+0000","last_active":"2023-05-24T03:31:55.635512+0000","last_peered":"2023-05-24T03:31:55.635512+0000","last_clean":"2023-05-24T03:31:55.635512+0000","last_became_active":"2023-05-24T03:29:48.517771+0000","last_became_peered":"2023-05-24T03:29:48.517771+0000","last_unstale":"2023-05-24T03:31:55.635512+0000","last_undegraded":"2023-05-24T03:31:55.635512+0000","last_fullsized":"2023-05-24T03:31:55.635512+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:53:39.929296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.948014+0000","last_change":"2023-05-24T03:29:44.087910+0000","last_active":"2023-05-24T03:30:25.948014+0000","last_peered":"2023-05-24T03:30:25.948014+0000","last_clean":"2023-05-24T03:30:25.948014+0000","last_became_active":"2023-05-24T03:29:44.087601+0000","last_became_peered":"2023-05-24T03:29:44.087601+0000","last_unstale":"2023-05-24T03:30:25.948014+0000","last_undegraded":"2023-05-24T03:30:25.948014+0000","last_fullsized":"2023-05-24T03:30:25.948014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:47:02.508699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"30'16","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.042465+0000","last_change":"2023-05-24T03:29:44.496020+0000","last_active":"2023-05-24T03:31:55.042465+0000","last_peered":"2023-05-24T03:31:55.042465+0000","last_clean":"2023-05-24T03:31:55.042465+0000","last_became_active":"2023-05-24T03:29:44.495752+0000","last_became_peered":"2023-05-24T03:29:44.495752+0000","last_unstale":"2023-05-24T03:31:55.042465+0000","last_undegraded":"2023-05-24T03:31:55.042465+0000","last_fullsized":"2023-05-24T03:31:55.042465+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:28:24.448757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"30'477","reported_seq":494,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.996996+0000","last_change":"2023-05-24T03:29:48.529893+0000","last_active":"2023-05-24T03:31:54.996996+0000","last_peered":"2023-05-24T03:31:54.996996+0000","last_clean":"2023-05-24T03:31:54.996996+0000","last_became_active":"2023-05-24T03:29:48.529514+0000","last_became_peered":"2023-05-24T03:29:48.529514+0000","last_unstale":"2023-05-24T03:31:54.996996+0000","last_undegraded":"2023-05-24T03:31:54.996996+0000","last_fullsized":"2023-05-24T03:31:54.996996+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:17:12.538446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"30'9","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.919514+0000","last_change":"2023-05-24T03:29:44.091648+0000","last_active":"2023-05-24T03:31:54.919514+0000","last_peered":"2023-05-24T03:31:54.919514+0000","last_clean":"2023-05-24T03:31:54.919514+0000","last_became_active":"2023-05-24T03:29:44.091390+0000","last_became_peered":"2023-05-24T03:29:44.091390+0000","last_unstale":"2023-05-24T03:31:54.919514+0000","last_undegraded":"2023-05-24T03:31:54.919514+0000","last_fullsized":"2023-05-24T03:31:54.919514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:28:23.442311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"30'19","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.038705+0000","last_change":"2023-05-24T03:29:44.481629+0000","last_active":"2023-05-24T03:31:55.038705+0000","last_peered":"2023-05-24T03:31:55.038705+0000","last_clean":"2023-05-24T03:31:55.038705+0000","last_became_active":"2023-05-24T03:29:44.481385+0000","last_became_peered":"2023-05-24T03:29:44.481385+0000","last_unstale":"2023-05-24T03:31:55.038705+0000","last_undegraded":"2023-05-24T03:31:55.038705+0000","last_fullsized":"2023-05-24T03:31:55.038705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:15:01.553262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"30'463","reported_seq":480,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.862948+0000","last_change":"2023-05-24T03:29:48.524712+0000","last_active":"2023-05-24T03:31:54.862948+0000","last_peered":"2023-05-24T03:31:54.862948+0000","last_clean":"2023-05-24T03:31:54.862948+0000","last_became_active":"2023-05-24T03:29:48.524312+0000","last_became_peered":"2023-05-24T03:29:48.524312+0000","last_unstale":"2023-05-24T03:31:54.862948+0000","last_undegraded":"2023-05-24T03:31:54.862948+0000","last_fullsized":"2023-05-24T03:31:54.862948+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:09:53.803718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"30'350","reported_seq":375,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.007236+0000","last_change":"2023-05-24T03:29:44.079067+0000","last_active":"2023-05-24T03:31:55.007236+0000","last_peered":"2023-05-24T03:31:55.007236+0000","last_clean":"2023-05-24T03:31:55.007236+0000","last_became_active":"2023-05-24T03:29:44.078785+0000","last_became_peered":"2023-05-24T03:29:44.078785+0000","last_unstale":"2023-05-24T03:31:55.007236+0000","last_undegraded":"2023-05-24T03:31:55.007236+0000","last_fullsized":"2023-05-24T03:31:55.007236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:07:01.888999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1390402,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":349,"num_write_kb":1595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"30'24","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.035065+0000","last_change":"2023-05-24T03:29:44.497603+0000","last_active":"2023-05-24T03:31:55.035065+0000","last_peered":"2023-05-24T03:31:55.035065+0000","last_clean":"2023-05-24T03:31:55.035065+0000","last_became_active":"2023-05-24T03:29:44.497120+0000","last_became_peered":"2023-05-24T03:29:44.497120+0000","last_unstale":"2023-05-24T03:31:55.035065+0000","last_undegraded":"2023-05-24T03:31:55.035065+0000","last_fullsized":"2023-05-24T03:31:55.035065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:29:14.482310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"30'435","reported_seq":452,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.998980+0000","last_change":"2023-05-24T03:29:48.531846+0000","last_active":"2023-05-24T03:31:54.998980+0000","last_peered":"2023-05-24T03:31:54.998980+0000","last_clean":"2023-05-24T03:31:54.998980+0000","last_became_active":"2023-05-24T03:29:48.531538+0000","last_became_peered":"2023-05-24T03:29:48.531538+0000","last_unstale":"2023-05-24T03:31:54.998980+0000","last_undegraded":"2023-05-24T03:31:54.998980+0000","last_fullsized":"2023-05-24T03:31:54.998980+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:26:45.584372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"30'3","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.949502+0000","last_change":"2023-05-24T03:29:44.087315+0000","last_active":"2023-05-24T03:30:25.949502+0000","last_peered":"2023-05-24T03:30:25.949502+0000","last_clean":"2023-05-24T03:30:25.949502+0000","last_became_active":"2023-05-24T03:29:44.086997+0000","last_became_peered":"2023-05-24T03:29:44.086997+0000","last_unstale":"2023-05-24T03:30:25.949502+0000","last_undegraded":"2023-05-24T03:30:25.949502+0000","last_fullsized":"2023-05-24T03:30:25.949502+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:28:59.320540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"30'17","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.041562+0000","last_change":"2023-05-24T03:29:44.487497+0000","last_active":"2023-05-24T03:31:55.041562+0000","last_peered":"2023-05-24T03:31:55.041562+0000","last_clean":"2023-05-24T03:31:55.041562+0000","last_became_active":"2023-05-24T03:29:44.487257+0000","last_became_peered":"2023-05-24T03:29:44.487257+0000","last_unstale":"2023-05-24T03:31:55.041562+0000","last_undegraded":"2023-05-24T03:31:55.041562+0000","last_fullsized":"2023-05-24T03:31:55.041562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:34:40.725013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"30'462","reported_seq":479,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.836747+0000","last_change":"2023-05-24T03:29:48.526115+0000","last_active":"2023-05-24T03:31:54.836747+0000","last_peered":"2023-05-24T03:31:54.836747+0000","last_clean":"2023-05-24T03:31:54.836747+0000","last_became_active":"2023-05-24T03:29:48.525726+0000","last_became_peered":"2023-05-24T03:29:48.525726+0000","last_unstale":"2023-05-24T03:31:54.836747+0000","last_undegraded":"2023-05-24T03:31:54.836747+0000","last_fullsized":"2023-05-24T03:31:54.836747+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:15:16.805837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:26.131470+0000","last_change":"2023-05-24T03:29:44.084599+0000","last_active":"2023-05-24T03:30:26.131470+0000","last_peered":"2023-05-24T03:30:26.131470+0000","last_clean":"2023-05-24T03:30:26.131470+0000","last_became_active":"2023-05-24T03:29:44.084278+0000","last_became_peered":"2023-05-24T03:29:44.084278+0000","last_unstale":"2023-05-24T03:30:26.131470+0000","last_undegraded":"2023-05-24T03:30:26.131470+0000","last_fullsized":"2023-05-24T03:30:26.131470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:00:19.972006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"30'15","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.032638+0000","last_change":"2023-05-24T03:29:44.498378+0000","last_active":"2023-05-24T03:31:55.032638+0000","last_peered":"2023-05-24T03:31:55.032638+0000","last_clean":"2023-05-24T03:31:55.032638+0000","last_became_active":"2023-05-24T03:29:44.498097+0000","last_became_peered":"2023-05-24T03:29:44.498097+0000","last_unstale":"2023-05-24T03:31:55.032638+0000","last_undegraded":"2023-05-24T03:31:55.032638+0000","last_fullsized":"2023-05-24T03:31:55.032638+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:28:43.398723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"30'445","reported_seq":462,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.859517+0000","last_change":"2023-05-24T03:29:48.525018+0000","last_active":"2023-05-24T03:31:54.859517+0000","last_peered":"2023-05-24T03:31:54.859517+0000","last_clean":"2023-05-24T03:31:54.859517+0000","last_became_active":"2023-05-24T03:29:48.524602+0000","last_became_peered":"2023-05-24T03:29:48.524602+0000","last_unstale":"2023-05-24T03:31:54.859517+0000","last_undegraded":"2023-05-24T03:31:54.859517+0000","last_fullsized":"2023-05-24T03:31:54.859517+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:32:16.657149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"30'1","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.948925+0000","last_change":"2023-05-24T03:29:44.085212+0000","last_active":"2023-05-24T03:30:25.948925+0000","last_peered":"2023-05-24T03:30:25.948925+0000","last_clean":"2023-05-24T03:30:25.948925+0000","last_became_active":"2023-05-24T03:29:44.085001+0000","last_became_peered":"2023-05-24T03:29:44.085001+0000","last_unstale":"2023-05-24T03:30:25.948925+0000","last_undegraded":"2023-05-24T03:30:25.948925+0000","last_fullsized":"2023-05-24T03:30:25.948925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:57:48.715216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"30'22","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.050448+0000","last_change":"2023-05-24T03:29:44.500883+0000","last_active":"2023-05-24T03:31:55.050448+0000","last_peered":"2023-05-24T03:31:55.050448+0000","last_clean":"2023-05-24T03:31:55.050448+0000","last_became_active":"2023-05-24T03:29:44.500631+0000","last_became_peered":"2023-05-24T03:29:44.500631+0000","last_unstale":"2023-05-24T03:31:55.050448+0000","last_undegraded":"2023-05-24T03:31:55.050448+0000","last_fullsized":"2023-05-24T03:31:55.050448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:03:29.813763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"30'480","reported_seq":497,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.914788+0000","last_change":"2023-05-24T03:29:48.523523+0000","last_active":"2023-05-24T03:31:54.914788+0000","last_peered":"2023-05-24T03:31:54.914788+0000","last_clean":"2023-05-24T03:31:54.914788+0000","last_became_active":"2023-05-24T03:29:48.523138+0000","last_became_peered":"2023-05-24T03:29:48.523138+0000","last_unstale":"2023-05-24T03:31:54.914788+0000","last_undegraded":"2023-05-24T03:31:54.914788+0000","last_fullsized":"2023-05-24T03:31:54.914788+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:06:22.646046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:26.804069+0000","last_change":"2023-05-24T03:29:44.085229+0000","last_active":"2023-05-24T03:30:26.804069+0000","last_peered":"2023-05-24T03:30:26.804069+0000","last_clean":"2023-05-24T03:30:26.804069+0000","last_became_active":"2023-05-24T03:29:44.084914+0000","last_became_peered":"2023-05-24T03:29:44.084914+0000","last_unstale":"2023-05-24T03:30:26.804069+0000","last_undegraded":"2023-05-24T03:30:26.804069+0000","last_fullsized":"2023-05-24T03:30:26.804069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:26:25.494471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"30'19","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.037939+0000","last_change":"2023-05-24T03:29:44.496038+0000","last_active":"2023-05-24T03:31:55.037939+0000","last_peered":"2023-05-24T03:31:55.037939+0000","last_clean":"2023-05-24T03:31:55.037939+0000","last_became_active":"2023-05-24T03:29:44.495795+0000","last_became_peered":"2023-05-24T03:29:44.495795+0000","last_unstale":"2023-05-24T03:31:55.037939+0000","last_undegraded":"2023-05-24T03:31:55.037939+0000","last_fullsized":"2023-05-24T03:31:55.037939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:01:21.417593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"30'434","reported_seq":451,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.848942+0000","last_change":"2023-05-24T03:29:48.518930+0000","last_active":"2023-05-24T03:31:54.848942+0000","last_peered":"2023-05-24T03:31:54.848942+0000","last_clean":"2023-05-24T03:31:54.848942+0000","last_became_active":"2023-05-24T03:29:48.518531+0000","last_became_peered":"2023-05-24T03:29:48.518531+0000","last_unstale":"2023-05-24T03:31:54.848942+0000","last_undegraded":"2023-05-24T03:31:54.848942+0000","last_fullsized":"2023-05-24T03:31:54.848942+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:37:48.684803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.949768+0000","last_change":"2023-05-24T03:29:44.089650+0000","last_active":"2023-05-24T03:30:25.949768+0000","last_peered":"2023-05-24T03:30:25.949768+0000","last_clean":"2023-05-24T03:30:25.949768+0000","last_became_active":"2023-05-24T03:29:44.089340+0000","last_became_peered":"2023-05-24T03:29:44.089340+0000","last_unstale":"2023-05-24T03:30:25.949768+0000","last_undegraded":"2023-05-24T03:30:25.949768+0000","last_fullsized":"2023-05-24T03:30:25.949768+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:46:54.993008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"30'14","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.032179+0000","last_change":"2023-05-24T03:29:44.498089+0000","last_active":"2023-05-24T03:31:55.032179+0000","last_peered":"2023-05-24T03:31:55.032179+0000","last_clean":"2023-05-24T03:31:55.032179+0000","last_became_active":"2023-05-24T03:29:44.497795+0000","last_became_peered":"2023-05-24T03:29:44.497795+0000","last_unstale":"2023-05-24T03:31:55.032179+0000","last_undegraded":"2023-05-24T03:31:55.032179+0000","last_fullsized":"2023-05-24T03:31:55.032179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:11:59.800632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"30'409","reported_seq":426,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.996067+0000","last_change":"2023-05-24T03:29:48.521349+0000","last_active":"2023-05-24T03:31:54.996067+0000","last_peered":"2023-05-24T03:31:54.996067+0000","last_clean":"2023-05-24T03:31:54.996067+0000","last_became_active":"2023-05-24T03:29:48.520899+0000","last_became_peered":"2023-05-24T03:29:48.520899+0000","last_unstale":"2023-05-24T03:31:54.996067+0000","last_undegraded":"2023-05-24T03:31:54.996067+0000","last_fullsized":"2023-05-24T03:31:54.996067+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:59:08.584090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.949203+0000","last_change":"2023-05-24T03:29:44.086355+0000","last_active":"2023-05-24T03:30:25.949203+0000","last_peered":"2023-05-24T03:30:25.949203+0000","last_clean":"2023-05-24T03:30:25.949203+0000","last_became_active":"2023-05-24T03:29:44.086054+0000","last_became_peered":"2023-05-24T03:29:44.086054+0000","last_unstale":"2023-05-24T03:30:25.949203+0000","last_undegraded":"2023-05-24T03:30:25.949203+0000","last_fullsized":"2023-05-24T03:30:25.949203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:56:15.394098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"30'10","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.036553+0000","last_change":"2023-05-24T03:30:25.949869+0000","last_active":"2023-05-24T03:31:55.036553+0000","last_peered":"2023-05-24T03:31:55.036553+0000","last_clean":"2023-05-24T03:31:55.036553+0000","last_became_active":"2023-05-24T03:30:25.949461+0000","last_became_peered":"2023-05-24T03:30:25.949461+0000","last_unstale":"2023-05-24T03:31:55.036553+0000","last_undegraded":"2023-05-24T03:31:55.036553+0000","last_fullsized":"2023-05-24T03:31:55.036553+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:59:01.497346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"30'452","reported_seq":469,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.995617+0000","last_change":"2023-05-24T03:29:48.522128+0000","last_active":"2023-05-24T03:31:54.995617+0000","last_peered":"2023-05-24T03:31:54.995617+0000","last_clean":"2023-05-24T03:31:54.995617+0000","last_became_active":"2023-05-24T03:29:48.521729+0000","last_became_peered":"2023-05-24T03:29:48.521729+0000","last_unstale":"2023-05-24T03:31:54.995617+0000","last_undegraded":"2023-05-24T03:31:54.995617+0000","last_fullsized":"2023-05-24T03:31:54.995617+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:43:08.142518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.949540+0000","last_change":"2023-05-24T03:29:44.088761+0000","last_active":"2023-05-24T03:30:25.949540+0000","last_peered":"2023-05-24T03:30:25.949540+0000","last_clean":"2023-05-24T03:30:25.949540+0000","last_became_active":"2023-05-24T03:29:44.088459+0000","last_became_peered":"2023-05-24T03:29:44.088459+0000","last_unstale":"2023-05-24T03:30:25.949540+0000","last_undegraded":"2023-05-24T03:30:25.949540+0000","last_fullsized":"2023-05-24T03:30:25.949540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:28:42.392277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"30'9","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.032605+0000","last_change":"2023-05-24T03:29:44.490252+0000","last_active":"2023-05-24T03:31:55.032605+0000","last_peered":"2023-05-24T03:31:55.032605+0000","last_clean":"2023-05-24T03:31:55.032605+0000","last_became_active":"2023-05-24T03:29:44.489975+0000","last_became_peered":"2023-05-24T03:29:44.489975+0000","last_unstale":"2023-05-24T03:31:55.032605+0000","last_undegraded":"2023-05-24T03:31:55.032605+0000","last_fullsized":"2023-05-24T03:31:55.032605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:27:13.487917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"30'477","reported_seq":494,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.850746+0000","last_change":"2023-05-24T03:29:48.523911+0000","last_active":"2023-05-24T03:31:54.850746+0000","last_peered":"2023-05-24T03:31:54.850746+0000","last_clean":"2023-05-24T03:31:54.850746+0000","last_became_active":"2023-05-24T03:29:48.523545+0000","last_became_peered":"2023-05-24T03:29:48.523545+0000","last_unstale":"2023-05-24T03:31:54.850746+0000","last_undegraded":"2023-05-24T03:31:54.850746+0000","last_fullsized":"2023-05-24T03:31:54.850746+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:10:18.150623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"30'1","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.947808+0000","last_change":"2023-05-24T03:29:44.091185+0000","last_active":"2023-05-24T03:30:25.947808+0000","last_peered":"2023-05-24T03:30:25.947808+0000","last_clean":"2023-05-24T03:30:25.947808+0000","last_became_active":"2023-05-24T03:29:44.090887+0000","last_became_peered":"2023-05-24T03:29:44.090887+0000","last_unstale":"2023-05-24T03:30:25.947808+0000","last_undegraded":"2023-05-24T03:30:25.947808+0000","last_fullsized":"2023-05-24T03:30:25.947808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:28:59.320540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"30'14","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.049637+0000","last_change":"2023-05-24T03:29:44.502570+0000","last_active":"2023-05-24T03:31:55.049637+0000","last_peered":"2023-05-24T03:31:55.049637+0000","last_clean":"2023-05-24T03:31:55.049637+0000","last_became_active":"2023-05-24T03:29:44.502286+0000","last_became_peered":"2023-05-24T03:29:44.502286+0000","last_unstale":"2023-05-24T03:31:55.049637+0000","last_undegraded":"2023-05-24T03:31:55.049637+0000","last_fullsized":"2023-05-24T03:31:55.049637+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:56:16.400543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"30'459","reported_seq":476,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.905929+0000","last_change":"2023-05-24T03:29:48.521750+0000","last_active":"2023-05-24T03:31:54.905929+0000","last_peered":"2023-05-24T03:31:54.905929+0000","last_clean":"2023-05-24T03:31:54.905929+0000","last_became_active":"2023-05-24T03:29:48.520960+0000","last_became_peered":"2023-05-24T03:29:48.520960+0000","last_unstale":"2023-05-24T03:31:54.905929+0000","last_undegraded":"2023-05-24T03:31:54.905929+0000","last_fullsized":"2023-05-24T03:31:54.905929+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:18:50.657657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"30'4","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:43.731151+0000","last_change":"2023-05-24T03:29:44.088157+0000","last_active":"2023-05-24T03:31:43.731151+0000","last_peered":"2023-05-24T03:31:43.731151+0000","last_clean":"2023-05-24T03:31:43.731151+0000","last_became_active":"2023-05-24T03:29:44.087869+0000","last_became_peered":"2023-05-24T03:29:44.087869+0000","last_unstale":"2023-05-24T03:31:43.731151+0000","last_undegraded":"2023-05-24T03:31:43.731151+0000","last_fullsized":"2023-05-24T03:31:43.731151+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:30:53.298174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"30'11","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.043058+0000","last_change":"2023-05-24T03:29:44.501176+0000","last_active":"2023-05-24T03:31:55.043058+0000","last_peered":"2023-05-24T03:31:55.043058+0000","last_clean":"2023-05-24T03:31:55.043058+0000","last_became_active":"2023-05-24T03:29:44.499700+0000","last_became_peered":"2023-05-24T03:29:44.499700+0000","last_unstale":"2023-05-24T03:31:55.043058+0000","last_undegraded":"2023-05-24T03:31:55.043058+0000","last_fullsized":"2023-05-24T03:31:55.043058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:08:22.507011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"30'447","reported_seq":464,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.855461+0000","last_change":"2023-05-24T03:29:48.522778+0000","last_active":"2023-05-24T03:31:54.855461+0000","last_peered":"2023-05-24T03:31:54.855461+0000","last_clean":"2023-05-24T03:31:54.855461+0000","last_became_active":"2023-05-24T03:29:48.522104+0000","last_became_peered":"2023-05-24T03:29:48.522104+0000","last_unstale":"2023-05-24T03:31:54.855461+0000","last_undegraded":"2023-05-24T03:31:54.855461+0000","last_fullsized":"2023-05-24T03:31:54.855461+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:25:58.928535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"30'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:52.027142+0000","last_change":"2023-05-24T03:29:44.085211+0000","last_active":"2023-05-24T03:31:52.027142+0000","last_peered":"2023-05-24T03:31:52.027142+0000","last_clean":"2023-05-24T03:31:52.027142+0000","last_became_active":"2023-05-24T03:29:44.084894+0000","last_became_peered":"2023-05-24T03:29:44.084894+0000","last_unstale":"2023-05-24T03:31:52.027142+0000","last_undegraded":"2023-05-24T03:31:52.027142+0000","last_fullsized":"2023-05-24T03:31:52.027142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T03:40:04.765492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"30'15","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.042450+0000","last_change":"2023-05-24T03:29:44.492807+0000","last_active":"2023-05-24T03:31:55.042450+0000","last_peered":"2023-05-24T03:31:55.042450+0000","last_clean":"2023-05-24T03:31:55.042450+0000","last_became_active":"2023-05-24T03:29:44.492462+0000","last_became_peered":"2023-05-24T03:29:44.492462+0000","last_unstale":"2023-05-24T03:31:55.042450+0000","last_undegraded":"2023-05-24T03:31:55.042450+0000","last_fullsized":"2023-05-24T03:31:55.042450+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T03:34:42.017206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'477","reported_seq":494,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.639266+0000","last_change":"2023-05-24T03:29:48.524960+0000","last_active":"2023-05-24T03:31:55.639266+0000","last_peered":"2023-05-24T03:31:55.639266+0000","last_clean":"2023-05-24T03:31:55.639266+0000","last_became_active":"2023-05-24T03:29:48.524023+0000","last_became_peered":"2023-05-24T03:29:48.524023+0000","last_unstale":"2023-05-24T03:31:55.639266+0000","last_undegraded":"2023-05-24T03:31:55.639266+0000","last_fullsized":"2023-05-24T03:31:55.639266+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:17:12.538446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.945352+0000","last_change":"2023-05-24T03:29:44.082700+0000","last_active":"2023-05-24T03:30:25.945352+0000","last_peered":"2023-05-24T03:30:25.945352+0000","last_clean":"2023-05-24T03:30:25.945352+0000","last_became_active":"2023-05-24T03:29:44.082382+0000","last_became_peered":"2023-05-24T03:29:44.082382+0000","last_unstale":"2023-05-24T03:30:25.945352+0000","last_undegraded":"2023-05-24T03:30:25.945352+0000","last_fullsized":"2023-05-24T03:30:25.945352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:32:47.076800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"30'9","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.035186+0000","last_change":"2023-05-24T03:29:44.501409+0000","last_active":"2023-05-24T03:31:55.035186+0000","last_peered":"2023-05-24T03:31:55.035186+0000","last_clean":"2023-05-24T03:31:55.035186+0000","last_became_active":"2023-05-24T03:29:44.501080+0000","last_became_peered":"2023-05-24T03:29:44.501080+0000","last_unstale":"2023-05-24T03:31:55.035186+0000","last_undegraded":"2023-05-24T03:31:55.035186+0000","last_fullsized":"2023-05-24T03:31:55.035186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:32:22.255614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"30'488","reported_seq":505,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.909741+0000","last_change":"2023-05-24T03:29:48.519383+0000","last_active":"2023-05-24T03:31:54.909741+0000","last_peered":"2023-05-24T03:31:54.909741+0000","last_clean":"2023-05-24T03:31:54.909741+0000","last_became_active":"2023-05-24T03:29:48.519046+0000","last_became_peered":"2023-05-24T03:29:48.519046+0000","last_unstale":"2023-05-24T03:31:54.909741+0000","last_undegraded":"2023-05-24T03:31:54.909741+0000","last_fullsized":"2023-05-24T03:31:54.909741+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:02:44.132422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:26.804947+0000","last_change":"2023-05-24T03:29:44.085771+0000","last_active":"2023-05-24T03:30:26.804947+0000","last_peered":"2023-05-24T03:30:26.804947+0000","last_clean":"2023-05-24T03:30:26.804947+0000","last_became_active":"2023-05-24T03:29:44.085420+0000","last_became_peered":"2023-05-24T03:29:44.085420+0000","last_unstale":"2023-05-24T03:30:26.804947+0000","last_undegraded":"2023-05-24T03:30:26.804947+0000","last_fullsized":"2023-05-24T03:30:26.804947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:26:41.155647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"30'17","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.039969+0000","last_change":"2023-05-24T03:29:44.491345+0000","last_active":"2023-05-24T03:31:55.039969+0000","last_peered":"2023-05-24T03:31:55.039969+0000","last_clean":"2023-05-24T03:31:55.039969+0000","last_became_active":"2023-05-24T03:29:44.491089+0000","last_became_peered":"2023-05-24T03:29:44.491089+0000","last_unstale":"2023-05-24T03:31:55.039969+0000","last_undegraded":"2023-05-24T03:31:55.039969+0000","last_fullsized":"2023-05-24T03:31:55.039969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:11:59.800632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"30'492","reported_seq":510,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.647405+0000","last_change":"2023-05-24T03:29:48.530105+0000","last_active":"2023-05-24T03:31:55.647405+0000","last_peered":"2023-05-24T03:31:55.647405+0000","last_clean":"2023-05-24T03:31:55.647405+0000","last_became_active":"2023-05-24T03:29:48.529157+0000","last_became_peered":"2023-05-24T03:29:48.529157+0000","last_unstale":"2023-05-24T03:31:55.647405+0000","last_undegraded":"2023-05-24T03:31:55.647405+0000","last_fullsized":"2023-05-24T03:31:55.647405+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:57:53.143941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.946193+0000","last_change":"2023-05-24T03:29:39.143199+0000","last_active":"2023-05-24T03:30:25.946193+0000","last_peered":"2023-05-24T03:30:25.946193+0000","last_clean":"2023-05-24T03:30:25.946193+0000","last_became_active":"2023-05-24T03:29:39.142867+0000","last_became_peered":"2023-05-24T03:29:39.142867+0000","last_unstale":"2023-05-24T03:30:25.946193+0000","last_undegraded":"2023-05-24T03:30:25.946193+0000","last_fullsized":"2023-05-24T03:30:25.946193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:53:30.482418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"30'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:51.927110+0000","last_change":"2023-05-24T03:29:44.087790+0000","last_active":"2023-05-24T03:31:51.927110+0000","last_peered":"2023-05-24T03:31:51.927110+0000","last_clean":"2023-05-24T03:31:51.927110+0000","last_became_active":"2023-05-24T03:29:44.087475+0000","last_became_peered":"2023-05-24T03:29:44.087475+0000","last_unstale":"2023-05-24T03:31:51.927110+0000","last_undegraded":"2023-05-24T03:31:51.927110+0000","last_fullsized":"2023-05-24T03:31:51.927110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:56:15.394098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"30'16","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.035838+0000","last_change":"2023-05-24T03:29:44.497235+0000","last_active":"2023-05-24T03:31:55.035838+0000","last_peered":"2023-05-24T03:31:55.035838+0000","last_clean":"2023-05-24T03:31:55.035838+0000","last_became_active":"2023-05-24T03:29:44.497015+0000","last_became_peered":"2023-05-24T03:29:44.497015+0000","last_unstale":"2023-05-24T03:31:55.035838+0000","last_undegraded":"2023-05-24T03:31:55.035838+0000","last_fullsized":"2023-05-24T03:31:55.035838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:34:36.957340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"30'438","reported_seq":456,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.876773+0000","last_change":"2023-05-24T03:29:48.527805+0000","last_active":"2023-05-24T03:31:54.876773+0000","last_peered":"2023-05-24T03:31:54.876773+0000","last_clean":"2023-05-24T03:31:54.876773+0000","last_became_active":"2023-05-24T03:29:48.527010+0000","last_became_peered":"2023-05-24T03:29:48.527010+0000","last_unstale":"2023-05-24T03:31:54.876773+0000","last_undegraded":"2023-05-24T03:31:54.876773+0000","last_fullsized":"2023-05-24T03:31:54.876773+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:24:51.361665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.947589+0000","last_change":"2023-05-24T03:29:39.048516+0000","last_active":"2023-05-24T03:30:25.947589+0000","last_peered":"2023-05-24T03:30:25.947589+0000","last_clean":"2023-05-24T03:30:25.947589+0000","last_became_active":"2023-05-24T03:29:39.048141+0000","last_became_peered":"2023-05-24T03:29:39.048141+0000","last_unstale":"2023-05-24T03:30:25.947589+0000","last_undegraded":"2023-05-24T03:30:25.947589+0000","last_fullsized":"2023-05-24T03:30:25.947589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:37:39.237924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.945952+0000","last_change":"2023-05-24T03:29:44.085282+0000","last_active":"2023-05-24T03:30:25.945952+0000","last_peered":"2023-05-24T03:30:25.945952+0000","last_clean":"2023-05-24T03:30:25.945952+0000","last_became_active":"2023-05-24T03:29:44.084944+0000","last_became_peered":"2023-05-24T03:29:44.084944+0000","last_unstale":"2023-05-24T03:30:25.945952+0000","last_undegraded":"2023-05-24T03:30:25.945952+0000","last_fullsized":"2023-05-24T03:30:25.945952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:06:01.227379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"30'15","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.039882+0000","last_change":"2023-05-24T03:29:44.483553+0000","last_active":"2023-05-24T03:31:55.039882+0000","last_peered":"2023-05-24T03:31:55.039882+0000","last_clean":"2023-05-24T03:31:55.039882+0000","last_became_active":"2023-05-24T03:29:44.483134+0000","last_became_peered":"2023-05-24T03:29:44.483134+0000","last_unstale":"2023-05-24T03:31:55.039882+0000","last_undegraded":"2023-05-24T03:31:55.039882+0000","last_fullsized":"2023-05-24T03:31:55.039882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:00:20.978451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'470","reported_seq":487,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.996091+0000","last_change":"2023-05-24T03:29:48.519249+0000","last_active":"2023-05-24T03:31:54.996091+0000","last_peered":"2023-05-24T03:31:54.996091+0000","last_clean":"2023-05-24T03:31:54.996091+0000","last_became_active":"2023-05-24T03:29:48.518546+0000","last_became_peered":"2023-05-24T03:29:48.518546+0000","last_unstale":"2023-05-24T03:31:54.996091+0000","last_undegraded":"2023-05-24T03:31:54.996091+0000","last_fullsized":"2023-05-24T03:31:54.996091+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:26:29.923197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:26.105101+0000","last_change":"2023-05-24T03:29:39.310351+0000","last_active":"2023-05-24T03:30:26.105101+0000","last_peered":"2023-05-24T03:30:26.105101+0000","last_clean":"2023-05-24T03:30:26.105101+0000","last_became_active":"2023-05-24T03:29:39.310070+0000","last_became_peered":"2023-05-24T03:29:39.310070+0000","last_unstale":"2023-05-24T03:30:26.105101+0000","last_undegraded":"2023-05-24T03:30:26.105101+0000","last_fullsized":"2023-05-24T03:30:26.105101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:21:55.168531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.945636+0000","last_change":"2023-05-24T03:29:44.075504+0000","last_active":"2023-05-24T03:30:25.945636+0000","last_peered":"2023-05-24T03:30:25.945636+0000","last_clean":"2023-05-24T03:30:25.945636+0000","last_became_active":"2023-05-24T03:29:44.074551+0000","last_became_peered":"2023-05-24T03:29:44.074551+0000","last_unstale":"2023-05-24T03:30:25.945636+0000","last_undegraded":"2023-05-24T03:30:25.945636+0000","last_fullsized":"2023-05-24T03:30:25.945636+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:12:11.445050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"30'14","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.033247+0000","last_change":"2023-05-24T03:29:44.496225+0000","last_active":"2023-05-24T03:31:55.033247+0000","last_peered":"2023-05-24T03:31:55.033247+0000","last_clean":"2023-05-24T03:31:55.033247+0000","last_became_active":"2023-05-24T03:29:44.496030+0000","last_became_peered":"2023-05-24T03:29:44.496030+0000","last_unstale":"2023-05-24T03:31:55.033247+0000","last_undegraded":"2023-05-24T03:31:55.033247+0000","last_fullsized":"2023-05-24T03:31:55.033247+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:53:00.715123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"30'465","reported_seq":483,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.638847+0000","last_change":"2023-05-24T03:29:48.523816+0000","last_active":"2023-05-24T03:31:55.638847+0000","last_peered":"2023-05-24T03:31:55.638847+0000","last_clean":"2023-05-24T03:31:55.638847+0000","last_became_active":"2023-05-24T03:29:48.523380+0000","last_became_peered":"2023-05-24T03:29:48.523380+0000","last_unstale":"2023-05-24T03:31:55.638847+0000","last_undegraded":"2023-05-24T03:31:55.638847+0000","last_fullsized":"2023-05-24T03:31:55.638847+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:24:51.361665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.948180+0000","last_change":"2023-05-24T03:29:39.051113+0000","last_active":"2023-05-24T03:30:25.948180+0000","last_peered":"2023-05-24T03:30:25.948180+0000","last_clean":"2023-05-24T03:30:25.948180+0000","last_became_active":"2023-05-24T03:29:39.050751+0000","last_became_peered":"2023-05-24T03:29:39.050751+0000","last_unstale":"2023-05-24T03:30:25.948180+0000","last_undegraded":"2023-05-24T03:30:25.948180+0000","last_fullsized":"2023-05-24T03:30:25.948180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:30:48.280021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":188,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.948889+0000","last_change":"2023-05-24T03:29:34.025679+0000","last_active":"2023-05-24T03:30:25.948889+0000","last_peered":"2023-05-24T03:30:25.948889+0000","last_clean":"2023-05-24T03:30:25.948889+0000","last_became_active":"2023-05-24T03:29:34.024728+0000","last_became_peered":"2023-05-24T03:29:34.024728+0000","last_unstale":"2023-05-24T03:30:25.948889+0000","last_undegraded":"2023-05-24T03:30:25.948889+0000","last_fullsized":"2023-05-24T03:30:25.948889+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:32.968348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:32.968348+0000","last_clean_scrub_stamp":"2023-05-24T03:29:32.968348+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:52:49.623148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:26.804884+0000","last_change":"2023-05-24T03:29:44.086373+0000","last_active":"2023-05-24T03:30:26.804884+0000","last_peered":"2023-05-24T03:30:26.804884+0000","last_clean":"2023-05-24T03:30:26.804884+0000","last_became_active":"2023-05-24T03:29:44.086125+0000","last_became_peered":"2023-05-24T03:29:44.086125+0000","last_unstale":"2023-05-24T03:30:26.804884+0000","last_undegraded":"2023-05-24T03:30:26.804884+0000","last_fullsized":"2023-05-24T03:30:26.804884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:03:28.807318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"30'15","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.033691+0000","last_change":"2023-05-24T03:29:44.492654+0000","last_active":"2023-05-24T03:31:55.033691+0000","last_peered":"2023-05-24T03:31:55.033691+0000","last_clean":"2023-05-24T03:31:55.033691+0000","last_became_active":"2023-05-24T03:29:44.492375+0000","last_became_peered":"2023-05-24T03:29:44.492375+0000","last_unstale":"2023-05-24T03:31:55.033691+0000","last_undegraded":"2023-05-24T03:31:55.033691+0000","last_fullsized":"2023-05-24T03:31:55.033691+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:14:30.274935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"30'436","reported_seq":453,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.876352+0000","last_change":"2023-05-24T03:29:48.525206+0000","last_active":"2023-05-24T03:31:54.876352+0000","last_peered":"2023-05-24T03:31:54.876352+0000","last_clean":"2023-05-24T03:31:54.876352+0000","last_became_active":"2023-05-24T03:29:48.524615+0000","last_became_peered":"2023-05-24T03:29:48.524615+0000","last_unstale":"2023-05-24T03:31:54.876352+0000","last_undegraded":"2023-05-24T03:31:54.876352+0000","last_fullsized":"2023-05-24T03:31:54.876352+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:15:16.805837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.949105+0000","last_change":"2023-05-24T03:29:39.054117+0000","last_active":"2023-05-24T03:30:25.949105+0000","last_peered":"2023-05-24T03:30:25.949105+0000","last_clean":"2023-05-24T03:30:25.949105+0000","last_became_active":"2023-05-24T03:29:39.053813+0000","last_became_peered":"2023-05-24T03:29:39.053813+0000","last_unstale":"2023-05-24T03:30:25.949105+0000","last_undegraded":"2023-05-24T03:30:25.949105+0000","last_fullsized":"2023-05-24T03:30:25.949105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:20:55.877097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"30'11","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.627272+0000","last_change":"2023-05-24T03:29:44.090147+0000","last_active":"2023-05-24T03:31:55.627272+0000","last_peered":"2023-05-24T03:31:55.627272+0000","last_clean":"2023-05-24T03:31:55.627272+0000","last_became_active":"2023-05-24T03:29:44.089943+0000","last_became_peered":"2023-05-24T03:29:44.089943+0000","last_unstale":"2023-05-24T03:31:55.627272+0000","last_undegraded":"2023-05-24T03:31:55.627272+0000","last_fullsized":"2023-05-24T03:31:55.627272+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:52:59.708678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6444,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":10,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"30'18","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.051202+0000","last_change":"2023-05-24T03:29:44.498467+0000","last_active":"2023-05-24T03:31:55.051202+0000","last_peered":"2023-05-24T03:31:55.051202+0000","last_clean":"2023-05-24T03:31:55.051202+0000","last_became_active":"2023-05-24T03:29:44.498130+0000","last_became_peered":"2023-05-24T03:29:44.498130+0000","last_unstale":"2023-05-24T03:31:55.051202+0000","last_undegraded":"2023-05-24T03:31:55.051202+0000","last_fullsized":"2023-05-24T03:31:55.051202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:37:45.262523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"30'488","reported_seq":506,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.649800+0000","last_change":"2023-05-24T03:29:48.520034+0000","last_active":"2023-05-24T03:31:55.649800+0000","last_peered":"2023-05-24T03:31:55.649800+0000","last_clean":"2023-05-24T03:31:55.649800+0000","last_became_active":"2023-05-24T03:29:48.519673+0000","last_became_peered":"2023-05-24T03:29:48.519673+0000","last_unstale":"2023-05-24T03:31:55.649800+0000","last_undegraded":"2023-05-24T03:31:55.649800+0000","last_fullsized":"2023-05-24T03:31:55.649800+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:17:11.019561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.949461+0000","last_change":"2023-05-24T03:29:39.143215+0000","last_active":"2023-05-24T03:30:25.949461+0000","last_peered":"2023-05-24T03:30:25.949461+0000","last_clean":"2023-05-24T03:30:25.949461+0000","last_became_active":"2023-05-24T03:29:39.142949+0000","last_became_peered":"2023-05-24T03:29:39.142949+0000","last_unstale":"2023-05-24T03:30:25.949461+0000","last_undegraded":"2023-05-24T03:30:25.949461+0000","last_fullsized":"2023-05-24T03:30:25.949461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:06:13.199168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"30'2","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:51.960970+0000","last_change":"2023-05-24T03:29:44.074869+0000","last_active":"2023-05-24T03:31:51.960970+0000","last_peered":"2023-05-24T03:31:51.960970+0000","last_clean":"2023-05-24T03:31:51.960970+0000","last_became_active":"2023-05-24T03:29:44.074374+0000","last_became_peered":"2023-05-24T03:29:44.074374+0000","last_unstale":"2023-05-24T03:31:51.960970+0000","last_undegraded":"2023-05-24T03:31:51.960970+0000","last_fullsized":"2023-05-24T03:31:51.960970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:37:44.256077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"30'16","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.049875+0000","last_change":"2023-05-24T03:29:44.499979+0000","last_active":"2023-05-24T03:31:55.049875+0000","last_peered":"2023-05-24T03:31:55.049875+0000","last_clean":"2023-05-24T03:31:55.049875+0000","last_became_active":"2023-05-24T03:29:44.499768+0000","last_became_peered":"2023-05-24T03:29:44.499768+0000","last_unstale":"2023-05-24T03:31:55.049875+0000","last_undegraded":"2023-05-24T03:31:55.049875+0000","last_fullsized":"2023-05-24T03:31:55.049875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:11:59.800632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"30'478","reported_seq":496,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.634562+0000","last_change":"2023-05-24T03:29:48.530781+0000","last_active":"2023-05-24T03:31:55.634562+0000","last_peered":"2023-05-24T03:31:55.634562+0000","last_clean":"2023-05-24T03:31:55.634562+0000","last_became_active":"2023-05-24T03:29:48.530401+0000","last_became_peered":"2023-05-24T03:29:48.530401+0000","last_unstale":"2023-05-24T03:31:55.634562+0000","last_undegraded":"2023-05-24T03:31:55.634562+0000","last_fullsized":"2023-05-24T03:31:55.634562+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:28:34.171252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"30'3","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:52.027244+0000","last_change":"2023-05-24T03:29:44.084278+0000","last_active":"2023-05-24T03:31:52.027244+0000","last_peered":"2023-05-24T03:31:52.027244+0000","last_clean":"2023-05-24T03:31:52.027244+0000","last_became_active":"2023-05-24T03:29:44.083929+0000","last_became_peered":"2023-05-24T03:29:44.083929+0000","last_unstale":"2023-05-24T03:31:52.027244+0000","last_undegraded":"2023-05-24T03:31:52.027244+0000","last_fullsized":"2023-05-24T03:31:52.027244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:08:29.969550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.946231+0000","last_change":"2023-05-24T03:29:39.045821+0000","last_active":"2023-05-24T03:30:25.946231+0000","last_peered":"2023-05-24T03:30:25.946231+0000","last_clean":"2023-05-24T03:30:25.946231+0000","last_became_active":"2023-05-24T03:29:39.045543+0000","last_became_peered":"2023-05-24T03:29:39.045543+0000","last_unstale":"2023-05-24T03:30:25.946231+0000","last_undegraded":"2023-05-24T03:30:25.946231+0000","last_fullsized":"2023-05-24T03:30:25.946231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:57:43.697063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"30'16","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.040363+0000","last_change":"2023-05-24T03:29:44.496106+0000","last_active":"2023-05-24T03:31:55.040363+0000","last_peered":"2023-05-24T03:31:55.040363+0000","last_clean":"2023-05-24T03:31:55.040363+0000","last_became_active":"2023-05-24T03:29:44.495816+0000","last_became_peered":"2023-05-24T03:29:44.495816+0000","last_unstale":"2023-05-24T03:31:55.040363+0000","last_undegraded":"2023-05-24T03:31:55.040363+0000","last_fullsized":"2023-05-24T03:31:55.040363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:56:16.400543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"30'438","reported_seq":456,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.998273+0000","last_change":"2023-05-24T03:29:48.527602+0000","last_active":"2023-05-24T03:31:54.998273+0000","last_peered":"2023-05-24T03:31:54.998273+0000","last_clean":"2023-05-24T03:31:54.998273+0000","last_became_active":"2023-05-24T03:29:48.527196+0000","last_became_peered":"2023-05-24T03:29:48.527196+0000","last_unstale":"2023-05-24T03:31:54.998273+0000","last_undegraded":"2023-05-24T03:31:54.998273+0000","last_fullsized":"2023-05-24T03:31:54.998273+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:37:48.684803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13631488,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":31744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:26.804512+0000","last_change":"2023-05-24T03:29:39.046445+0000","last_active":"2023-05-24T03:30:26.804512+0000","last_peered":"2023-05-24T03:30:26.804512+0000","last_clean":"2023-05-24T03:30:26.804512+0000","last_became_active":"2023-05-24T03:29:39.046149+0000","last_became_peered":"2023-05-24T03:29:39.046149+0000","last_unstale":"2023-05-24T03:30:26.804512+0000","last_undegraded":"2023-05-24T03:30:26.804512+0000","last_fullsized":"2023-05-24T03:30:26.804512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:09:38.768895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"30'9","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.185381+0000","last_change":"2023-05-24T03:29:44.088780+0000","last_active":"2023-05-24T03:31:54.185381+0000","last_peered":"2023-05-24T03:31:54.185381+0000","last_clean":"2023-05-24T03:31:54.185381+0000","last_became_active":"2023-05-24T03:29:44.088495+0000","last_became_peered":"2023-05-24T03:29:44.088495+0000","last_unstale":"2023-05-24T03:31:54.185381+0000","last_undegraded":"2023-05-24T03:31:54.185381+0000","last_fullsized":"2023-05-24T03:31:54.185381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:28:23.442311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"30'8","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.031293+0000","last_change":"2023-05-24T03:29:44.496966+0000","last_active":"2023-05-24T03:31:55.031293+0000","last_peered":"2023-05-24T03:31:55.031293+0000","last_clean":"2023-05-24T03:31:55.031293+0000","last_became_active":"2023-05-24T03:29:44.496597+0000","last_became_peered":"2023-05-24T03:29:44.496597+0000","last_unstale":"2023-05-24T03:31:55.031293+0000","last_undegraded":"2023-05-24T03:31:55.031293+0000","last_fullsized":"2023-05-24T03:31:55.031293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:32:09.391394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"30'462","reported_seq":479,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.890055+0000","last_change":"2023-05-24T03:29:48.524541+0000","last_active":"2023-05-24T03:31:54.890055+0000","last_peered":"2023-05-24T03:31:54.890055+0000","last_clean":"2023-05-24T03:31:54.890055+0000","last_became_active":"2023-05-24T03:29:48.524170+0000","last_became_peered":"2023-05-24T03:29:48.524170+0000","last_unstale":"2023-05-24T03:31:54.890055+0000","last_undegraded":"2023-05-24T03:31:54.890055+0000","last_fullsized":"2023-05-24T03:31:54.890055+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:21:05.323975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:26.131668+0000","last_change":"2023-05-24T03:29:44.090259+0000","last_active":"2023-05-24T03:30:26.131668+0000","last_peered":"2023-05-24T03:30:26.131668+0000","last_clean":"2023-05-24T03:30:26.131668+0000","last_became_active":"2023-05-24T03:29:44.089993+0000","last_became_peered":"2023-05-24T03:29:44.089993+0000","last_unstale":"2023-05-24T03:30:26.131668+0000","last_undegraded":"2023-05-24T03:30:26.131668+0000","last_fullsized":"2023-05-24T03:30:26.131668+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:21:00.895250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"30'17","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.038326+0000","last_change":"2023-05-24T03:29:44.481933+0000","last_active":"2023-05-24T03:31:55.038326+0000","last_peered":"2023-05-24T03:31:55.038326+0000","last_clean":"2023-05-24T03:31:55.038326+0000","last_became_active":"2023-05-24T03:29:44.481655+0000","last_became_peered":"2023-05-24T03:29:44.481655+0000","last_unstale":"2023-05-24T03:31:55.038326+0000","last_undegraded":"2023-05-24T03:31:55.038326+0000","last_fullsized":"2023-05-24T03:31:55.038326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:32:32.559676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"30'471","reported_seq":488,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.643022+0000","last_change":"2023-05-24T03:29:48.516800+0000","last_active":"2023-05-24T03:31:55.643022+0000","last_peered":"2023-05-24T03:31:55.643022+0000","last_clean":"2023-05-24T03:31:55.643022+0000","last_became_active":"2023-05-24T03:29:48.516366+0000","last_became_peered":"2023-05-24T03:29:48.516366+0000","last_unstale":"2023-05-24T03:31:55.643022+0000","last_undegraded":"2023-05-24T03:31:55.643022+0000","last_fullsized":"2023-05-24T03:31:55.643022+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:10:18.027326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.947901+0000","last_change":"2023-05-24T03:29:44.094179+0000","last_active":"2023-05-24T03:30:25.947901+0000","last_peered":"2023-05-24T03:30:25.947901+0000","last_clean":"2023-05-24T03:30:25.947901+0000","last_became_active":"2023-05-24T03:29:44.093909+0000","last_became_peered":"2023-05-24T03:29:44.093909+0000","last_unstale":"2023-05-24T03:30:25.947901+0000","last_undegraded":"2023-05-24T03:30:25.947901+0000","last_fullsized":"2023-05-24T03:30:25.947901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:09:02.075394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"30'13","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.043652+0000","last_change":"2023-05-24T03:29:44.497379+0000","last_active":"2023-05-24T03:31:55.043652+0000","last_peered":"2023-05-24T03:31:55.043652+0000","last_clean":"2023-05-24T03:31:55.043652+0000","last_became_active":"2023-05-24T03:29:44.496679+0000","last_became_peered":"2023-05-24T03:29:44.496679+0000","last_unstale":"2023-05-24T03:31:55.043652+0000","last_undegraded":"2023-05-24T03:31:55.043652+0000","last_fullsized":"2023-05-24T03:31:55.043652+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:14:25.131724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"30'454","reported_seq":471,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.891571+0000","last_change":"2023-05-24T03:29:48.529231+0000","last_active":"2023-05-24T03:31:54.891571+0000","last_peered":"2023-05-24T03:31:54.891571+0000","last_clean":"2023-05-24T03:31:54.891571+0000","last_became_active":"2023-05-24T03:29:48.528862+0000","last_became_peered":"2023-05-24T03:29:48.528862+0000","last_unstale":"2023-05-24T03:31:54.891571+0000","last_undegraded":"2023-05-24T03:31:54.891571+0000","last_fullsized":"2023-05-24T03:31:54.891571+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:28:27.871037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"30'3","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.947544+0000","last_change":"2023-05-24T03:29:44.090289+0000","last_active":"2023-05-24T03:30:25.947544+0000","last_peered":"2023-05-24T03:30:25.947544+0000","last_clean":"2023-05-24T03:30:25.947544+0000","last_became_active":"2023-05-24T03:29:44.089949+0000","last_became_peered":"2023-05-24T03:29:44.089949+0000","last_unstale":"2023-05-24T03:30:25.947544+0000","last_undegraded":"2023-05-24T03:30:25.947544+0000","last_fullsized":"2023-05-24T03:30:25.947544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:24:46.932939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'12","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.042240+0000","last_change":"2023-05-24T03:29:44.498632+0000","last_active":"2023-05-24T03:31:55.042240+0000","last_peered":"2023-05-24T03:31:55.042240+0000","last_clean":"2023-05-24T03:31:55.042240+0000","last_became_active":"2023-05-24T03:29:44.498350+0000","last_became_peered":"2023-05-24T03:29:44.498350+0000","last_unstale":"2023-05-24T03:31:55.042240+0000","last_undegraded":"2023-05-24T03:31:55.042240+0000","last_fullsized":"2023-05-24T03:31:55.042240+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:22:26.333903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"30'476","reported_seq":493,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.635369+0000","last_change":"2023-05-24T03:29:48.523434+0000","last_active":"2023-05-24T03:31:55.635369+0000","last_peered":"2023-05-24T03:31:55.635369+0000","last_clean":"2023-05-24T03:31:55.635369+0000","last_became_active":"2023-05-24T03:29:48.522228+0000","last_became_peered":"2023-05-24T03:29:48.522228+0000","last_unstale":"2023-05-24T03:31:55.635369+0000","last_undegraded":"2023-05-24T03:31:55.635369+0000","last_fullsized":"2023-05-24T03:31:55.635369+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:40:50.804869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:26.805353+0000","last_change":"2023-05-24T03:29:44.083178+0000","last_active":"2023-05-24T03:30:26.805353+0000","last_peered":"2023-05-24T03:30:26.805353+0000","last_clean":"2023-05-24T03:30:26.805353+0000","last_became_active":"2023-05-24T03:29:44.082903+0000","last_became_peered":"2023-05-24T03:29:44.082903+0000","last_unstale":"2023-05-24T03:30:26.805353+0000","last_undegraded":"2023-05-24T03:30:26.805353+0000","last_fullsized":"2023-05-24T03:30:26.805353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:56:27.514130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"30'19","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.043523+0000","last_change":"2023-05-24T03:29:44.488206+0000","last_active":"2023-05-24T03:31:55.043523+0000","last_peered":"2023-05-24T03:31:55.043523+0000","last_clean":"2023-05-24T03:31:55.043523+0000","last_became_active":"2023-05-24T03:29:44.487925+0000","last_became_peered":"2023-05-24T03:29:44.487925+0000","last_unstale":"2023-05-24T03:31:55.043523+0000","last_undegraded":"2023-05-24T03:31:55.043523+0000","last_fullsized":"2023-05-24T03:31:55.043523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:28:43.398723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"30'482","reported_seq":499,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.819538+0000","last_change":"2023-05-24T03:29:48.519899+0000","last_active":"2023-05-24T03:31:54.819538+0000","last_peered":"2023-05-24T03:31:54.819538+0000","last_clean":"2023-05-24T03:31:54.819538+0000","last_became_active":"2023-05-24T03:29:48.519517+0000","last_became_peered":"2023-05-24T03:29:48.519517+0000","last_unstale":"2023-05-24T03:31:54.819538+0000","last_undegraded":"2023-05-24T03:31:54.819538+0000","last_fullsized":"2023-05-24T03:31:54.819538+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:21:09.342432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"30'5","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:51.943205+0000","last_change":"2023-05-24T03:29:44.088545+0000","last_active":"2023-05-24T03:31:51.943205+0000","last_peered":"2023-05-24T03:31:51.943205+0000","last_clean":"2023-05-24T03:31:51.943205+0000","last_became_active":"2023-05-24T03:29:44.087891+0000","last_became_peered":"2023-05-24T03:29:44.087891+0000","last_unstale":"2023-05-24T03:31:51.943205+0000","last_undegraded":"2023-05-24T03:31:51.943205+0000","last_fullsized":"2023-05-24T03:31:51.943205+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:26:41.155647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"30'23","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.037013+0000","last_change":"2023-05-24T03:29:44.493246+0000","last_active":"2023-05-24T03:31:55.037013+0000","last_peered":"2023-05-24T03:31:55.037013+0000","last_clean":"2023-05-24T03:31:55.037013+0000","last_became_active":"2023-05-24T03:29:44.492923+0000","last_became_peered":"2023-05-24T03:29:44.492923+0000","last_unstale":"2023-05-24T03:31:55.037013+0000","last_undegraded":"2023-05-24T03:31:55.037013+0000","last_fullsized":"2023-05-24T03:31:55.037013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:11:24.300717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"30'27","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.039268+0000","last_change":"2023-05-24T03:29:44.486961+0000","last_active":"2023-05-24T03:31:55.039268+0000","last_peered":"2023-05-24T03:31:55.039268+0000","last_clean":"2023-05-24T03:31:55.039268+0000","last_became_active":"2023-05-24T03:29:44.483898+0000","last_became_peered":"2023-05-24T03:29:44.483898+0000","last_unstale":"2023-05-24T03:31:55.039268+0000","last_undegraded":"2023-05-24T03:31:55.039268+0000","last_fullsized":"2023-05-24T03:31:55.039268+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:58:20.689097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"30'20","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.035003+0000","last_change":"2023-05-24T03:29:44.494451+0000","last_active":"2023-05-24T03:31:55.035003+0000","last_peered":"2023-05-24T03:31:55.035003+0000","last_clean":"2023-05-24T03:31:55.035003+0000","last_became_active":"2023-05-24T03:29:44.494073+0000","last_became_peered":"2023-05-24T03:29:44.494073+0000","last_unstale":"2023-05-24T03:31:55.035003+0000","last_undegraded":"2023-05-24T03:31:55.035003+0000","last_fullsized":"2023-05-24T03:31:55.035003+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:09:03.081839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"30'18","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.037312+0000","last_change":"2023-05-24T03:29:44.498119+0000","last_active":"2023-05-24T03:31:55.037312+0000","last_peered":"2023-05-24T03:31:55.037312+0000","last_clean":"2023-05-24T03:31:55.037312+0000","last_became_active":"2023-05-24T03:29:44.497832+0000","last_became_peered":"2023-05-24T03:29:44.497832+0000","last_unstale":"2023-05-24T03:31:55.037312+0000","last_undegraded":"2023-05-24T03:31:55.037312+0000","last_fullsized":"2023-05-24T03:31:55.037312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:29:45.352536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"30'15","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.042561+0000","last_change":"2023-05-24T03:29:44.496468+0000","last_active":"2023-05-24T03:31:55.042561+0000","last_peered":"2023-05-24T03:31:55.042561+0000","last_clean":"2023-05-24T03:31:55.042561+0000","last_became_active":"2023-05-24T03:29:44.496197+0000","last_became_peered":"2023-05-24T03:29:44.496197+0000","last_unstale":"2023-05-24T03:31:55.042561+0000","last_undegraded":"2023-05-24T03:31:55.042561+0000","last_fullsized":"2023-05-24T03:31:55.042561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:47:03.515144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"30'12","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.034205+0000","last_change":"2023-05-24T03:29:44.495194+0000","last_active":"2023-05-24T03:31:55.034205+0000","last_peered":"2023-05-24T03:31:55.034205+0000","last_clean":"2023-05-24T03:31:55.034205+0000","last_became_active":"2023-05-24T03:29:44.494928+0000","last_became_peered":"2023-05-24T03:29:44.494928+0000","last_unstale":"2023-05-24T03:31:55.034205+0000","last_undegraded":"2023-05-24T03:31:55.034205+0000","last_fullsized":"2023-05-24T03:31:55.034205+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:10:14.605046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":262144000,"num_objects":64,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":342,"num_write_kb":812032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":524288000,"data_stored":524288000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14714,"ondisk_log_size":14714,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1048,"ondisk_log_size":1048,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1397644,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":419,"num_write_kb":1638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2859008,"data_stored":2795288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":422,"ondisk_log_size":422,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99380,"kb_used_data":68332,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94272460,"statfs":{"total":96636764160,"available":96534999040,"internally_reserved":0,"allocated":69971968,"data_stored":69752984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":4.7569999999999997,"5min":1.3480000000000001,"15min":0.78000000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":14.757999999999999,"5min":14.757999999999999,"15min":14.757999999999999},"last":0.29899999999999999},{"interface":"front","average":{"1min":6.2599999999999998,"5min":1.663,"15min":0.89700000000000002},"min":{"1min":0.307,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":17.954000000000001,"5min":17.954000000000001,"15min":17.954000000000001},"last":0.45700000000000002}]},{"osd":1,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":4.8380000000000001,"5min":1.3740000000000001,"15min":0.79600000000000004},"min":{"1min":0.35599999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":16.939,"5min":16.939,"15min":16.939},"last":0.36799999999999999},{"interface":"front","average":{"1min":6.6909999999999998,"5min":1.766,"15min":0.94499999999999995},"min":{"1min":0.35599999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":17.981999999999999,"5min":17.981999999999999,"15min":17.981999999999999},"last":0.504}]},{"osd":2,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":6.1429999999999998,"5min":1.641,"15min":0.89100000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":14.720000000000001,"5min":14.720000000000001,"15min":14.720000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":5.6150000000000002,"5min":1.5469999999999999,"15min":0.86899999999999999},"min":{"1min":0.40799999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":14.814,"5min":14.814,"15min":14.814},"last":0.59399999999999997}]},{"osd":3,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":6.3620000000000001,"5min":1.7150000000000001,"15min":0.94099999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":22.977,"5min":22.977,"15min":22.977},"last":0.54500000000000004},{"interface":"front","average":{"1min":4.742,"5min":1.3779999999999999,"15min":0.81699999999999995},"min":{"1min":0.47099999999999997,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":14.836,"5min":14.836,"15min":14.836},"last":0.628}]},{"osd":4,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":4.8449999999999998,"5min":1.345,"15min":0.76200000000000001},"min":{"1min":0.35099999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":18.027000000000001,"5min":18.027000000000001,"15min":18.027000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":3.347,"5min":1.077,"15min":0.69899999999999995},"min":{"1min":0.36299999999999999,"5min":0.307,"15min":0.307},"max":{"1min":22.922000000000001,"5min":22.922000000000001,"15min":22.922000000000001},"last":0.51500000000000001}]},{"osd":5,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":3.512,"5min":1.1579999999999999,"15min":0.76600000000000001},"min":{"1min":0.39700000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":17.925999999999998,"5min":17.925999999999998,"15min":17.925999999999998},"last":0.56200000000000006},{"interface":"front","average":{"1min":3.79,"5min":1.206,"15min":0.77600000000000002},"min":{"1min":0.42099999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":18.004999999999999,"5min":18.004999999999999,"15min":18.004999999999999},"last":0.55500000000000005}]},{"osd":6,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":5.5069999999999997,"5min":1.5609999999999999,"15min":0.90300000000000002},"min":{"1min":0.45900000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":23.933,"5min":23.933,"15min":23.933},"last":0.53200000000000003},{"interface":"front","average":{"1min":5.3019999999999996,"5min":1.534,"15min":0.90600000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":22.954000000000001,"5min":22.954000000000001,"15min":22.954000000000001},"last":0.58199999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574881,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84296,"kb_used_data":62272,"kb_used_omap":0,"kb_used_meta":22016,"kb_avail":94287544,"statfs":{"total":96636764160,"available":96550445056,"internally_reserved":0,"allocated":63766528,"data_stored":63577694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22544384},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":8.5820000000000007,"5min":2.4780000000000002,"15min":1.46},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":22.922999999999998,"5min":22.922999999999998,"15min":22.922999999999998},"last":0.35499999999999998},{"interface":"front","average":{"1min":7.4909999999999997,"5min":1.952,"15min":1.0289999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":28.870000000000001,"5min":28.870000000000001,"15min":28.870000000000001},"last":0.47599999999999998}]},{"osd":1,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":7.5229999999999997,"5min":2.3090000000000002,"15min":1.4399999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":22.984999999999999,"5min":22.984999999999999,"15min":22.984999999999999},"last":0.496},{"interface":"front","average":{"1min":6.492,"5min":2.0910000000000002,"15min":1.357},"min":{"1min":0.434,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":21.984999999999999,"5min":21.984999999999999,"15min":21.984999999999999},"last":0.33000000000000002}]},{"osd":2,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":5.6580000000000004,"5min":1.6020000000000001,"15min":0.92600000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":22.649999999999999,"5min":22.649999999999999,"15min":22.649999999999999},"last":0.36299999999999999},{"interface":"front","average":{"1min":7.5709999999999997,"5min":2.3199999999999998,"15min":1.4450000000000001},"min":{"1min":0.40100000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":23.035,"5min":23.035,"15min":23.035},"last":0.38400000000000001}]},{"osd":3,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":6.4699999999999998,"5min":1.8380000000000001,"15min":1.0660000000000001},"min":{"1min":0.42699999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":18.056000000000001,"5min":18.056000000000001,"15min":18.056000000000001},"last":0.377},{"interface":"front","average":{"1min":6.2069999999999999,"5min":1.7749999999999999,"15min":1.036},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":19.963999999999999,"5min":19.963999999999999,"15min":19.963999999999999},"last":0.40799999999999997}]},{"osd":4,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":5.3230000000000004,"5min":1.4830000000000001,"15min":0.84299999999999997},"min":{"1min":0.372,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":18.056000000000001,"5min":18.056000000000001,"15min":18.056000000000001},"last":0.313},{"interface":"front","average":{"1min":5.1360000000000001,"5min":1.476,"15min":0.86599999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":21.943999999999999,"5min":21.943999999999999,"15min":21.943999999999999},"last":0.42199999999999999}]},{"osd":5,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":4.7370000000000001,"5min":1.3799999999999999,"15min":0.81999999999999995},"min":{"1min":0.36599999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":11.976000000000001,"5min":11.976000000000001,"15min":11.976000000000001},"last":0.435},{"interface":"front","average":{"1min":7.032,"5min":1.9119999999999999,"15min":1.0589999999999999},"min":{"1min":0.44600000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":23.010999999999999,"5min":23.010999999999999,"15min":23.010999999999999},"last":0.44}]},{"osd":7,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":5.8639999999999999,"5min":1.6479999999999999,"15min":0.94599999999999995},"min":{"1min":0.48699999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":11.989000000000001,"5min":11.989000000000001,"15min":11.989000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":5.157,"5min":1.528,"15min":0.92300000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":21.042000000000002,"5min":21.042000000000002,"15min":21.042000000000002},"last":0.46700000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574881,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98632,"kb_used_data":76608,"kb_used_omap":0,"kb_used_meta":22016,"kb_avail":94273208,"statfs":{"total":96636764160,"available":96535764992,"internally_reserved":0,"allocated":78446592,"data_stored":78257758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22544384},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:31:32 2023","interfaces":[{"interface":"back","average":{"1min":5.5410000000000004,"5min":1.452,"15min":0.77000000000000002},"min":{"1min":0.24199999999999999,"5min":0.223,"15min":0.223},"max":{"1min":18.954000000000001,"5min":18.954000000000001,"15min":18.954000000000001},"last":0.23499999999999999},{"interface":"front","average":{"1min":6.6689999999999996,"5min":1.8400000000000001,"15min":1.0349999999999999},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":21.981999999999999,"5min":21.981999999999999,"15min":21.981999999999999},"last":0.221}]},{"osd":2,"last update":"Wed May 24 03:31:32 2023","interfaces":[{"interface":"back","average":{"1min":4.258,"5min":1.151,"15min":0.63300000000000001},"min":{"1min":0.255,"5min":0.221,"15min":0.221},"max":{"1min":15.004,"5min":15.004,"15min":15.004},"last":0.25600000000000001},{"interface":"front","average":{"1min":6.0179999999999998,"5min":1.5680000000000001,"15min":0.82599999999999996},"min":{"1min":0.29399999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":21.885000000000002,"5min":21.885000000000002,"15min":21.885000000000002},"last":0.26800000000000002}]},{"osd":3,"last update":"Wed May 24 03:31:32 2023","interfaces":[{"interface":"back","average":{"1min":4.5700000000000003,"5min":1.3160000000000001,"15min":0.77400000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":18.167000000000002,"5min":18.167000000000002,"15min":18.167000000000002},"last":0.32700000000000001},{"interface":"front","average":{"1min":3.7869999999999999,"5min":1.089,"15min":0.63900000000000001},"min":{"1min":0.33200000000000002,"5min":0.254,"15min":0.254},"max":{"1min":11.935,"5min":11.935,"15min":11.935},"last":0.30599999999999999}]},{"osd":4,"last update":"Wed May 24 03:31:32 2023","interfaces":[{"interface":"back","average":{"1min":7.3700000000000001,"5min":1.9259999999999999,"15min":1.018},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":28.891999999999999,"5min":28.891999999999999,"15min":28.891999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":7.6630000000000003,"5min":2.044,"15min":1.1080000000000001},"min":{"1min":0.376,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":21.954999999999998,"5min":21.954999999999998,"15min":21.954999999999998},"last":0.40899999999999997}]},{"osd":5,"last update":"Wed May 24 03:31:32 2023","interfaces":[{"interface":"back","average":{"1min":8.9190000000000005,"5min":2.323,"15min":1.2230000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":21.928000000000001,"5min":21.928000000000001,"15min":21.928000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":7.6909999999999998,"5min":2.0720000000000001,"15min":1.1359999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":19.757999999999999,"5min":19.757999999999999,"15min":19.757999999999999},"last":0.49199999999999999}]},{"osd":6,"last update":"Wed May 24 03:31:32 2023","interfaces":[{"interface":"back","average":{"1min":6.984,"5min":1.9039999999999999,"15min":1.0580000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":22.033999999999999,"5min":22.033999999999999,"15min":22.033999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":7.6849999999999996,"5min":2.0339999999999998,"15min":1.0920000000000001},"min":{"1min":0.40200000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":19.734999999999999,"5min":19.734999999999999,"15min":19.734999999999999},"last":0.51600000000000001}]},{"osd":7,"last update":"Wed May 24 03:31:32 2023","interfaces":[{"interface":"back","average":{"1min":8.1940000000000008,"5min":2.2130000000000001,"15min":1.216},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":21.994,"5min":21.994,"15min":21.994},"last":0.46999999999999997},{"interface":"front","average":{"1min":7.8959999999999999,"5min":2.109,"15min":1.145},"min":{"1min":0.47999999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":21.957999999999998,"5min":21.957999999999998,"15min":21.957999999999998},"last":0.502}]}]},{"osd":0,"up_from":13,"seq":55834574881,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98008,"kb_used_data":66960,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94273832,"statfs":{"total":96636764160,"available":96536403968,"internally_reserved":0,"allocated":68567040,"data_stored":68369392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":5.6539999999999999,"5min":1.4419999999999999,"15min":0.73999999999999999},"min":{"1min":0.29099999999999998,"5min":0.253,"15min":0.253},"max":{"1min":21.216000000000001,"5min":21.216000000000001,"15min":21.216000000000001},"last":0.30599999999999999},{"interface":"front","average":{"1min":6.9509999999999996,"5min":1.6930000000000001,"15min":0.81699999999999995},"min":{"1min":0.247,"5min":0.185,"15min":0.185},"max":{"1min":29.925000000000001,"5min":29.925000000000001,"15min":29.925000000000001},"last":0.26300000000000001}]},{"osd":2,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":5.431,"5min":1.403,"15min":0.73199999999999998},"min":{"1min":0.29099999999999998,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":19.018999999999998,"5min":19.018999999999998,"15min":19.018999999999998},"last":0.88800000000000001},{"interface":"front","average":{"1min":7.6340000000000003,"5min":1.861,"15min":0.89900000000000002},"min":{"1min":0.32700000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":21.945,"5min":21.945,"15min":21.945},"last":0.378}]},{"osd":3,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":5.6120000000000001,"5min":1.4630000000000001,"15min":0.77100000000000002},"min":{"1min":0.30599999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":25.381,"5min":25.381,"15min":25.381},"last":0.47699999999999998},{"interface":"front","average":{"1min":8.2040000000000006,"5min":2.0129999999999999,"15min":0.98099999999999998},"min":{"1min":0.38900000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":21.209,"5min":21.209,"15min":21.209},"last":0.51700000000000002}]},{"osd":4,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":8.1859999999999999,"5min":2.1680000000000001,"15min":1.165},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":22.030000000000001,"5min":22.030000000000001,"15min":22.030000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":7.9889999999999999,"5min":2.113,"15min":1.1339999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":25.279,"5min":25.279,"15min":25.279},"last":0.83199999999999996}]},{"osd":5,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":7.1589999999999998,"5min":1.9690000000000001,"15min":1.1040000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":25.329999999999998,"5min":25.329999999999998,"15min":25.329999999999998},"last":0.94799999999999995},{"interface":"front","average":{"1min":7.4630000000000001,"5min":2.0110000000000001,"15min":1.103},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":28.928000000000001,"5min":28.928000000000001,"15min":28.928000000000001},"last":0.86099999999999999}]},{"osd":6,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":6.9420000000000002,"5min":1.8899999999999999,"15min":1.048},"min":{"1min":0.376,"5min":0.37,"15min":0.37},"max":{"1min":21.132000000000001,"5min":21.132000000000001,"15min":21.132000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":7.8250000000000002,"5min":2.0550000000000002,"15min":1.093},"min":{"1min":0.44400000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":22.007000000000001,"5min":22.007000000000001,"15min":22.007000000000001},"last":0.68400000000000005}]},{"osd":7,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":9.327,"5min":2.3700000000000001,"15min":1.21},"min":{"1min":0.47799999999999998,"5min":0.437,"15min":0.437},"max":{"1min":21.983000000000001,"5min":21.983000000000001,"15min":21.983000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":7.0700000000000003,"5min":1.9359999999999999,"15min":1.0800000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":25.356000000000002,"5min":25.356000000000002,"15min":25.356000000000002},"last":0.79600000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574881,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73544,"kb_used_data":55616,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94298296,"statfs":{"total":96636764160,"available":96561455104,"internally_reserved":0,"allocated":56950784,"data_stored":56761950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":2.8090000000000002,"5min":0.83899999999999997,"15min":0.51100000000000001},"min":{"1min":0.26400000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":10.821999999999999,"5min":10.821999999999999,"15min":10.821999999999999},"last":0.24199999999999999},{"interface":"front","average":{"1min":2.762,"5min":0.96099999999999997,"15min":0.66100000000000003},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":11.743,"5min":11.743,"15min":11.743},"last":0.32400000000000001}]},{"osd":1,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":2.4900000000000002,"5min":0.80600000000000005,"15min":0.52500000000000002},"min":{"1min":0.316,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":12.079000000000001,"5min":12.079000000000001,"15min":12.079000000000001},"last":0.27800000000000002},{"interface":"front","average":{"1min":3.9860000000000002,"5min":1.234,"15min":0.77600000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":19.954000000000001,"5min":19.954000000000001,"15min":19.954000000000001},"last":0.35599999999999998}]},{"osd":3,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":4.5510000000000002,"5min":1.214,"15min":0.65800000000000003},"min":{"1min":0.313,"5min":0.255,"15min":0.255},"max":{"1min":21.611000000000001,"5min":21.611000000000001,"15min":21.611000000000001},"last":0.26200000000000001},{"interface":"front","average":{"1min":3.4460000000000002,"5min":1.034,"15min":0.63200000000000001},"min":{"1min":0.34999999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":21.055,"5min":21.055,"15min":21.055},"last":0.308}]},{"osd":4,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":4.8609999999999998,"5min":1.4690000000000001,"15min":0.90400000000000003},"min":{"1min":0.39600000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":16.657,"5min":16.657,"15min":16.657},"last":0.52700000000000002},{"interface":"front","average":{"1min":4.1879999999999997,"5min":1.4319999999999999,"15min":0.97299999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":17.116,"5min":17.116,"15min":17.116},"last":0.51300000000000001}]},{"osd":5,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":5.6180000000000003,"5min":1.6100000000000001,"15min":0.94199999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":21.655000000000001,"5min":21.655000000000001,"15min":21.655000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":3.903,"5min":1.3,"15min":0.86599999999999999},"min":{"1min":0.42099999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":14.045999999999999,"5min":14.045999999999999,"15min":14.045999999999999},"last":0.46800000000000003}]},{"osd":6,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":4.8600000000000003,"5min":1.595,"15min":1.0509999999999999},"min":{"1min":0.48299999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":20.966999999999999,"5min":20.966999999999999,"15min":20.966999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":3.9710000000000001,"5min":1.2909999999999999,"15min":0.84499999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":15.119,"5min":15.119,"15min":15.119},"last":0.53900000000000003}]},{"osd":7,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":5.2690000000000001,"5min":1.6890000000000001,"15min":1.093},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":17.035,"5min":17.035,"15min":17.035},"last":0.47899999999999998},{"interface":"front","average":{"1min":5.0380000000000003,"5min":1.502,"15min":0.91200000000000003},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":18.611999999999998,"5min":18.611999999999998,"15min":18.611999999999998},"last":0.501}]}]},{"osd":3,"up_from":13,"seq":55834574880,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76620,"kb_used_data":58692,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94295220,"statfs":{"total":96636764160,"available":96558305280,"internally_reserved":0,"allocated":60100608,"data_stored":59907768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":4.7919999999999998,"5min":1.7130000000000001,"15min":1.2},"min":{"1min":0.25800000000000001,"5min":0.224,"15min":0.224},"max":{"1min":22.969000000000001,"5min":22.969000000000001,"15min":22.969000000000001},"last":0.317},{"interface":"front","average":{"1min":3.7040000000000002,"5min":1.4510000000000001,"15min":1.075},"min":{"1min":0.31,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":15.933999999999999,"5min":15.933999999999999,"15min":15.933999999999999},"last":0.28000000000000003}]},{"osd":1,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":3.2229999999999999,"5min":1.246,"15min":0.91600000000000004},"min":{"1min":0.28499999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":19.882000000000001,"5min":19.882000000000001,"15min":19.882000000000001},"last":0.29499999999999998},{"interface":"front","average":{"1min":3.5920000000000001,"5min":1.0569999999999999,"15min":0.63500000000000001},"min":{"1min":0.379,"5min":0.251,"15min":0.251},"max":{"1min":18.792000000000002,"5min":18.792000000000002,"15min":18.792000000000002},"last":0.22900000000000001}]},{"osd":2,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":5.7619999999999996,"5min":1.7709999999999999,"15min":1.1060000000000001},"min":{"1min":0.27200000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":22.922999999999998,"5min":22.922999999999998,"15min":22.922999999999998},"last":0.36399999999999999},{"interface":"front","average":{"1min":3.8540000000000001,"5min":2.3860000000000001,"15min":2.1419999999999999},"min":{"1min":0.318,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":19.645,"5min":22.919,"15min":22.919},"last":0.26200000000000001}]},{"osd":4,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":5.016,"5min":1.5069999999999999,"15min":0.92200000000000004},"min":{"1min":0.37,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":18.952000000000002,"5min":18.952000000000002,"15min":18.952000000000002},"last":0.48299999999999998},{"interface":"front","average":{"1min":6.4580000000000002,"5min":2.0539999999999998,"15min":1.3200000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":24.933,"5min":24.933,"15min":24.933},"last":0.49299999999999999}]},{"osd":5,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":5.4980000000000002,"5min":2.0209999999999999,"15min":1.4410000000000001},"min":{"1min":0.47699999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":20.056000000000001,"5min":20.056000000000001,"15min":20.056000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":5.3170000000000002,"5min":1.5649999999999999,"15min":0.93999999999999995},"min":{"1min":0.42399999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":16.013000000000002,"5min":16.013000000000002,"15min":16.013000000000002},"last":0.442}]},{"osd":6,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":4.3959999999999999,"5min":1.6759999999999999,"15min":1.222},"min":{"1min":0.433,"5min":0.379,"15min":0.379},"max":{"1min":13.986000000000001,"5min":13.986000000000001,"15min":13.986000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":4.9909999999999997,"5min":1.923,"15min":1.4119999999999999},"min":{"1min":0.43099999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":20.088000000000001,"5min":20.088000000000001,"15min":20.088000000000001},"last":0.40799999999999997}]},{"osd":7,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":5.7279999999999998,"5min":1.6639999999999999,"15min":0.98699999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":21.571000000000002,"5min":21.571000000000002,"15min":21.571000000000002},"last":0.39900000000000002},{"interface":"front","average":{"1min":4.6029999999999998,"5min":1.724,"15min":1.244},"min":{"1min":0.44400000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":13.922000000000001,"5min":13.922000000000001,"15min":13.922000000000001},"last":0.51000000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574881,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":103408,"kb_used_data":68264,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94268432,"statfs":{"total":96636764160,"available":96530874368,"internally_reserved":0,"allocated":69902336,"data_stored":69693188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:31:33 2023","interfaces":[{"interface":"back","average":{"1min":6.3440000000000003,"5min":1.663,"15min":0.88300000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":17.794,"5min":17.794,"15min":17.794},"last":0.438},{"interface":"front","average":{"1min":5.2089999999999996,"5min":1.448,"15min":0.82099999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":16.597999999999999,"5min":16.597999999999999,"15min":16.597999999999999},"last":0.504}]},{"osd":1,"last update":"Wed May 24 03:31:33 2023","interfaces":[{"interface":"back","average":{"1min":6.2549999999999999,"5min":1.6619999999999999,"15min":0.89600000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":22.933,"5min":22.933,"15min":22.933},"last":0.47699999999999998},{"interface":"front","average":{"1min":5.0650000000000004,"5min":1.4399999999999999,"15min":0.83599999999999997},"min":{"1min":0.35499999999999998,"5min":0.309,"15min":0.309},"max":{"1min":16.196000000000002,"5min":16.196000000000002,"15min":16.196000000000002},"last":0.55700000000000005}]},{"osd":2,"last update":"Wed May 24 03:31:33 2023","interfaces":[{"interface":"back","average":{"1min":5.0049999999999999,"5min":1.4119999999999999,"15min":0.81299999999999994},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":18.919,"5min":18.919,"15min":18.919},"last":0.40899999999999997},{"interface":"front","average":{"1min":5.391,"5min":1.4990000000000001,"15min":0.84999999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":16.277999999999999,"5min":16.277999999999999,"15min":16.277999999999999},"last":0.52600000000000002}]},{"osd":3,"last update":"Wed May 24 03:31:33 2023","interfaces":[{"interface":"back","average":{"1min":4.633,"5min":1.3169999999999999,"15min":0.76400000000000001},"min":{"1min":0.32000000000000001,"5min":0.312,"15min":0.312},"max":{"1min":18.956,"5min":18.956,"15min":18.956},"last":0.56999999999999995},{"interface":"front","average":{"1min":6.0899999999999999,"5min":1.651,"15min":0.91100000000000003},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":22.960000000000001,"5min":22.960000000000001,"15min":22.960000000000001},"last":0.42799999999999999}]},{"osd":5,"last update":"Wed May 24 03:31:33 2023","interfaces":[{"interface":"back","average":{"1min":4.0069999999999997,"5min":1.2230000000000001,"15min":0.75900000000000001},"min":{"1min":0.36199999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":16.231999999999999,"5min":16.231999999999999,"15min":16.231999999999999},"last":0.38900000000000001},{"interface":"front","average":{"1min":3.1560000000000001,"5min":1.0940000000000001,"15min":0.75},"min":{"1min":0.42399999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":11.904999999999999,"5min":11.904999999999999,"15min":11.904999999999999},"last":0.46100000000000002}]},{"osd":6,"last update":"Wed May 24 03:31:33 2023","interfaces":[{"interface":"back","average":{"1min":5.4790000000000001,"5min":1.492,"15min":0.82799999999999996},"min":{"1min":0.33400000000000002,"5min":0.315,"15min":0.315},"max":{"1min":22.983000000000001,"5min":22.983000000000001,"15min":22.983000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":3.2970000000000002,"5min":1.1100000000000001,"15min":0.746},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":12.367000000000001,"5min":12.367000000000001,"15min":12.367000000000001},"last":0.48699999999999999}]},{"osd":7,"last update":"Wed May 24 03:31:33 2023","interfaces":[{"interface":"back","average":{"1min":3.2090000000000001,"5min":1.085,"15min":0.73099999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":16.576000000000001,"5min":16.576000000000001,"15min":16.576000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":5.5149999999999997,"5min":1.5820000000000001,"15min":0.92600000000000005},"min":{"1min":0.432,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":22.882000000000001,"5min":22.882000000000001,"15min":22.882000000000001},"last":0.45200000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574880,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":83792,"kb_used_data":61768,"kb_used_omap":0,"kb_used_meta":22016,"kb_avail":94288048,"statfs":{"total":96636764160,"available":96550961152,"internally_reserved":0,"allocated":63250432,"data_stored":63054058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22544384},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,1,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:31:35 2023","interfaces":[{"interface":"back","average":{"1min":7.0830000000000002,"5min":1.831,"15min":0.95599999999999996},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":20.137,"5min":20.137,"15min":20.137},"last":0.93999999999999995},{"interface":"front","average":{"1min":6.6159999999999997,"5min":1.9019999999999999,"15min":1.1160000000000001},"min":{"1min":0.30499999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":25.988,"5min":25.988,"15min":25.988},"last":0.49199999999999999}]},{"osd":1,"last update":"Wed May 24 03:31:35 2023","interfaces":[{"interface":"back","average":{"1min":6.5759999999999996,"5min":1.748,"15min":0.94399999999999995},"min":{"1min":0.42799999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":22.765999999999998,"5min":22.765999999999998,"15min":22.765999999999998},"last":0.318},{"interface":"front","average":{"1min":7.2190000000000003,"5min":2.044,"15min":1.1819999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":20.161999999999999,"5min":20.161999999999999,"15min":20.161999999999999},"last":0.72999999999999998}]},{"osd":2,"last update":"Wed May 24 03:31:35 2023","interfaces":[{"interface":"back","average":{"1min":7.4820000000000002,"5min":1.929,"15min":1.0029999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":25.946000000000002,"5min":25.946000000000002,"15min":25.946000000000002},"last":0.71899999999999997},{"interface":"front","average":{"1min":5.6459999999999999,"5min":1.7490000000000001,"15min":1.099},"min":{"1min":0.45900000000000002,"5min":0.437,"15min":0.437},"max":{"1min":22.800000000000001,"5min":22.800000000000001,"15min":22.800000000000001},"last":1.0469999999999999}]},{"osd":3,"last update":"Wed May 24 03:31:35 2023","interfaces":[{"interface":"back","average":{"1min":6.093,"5min":1.9059999999999999,"15min":1.208},"min":{"1min":0.38600000000000001,"5min":0.375,"15min":0.375},"max":{"1min":26.013999999999999,"5min":26.013999999999999,"15min":26.013999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":6.2140000000000004,"5min":1.8959999999999999,"15min":1.1759999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":22.687999999999999,"5min":22.687999999999999,"15min":22.687999999999999},"last":0.42099999999999999}]},{"osd":4,"last update":"Wed May 24 03:31:35 2023","interfaces":[{"interface":"back","average":{"1min":5.6379999999999999,"5min":1.5289999999999999,"15min":0.84399999999999997},"min":{"1min":0.33500000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":19.998000000000001,"5min":19.998000000000001,"15min":19.998000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":4.3520000000000003,"5min":1.2929999999999999,"15min":0.78300000000000003},"min":{"1min":0.38800000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":17.628,"5min":17.628,"15min":17.628},"last":0.52500000000000002}]},{"osd":6,"last update":"Wed May 24 03:31:35 2023","interfaces":[{"interface":"back","average":{"1min":4.516,"5min":1.3420000000000001,"15min":0.81299999999999994},"min":{"1min":0.39600000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":19.969000000000001,"5min":19.969000000000001,"15min":19.969000000000001},"last":0.34899999999999998},{"interface":"front","average":{"1min":5.2229999999999999,"5min":1.4970000000000001,"15min":0.876},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":19.913,"5min":19.913,"15min":19.913},"last":1.117}]},{"osd":7,"last update":"Wed May 24 03:31:35 2023","interfaces":[{"interface":"back","average":{"1min":3.9180000000000001,"5min":1.274,"15min":0.83399999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":17.731000000000002,"5min":17.731000000000002,"15min":17.731000000000002},"last":0.55300000000000005},{"interface":"front","average":{"1min":4.2949999999999999,"5min":1.3620000000000001,"15min":0.873},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":20.099,"5min":20.099,"15min":20.099},"last":0.374}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":7026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1417216,"data_stored":1396902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1417216,"data_stored":1390618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":67633152,"data_stored":67633152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":78118912,"data_stored":78118912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":56623104,"data_stored":56623104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":59768832,"data_stored":59768832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":68157440,"data_stored":68157440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":62914560,"data_stored":62914560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":63438848,"data_stored":63438848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":67633152,"data_stored":67633152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-24T03:32:02.359 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-05-24T03:32:02.359 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-24T03:32:02.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.505+0000 7fba696ce700 1 Processor -- start 2023-05-24T03:32:02.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.505+0000 7fba696ce700 1 -- start start 2023-05-24T03:32:02.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.505+0000 7fba696ce700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fba640b8a50 0x7fba6415daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:02.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.505+0000 7fba696ce700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba6406bb40 0x7fba640cfe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:02.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.505+0000 7fba696ce700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba640cf9d0 con 0x7fba640d03a0 2023-05-24T03:32:02.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.505+0000 7fba696ce700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba640cd790 con 0x7fba640b8a50 2023-05-24T03:32:02.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.505+0000 7fba696ce700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba6415e030 con 0x7fba6406bb40 2023-05-24T03:32:02.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.505+0000 7fba637fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fba640d03a0 0x7fba640b4c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46932/0 (socket says 172.21.15.146:46932) 2023-05-24T03:32:02.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.505+0000 7fba637fe700 1 -- 172.21.15.146:0/4176140049 learned_addr learned my addr 172.21.15.146:0/4176140049 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:32:02.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.506+0000 7fba627fc700 1 --2- 172.21.15.146:0/4176140049 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba6406bb40 0x7fba640cfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:02.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.506+0000 7fba62ffd700 1 --2- 172.21.15.146:0/4176140049 >> v2:172.21.15.151:3300/0 conn(0x7fba640b8a50 0x7fba6415daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:02.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.506+0000 7fba61ffb700 1 -- 172.21.15.146:0/4176140049 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1587845902 0 0) 0x7fba640cf9d0 con 0x7fba640d03a0 2023-05-24T03:32:02.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.506+0000 7fba61ffb700 1 -- 172.21.15.146:0/4176140049 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba4c0035b0 con 0x7fba640d03a0 2023-05-24T03:32:02.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.506+0000 7fba61ffb700 1 -- 172.21.15.146:0/4176140049 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1640826737 0 0) 0x7fba4c0035b0 con 0x7fba640d03a0 2023-05-24T03:32:02.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.506+0000 7fba61ffb700 1 -- 172.21.15.146:0/4176140049 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba6406bb40 msgr2=0x7fba640cfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:32:02.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.506+0000 7fba61ffb700 1 --2- 172.21.15.146:0/4176140049 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba6406bb40 0x7fba640cfe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:02.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.506+0000 7fba61ffb700 1 -- 172.21.15.146:0/4176140049 >> v2:172.21.15.151:3300/0 conn(0x7fba640b8a50 msgr2=0x7fba6415daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:32:02.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.506+0000 7fba61ffb700 1 --2- 172.21.15.146:0/4176140049 >> v2:172.21.15.151:3300/0 conn(0x7fba640b8a50 0x7fba6415daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:02.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.506+0000 7fba61ffb700 1 -- 172.21.15.146:0/4176140049 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba640cf400 con 0x7fba640d03a0 2023-05-24T03:32:02.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.506+0000 7fba61ffb700 1 -- 172.21.15.146:0/4176140049 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1301887351 0 0) 0x7fba5c0019f0 con 0x7fba640d03a0 2023-05-24T03:32:02.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.506+0000 7fba61ffb700 1 -- 172.21.15.146:0/4176140049 >> v1:172.21.15.146:6789/0 conn(0x7fba640d03a0 legacy=0x7fba640b4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:02.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.506+0000 7fba61ffb700 1 --2- 172.21.15.146:0/4176140049 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba6406bb40 0x7fba4c003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:02.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.506+0000 7fba61ffb700 1 --2- 172.21.15.146:0/4176140049 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba4c003f80 0x7fba4c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:02.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.506+0000 7fba61ffb700 1 --2- 172.21.15.146:0/4176140049 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba4c004d90 0x7fba4c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:02.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.506+0000 7fba61ffb700 1 -- 172.21.15.146:0/4176140049 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba640cd790 con 0x7fba4c004d90 2023-05-24T03:32:02.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.506+0000 7fba61ffb700 1 -- 172.21.15.146:0/4176140049 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba6415e030 con 0x7fba4c003f80 2023-05-24T03:32:02.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.506+0000 7fba61ffb700 1 -- 172.21.15.146:0/4176140049 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba4c00ba10 con 0x7fba6406bb40 2023-05-24T03:32:02.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.506+0000 7fba637fe700 1 --2- 172.21.15.146:0/4176140049 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba4c004d90 0x7fba4c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:02.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.506+0000 7fba627fc700 1 --2- 172.21.15.146:0/4176140049 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba4c003f80 0x7fba4c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:02.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.506+0000 7fba62ffd700 1 --2- 172.21.15.146:0/4176140049 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba6406bb40 0x7fba4c003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:02.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.506+0000 7fba637fe700 1 -- 172.21.15.146:0/4176140049 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba6406bb40 msgr2=0x7fba4c003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:32:02.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.506+0000 7fba637fe700 1 --2- 172.21.15.146:0/4176140049 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba6406bb40 0x7fba4c003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:02.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.506+0000 7fba637fe700 1 -- 172.21.15.146:0/4176140049 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba4c003f80 msgr2=0x7fba4c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:32:02.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.506+0000 7fba637fe700 1 --2- 172.21.15.146:0/4176140049 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba4c003f80 0x7fba4c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:02.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.506+0000 7fba637fe700 1 -- 172.21.15.146:0/4176140049 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba4c0035b0 con 0x7fba4c004d90 2023-05-24T03:32:02.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.507+0000 7fba637fe700 1 --2- 172.21.15.146:0/4176140049 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba4c004d90 0x7fba4c005200 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fba640d0800 tx=0x7fba4c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5a4116f965c73f3 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:02.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.507+0000 7fba61ffb700 1 -- 172.21.15.146:0/4176140049 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5c00a340 con 0x7fba4c004d90 2023-05-24T03:32:02.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.507+0000 7fba61ffb700 1 -- 172.21.15.146:0/4176140049 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba5c012600 con 0x7fba4c004d90 2023-05-24T03:32:02.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.507+0000 7fba61ffb700 1 -- 172.21.15.146:0/4176140049 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5c0129b0 con 0x7fba4c004d90 2023-05-24T03:32:02.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.507+0000 7fba696ce700 1 -- 172.21.15.146:0/4176140049 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba4c004d90 msgr2=0x7fba4c005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:02.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.507+0000 7fba696ce700 1 --2- 172.21.15.146:0/4176140049 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba4c004d90 0x7fba4c005200 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fba640d0800 tx=0x7fba4c005880 comp rx=0 tx=0).stop 2023-05-24T03:32:02.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.507+0000 7fba637fe700 1 -- 172.21.15.146:0/4176140049 reap_dead start 2023-05-24T03:32:02.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.507+0000 7fba696ce700 1 -- 172.21.15.146:0/4176140049 shutdown_connections 2023-05-24T03:32:02.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.507+0000 7fba696ce700 1 -- 172.21.15.146:0/4176140049 >> 172.21.15.146:0/4176140049 conn(0x7fba6406af30 msgr2=0x7fba6406b330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:32:02.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.507+0000 7fba696ce700 1 -- 172.21.15.146:0/4176140049 shutdown_connections 2023-05-24T03:32:02.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.507+0000 7fba696ce700 1 -- 172.21.15.146:0/4176140049 wait complete. 2023-05-24T03:32:02.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.509+0000 7fba696ce700 1 Processor -- start 2023-05-24T03:32:02.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.509+0000 7fba696ce700 1 -- start start 2023-05-24T03:32:02.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.510+0000 7fba696ce700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba640d2760 0x7fba641f6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:02.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.510+0000 7fba696ce700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba640d2b30 0x7fba640aade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:02.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.510+0000 7fba696ce700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba640ab320 0x7fba640a9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:02.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.510+0000 7fba696ce700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba640ab7c0 con 0x7fba640ab320 2023-05-24T03:32:02.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.510+0000 7fba696ce700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba640cb150 con 0x7fba640d2b30 2023-05-24T03:32:02.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.510+0000 7fba696ce700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba641f65c0 con 0x7fba640d2760 2023-05-24T03:32:02.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.510+0000 7fba637fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba640ab320 0x7fba640a9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:02.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.510+0000 7fba637fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba640ab320 0x7fba640a9b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40492/0 (socket says 172.21.15.146:40492) 2023-05-24T03:32:02.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.510+0000 7fba637fe700 1 -- 172.21.15.146:0/4127779287 learned_addr learned my addr 172.21.15.146:0/4127779287 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:32:02.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.510+0000 7fba627fc700 1 --2- 172.21.15.146:0/4127779287 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba640d2b30 0x7fba640aade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:02.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.510+0000 7fba62ffd700 1 --2- 172.21.15.146:0/4127779287 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba640d2760 0x7fba641f6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:02.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.510+0000 7fba637fe700 1 -- 172.21.15.146:0/4127779287 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba640d2760 msgr2=0x7fba641f6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:02.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.510+0000 7fba637fe700 1 --2- 172.21.15.146:0/4127779287 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba640d2760 0x7fba641f6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:02.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.510+0000 7fba637fe700 1 -- 172.21.15.146:0/4127779287 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba640d2b30 msgr2=0x7fba640aade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:02.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.510+0000 7fba637fe700 1 --2- 172.21.15.146:0/4127779287 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba640d2b30 0x7fba640aade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:02.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.510+0000 7fba637fe700 1 -- 172.21.15.146:0/4127779287 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba640cdf60 con 0x7fba640ab320 2023-05-24T03:32:02.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.511+0000 7fba637fe700 1 --2- 172.21.15.146:0/4127779287 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba640ab320 0x7fba640a9b70 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fba4c0046d0 tx=0x7fba5c001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:02.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.511+0000 7fba4b7fe700 1 -- 172.21.15.146:0/4127779287 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5c00a340 con 0x7fba640ab320 2023-05-24T03:32:02.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.511+0000 7fba4b7fe700 1 -- 172.21.15.146:0/4127779287 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba5c0019c0 con 0x7fba640ab320 2023-05-24T03:32:02.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.511+0000 7fba696ce700 1 -- 172.21.15.146:0/4127779287 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba640cf6a0 con 0x7fba640ab320 2023-05-24T03:32:02.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.511+0000 7fba4b7fe700 1 -- 172.21.15.146:0/4127779287 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5c027410 con 0x7fba640ab320 2023-05-24T03:32:02.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.511+0000 7fba696ce700 1 -- 172.21.15.146:0/4127779287 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba640cd9a0 con 0x7fba640ab320 2023-05-24T03:32:02.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.512+0000 7fba696ce700 1 -- 172.21.15.146:0/4127779287 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba64072ae0 con 0x7fba640ab320 2023-05-24T03:32:02.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.512+0000 7fba4b7fe700 1 -- 172.21.15.146:0/4127779287 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fba5c019070 con 0x7fba640ab320 2023-05-24T03:32:02.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.513+0000 7fba4b7fe700 1 --2- 172.21.15.146:0/4127779287 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fba5006ace0 0x7fba5006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:02.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.513+0000 7fba62ffd700 1 --2- 172.21.15.146:0/4127779287 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fba5006ace0 0x7fba5006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:02.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.513+0000 7fba4b7fe700 1 -- 172.21.15.146:0/4127779287 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fba5c08abe0 con 0x7fba640ab320 2023-05-24T03:32:02.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.513+0000 7fba62ffd700 1 --2- 172.21.15.146:0/4127779287 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fba5006ace0 0x7fba5006d190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fba58009ce0 tx=0x7fba58009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:02.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.517+0000 7fba4b7fe700 1 -- 172.21.15.146:0/4127779287 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fba5c055a30 con 0x7fba640ab320 2023-05-24T03:32:02.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.701+0000 7fba696ce700 1 -- 172.21.15.146:0/4127779287 --> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fba6404e810 con 0x7fba5006ace0 2023-05-24T03:32:02.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.711+0000 7fba4b7fe700 1 -- 172.21.15.146:0/4127779287 <== mgr.4104 v2:172.21.15.146:6832/1985394169 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+391935 (secure 0 0 0) 0x7fba6404e810 con 0x7fba5006ace0 2023-05-24T03:32:02.719 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:32:02.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.715+0000 7fba696ce700 1 -- 172.21.15.146:0/4127779287 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fba5006ace0 msgr2=0x7fba5006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:02.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.715+0000 7fba696ce700 1 --2- 172.21.15.146:0/4127779287 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fba5006ace0 0x7fba5006d190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fba58009ce0 tx=0x7fba58009210 comp rx=0 tx=0).stop 2023-05-24T03:32:02.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.715+0000 7fba696ce700 1 -- 172.21.15.146:0/4127779287 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba640ab320 msgr2=0x7fba640a9b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:02.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.715+0000 7fba696ce700 1 --2- 172.21.15.146:0/4127779287 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba640ab320 0x7fba640a9b70 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fba4c0046d0 tx=0x7fba5c001360 comp rx=0 tx=0).stop 2023-05-24T03:32:02.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.715+0000 7fba696ce700 1 -- 172.21.15.146:0/4127779287 shutdown_connections 2023-05-24T03:32:02.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.715+0000 7fba696ce700 1 --2- 172.21.15.146:0/4127779287 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fba5006ace0 0x7fba5006d190 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:02.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.715+0000 7fba696ce700 1 --2- 172.21.15.146:0/4127779287 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba640ab320 0x7fba640a9b70 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:02.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.715+0000 7fba696ce700 1 --2- 172.21.15.146:0/4127779287 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba640d2760 0x7fba641f6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:02.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.715+0000 7fba696ce700 1 --2- 172.21.15.146:0/4127779287 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba640d2b30 0x7fba640aade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:02.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.715+0000 7fba696ce700 1 -- 172.21.15.146:0/4127779287 >> 172.21.15.146:0/4127779287 conn(0x7fba6406af30 msgr2=0x7fba6415cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:32:02.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.715+0000 7fba696ce700 1 -- 172.21.15.146:0/4127779287 shutdown_connections 2023-05-24T03:32:02.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.715+0000 7fba696ce700 1 -- 172.21.15.146:0/4127779287 wait complete. 2023-05-24T03:32:02.725 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-05-24T03:32:02.732 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":98,"stamp":"2023-05-24T03:32:00.791562+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":264132012,"num_objects":89,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":126,"num_read_kb":114,"num_write":920,"num_write_kb":816086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16301,"ondisk_log_size":16301,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":717680,"kb_used_data":518512,"kb_used_omap":0,"kb_used_meta":199104,"kb_avail":754257040,"statfs":{"total":773094113280,"available":772359208960,"internally_reserved":0,"allocated":530956288,"data_stored":529374792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":203882496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,1,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-162252769,"num_objects":-40,"num_object_clones":0,"num_object_copies":-160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-40,"num_whiteouts":0,"num_read":7,"num_read_kb":11,"num_write":334,"num_write_kb":397645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003136"},"pg_stats":[{"pgid":"4.3f","version":"30'15","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.039569+0000","last_change":"2023-05-24T03:29:44.490120+0000","last_active":"2023-05-24T03:31:55.039569+0000","last_peered":"2023-05-24T03:31:55.039569+0000","last_clean":"2023-05-24T03:31:55.039569+0000","last_became_active":"2023-05-24T03:29:44.489854+0000","last_became_peered":"2023-05-24T03:29:44.489854+0000","last_unstale":"2023-05-24T03:31:55.039569+0000","last_undegraded":"2023-05-24T03:31:55.039569+0000","last_fullsized":"2023-05-24T03:31:55.039569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:27:13.487917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"30'11","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.032618+0000","last_change":"2023-05-24T03:29:44.495973+0000","last_active":"2023-05-24T03:31:55.032618+0000","last_peered":"2023-05-24T03:31:55.032618+0000","last_clean":"2023-05-24T03:31:55.032618+0000","last_became_active":"2023-05-24T03:29:44.495700+0000","last_became_peered":"2023-05-24T03:29:44.495700+0000","last_unstale":"2023-05-24T03:31:55.032618+0000","last_undegraded":"2023-05-24T03:31:55.032618+0000","last_fullsized":"2023-05-24T03:31:55.032618+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:46:55.999454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"30'22","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.047990+0000","last_change":"2023-05-24T03:29:44.499947+0000","last_active":"2023-05-24T03:31:55.047990+0000","last_peered":"2023-05-24T03:31:55.047990+0000","last_clean":"2023-05-24T03:31:55.047990+0000","last_became_active":"2023-05-24T03:29:44.499663+0000","last_became_peered":"2023-05-24T03:29:44.499663+0000","last_unstale":"2023-05-24T03:31:55.047990+0000","last_undegraded":"2023-05-24T03:31:55.047990+0000","last_fullsized":"2023-05-24T03:31:55.047990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:31:12.011318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"30'14","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.035675+0000","last_change":"2023-05-24T03:29:44.498790+0000","last_active":"2023-05-24T03:31:55.035675+0000","last_peered":"2023-05-24T03:31:55.035675+0000","last_clean":"2023-05-24T03:31:55.035675+0000","last_became_active":"2023-05-24T03:29:44.498528+0000","last_became_peered":"2023-05-24T03:29:44.498528+0000","last_unstale":"2023-05-24T03:31:55.035675+0000","last_undegraded":"2023-05-24T03:31:55.035675+0000","last_fullsized":"2023-05-24T03:31:55.035675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:14:55.806370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"30'14","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.049414+0000","last_change":"2023-05-24T03:29:44.504225+0000","last_active":"2023-05-24T03:31:55.049414+0000","last_peered":"2023-05-24T03:31:55.049414+0000","last_clean":"2023-05-24T03:31:55.049414+0000","last_became_active":"2023-05-24T03:29:44.503998+0000","last_became_peered":"2023-05-24T03:29:44.503998+0000","last_unstale":"2023-05-24T03:31:55.049414+0000","last_undegraded":"2023-05-24T03:31:55.049414+0000","last_fullsized":"2023-05-24T03:31:55.049414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:10:14.605046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"30'20","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.049421+0000","last_change":"2023-05-24T03:29:44.500355+0000","last_active":"2023-05-24T03:31:55.049421+0000","last_peered":"2023-05-24T03:31:55.049421+0000","last_clean":"2023-05-24T03:31:55.049421+0000","last_became_active":"2023-05-24T03:29:44.500065+0000","last_became_peered":"2023-05-24T03:29:44.500065+0000","last_unstale":"2023-05-24T03:31:55.049421+0000","last_undegraded":"2023-05-24T03:31:55.049421+0000","last_fullsized":"2023-05-24T03:31:55.049421+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T03:45:21.255320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"30'12","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.033420+0000","last_change":"2023-05-24T03:29:44.499607+0000","last_active":"2023-05-24T03:31:55.033420+0000","last_peered":"2023-05-24T03:31:55.033420+0000","last_clean":"2023-05-24T03:31:55.033420+0000","last_became_active":"2023-05-24T03:29:44.499324+0000","last_became_peered":"2023-05-24T03:29:44.499324+0000","last_unstale":"2023-05-24T03:31:55.033420+0000","last_undegraded":"2023-05-24T03:31:55.033420+0000","last_fullsized":"2023-05-24T03:31:55.033420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:11:59.800632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"30'18","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.036835+0000","last_change":"2023-05-24T03:29:44.500576+0000","last_active":"2023-05-24T03:31:55.036835+0000","last_peered":"2023-05-24T03:31:55.036835+0000","last_clean":"2023-05-24T03:31:55.036835+0000","last_became_active":"2023-05-24T03:29:44.500260+0000","last_became_peered":"2023-05-24T03:29:44.500260+0000","last_unstale":"2023-05-24T03:31:55.036835+0000","last_undegraded":"2023-05-24T03:31:55.036835+0000","last_fullsized":"2023-05-24T03:31:55.036835+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:52:06.913754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"30'25","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.049023+0000","last_change":"2023-05-24T03:29:44.502655+0000","last_active":"2023-05-24T03:31:55.049023+0000","last_peered":"2023-05-24T03:31:55.049023+0000","last_clean":"2023-05-24T03:31:55.049023+0000","last_became_active":"2023-05-24T03:29:44.502341+0000","last_became_peered":"2023-05-24T03:29:44.502341+0000","last_unstale":"2023-05-24T03:31:55.049023+0000","last_undegraded":"2023-05-24T03:31:55.049023+0000","last_fullsized":"2023-05-24T03:31:55.049023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:28:43.398723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"30'23","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.050363+0000","last_change":"2023-05-24T03:29:44.500505+0000","last_active":"2023-05-24T03:31:55.050363+0000","last_peered":"2023-05-24T03:31:55.050363+0000","last_clean":"2023-05-24T03:31:55.050363+0000","last_became_active":"2023-05-24T03:29:44.500156+0000","last_became_peered":"2023-05-24T03:29:44.500156+0000","last_unstale":"2023-05-24T03:31:55.050363+0000","last_undegraded":"2023-05-24T03:31:55.050363+0000","last_fullsized":"2023-05-24T03:31:55.050363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:34:40.725013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"30'13","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.034757+0000","last_change":"2023-05-24T03:29:44.492850+0000","last_active":"2023-05-24T03:31:55.034757+0000","last_peered":"2023-05-24T03:31:55.034757+0000","last_clean":"2023-05-24T03:31:55.034757+0000","last_became_active":"2023-05-24T03:29:44.492573+0000","last_became_peered":"2023-05-24T03:29:44.492573+0000","last_unstale":"2023-05-24T03:31:55.034757+0000","last_undegraded":"2023-05-24T03:31:55.034757+0000","last_fullsized":"2023-05-24T03:31:55.034757+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:25:03.563573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"30'13","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.038097+0000","last_change":"2023-05-24T03:29:44.501565+0000","last_active":"2023-05-24T03:31:55.038097+0000","last_peered":"2023-05-24T03:31:55.038097+0000","last_clean":"2023-05-24T03:31:55.038097+0000","last_became_active":"2023-05-24T03:29:44.501371+0000","last_became_peered":"2023-05-24T03:29:44.501371+0000","last_unstale":"2023-05-24T03:31:55.038097+0000","last_undegraded":"2023-05-24T03:31:55.038097+0000","last_fullsized":"2023-05-24T03:31:55.038097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:31:52.511256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"30'23","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.042174+0000","last_change":"2023-05-24T03:29:44.490972+0000","last_active":"2023-05-24T03:31:55.042174+0000","last_peered":"2023-05-24T03:31:55.042174+0000","last_clean":"2023-05-24T03:31:55.042174+0000","last_became_active":"2023-05-24T03:29:44.490411+0000","last_became_peered":"2023-05-24T03:29:44.490411+0000","last_unstale":"2023-05-24T03:31:55.042174+0000","last_undegraded":"2023-05-24T03:31:55.042174+0000","last_fullsized":"2023-05-24T03:31:55.042174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:20:09.308993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"30'16","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.040913+0000","last_change":"2023-05-24T03:29:44.495213+0000","last_active":"2023-05-24T03:31:55.040913+0000","last_peered":"2023-05-24T03:31:55.040913+0000","last_clean":"2023-05-24T03:31:55.040913+0000","last_became_active":"2023-05-24T03:29:44.494879+0000","last_became_peered":"2023-05-24T03:29:44.494879+0000","last_unstale":"2023-05-24T03:31:55.040913+0000","last_undegraded":"2023-05-24T03:31:55.040913+0000","last_fullsized":"2023-05-24T03:31:55.040913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:21:01.901695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"30'16","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.033525+0000","last_change":"2023-05-24T03:29:44.499673+0000","last_active":"2023-05-24T03:31:55.033525+0000","last_peered":"2023-05-24T03:31:55.033525+0000","last_clean":"2023-05-24T03:31:55.033525+0000","last_became_active":"2023-05-24T03:29:44.499393+0000","last_became_peered":"2023-05-24T03:29:44.499393+0000","last_unstale":"2023-05-24T03:31:55.033525+0000","last_undegraded":"2023-05-24T03:31:55.033525+0000","last_fullsized":"2023-05-24T03:31:55.033525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:36:39.587451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"30'19","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.046546+0000","last_change":"2023-05-24T03:29:44.501101+0000","last_active":"2023-05-24T03:31:55.046546+0000","last_peered":"2023-05-24T03:31:55.046546+0000","last_clean":"2023-05-24T03:31:55.046546+0000","last_became_active":"2023-05-24T03:29:44.500818+0000","last_became_peered":"2023-05-24T03:29:44.500818+0000","last_unstale":"2023-05-24T03:31:55.046546+0000","last_undegraded":"2023-05-24T03:31:55.046546+0000","last_fullsized":"2023-05-24T03:31:55.046546+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:13:18.627969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"30'18","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.049373+0000","last_change":"2023-05-24T03:29:44.500209+0000","last_active":"2023-05-24T03:31:55.049373+0000","last_peered":"2023-05-24T03:31:55.049373+0000","last_clean":"2023-05-24T03:31:55.049373+0000","last_became_active":"2023-05-24T03:29:44.499543+0000","last_became_peered":"2023-05-24T03:29:44.499543+0000","last_unstale":"2023-05-24T03:31:55.049373+0000","last_undegraded":"2023-05-24T03:31:55.049373+0000","last_fullsized":"2023-05-24T03:31:55.049373+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:29:00.326985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"30'17","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.038410+0000","last_change":"2023-05-24T03:29:44.492545+0000","last_active":"2023-05-24T03:31:55.038410+0000","last_peered":"2023-05-24T03:31:55.038410+0000","last_clean":"2023-05-24T03:31:55.038410+0000","last_became_active":"2023-05-24T03:29:44.492109+0000","last_became_peered":"2023-05-24T03:29:44.492109+0000","last_unstale":"2023-05-24T03:31:55.038410+0000","last_undegraded":"2023-05-24T03:31:55.038410+0000","last_fullsized":"2023-05-24T03:31:55.038410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:22:07.073049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"30'16","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.037665+0000","last_change":"2023-05-24T03:29:44.480834+0000","last_active":"2023-05-24T03:31:55.037665+0000","last_peered":"2023-05-24T03:31:55.037665+0000","last_clean":"2023-05-24T03:31:55.037665+0000","last_became_active":"2023-05-24T03:29:44.480597+0000","last_became_peered":"2023-05-24T03:29:44.480597+0000","last_unstale":"2023-05-24T03:31:55.037665+0000","last_undegraded":"2023-05-24T03:31:55.037665+0000","last_fullsized":"2023-05-24T03:31:55.037665+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:44:17.635928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"30'17","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.035390+0000","last_change":"2023-05-24T03:29:44.501003+0000","last_active":"2023-05-24T03:31:55.035390+0000","last_peered":"2023-05-24T03:31:55.035390+0000","last_clean":"2023-05-24T03:31:55.035390+0000","last_became_active":"2023-05-24T03:29:44.499405+0000","last_became_peered":"2023-05-24T03:29:44.499405+0000","last_unstale":"2023-05-24T03:31:55.035390+0000","last_undegraded":"2023-05-24T03:31:55.035390+0000","last_fullsized":"2023-05-24T03:31:55.035390+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:32:47.250786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"30'25","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.039028+0000","last_change":"2023-05-24T03:30:26.106086+0000","last_active":"2023-05-24T03:31:55.039028+0000","last_peered":"2023-05-24T03:31:55.039028+0000","last_clean":"2023-05-24T03:31:55.039028+0000","last_became_active":"2023-05-24T03:30:26.105858+0000","last_became_peered":"2023-05-24T03:30:26.105858+0000","last_unstale":"2023-05-24T03:31:55.039028+0000","last_undegraded":"2023-05-24T03:31:55.039028+0000","last_fullsized":"2023-05-24T03:31:55.039028+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:03:29.813763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"30'16","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.047093+0000","last_change":"2023-05-24T03:29:44.498675+0000","last_active":"2023-05-24T03:31:55.047093+0000","last_peered":"2023-05-24T03:31:55.047093+0000","last_clean":"2023-05-24T03:31:55.047093+0000","last_became_active":"2023-05-24T03:29:44.498463+0000","last_became_peered":"2023-05-24T03:29:44.498463+0000","last_unstale":"2023-05-24T03:31:55.047093+0000","last_undegraded":"2023-05-24T03:31:55.047093+0000","last_fullsized":"2023-05-24T03:31:55.047093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:36:39.587451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"30'21","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.049431+0000","last_change":"2023-05-24T03:29:44.500169+0000","last_active":"2023-05-24T03:31:55.049431+0000","last_peered":"2023-05-24T03:31:55.049431+0000","last_clean":"2023-05-24T03:31:55.049431+0000","last_became_active":"2023-05-24T03:29:44.499960+0000","last_became_peered":"2023-05-24T03:29:44.499960+0000","last_unstale":"2023-05-24T03:31:55.049431+0000","last_undegraded":"2023-05-24T03:31:55.049431+0000","last_fullsized":"2023-05-24T03:31:55.049431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:06:19.223766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"30'12","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.038999+0000","last_change":"2023-05-24T03:29:44.499015+0000","last_active":"2023-05-24T03:31:55.038999+0000","last_peered":"2023-05-24T03:31:55.038999+0000","last_clean":"2023-05-24T03:31:55.038999+0000","last_became_active":"2023-05-24T03:29:44.498437+0000","last_became_peered":"2023-05-24T03:29:44.498437+0000","last_unstale":"2023-05-24T03:31:55.038999+0000","last_undegraded":"2023-05-24T03:31:55.038999+0000","last_fullsized":"2023-05-24T03:31:55.038999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:00:20.978451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"30'8","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.031323+0000","last_change":"2023-05-24T03:29:44.481162+0000","last_active":"2023-05-24T03:31:55.031323+0000","last_peered":"2023-05-24T03:31:55.031323+0000","last_clean":"2023-05-24T03:31:55.031323+0000","last_became_active":"2023-05-24T03:29:44.481004+0000","last_became_peered":"2023-05-24T03:29:44.481004+0000","last_unstale":"2023-05-24T03:31:55.031323+0000","last_undegraded":"2023-05-24T03:31:55.031323+0000","last_fullsized":"2023-05-24T03:31:55.031323+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:36:39.587451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"30'26","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.038979+0000","last_change":"2023-05-24T03:29:44.481942+0000","last_active":"2023-05-24T03:31:55.038979+0000","last_peered":"2023-05-24T03:31:55.038979+0000","last_clean":"2023-05-24T03:31:55.038979+0000","last_became_active":"2023-05-24T03:29:44.481686+0000","last_became_peered":"2023-05-24T03:29:44.481686+0000","last_unstale":"2023-05-24T03:31:55.038979+0000","last_undegraded":"2023-05-24T03:31:55.038979+0000","last_fullsized":"2023-05-24T03:31:55.038979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:24:47.939385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"30'9","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.032829+0000","last_change":"2023-05-24T03:29:44.502948+0000","last_active":"2023-05-24T03:31:55.032829+0000","last_peered":"2023-05-24T03:31:55.032829+0000","last_clean":"2023-05-24T03:31:55.032829+0000","last_became_active":"2023-05-24T03:29:44.502669+0000","last_became_peered":"2023-05-24T03:29:44.502669+0000","last_unstale":"2023-05-24T03:31:55.032829+0000","last_undegraded":"2023-05-24T03:31:55.032829+0000","last_fullsized":"2023-05-24T03:31:55.032829+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:03:29.813763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"30'471","reported_seq":488,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.910749+0000","last_change":"2023-05-24T03:29:48.523138+0000","last_active":"2023-05-24T03:31:54.910749+0000","last_peered":"2023-05-24T03:31:54.910749+0000","last_clean":"2023-05-24T03:31:54.910749+0000","last_became_active":"2023-05-24T03:29:48.522749+0000","last_became_peered":"2023-05-24T03:29:48.522749+0000","last_unstale":"2023-05-24T03:31:54.910749+0000","last_undegraded":"2023-05-24T03:31:54.910749+0000","last_fullsized":"2023-05-24T03:31:54.910749+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:02:45.564369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.945993+0000","last_change":"2023-05-24T03:29:44.086543+0000","last_active":"2023-05-24T03:30:25.945993+0000","last_peered":"2023-05-24T03:30:25.945993+0000","last_clean":"2023-05-24T03:30:25.945993+0000","last_became_active":"2023-05-24T03:29:44.086143+0000","last_became_peered":"2023-05-24T03:29:44.086143+0000","last_unstale":"2023-05-24T03:30:25.945993+0000","last_undegraded":"2023-05-24T03:30:25.945993+0000","last_fullsized":"2023-05-24T03:30:25.945993+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:45:41.681638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'25","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.039276+0000","last_change":"2023-05-24T03:29:44.491005+0000","last_active":"2023-05-24T03:31:55.039276+0000","last_peered":"2023-05-24T03:31:55.039276+0000","last_clean":"2023-05-24T03:31:55.039276+0000","last_became_active":"2023-05-24T03:29:44.490772+0000","last_became_peered":"2023-05-24T03:29:44.490772+0000","last_unstale":"2023-05-24T03:31:55.039276+0000","last_undegraded":"2023-05-24T03:31:55.039276+0000","last_fullsized":"2023-05-24T03:31:55.039276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:52:06.913754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"30'438","reported_seq":456,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.899992+0000","last_change":"2023-05-24T03:29:48.523521+0000","last_active":"2023-05-24T03:31:54.899992+0000","last_peered":"2023-05-24T03:31:54.899992+0000","last_clean":"2023-05-24T03:31:54.899992+0000","last_became_active":"2023-05-24T03:29:48.523125+0000","last_became_peered":"2023-05-24T03:29:48.523125+0000","last_unstale":"2023-05-24T03:31:54.899992+0000","last_undegraded":"2023-05-24T03:31:54.899992+0000","last_fullsized":"2023-05-24T03:31:54.899992+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:55:49.240935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":21504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.945583+0000","last_change":"2023-05-24T03:29:44.084408+0000","last_active":"2023-05-24T03:30:25.945583+0000","last_peered":"2023-05-24T03:30:25.945583+0000","last_clean":"2023-05-24T03:30:25.945583+0000","last_became_active":"2023-05-24T03:29:44.084099+0000","last_became_peered":"2023-05-24T03:29:44.084099+0000","last_unstale":"2023-05-24T03:30:25.945583+0000","last_undegraded":"2023-05-24T03:30:25.945583+0000","last_fullsized":"2023-05-24T03:30:25.945583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:55:17.269834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"30'10","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.049187+0000","last_change":"2023-05-24T03:29:44.503346+0000","last_active":"2023-05-24T03:31:55.049187+0000","last_peered":"2023-05-24T03:31:55.049187+0000","last_clean":"2023-05-24T03:31:55.049187+0000","last_became_active":"2023-05-24T03:29:44.503039+0000","last_became_peered":"2023-05-24T03:29:44.503039+0000","last_unstale":"2023-05-24T03:31:55.049187+0000","last_undegraded":"2023-05-24T03:31:55.049187+0000","last_fullsized":"2023-05-24T03:31:55.049187+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:06:19.223766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"30'450","reported_seq":468,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.631735+0000","last_change":"2023-05-24T03:29:48.529615+0000","last_active":"2023-05-24T03:31:55.631735+0000","last_peered":"2023-05-24T03:31:55.631735+0000","last_clean":"2023-05-24T03:31:55.631735+0000","last_became_active":"2023-05-24T03:29:48.529142+0000","last_became_peered":"2023-05-24T03:29:48.529142+0000","last_unstale":"2023-05-24T03:31:55.631735+0000","last_undegraded":"2023-05-24T03:31:55.631735+0000","last_fullsized":"2023-05-24T03:31:55.631735+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:09:06.504119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"30'1","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:26.804992+0000","last_change":"2023-05-24T03:29:44.085410+0000","last_active":"2023-05-24T03:30:26.804992+0000","last_peered":"2023-05-24T03:30:26.804992+0000","last_clean":"2023-05-24T03:30:26.804992+0000","last_became_active":"2023-05-24T03:29:44.084907+0000","last_became_peered":"2023-05-24T03:29:44.084907+0000","last_unstale":"2023-05-24T03:30:26.804992+0000","last_undegraded":"2023-05-24T03:30:26.804992+0000","last_fullsized":"2023-05-24T03:30:26.804992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:46:54.993008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"30'14","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.030034+0000","last_change":"2023-05-24T03:29:44.497128+0000","last_active":"2023-05-24T03:31:55.030034+0000","last_peered":"2023-05-24T03:31:55.030034+0000","last_clean":"2023-05-24T03:31:55.030034+0000","last_became_active":"2023-05-24T03:29:44.496746+0000","last_became_peered":"2023-05-24T03:29:44.496746+0000","last_unstale":"2023-05-24T03:31:55.030034+0000","last_undegraded":"2023-05-24T03:31:55.030034+0000","last_fullsized":"2023-05-24T03:31:55.030034+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:27:24.810532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"30'463","reported_seq":480,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.867946+0000","last_change":"2023-05-24T03:29:48.520693+0000","last_active":"2023-05-24T03:31:54.867946+0000","last_peered":"2023-05-24T03:31:54.867946+0000","last_clean":"2023-05-24T03:31:54.867946+0000","last_became_active":"2023-05-24T03:29:48.520319+0000","last_became_peered":"2023-05-24T03:29:48.520319+0000","last_unstale":"2023-05-24T03:31:54.867946+0000","last_undegraded":"2023-05-24T03:31:54.867946+0000","last_fullsized":"2023-05-24T03:31:54.867946+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:32:35.981956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"30'1","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:26.131959+0000","last_change":"2023-05-24T03:29:44.088769+0000","last_active":"2023-05-24T03:30:26.131959+0000","last_peered":"2023-05-24T03:30:26.131959+0000","last_clean":"2023-05-24T03:30:26.131959+0000","last_became_active":"2023-05-24T03:29:44.088267+0000","last_became_peered":"2023-05-24T03:29:44.088267+0000","last_unstale":"2023-05-24T03:30:26.131959+0000","last_undegraded":"2023-05-24T03:30:26.131959+0000","last_fullsized":"2023-05-24T03:30:26.131959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:46:54.993008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"30'15","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.040917+0000","last_change":"2023-05-24T03:29:44.489309+0000","last_active":"2023-05-24T03:31:55.040917+0000","last_peered":"2023-05-24T03:31:55.040917+0000","last_clean":"2023-05-24T03:31:55.040917+0000","last_became_active":"2023-05-24T03:29:44.488666+0000","last_became_peered":"2023-05-24T03:29:44.488666+0000","last_unstale":"2023-05-24T03:31:55.040917+0000","last_undegraded":"2023-05-24T03:31:55.040917+0000","last_fullsized":"2023-05-24T03:31:55.040917+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:29:00.326985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"30'437","reported_seq":454,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.635512+0000","last_change":"2023-05-24T03:29:48.518108+0000","last_active":"2023-05-24T03:31:55.635512+0000","last_peered":"2023-05-24T03:31:55.635512+0000","last_clean":"2023-05-24T03:31:55.635512+0000","last_became_active":"2023-05-24T03:29:48.517771+0000","last_became_peered":"2023-05-24T03:29:48.517771+0000","last_unstale":"2023-05-24T03:31:55.635512+0000","last_undegraded":"2023-05-24T03:31:55.635512+0000","last_fullsized":"2023-05-24T03:31:55.635512+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:53:39.929296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.948014+0000","last_change":"2023-05-24T03:29:44.087910+0000","last_active":"2023-05-24T03:30:25.948014+0000","last_peered":"2023-05-24T03:30:25.948014+0000","last_clean":"2023-05-24T03:30:25.948014+0000","last_became_active":"2023-05-24T03:29:44.087601+0000","last_became_peered":"2023-05-24T03:29:44.087601+0000","last_unstale":"2023-05-24T03:30:25.948014+0000","last_undegraded":"2023-05-24T03:30:25.948014+0000","last_fullsized":"2023-05-24T03:30:25.948014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:47:02.508699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"30'16","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.042465+0000","last_change":"2023-05-24T03:29:44.496020+0000","last_active":"2023-05-24T03:31:55.042465+0000","last_peered":"2023-05-24T03:31:55.042465+0000","last_clean":"2023-05-24T03:31:55.042465+0000","last_became_active":"2023-05-24T03:29:44.495752+0000","last_became_peered":"2023-05-24T03:29:44.495752+0000","last_unstale":"2023-05-24T03:31:55.042465+0000","last_undegraded":"2023-05-24T03:31:55.042465+0000","last_fullsized":"2023-05-24T03:31:55.042465+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:28:24.448757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"30'477","reported_seq":494,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.996996+0000","last_change":"2023-05-24T03:29:48.529893+0000","last_active":"2023-05-24T03:31:54.996996+0000","last_peered":"2023-05-24T03:31:54.996996+0000","last_clean":"2023-05-24T03:31:54.996996+0000","last_became_active":"2023-05-24T03:29:48.529514+0000","last_became_peered":"2023-05-24T03:29:48.529514+0000","last_unstale":"2023-05-24T03:31:54.996996+0000","last_undegraded":"2023-05-24T03:31:54.996996+0000","last_fullsized":"2023-05-24T03:31:54.996996+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:17:12.538446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"30'9","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.919514+0000","last_change":"2023-05-24T03:29:44.091648+0000","last_active":"2023-05-24T03:31:54.919514+0000","last_peered":"2023-05-24T03:31:54.919514+0000","last_clean":"2023-05-24T03:31:54.919514+0000","last_became_active":"2023-05-24T03:29:44.091390+0000","last_became_peered":"2023-05-24T03:29:44.091390+0000","last_unstale":"2023-05-24T03:31:54.919514+0000","last_undegraded":"2023-05-24T03:31:54.919514+0000","last_fullsized":"2023-05-24T03:31:54.919514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:28:23.442311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"30'19","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.038705+0000","last_change":"2023-05-24T03:29:44.481629+0000","last_active":"2023-05-24T03:31:55.038705+0000","last_peered":"2023-05-24T03:31:55.038705+0000","last_clean":"2023-05-24T03:31:55.038705+0000","last_became_active":"2023-05-24T03:29:44.481385+0000","last_became_peered":"2023-05-24T03:29:44.481385+0000","last_unstale":"2023-05-24T03:31:55.038705+0000","last_undegraded":"2023-05-24T03:31:55.038705+0000","last_fullsized":"2023-05-24T03:31:55.038705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:15:01.553262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"30'463","reported_seq":480,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.862948+0000","last_change":"2023-05-24T03:29:48.524712+0000","last_active":"2023-05-24T03:31:54.862948+0000","last_peered":"2023-05-24T03:31:54.862948+0000","last_clean":"2023-05-24T03:31:54.862948+0000","last_became_active":"2023-05-24T03:29:48.524312+0000","last_became_peered":"2023-05-24T03:29:48.524312+0000","last_unstale":"2023-05-24T03:31:54.862948+0000","last_undegraded":"2023-05-24T03:31:54.862948+0000","last_fullsized":"2023-05-24T03:31:54.862948+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:09:53.803718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"30'350","reported_seq":375,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.007236+0000","last_change":"2023-05-24T03:29:44.079067+0000","last_active":"2023-05-24T03:31:55.007236+0000","last_peered":"2023-05-24T03:31:55.007236+0000","last_clean":"2023-05-24T03:31:55.007236+0000","last_became_active":"2023-05-24T03:29:44.078785+0000","last_became_peered":"2023-05-24T03:29:44.078785+0000","last_unstale":"2023-05-24T03:31:55.007236+0000","last_undegraded":"2023-05-24T03:31:55.007236+0000","last_fullsized":"2023-05-24T03:31:55.007236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:07:01.888999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1390402,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":349,"num_write_kb":1595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"30'24","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.035065+0000","last_change":"2023-05-24T03:29:44.497603+0000","last_active":"2023-05-24T03:31:55.035065+0000","last_peered":"2023-05-24T03:31:55.035065+0000","last_clean":"2023-05-24T03:31:55.035065+0000","last_became_active":"2023-05-24T03:29:44.497120+0000","last_became_peered":"2023-05-24T03:29:44.497120+0000","last_unstale":"2023-05-24T03:31:55.035065+0000","last_undegraded":"2023-05-24T03:31:55.035065+0000","last_fullsized":"2023-05-24T03:31:55.035065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:29:14.482310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"30'435","reported_seq":452,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.998980+0000","last_change":"2023-05-24T03:29:48.531846+0000","last_active":"2023-05-24T03:31:54.998980+0000","last_peered":"2023-05-24T03:31:54.998980+0000","last_clean":"2023-05-24T03:31:54.998980+0000","last_became_active":"2023-05-24T03:29:48.531538+0000","last_became_peered":"2023-05-24T03:29:48.531538+0000","last_unstale":"2023-05-24T03:31:54.998980+0000","last_undegraded":"2023-05-24T03:31:54.998980+0000","last_fullsized":"2023-05-24T03:31:54.998980+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:26:45.584372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"30'3","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.949502+0000","last_change":"2023-05-24T03:29:44.087315+0000","last_active":"2023-05-24T03:30:25.949502+0000","last_peered":"2023-05-24T03:30:25.949502+0000","last_clean":"2023-05-24T03:30:25.949502+0000","last_became_active":"2023-05-24T03:29:44.086997+0000","last_became_peered":"2023-05-24T03:29:44.086997+0000","last_unstale":"2023-05-24T03:30:25.949502+0000","last_undegraded":"2023-05-24T03:30:25.949502+0000","last_fullsized":"2023-05-24T03:30:25.949502+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:28:59.320540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"30'17","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.041562+0000","last_change":"2023-05-24T03:29:44.487497+0000","last_active":"2023-05-24T03:31:55.041562+0000","last_peered":"2023-05-24T03:31:55.041562+0000","last_clean":"2023-05-24T03:31:55.041562+0000","last_became_active":"2023-05-24T03:29:44.487257+0000","last_became_peered":"2023-05-24T03:29:44.487257+0000","last_unstale":"2023-05-24T03:31:55.041562+0000","last_undegraded":"2023-05-24T03:31:55.041562+0000","last_fullsized":"2023-05-24T03:31:55.041562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:34:40.725013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"30'462","reported_seq":479,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.836747+0000","last_change":"2023-05-24T03:29:48.526115+0000","last_active":"2023-05-24T03:31:54.836747+0000","last_peered":"2023-05-24T03:31:54.836747+0000","last_clean":"2023-05-24T03:31:54.836747+0000","last_became_active":"2023-05-24T03:29:48.525726+0000","last_became_peered":"2023-05-24T03:29:48.525726+0000","last_unstale":"2023-05-24T03:31:54.836747+0000","last_undegraded":"2023-05-24T03:31:54.836747+0000","last_fullsized":"2023-05-24T03:31:54.836747+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:15:16.805837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:26.131470+0000","last_change":"2023-05-24T03:29:44.084599+0000","last_active":"2023-05-24T03:30:26.131470+0000","last_peered":"2023-05-24T03:30:26.131470+0000","last_clean":"2023-05-24T03:30:26.131470+0000","last_became_active":"2023-05-24T03:29:44.084278+0000","last_became_peered":"2023-05-24T03:29:44.084278+0000","last_unstale":"2023-05-24T03:30:26.131470+0000","last_undegraded":"2023-05-24T03:30:26.131470+0000","last_fullsized":"2023-05-24T03:30:26.131470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:00:19.972006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"30'15","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.032638+0000","last_change":"2023-05-24T03:29:44.498378+0000","last_active":"2023-05-24T03:31:55.032638+0000","last_peered":"2023-05-24T03:31:55.032638+0000","last_clean":"2023-05-24T03:31:55.032638+0000","last_became_active":"2023-05-24T03:29:44.498097+0000","last_became_peered":"2023-05-24T03:29:44.498097+0000","last_unstale":"2023-05-24T03:31:55.032638+0000","last_undegraded":"2023-05-24T03:31:55.032638+0000","last_fullsized":"2023-05-24T03:31:55.032638+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:28:43.398723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"30'445","reported_seq":462,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.859517+0000","last_change":"2023-05-24T03:29:48.525018+0000","last_active":"2023-05-24T03:31:54.859517+0000","last_peered":"2023-05-24T03:31:54.859517+0000","last_clean":"2023-05-24T03:31:54.859517+0000","last_became_active":"2023-05-24T03:29:48.524602+0000","last_became_peered":"2023-05-24T03:29:48.524602+0000","last_unstale":"2023-05-24T03:31:54.859517+0000","last_undegraded":"2023-05-24T03:31:54.859517+0000","last_fullsized":"2023-05-24T03:31:54.859517+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:32:16.657149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"30'1","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.948925+0000","last_change":"2023-05-24T03:29:44.085212+0000","last_active":"2023-05-24T03:30:25.948925+0000","last_peered":"2023-05-24T03:30:25.948925+0000","last_clean":"2023-05-24T03:30:25.948925+0000","last_became_active":"2023-05-24T03:29:44.085001+0000","last_became_peered":"2023-05-24T03:29:44.085001+0000","last_unstale":"2023-05-24T03:30:25.948925+0000","last_undegraded":"2023-05-24T03:30:25.948925+0000","last_fullsized":"2023-05-24T03:30:25.948925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:57:48.715216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"30'22","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.050448+0000","last_change":"2023-05-24T03:29:44.500883+0000","last_active":"2023-05-24T03:31:55.050448+0000","last_peered":"2023-05-24T03:31:55.050448+0000","last_clean":"2023-05-24T03:31:55.050448+0000","last_became_active":"2023-05-24T03:29:44.500631+0000","last_became_peered":"2023-05-24T03:29:44.500631+0000","last_unstale":"2023-05-24T03:31:55.050448+0000","last_undegraded":"2023-05-24T03:31:55.050448+0000","last_fullsized":"2023-05-24T03:31:55.050448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:03:29.813763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"30'480","reported_seq":497,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.914788+0000","last_change":"2023-05-24T03:29:48.523523+0000","last_active":"2023-05-24T03:31:54.914788+0000","last_peered":"2023-05-24T03:31:54.914788+0000","last_clean":"2023-05-24T03:31:54.914788+0000","last_became_active":"2023-05-24T03:29:48.523138+0000","last_became_peered":"2023-05-24T03:29:48.523138+0000","last_unstale":"2023-05-24T03:31:54.914788+0000","last_undegraded":"2023-05-24T03:31:54.914788+0000","last_fullsized":"2023-05-24T03:31:54.914788+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:06:22.646046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:26.804069+0000","last_change":"2023-05-24T03:29:44.085229+0000","last_active":"2023-05-24T03:30:26.804069+0000","last_peered":"2023-05-24T03:30:26.804069+0000","last_clean":"2023-05-24T03:30:26.804069+0000","last_became_active":"2023-05-24T03:29:44.084914+0000","last_became_peered":"2023-05-24T03:29:44.084914+0000","last_unstale":"2023-05-24T03:30:26.804069+0000","last_undegraded":"2023-05-24T03:30:26.804069+0000","last_fullsized":"2023-05-24T03:30:26.804069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:26:25.494471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"30'19","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.037939+0000","last_change":"2023-05-24T03:29:44.496038+0000","last_active":"2023-05-24T03:31:55.037939+0000","last_peered":"2023-05-24T03:31:55.037939+0000","last_clean":"2023-05-24T03:31:55.037939+0000","last_became_active":"2023-05-24T03:29:44.495795+0000","last_became_peered":"2023-05-24T03:29:44.495795+0000","last_unstale":"2023-05-24T03:31:55.037939+0000","last_undegraded":"2023-05-24T03:31:55.037939+0000","last_fullsized":"2023-05-24T03:31:55.037939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:01:21.417593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"30'434","reported_seq":451,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.848942+0000","last_change":"2023-05-24T03:29:48.518930+0000","last_active":"2023-05-24T03:31:54.848942+0000","last_peered":"2023-05-24T03:31:54.848942+0000","last_clean":"2023-05-24T03:31:54.848942+0000","last_became_active":"2023-05-24T03:29:48.518531+0000","last_became_peered":"2023-05-24T03:29:48.518531+0000","last_unstale":"2023-05-24T03:31:54.848942+0000","last_undegraded":"2023-05-24T03:31:54.848942+0000","last_fullsized":"2023-05-24T03:31:54.848942+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:37:48.684803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.949768+0000","last_change":"2023-05-24T03:29:44.089650+0000","last_active":"2023-05-24T03:30:25.949768+0000","last_peered":"2023-05-24T03:30:25.949768+0000","last_clean":"2023-05-24T03:30:25.949768+0000","last_became_active":"2023-05-24T03:29:44.089340+0000","last_became_peered":"2023-05-24T03:29:44.089340+0000","last_unstale":"2023-05-24T03:30:25.949768+0000","last_undegraded":"2023-05-24T03:30:25.949768+0000","last_fullsized":"2023-05-24T03:30:25.949768+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:46:54.993008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"30'14","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.032179+0000","last_change":"2023-05-24T03:29:44.498089+0000","last_active":"2023-05-24T03:31:55.032179+0000","last_peered":"2023-05-24T03:31:55.032179+0000","last_clean":"2023-05-24T03:31:55.032179+0000","last_became_active":"2023-05-24T03:29:44.497795+0000","last_became_peered":"2023-05-24T03:29:44.497795+0000","last_unstale":"2023-05-24T03:31:55.032179+0000","last_undegraded":"2023-05-24T03:31:55.032179+0000","last_fullsized":"2023-05-24T03:31:55.032179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:11:59.800632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"30'409","reported_seq":426,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.996067+0000","last_change":"2023-05-24T03:29:48.521349+0000","last_active":"2023-05-24T03:31:54.996067+0000","last_peered":"2023-05-24T03:31:54.996067+0000","last_clean":"2023-05-24T03:31:54.996067+0000","last_became_active":"2023-05-24T03:29:48.520899+0000","last_became_peered":"2023-05-24T03:29:48.520899+0000","last_unstale":"2023-05-24T03:31:54.996067+0000","last_undegraded":"2023-05-24T03:31:54.996067+0000","last_fullsized":"2023-05-24T03:31:54.996067+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:59:08.584090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.949203+0000","last_change":"2023-05-24T03:29:44.086355+0000","last_active":"2023-05-24T03:30:25.949203+0000","last_peered":"2023-05-24T03:30:25.949203+0000","last_clean":"2023-05-24T03:30:25.949203+0000","last_became_active":"2023-05-24T03:29:44.086054+0000","last_became_peered":"2023-05-24T03:29:44.086054+0000","last_unstale":"2023-05-24T03:30:25.949203+0000","last_undegraded":"2023-05-24T03:30:25.949203+0000","last_fullsized":"2023-05-24T03:30:25.949203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:56:15.394098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"30'10","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.036553+0000","last_change":"2023-05-24T03:30:25.949869+0000","last_active":"2023-05-24T03:31:55.036553+0000","last_peered":"2023-05-24T03:31:55.036553+0000","last_clean":"2023-05-24T03:31:55.036553+0000","last_became_active":"2023-05-24T03:30:25.949461+0000","last_became_peered":"2023-05-24T03:30:25.949461+0000","last_unstale":"2023-05-24T03:31:55.036553+0000","last_undegraded":"2023-05-24T03:31:55.036553+0000","last_fullsized":"2023-05-24T03:31:55.036553+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:59:01.497346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"30'452","reported_seq":469,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.995617+0000","last_change":"2023-05-24T03:29:48.522128+0000","last_active":"2023-05-24T03:31:54.995617+0000","last_peered":"2023-05-24T03:31:54.995617+0000","last_clean":"2023-05-24T03:31:54.995617+0000","last_became_active":"2023-05-24T03:29:48.521729+0000","last_became_peered":"2023-05-24T03:29:48.521729+0000","last_unstale":"2023-05-24T03:31:54.995617+0000","last_undegraded":"2023-05-24T03:31:54.995617+0000","last_fullsized":"2023-05-24T03:31:54.995617+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:43:08.142518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.949540+0000","last_change":"2023-05-24T03:29:44.088761+0000","last_active":"2023-05-24T03:30:25.949540+0000","last_peered":"2023-05-24T03:30:25.949540+0000","last_clean":"2023-05-24T03:30:25.949540+0000","last_became_active":"2023-05-24T03:29:44.088459+0000","last_became_peered":"2023-05-24T03:29:44.088459+0000","last_unstale":"2023-05-24T03:30:25.949540+0000","last_undegraded":"2023-05-24T03:30:25.949540+0000","last_fullsized":"2023-05-24T03:30:25.949540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:28:42.392277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"30'9","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.032605+0000","last_change":"2023-05-24T03:29:44.490252+0000","last_active":"2023-05-24T03:31:55.032605+0000","last_peered":"2023-05-24T03:31:55.032605+0000","last_clean":"2023-05-24T03:31:55.032605+0000","last_became_active":"2023-05-24T03:29:44.489975+0000","last_became_peered":"2023-05-24T03:29:44.489975+0000","last_unstale":"2023-05-24T03:31:55.032605+0000","last_undegraded":"2023-05-24T03:31:55.032605+0000","last_fullsized":"2023-05-24T03:31:55.032605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:27:13.487917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"30'477","reported_seq":494,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.850746+0000","last_change":"2023-05-24T03:29:48.523911+0000","last_active":"2023-05-24T03:31:54.850746+0000","last_peered":"2023-05-24T03:31:54.850746+0000","last_clean":"2023-05-24T03:31:54.850746+0000","last_became_active":"2023-05-24T03:29:48.523545+0000","last_became_peered":"2023-05-24T03:29:48.523545+0000","last_unstale":"2023-05-24T03:31:54.850746+0000","last_undegraded":"2023-05-24T03:31:54.850746+0000","last_fullsized":"2023-05-24T03:31:54.850746+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:10:18.150623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"30'1","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.947808+0000","last_change":"2023-05-24T03:29:44.091185+0000","last_active":"2023-05-24T03:30:25.947808+0000","last_peered":"2023-05-24T03:30:25.947808+0000","last_clean":"2023-05-24T03:30:25.947808+0000","last_became_active":"2023-05-24T03:29:44.090887+0000","last_became_peered":"2023-05-24T03:29:44.090887+0000","last_unstale":"2023-05-24T03:30:25.947808+0000","last_undegraded":"2023-05-24T03:30:25.947808+0000","last_fullsized":"2023-05-24T03:30:25.947808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:28:59.320540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"30'14","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.049637+0000","last_change":"2023-05-24T03:29:44.502570+0000","last_active":"2023-05-24T03:31:55.049637+0000","last_peered":"2023-05-24T03:31:55.049637+0000","last_clean":"2023-05-24T03:31:55.049637+0000","last_became_active":"2023-05-24T03:29:44.502286+0000","last_became_peered":"2023-05-24T03:29:44.502286+0000","last_unstale":"2023-05-24T03:31:55.049637+0000","last_undegraded":"2023-05-24T03:31:55.049637+0000","last_fullsized":"2023-05-24T03:31:55.049637+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:56:16.400543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"30'459","reported_seq":476,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.905929+0000","last_change":"2023-05-24T03:29:48.521750+0000","last_active":"2023-05-24T03:31:54.905929+0000","last_peered":"2023-05-24T03:31:54.905929+0000","last_clean":"2023-05-24T03:31:54.905929+0000","last_became_active":"2023-05-24T03:29:48.520960+0000","last_became_peered":"2023-05-24T03:29:48.520960+0000","last_unstale":"2023-05-24T03:31:54.905929+0000","last_undegraded":"2023-05-24T03:31:54.905929+0000","last_fullsized":"2023-05-24T03:31:54.905929+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:18:50.657657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"30'4","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:43.731151+0000","last_change":"2023-05-24T03:29:44.088157+0000","last_active":"2023-05-24T03:31:43.731151+0000","last_peered":"2023-05-24T03:31:43.731151+0000","last_clean":"2023-05-24T03:31:43.731151+0000","last_became_active":"2023-05-24T03:29:44.087869+0000","last_became_peered":"2023-05-24T03:29:44.087869+0000","last_unstale":"2023-05-24T03:31:43.731151+0000","last_undegraded":"2023-05-24T03:31:43.731151+0000","last_fullsized":"2023-05-24T03:31:43.731151+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:30:53.298174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"30'11","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.043058+0000","last_change":"2023-05-24T03:29:44.501176+0000","last_active":"2023-05-24T03:31:55.043058+0000","last_peered":"2023-05-24T03:31:55.043058+0000","last_clean":"2023-05-24T03:31:55.043058+0000","last_became_active":"2023-05-24T03:29:44.499700+0000","last_became_peered":"2023-05-24T03:29:44.499700+0000","last_unstale":"2023-05-24T03:31:55.043058+0000","last_undegraded":"2023-05-24T03:31:55.043058+0000","last_fullsized":"2023-05-24T03:31:55.043058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:08:22.507011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"30'447","reported_seq":464,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.855461+0000","last_change":"2023-05-24T03:29:48.522778+0000","last_active":"2023-05-24T03:31:54.855461+0000","last_peered":"2023-05-24T03:31:54.855461+0000","last_clean":"2023-05-24T03:31:54.855461+0000","last_became_active":"2023-05-24T03:29:48.522104+0000","last_became_peered":"2023-05-24T03:29:48.522104+0000","last_unstale":"2023-05-24T03:31:54.855461+0000","last_undegraded":"2023-05-24T03:31:54.855461+0000","last_fullsized":"2023-05-24T03:31:54.855461+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:25:58.928535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"30'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:52.027142+0000","last_change":"2023-05-24T03:29:44.085211+0000","last_active":"2023-05-24T03:31:52.027142+0000","last_peered":"2023-05-24T03:31:52.027142+0000","last_clean":"2023-05-24T03:31:52.027142+0000","last_became_active":"2023-05-24T03:29:44.084894+0000","last_became_peered":"2023-05-24T03:29:44.084894+0000","last_unstale":"2023-05-24T03:31:52.027142+0000","last_undegraded":"2023-05-24T03:31:52.027142+0000","last_fullsized":"2023-05-24T03:31:52.027142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T03:40:04.765492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"30'15","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.042450+0000","last_change":"2023-05-24T03:29:44.492807+0000","last_active":"2023-05-24T03:31:55.042450+0000","last_peered":"2023-05-24T03:31:55.042450+0000","last_clean":"2023-05-24T03:31:55.042450+0000","last_became_active":"2023-05-24T03:29:44.492462+0000","last_became_peered":"2023-05-24T03:29:44.492462+0000","last_unstale":"2023-05-24T03:31:55.042450+0000","last_undegraded":"2023-05-24T03:31:55.042450+0000","last_fullsized":"2023-05-24T03:31:55.042450+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T03:34:42.017206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'477","reported_seq":494,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.639266+0000","last_change":"2023-05-24T03:29:48.524960+0000","last_active":"2023-05-24T03:31:55.639266+0000","last_peered":"2023-05-24T03:31:55.639266+0000","last_clean":"2023-05-24T03:31:55.639266+0000","last_became_active":"2023-05-24T03:29:48.524023+0000","last_became_peered":"2023-05-24T03:29:48.524023+0000","last_unstale":"2023-05-24T03:31:55.639266+0000","last_undegraded":"2023-05-24T03:31:55.639266+0000","last_fullsized":"2023-05-24T03:31:55.639266+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:17:12.538446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.945352+0000","last_change":"2023-05-24T03:29:44.082700+0000","last_active":"2023-05-24T03:30:25.945352+0000","last_peered":"2023-05-24T03:30:25.945352+0000","last_clean":"2023-05-24T03:30:25.945352+0000","last_became_active":"2023-05-24T03:29:44.082382+0000","last_became_peered":"2023-05-24T03:29:44.082382+0000","last_unstale":"2023-05-24T03:30:25.945352+0000","last_undegraded":"2023-05-24T03:30:25.945352+0000","last_fullsized":"2023-05-24T03:30:25.945352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:32:47.076800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"30'9","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.035186+0000","last_change":"2023-05-24T03:29:44.501409+0000","last_active":"2023-05-24T03:31:55.035186+0000","last_peered":"2023-05-24T03:31:55.035186+0000","last_clean":"2023-05-24T03:31:55.035186+0000","last_became_active":"2023-05-24T03:29:44.501080+0000","last_became_peered":"2023-05-24T03:29:44.501080+0000","last_unstale":"2023-05-24T03:31:55.035186+0000","last_undegraded":"2023-05-24T03:31:55.035186+0000","last_fullsized":"2023-05-24T03:31:55.035186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:32:22.255614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"30'488","reported_seq":505,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.909741+0000","last_change":"2023-05-24T03:29:48.519383+0000","last_active":"2023-05-24T03:31:54.909741+0000","last_peered":"2023-05-24T03:31:54.909741+0000","last_clean":"2023-05-24T03:31:54.909741+0000","last_became_active":"2023-05-24T03:29:48.519046+0000","last_became_peered":"2023-05-24T03:29:48.519046+0000","last_unstale":"2023-05-24T03:31:54.909741+0000","last_undegraded":"2023-05-24T03:31:54.909741+0000","last_fullsized":"2023-05-24T03:31:54.909741+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:02:44.132422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:26.804947+0000","last_change":"2023-05-24T03:29:44.085771+0000","last_active":"2023-05-24T03:30:26.804947+0000","last_peered":"2023-05-24T03:30:26.804947+0000","last_clean":"2023-05-24T03:30:26.804947+0000","last_became_active":"2023-05-24T03:29:44.085420+0000","last_became_peered":"2023-05-24T03:29:44.085420+0000","last_unstale":"2023-05-24T03:30:26.804947+0000","last_undegraded":"2023-05-24T03:30:26.804947+0000","last_fullsized":"2023-05-24T03:30:26.804947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:26:41.155647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"30'17","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.039969+0000","last_change":"2023-05-24T03:29:44.491345+0000","last_active":"2023-05-24T03:31:55.039969+0000","last_peered":"2023-05-24T03:31:55.039969+0000","last_clean":"2023-05-24T03:31:55.039969+0000","last_became_active":"2023-05-24T03:29:44.491089+0000","last_became_peered":"2023-05-24T03:29:44.491089+0000","last_unstale":"2023-05-24T03:31:55.039969+0000","last_undegraded":"2023-05-24T03:31:55.039969+0000","last_fullsized":"2023-05-24T03:31:55.039969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:11:59.800632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"30'492","reported_seq":510,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.647405+0000","last_change":"2023-05-24T03:29:48.530105+0000","last_active":"2023-05-24T03:31:55.647405+0000","last_peered":"2023-05-24T03:31:55.647405+0000","last_clean":"2023-05-24T03:31:55.647405+0000","last_became_active":"2023-05-24T03:29:48.529157+0000","last_became_peered":"2023-05-24T03:29:48.529157+0000","last_unstale":"2023-05-24T03:31:55.647405+0000","last_undegraded":"2023-05-24T03:31:55.647405+0000","last_fullsized":"2023-05-24T03:31:55.647405+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:57:53.143941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.946193+0000","last_change":"2023-05-24T03:29:39.143199+0000","last_active":"2023-05-24T03:30:25.946193+0000","last_peered":"2023-05-24T03:30:25.946193+0000","last_clean":"2023-05-24T03:30:25.946193+0000","last_became_active":"2023-05-24T03:29:39.142867+0000","last_became_peered":"2023-05-24T03:29:39.142867+0000","last_unstale":"2023-05-24T03:30:25.946193+0000","last_undegraded":"2023-05-24T03:30:25.946193+0000","last_fullsized":"2023-05-24T03:30:25.946193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:53:30.482418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"30'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:51.927110+0000","last_change":"2023-05-24T03:29:44.087790+0000","last_active":"2023-05-24T03:31:51.927110+0000","last_peered":"2023-05-24T03:31:51.927110+0000","last_clean":"2023-05-24T03:31:51.927110+0000","last_became_active":"2023-05-24T03:29:44.087475+0000","last_became_peered":"2023-05-24T03:29:44.087475+0000","last_unstale":"2023-05-24T03:31:51.927110+0000","last_undegraded":"2023-05-24T03:31:51.927110+0000","last_fullsized":"2023-05-24T03:31:51.927110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:56:15.394098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"30'16","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.035838+0000","last_change":"2023-05-24T03:29:44.497235+0000","last_active":"2023-05-24T03:31:55.035838+0000","last_peered":"2023-05-24T03:31:55.035838+0000","last_clean":"2023-05-24T03:31:55.035838+0000","last_became_active":"2023-05-24T03:29:44.497015+0000","last_became_peered":"2023-05-24T03:29:44.497015+0000","last_unstale":"2023-05-24T03:31:55.035838+0000","last_undegraded":"2023-05-24T03:31:55.035838+0000","last_fullsized":"2023-05-24T03:31:55.035838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:34:36.957340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"30'438","reported_seq":456,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.876773+0000","last_change":"2023-05-24T03:29:48.527805+0000","last_active":"2023-05-24T03:31:54.876773+0000","last_peered":"2023-05-24T03:31:54.876773+0000","last_clean":"2023-05-24T03:31:54.876773+0000","last_became_active":"2023-05-24T03:29:48.527010+0000","last_became_peered":"2023-05-24T03:29:48.527010+0000","last_unstale":"2023-05-24T03:31:54.876773+0000","last_undegraded":"2023-05-24T03:31:54.876773+0000","last_fullsized":"2023-05-24T03:31:54.876773+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:24:51.361665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.947589+0000","last_change":"2023-05-24T03:29:39.048516+0000","last_active":"2023-05-24T03:30:25.947589+0000","last_peered":"2023-05-24T03:30:25.947589+0000","last_clean":"2023-05-24T03:30:25.947589+0000","last_became_active":"2023-05-24T03:29:39.048141+0000","last_became_peered":"2023-05-24T03:29:39.048141+0000","last_unstale":"2023-05-24T03:30:25.947589+0000","last_undegraded":"2023-05-24T03:30:25.947589+0000","last_fullsized":"2023-05-24T03:30:25.947589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:37:39.237924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.945952+0000","last_change":"2023-05-24T03:29:44.085282+0000","last_active":"2023-05-24T03:30:25.945952+0000","last_peered":"2023-05-24T03:30:25.945952+0000","last_clean":"2023-05-24T03:30:25.945952+0000","last_became_active":"2023-05-24T03:29:44.084944+0000","last_became_peered":"2023-05-24T03:29:44.084944+0000","last_unstale":"2023-05-24T03:30:25.945952+0000","last_undegraded":"2023-05-24T03:30:25.945952+0000","last_fullsized":"2023-05-24T03:30:25.945952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:06:01.227379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"30'15","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.039882+0000","last_change":"2023-05-24T03:29:44.483553+0000","last_active":"2023-05-24T03:31:55.039882+0000","last_peered":"2023-05-24T03:31:55.039882+0000","last_clean":"2023-05-24T03:31:55.039882+0000","last_became_active":"2023-05-24T03:29:44.483134+0000","last_became_peered":"2023-05-24T03:29:44.483134+0000","last_unstale":"2023-05-24T03:31:55.039882+0000","last_undegraded":"2023-05-24T03:31:55.039882+0000","last_fullsized":"2023-05-24T03:31:55.039882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:00:20.978451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'470","reported_seq":487,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.996091+0000","last_change":"2023-05-24T03:29:48.519249+0000","last_active":"2023-05-24T03:31:54.996091+0000","last_peered":"2023-05-24T03:31:54.996091+0000","last_clean":"2023-05-24T03:31:54.996091+0000","last_became_active":"2023-05-24T03:29:48.518546+0000","last_became_peered":"2023-05-24T03:29:48.518546+0000","last_unstale":"2023-05-24T03:31:54.996091+0000","last_undegraded":"2023-05-24T03:31:54.996091+0000","last_fullsized":"2023-05-24T03:31:54.996091+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:26:29.923197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:26.105101+0000","last_change":"2023-05-24T03:29:39.310351+0000","last_active":"2023-05-24T03:30:26.105101+0000","last_peered":"2023-05-24T03:30:26.105101+0000","last_clean":"2023-05-24T03:30:26.105101+0000","last_became_active":"2023-05-24T03:29:39.310070+0000","last_became_peered":"2023-05-24T03:29:39.310070+0000","last_unstale":"2023-05-24T03:30:26.105101+0000","last_undegraded":"2023-05-24T03:30:26.105101+0000","last_fullsized":"2023-05-24T03:30:26.105101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:21:55.168531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.945636+0000","last_change":"2023-05-24T03:29:44.075504+0000","last_active":"2023-05-24T03:30:25.945636+0000","last_peered":"2023-05-24T03:30:25.945636+0000","last_clean":"2023-05-24T03:30:25.945636+0000","last_became_active":"2023-05-24T03:29:44.074551+0000","last_became_peered":"2023-05-24T03:29:44.074551+0000","last_unstale":"2023-05-24T03:30:25.945636+0000","last_undegraded":"2023-05-24T03:30:25.945636+0000","last_fullsized":"2023-05-24T03:30:25.945636+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:12:11.445050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"30'14","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.033247+0000","last_change":"2023-05-24T03:29:44.496225+0000","last_active":"2023-05-24T03:31:55.033247+0000","last_peered":"2023-05-24T03:31:55.033247+0000","last_clean":"2023-05-24T03:31:55.033247+0000","last_became_active":"2023-05-24T03:29:44.496030+0000","last_became_peered":"2023-05-24T03:29:44.496030+0000","last_unstale":"2023-05-24T03:31:55.033247+0000","last_undegraded":"2023-05-24T03:31:55.033247+0000","last_fullsized":"2023-05-24T03:31:55.033247+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:53:00.715123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"30'465","reported_seq":483,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.638847+0000","last_change":"2023-05-24T03:29:48.523816+0000","last_active":"2023-05-24T03:31:55.638847+0000","last_peered":"2023-05-24T03:31:55.638847+0000","last_clean":"2023-05-24T03:31:55.638847+0000","last_became_active":"2023-05-24T03:29:48.523380+0000","last_became_peered":"2023-05-24T03:29:48.523380+0000","last_unstale":"2023-05-24T03:31:55.638847+0000","last_undegraded":"2023-05-24T03:31:55.638847+0000","last_fullsized":"2023-05-24T03:31:55.638847+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:24:51.361665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.948180+0000","last_change":"2023-05-24T03:29:39.051113+0000","last_active":"2023-05-24T03:30:25.948180+0000","last_peered":"2023-05-24T03:30:25.948180+0000","last_clean":"2023-05-24T03:30:25.948180+0000","last_became_active":"2023-05-24T03:29:39.050751+0000","last_became_peered":"2023-05-24T03:29:39.050751+0000","last_unstale":"2023-05-24T03:30:25.948180+0000","last_undegraded":"2023-05-24T03:30:25.948180+0000","last_fullsized":"2023-05-24T03:30:25.948180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:30:48.280021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":188,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.948889+0000","last_change":"2023-05-24T03:29:34.025679+0000","last_active":"2023-05-24T03:30:25.948889+0000","last_peered":"2023-05-24T03:30:25.948889+0000","last_clean":"2023-05-24T03:30:25.948889+0000","last_became_active":"2023-05-24T03:29:34.024728+0000","last_became_peered":"2023-05-24T03:29:34.024728+0000","last_unstale":"2023-05-24T03:30:25.948889+0000","last_undegraded":"2023-05-24T03:30:25.948889+0000","last_fullsized":"2023-05-24T03:30:25.948889+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:32.968348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:32.968348+0000","last_clean_scrub_stamp":"2023-05-24T03:29:32.968348+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:52:49.623148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:26.804884+0000","last_change":"2023-05-24T03:29:44.086373+0000","last_active":"2023-05-24T03:30:26.804884+0000","last_peered":"2023-05-24T03:30:26.804884+0000","last_clean":"2023-05-24T03:30:26.804884+0000","last_became_active":"2023-05-24T03:29:44.086125+0000","last_became_peered":"2023-05-24T03:29:44.086125+0000","last_unstale":"2023-05-24T03:30:26.804884+0000","last_undegraded":"2023-05-24T03:30:26.804884+0000","last_fullsized":"2023-05-24T03:30:26.804884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:03:28.807318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"30'15","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.033691+0000","last_change":"2023-05-24T03:29:44.492654+0000","last_active":"2023-05-24T03:31:55.033691+0000","last_peered":"2023-05-24T03:31:55.033691+0000","last_clean":"2023-05-24T03:31:55.033691+0000","last_became_active":"2023-05-24T03:29:44.492375+0000","last_became_peered":"2023-05-24T03:29:44.492375+0000","last_unstale":"2023-05-24T03:31:55.033691+0000","last_undegraded":"2023-05-24T03:31:55.033691+0000","last_fullsized":"2023-05-24T03:31:55.033691+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:14:30.274935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"30'436","reported_seq":453,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.876352+0000","last_change":"2023-05-24T03:29:48.525206+0000","last_active":"2023-05-24T03:31:54.876352+0000","last_peered":"2023-05-24T03:31:54.876352+0000","last_clean":"2023-05-24T03:31:54.876352+0000","last_became_active":"2023-05-24T03:29:48.524615+0000","last_became_peered":"2023-05-24T03:29:48.524615+0000","last_unstale":"2023-05-24T03:31:54.876352+0000","last_undegraded":"2023-05-24T03:31:54.876352+0000","last_fullsized":"2023-05-24T03:31:54.876352+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:15:16.805837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.949105+0000","last_change":"2023-05-24T03:29:39.054117+0000","last_active":"2023-05-24T03:30:25.949105+0000","last_peered":"2023-05-24T03:30:25.949105+0000","last_clean":"2023-05-24T03:30:25.949105+0000","last_became_active":"2023-05-24T03:29:39.053813+0000","last_became_peered":"2023-05-24T03:29:39.053813+0000","last_unstale":"2023-05-24T03:30:25.949105+0000","last_undegraded":"2023-05-24T03:30:25.949105+0000","last_fullsized":"2023-05-24T03:30:25.949105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:20:55.877097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"30'11","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.627272+0000","last_change":"2023-05-24T03:29:44.090147+0000","last_active":"2023-05-24T03:31:55.627272+0000","last_peered":"2023-05-24T03:31:55.627272+0000","last_clean":"2023-05-24T03:31:55.627272+0000","last_became_active":"2023-05-24T03:29:44.089943+0000","last_became_peered":"2023-05-24T03:29:44.089943+0000","last_unstale":"2023-05-24T03:31:55.627272+0000","last_undegraded":"2023-05-24T03:31:55.627272+0000","last_fullsized":"2023-05-24T03:31:55.627272+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:52:59.708678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6444,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":10,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"30'18","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.051202+0000","last_change":"2023-05-24T03:29:44.498467+0000","last_active":"2023-05-24T03:31:55.051202+0000","last_peered":"2023-05-24T03:31:55.051202+0000","last_clean":"2023-05-24T03:31:55.051202+0000","last_became_active":"2023-05-24T03:29:44.498130+0000","last_became_peered":"2023-05-24T03:29:44.498130+0000","last_unstale":"2023-05-24T03:31:55.051202+0000","last_undegraded":"2023-05-24T03:31:55.051202+0000","last_fullsized":"2023-05-24T03:31:55.051202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:37:45.262523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"30'488","reported_seq":506,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.649800+0000","last_change":"2023-05-24T03:29:48.520034+0000","last_active":"2023-05-24T03:31:55.649800+0000","last_peered":"2023-05-24T03:31:55.649800+0000","last_clean":"2023-05-24T03:31:55.649800+0000","last_became_active":"2023-05-24T03:29:48.519673+0000","last_became_peered":"2023-05-24T03:29:48.519673+0000","last_unstale":"2023-05-24T03:31:55.649800+0000","last_undegraded":"2023-05-24T03:31:55.649800+0000","last_fullsized":"2023-05-24T03:31:55.649800+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:17:11.019561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.949461+0000","last_change":"2023-05-24T03:29:39.143215+0000","last_active":"2023-05-24T03:30:25.949461+0000","last_peered":"2023-05-24T03:30:25.949461+0000","last_clean":"2023-05-24T03:30:25.949461+0000","last_became_active":"2023-05-24T03:29:39.142949+0000","last_became_peered":"2023-05-24T03:29:39.142949+0000","last_unstale":"2023-05-24T03:30:25.949461+0000","last_undegraded":"2023-05-24T03:30:25.949461+0000","last_fullsized":"2023-05-24T03:30:25.949461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:06:13.199168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"30'2","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:51.960970+0000","last_change":"2023-05-24T03:29:44.074869+0000","last_active":"2023-05-24T03:31:51.960970+0000","last_peered":"2023-05-24T03:31:51.960970+0000","last_clean":"2023-05-24T03:31:51.960970+0000","last_became_active":"2023-05-24T03:29:44.074374+0000","last_became_peered":"2023-05-24T03:29:44.074374+0000","last_unstale":"2023-05-24T03:31:51.960970+0000","last_undegraded":"2023-05-24T03:31:51.960970+0000","last_fullsized":"2023-05-24T03:31:51.960970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:37:44.256077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"30'16","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.049875+0000","last_change":"2023-05-24T03:29:44.499979+0000","last_active":"2023-05-24T03:31:55.049875+0000","last_peered":"2023-05-24T03:31:55.049875+0000","last_clean":"2023-05-24T03:31:55.049875+0000","last_became_active":"2023-05-24T03:29:44.499768+0000","last_became_peered":"2023-05-24T03:29:44.499768+0000","last_unstale":"2023-05-24T03:31:55.049875+0000","last_undegraded":"2023-05-24T03:31:55.049875+0000","last_fullsized":"2023-05-24T03:31:55.049875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:11:59.800632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"30'478","reported_seq":496,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.634562+0000","last_change":"2023-05-24T03:29:48.530781+0000","last_active":"2023-05-24T03:31:55.634562+0000","last_peered":"2023-05-24T03:31:55.634562+0000","last_clean":"2023-05-24T03:31:55.634562+0000","last_became_active":"2023-05-24T03:29:48.530401+0000","last_became_peered":"2023-05-24T03:29:48.530401+0000","last_unstale":"2023-05-24T03:31:55.634562+0000","last_undegraded":"2023-05-24T03:31:55.634562+0000","last_fullsized":"2023-05-24T03:31:55.634562+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:28:34.171252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"30'3","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:52.027244+0000","last_change":"2023-05-24T03:29:44.084278+0000","last_active":"2023-05-24T03:31:52.027244+0000","last_peered":"2023-05-24T03:31:52.027244+0000","last_clean":"2023-05-24T03:31:52.027244+0000","last_became_active":"2023-05-24T03:29:44.083929+0000","last_became_peered":"2023-05-24T03:29:44.083929+0000","last_unstale":"2023-05-24T03:31:52.027244+0000","last_undegraded":"2023-05-24T03:31:52.027244+0000","last_fullsized":"2023-05-24T03:31:52.027244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:08:29.969550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.946231+0000","last_change":"2023-05-24T03:29:39.045821+0000","last_active":"2023-05-24T03:30:25.946231+0000","last_peered":"2023-05-24T03:30:25.946231+0000","last_clean":"2023-05-24T03:30:25.946231+0000","last_became_active":"2023-05-24T03:29:39.045543+0000","last_became_peered":"2023-05-24T03:29:39.045543+0000","last_unstale":"2023-05-24T03:30:25.946231+0000","last_undegraded":"2023-05-24T03:30:25.946231+0000","last_fullsized":"2023-05-24T03:30:25.946231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:57:43.697063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"30'16","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.040363+0000","last_change":"2023-05-24T03:29:44.496106+0000","last_active":"2023-05-24T03:31:55.040363+0000","last_peered":"2023-05-24T03:31:55.040363+0000","last_clean":"2023-05-24T03:31:55.040363+0000","last_became_active":"2023-05-24T03:29:44.495816+0000","last_became_peered":"2023-05-24T03:29:44.495816+0000","last_unstale":"2023-05-24T03:31:55.040363+0000","last_undegraded":"2023-05-24T03:31:55.040363+0000","last_fullsized":"2023-05-24T03:31:55.040363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:56:16.400543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"30'438","reported_seq":456,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.998273+0000","last_change":"2023-05-24T03:29:48.527602+0000","last_active":"2023-05-24T03:31:54.998273+0000","last_peered":"2023-05-24T03:31:54.998273+0000","last_clean":"2023-05-24T03:31:54.998273+0000","last_became_active":"2023-05-24T03:29:48.527196+0000","last_became_peered":"2023-05-24T03:29:48.527196+0000","last_unstale":"2023-05-24T03:31:54.998273+0000","last_undegraded":"2023-05-24T03:31:54.998273+0000","last_fullsized":"2023-05-24T03:31:54.998273+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:37:48.684803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13631488,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":31744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:26.804512+0000","last_change":"2023-05-24T03:29:39.046445+0000","last_active":"2023-05-24T03:30:26.804512+0000","last_peered":"2023-05-24T03:30:26.804512+0000","last_clean":"2023-05-24T03:30:26.804512+0000","last_became_active":"2023-05-24T03:29:39.046149+0000","last_became_peered":"2023-05-24T03:29:39.046149+0000","last_unstale":"2023-05-24T03:30:26.804512+0000","last_undegraded":"2023-05-24T03:30:26.804512+0000","last_fullsized":"2023-05-24T03:30:26.804512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:09:38.768895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"30'9","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.185381+0000","last_change":"2023-05-24T03:29:44.088780+0000","last_active":"2023-05-24T03:31:54.185381+0000","last_peered":"2023-05-24T03:31:54.185381+0000","last_clean":"2023-05-24T03:31:54.185381+0000","last_became_active":"2023-05-24T03:29:44.088495+0000","last_became_peered":"2023-05-24T03:29:44.088495+0000","last_unstale":"2023-05-24T03:31:54.185381+0000","last_undegraded":"2023-05-24T03:31:54.185381+0000","last_fullsized":"2023-05-24T03:31:54.185381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:28:23.442311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"30'8","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.031293+0000","last_change":"2023-05-24T03:29:44.496966+0000","last_active":"2023-05-24T03:31:55.031293+0000","last_peered":"2023-05-24T03:31:55.031293+0000","last_clean":"2023-05-24T03:31:55.031293+0000","last_became_active":"2023-05-24T03:29:44.496597+0000","last_became_peered":"2023-05-24T03:29:44.496597+0000","last_unstale":"2023-05-24T03:31:55.031293+0000","last_undegraded":"2023-05-24T03:31:55.031293+0000","last_fullsized":"2023-05-24T03:31:55.031293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:32:09.391394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"30'462","reported_seq":479,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.890055+0000","last_change":"2023-05-24T03:29:48.524541+0000","last_active":"2023-05-24T03:31:54.890055+0000","last_peered":"2023-05-24T03:31:54.890055+0000","last_clean":"2023-05-24T03:31:54.890055+0000","last_became_active":"2023-05-24T03:29:48.524170+0000","last_became_peered":"2023-05-24T03:29:48.524170+0000","last_unstale":"2023-05-24T03:31:54.890055+0000","last_undegraded":"2023-05-24T03:31:54.890055+0000","last_fullsized":"2023-05-24T03:31:54.890055+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:21:05.323975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:26.131668+0000","last_change":"2023-05-24T03:29:44.090259+0000","last_active":"2023-05-24T03:30:26.131668+0000","last_peered":"2023-05-24T03:30:26.131668+0000","last_clean":"2023-05-24T03:30:26.131668+0000","last_became_active":"2023-05-24T03:29:44.089993+0000","last_became_peered":"2023-05-24T03:29:44.089993+0000","last_unstale":"2023-05-24T03:30:26.131668+0000","last_undegraded":"2023-05-24T03:30:26.131668+0000","last_fullsized":"2023-05-24T03:30:26.131668+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:21:00.895250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"30'17","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.038326+0000","last_change":"2023-05-24T03:29:44.481933+0000","last_active":"2023-05-24T03:31:55.038326+0000","last_peered":"2023-05-24T03:31:55.038326+0000","last_clean":"2023-05-24T03:31:55.038326+0000","last_became_active":"2023-05-24T03:29:44.481655+0000","last_became_peered":"2023-05-24T03:29:44.481655+0000","last_unstale":"2023-05-24T03:31:55.038326+0000","last_undegraded":"2023-05-24T03:31:55.038326+0000","last_fullsized":"2023-05-24T03:31:55.038326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:32:32.559676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"30'471","reported_seq":488,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.643022+0000","last_change":"2023-05-24T03:29:48.516800+0000","last_active":"2023-05-24T03:31:55.643022+0000","last_peered":"2023-05-24T03:31:55.643022+0000","last_clean":"2023-05-24T03:31:55.643022+0000","last_became_active":"2023-05-24T03:29:48.516366+0000","last_became_peered":"2023-05-24T03:29:48.516366+0000","last_unstale":"2023-05-24T03:31:55.643022+0000","last_undegraded":"2023-05-24T03:31:55.643022+0000","last_fullsized":"2023-05-24T03:31:55.643022+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:10:18.027326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.947901+0000","last_change":"2023-05-24T03:29:44.094179+0000","last_active":"2023-05-24T03:30:25.947901+0000","last_peered":"2023-05-24T03:30:25.947901+0000","last_clean":"2023-05-24T03:30:25.947901+0000","last_became_active":"2023-05-24T03:29:44.093909+0000","last_became_peered":"2023-05-24T03:29:44.093909+0000","last_unstale":"2023-05-24T03:30:25.947901+0000","last_undegraded":"2023-05-24T03:30:25.947901+0000","last_fullsized":"2023-05-24T03:30:25.947901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:09:02.075394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"30'13","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.043652+0000","last_change":"2023-05-24T03:29:44.497379+0000","last_active":"2023-05-24T03:31:55.043652+0000","last_peered":"2023-05-24T03:31:55.043652+0000","last_clean":"2023-05-24T03:31:55.043652+0000","last_became_active":"2023-05-24T03:29:44.496679+0000","last_became_peered":"2023-05-24T03:29:44.496679+0000","last_unstale":"2023-05-24T03:31:55.043652+0000","last_undegraded":"2023-05-24T03:31:55.043652+0000","last_fullsized":"2023-05-24T03:31:55.043652+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:14:25.131724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"30'454","reported_seq":471,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.891571+0000","last_change":"2023-05-24T03:29:48.529231+0000","last_active":"2023-05-24T03:31:54.891571+0000","last_peered":"2023-05-24T03:31:54.891571+0000","last_clean":"2023-05-24T03:31:54.891571+0000","last_became_active":"2023-05-24T03:29:48.528862+0000","last_became_peered":"2023-05-24T03:29:48.528862+0000","last_unstale":"2023-05-24T03:31:54.891571+0000","last_undegraded":"2023-05-24T03:31:54.891571+0000","last_fullsized":"2023-05-24T03:31:54.891571+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:28:27.871037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"30'3","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.947544+0000","last_change":"2023-05-24T03:29:44.090289+0000","last_active":"2023-05-24T03:30:25.947544+0000","last_peered":"2023-05-24T03:30:25.947544+0000","last_clean":"2023-05-24T03:30:25.947544+0000","last_became_active":"2023-05-24T03:29:44.089949+0000","last_became_peered":"2023-05-24T03:29:44.089949+0000","last_unstale":"2023-05-24T03:30:25.947544+0000","last_undegraded":"2023-05-24T03:30:25.947544+0000","last_fullsized":"2023-05-24T03:30:25.947544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:24:46.932939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'12","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.042240+0000","last_change":"2023-05-24T03:29:44.498632+0000","last_active":"2023-05-24T03:31:55.042240+0000","last_peered":"2023-05-24T03:31:55.042240+0000","last_clean":"2023-05-24T03:31:55.042240+0000","last_became_active":"2023-05-24T03:29:44.498350+0000","last_became_peered":"2023-05-24T03:29:44.498350+0000","last_unstale":"2023-05-24T03:31:55.042240+0000","last_undegraded":"2023-05-24T03:31:55.042240+0000","last_fullsized":"2023-05-24T03:31:55.042240+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:22:26.333903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"30'476","reported_seq":493,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.635369+0000","last_change":"2023-05-24T03:29:48.523434+0000","last_active":"2023-05-24T03:31:55.635369+0000","last_peered":"2023-05-24T03:31:55.635369+0000","last_clean":"2023-05-24T03:31:55.635369+0000","last_became_active":"2023-05-24T03:29:48.522228+0000","last_became_peered":"2023-05-24T03:29:48.522228+0000","last_unstale":"2023-05-24T03:31:55.635369+0000","last_undegraded":"2023-05-24T03:31:55.635369+0000","last_fullsized":"2023-05-24T03:31:55.635369+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:40:50.804869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:26.805353+0000","last_change":"2023-05-24T03:29:44.083178+0000","last_active":"2023-05-24T03:30:26.805353+0000","last_peered":"2023-05-24T03:30:26.805353+0000","last_clean":"2023-05-24T03:30:26.805353+0000","last_became_active":"2023-05-24T03:29:44.082903+0000","last_became_peered":"2023-05-24T03:29:44.082903+0000","last_unstale":"2023-05-24T03:30:26.805353+0000","last_undegraded":"2023-05-24T03:30:26.805353+0000","last_fullsized":"2023-05-24T03:30:26.805353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:56:27.514130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"30'19","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.043523+0000","last_change":"2023-05-24T03:29:44.488206+0000","last_active":"2023-05-24T03:31:55.043523+0000","last_peered":"2023-05-24T03:31:55.043523+0000","last_clean":"2023-05-24T03:31:55.043523+0000","last_became_active":"2023-05-24T03:29:44.487925+0000","last_became_peered":"2023-05-24T03:29:44.487925+0000","last_unstale":"2023-05-24T03:31:55.043523+0000","last_undegraded":"2023-05-24T03:31:55.043523+0000","last_fullsized":"2023-05-24T03:31:55.043523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:28:43.398723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"30'482","reported_seq":499,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.819538+0000","last_change":"2023-05-24T03:29:48.519899+0000","last_active":"2023-05-24T03:31:54.819538+0000","last_peered":"2023-05-24T03:31:54.819538+0000","last_clean":"2023-05-24T03:31:54.819538+0000","last_became_active":"2023-05-24T03:29:48.519517+0000","last_became_peered":"2023-05-24T03:29:48.519517+0000","last_unstale":"2023-05-24T03:31:54.819538+0000","last_undegraded":"2023-05-24T03:31:54.819538+0000","last_fullsized":"2023-05-24T03:31:54.819538+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:21:09.342432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"30'5","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:51.943205+0000","last_change":"2023-05-24T03:29:44.088545+0000","last_active":"2023-05-24T03:31:51.943205+0000","last_peered":"2023-05-24T03:31:51.943205+0000","last_clean":"2023-05-24T03:31:51.943205+0000","last_became_active":"2023-05-24T03:29:44.087891+0000","last_became_peered":"2023-05-24T03:29:44.087891+0000","last_unstale":"2023-05-24T03:31:51.943205+0000","last_undegraded":"2023-05-24T03:31:51.943205+0000","last_fullsized":"2023-05-24T03:31:51.943205+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:26:41.155647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"30'23","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.037013+0000","last_change":"2023-05-24T03:29:44.493246+0000","last_active":"2023-05-24T03:31:55.037013+0000","last_peered":"2023-05-24T03:31:55.037013+0000","last_clean":"2023-05-24T03:31:55.037013+0000","last_became_active":"2023-05-24T03:29:44.492923+0000","last_became_peered":"2023-05-24T03:29:44.492923+0000","last_unstale":"2023-05-24T03:31:55.037013+0000","last_undegraded":"2023-05-24T03:31:55.037013+0000","last_fullsized":"2023-05-24T03:31:55.037013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:11:24.300717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"30'27","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.039268+0000","last_change":"2023-05-24T03:29:44.486961+0000","last_active":"2023-05-24T03:31:55.039268+0000","last_peered":"2023-05-24T03:31:55.039268+0000","last_clean":"2023-05-24T03:31:55.039268+0000","last_became_active":"2023-05-24T03:29:44.483898+0000","last_became_peered":"2023-05-24T03:29:44.483898+0000","last_unstale":"2023-05-24T03:31:55.039268+0000","last_undegraded":"2023-05-24T03:31:55.039268+0000","last_fullsized":"2023-05-24T03:31:55.039268+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:58:20.689097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"30'20","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.035003+0000","last_change":"2023-05-24T03:29:44.494451+0000","last_active":"2023-05-24T03:31:55.035003+0000","last_peered":"2023-05-24T03:31:55.035003+0000","last_clean":"2023-05-24T03:31:55.035003+0000","last_became_active":"2023-05-24T03:29:44.494073+0000","last_became_peered":"2023-05-24T03:29:44.494073+0000","last_unstale":"2023-05-24T03:31:55.035003+0000","last_undegraded":"2023-05-24T03:31:55.035003+0000","last_fullsized":"2023-05-24T03:31:55.035003+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:09:03.081839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"30'18","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.037312+0000","last_change":"2023-05-24T03:29:44.498119+0000","last_active":"2023-05-24T03:31:55.037312+0000","last_peered":"2023-05-24T03:31:55.037312+0000","last_clean":"2023-05-24T03:31:55.037312+0000","last_became_active":"2023-05-24T03:29:44.497832+0000","last_became_peered":"2023-05-24T03:29:44.497832+0000","last_unstale":"2023-05-24T03:31:55.037312+0000","last_undegraded":"2023-05-24T03:31:55.037312+0000","last_fullsized":"2023-05-24T03:31:55.037312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:29:45.352536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"30'15","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.042561+0000","last_change":"2023-05-24T03:29:44.496468+0000","last_active":"2023-05-24T03:31:55.042561+0000","last_peered":"2023-05-24T03:31:55.042561+0000","last_clean":"2023-05-24T03:31:55.042561+0000","last_became_active":"2023-05-24T03:29:44.496197+0000","last_became_peered":"2023-05-24T03:29:44.496197+0000","last_unstale":"2023-05-24T03:31:55.042561+0000","last_undegraded":"2023-05-24T03:31:55.042561+0000","last_fullsized":"2023-05-24T03:31:55.042561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:47:03.515144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"30'12","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:55.034205+0000","last_change":"2023-05-24T03:29:44.495194+0000","last_active":"2023-05-24T03:31:55.034205+0000","last_peered":"2023-05-24T03:31:55.034205+0000","last_clean":"2023-05-24T03:31:55.034205+0000","last_became_active":"2023-05-24T03:29:44.494928+0000","last_became_peered":"2023-05-24T03:29:44.494928+0000","last_unstale":"2023-05-24T03:31:55.034205+0000","last_undegraded":"2023-05-24T03:31:55.034205+0000","last_fullsized":"2023-05-24T03:31:55.034205+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:10:14.605046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":262144000,"num_objects":64,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":342,"num_write_kb":812032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":524288000,"data_stored":524288000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14714,"ondisk_log_size":14714,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1048,"ondisk_log_size":1048,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1397644,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":419,"num_write_kb":1638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2859008,"data_stored":2795288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":422,"ondisk_log_size":422,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99380,"kb_used_data":68332,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94272460,"statfs":{"total":96636764160,"available":96534999040,"internally_reserved":0,"allocated":69971968,"data_stored":69752984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":4.7569999999999997,"5min":1.3480000000000001,"15min":0.78000000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":14.757999999999999,"5min":14.757999999999999,"15min":14.757999999999999},"last":0.29899999999999999},{"interface":"front","average":{"1min":6.2599999999999998,"5min":1.663,"15min":0.89700000000000002},"min":{"1min":0.307,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":17.954000000000001,"5min":17.954000000000001,"15min":17.954000000000001},"last":0.45700000000000002}]},{"osd":1,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":4.8380000000000001,"5min":1.3740000000000001,"15min":0.79600000000000004},"min":{"1min":0.35599999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":16.939,"5min":16.939,"15min":16.939},"last":0.36799999999999999},{"interface":"front","average":{"1min":6.6909999999999998,"5min":1.766,"15min":0.94499999999999995},"min":{"1min":0.35599999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":17.981999999999999,"5min":17.981999999999999,"15min":17.981999999999999},"last":0.504}]},{"osd":2,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":6.1429999999999998,"5min":1.641,"15min":0.89100000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":14.720000000000001,"5min":14.720000000000001,"15min":14.720000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":5.6150000000000002,"5min":1.5469999999999999,"15min":0.86899999999999999},"min":{"1min":0.40799999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":14.814,"5min":14.814,"15min":14.814},"last":0.59399999999999997}]},{"osd":3,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":6.3620000000000001,"5min":1.7150000000000001,"15min":0.94099999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":22.977,"5min":22.977,"15min":22.977},"last":0.54500000000000004},{"interface":"front","average":{"1min":4.742,"5min":1.3779999999999999,"15min":0.81699999999999995},"min":{"1min":0.47099999999999997,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":14.836,"5min":14.836,"15min":14.836},"last":0.628}]},{"osd":4,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":4.8449999999999998,"5min":1.345,"15min":0.76200000000000001},"min":{"1min":0.35099999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":18.027000000000001,"5min":18.027000000000001,"15min":18.027000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":3.347,"5min":1.077,"15min":0.69899999999999995},"min":{"1min":0.36299999999999999,"5min":0.307,"15min":0.307},"max":{"1min":22.922000000000001,"5min":22.922000000000001,"15min":22.922000000000001},"last":0.51500000000000001}]},{"osd":5,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":3.512,"5min":1.1579999999999999,"15min":0.76600000000000001},"min":{"1min":0.39700000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":17.925999999999998,"5min":17.925999999999998,"15min":17.925999999999998},"last":0.56200000000000006},{"interface":"front","average":{"1min":3.79,"5min":1.206,"15min":0.77600000000000002},"min":{"1min":0.42099999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":18.004999999999999,"5min":18.004999999999999,"15min":18.004999999999999},"last":0.55500000000000005}]},{"osd":6,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":5.5069999999999997,"5min":1.5609999999999999,"15min":0.90300000000000002},"min":{"1min":0.45900000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":23.933,"5min":23.933,"15min":23.933},"last":0.53200000000000003},{"interface":"front","average":{"1min":5.3019999999999996,"5min":1.534,"15min":0.90600000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":22.954000000000001,"5min":22.954000000000001,"15min":22.954000000000001},"last":0.58199999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574881,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84296,"kb_used_data":62272,"kb_used_omap":0,"kb_used_meta":22016,"kb_avail":94287544,"statfs":{"total":96636764160,"available":96550445056,"internally_reserved":0,"allocated":63766528,"data_stored":63577694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22544384},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":8.5820000000000007,"5min":2.4780000000000002,"15min":1.46},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":22.922999999999998,"5min":22.922999999999998,"15min":22.922999999999998},"last":0.35499999999999998},{"interface":"front","average":{"1min":7.4909999999999997,"5min":1.952,"15min":1.0289999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":28.870000000000001,"5min":28.870000000000001,"15min":28.870000000000001},"last":0.47599999999999998}]},{"osd":1,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":7.5229999999999997,"5min":2.3090000000000002,"15min":1.4399999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":22.984999999999999,"5min":22.984999999999999,"15min":22.984999999999999},"last":0.496},{"interface":"front","average":{"1min":6.492,"5min":2.0910000000000002,"15min":1.357},"min":{"1min":0.434,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":21.984999999999999,"5min":21.984999999999999,"15min":21.984999999999999},"last":0.33000000000000002}]},{"osd":2,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":5.6580000000000004,"5min":1.6020000000000001,"15min":0.92600000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":22.649999999999999,"5min":22.649999999999999,"15min":22.649999999999999},"last":0.36299999999999999},{"interface":"front","average":{"1min":7.5709999999999997,"5min":2.3199999999999998,"15min":1.4450000000000001},"min":{"1min":0.40100000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":23.035,"5min":23.035,"15min":23.035},"last":0.38400000000000001}]},{"osd":3,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":6.4699999999999998,"5min":1.8380000000000001,"15min":1.0660000000000001},"min":{"1min":0.42699999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":18.056000000000001,"5min":18.056000000000001,"15min":18.056000000000001},"last":0.377},{"interface":"front","average":{"1min":6.2069999999999999,"5min":1.7749999999999999,"15min":1.036},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":19.963999999999999,"5min":19.963999999999999,"15min":19.963999999999999},"last":0.40799999999999997}]},{"osd":4,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":5.3230000000000004,"5min":1.4830000000000001,"15min":0.84299999999999997},"min":{"1min":0.372,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":18.056000000000001,"5min":18.056000000000001,"15min":18.056000000000001},"last":0.313},{"interface":"front","average":{"1min":5.1360000000000001,"5min":1.476,"15min":0.86599999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":21.943999999999999,"5min":21.943999999999999,"15min":21.943999999999999},"last":0.42199999999999999}]},{"osd":5,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":4.7370000000000001,"5min":1.3799999999999999,"15min":0.81999999999999995},"min":{"1min":0.36599999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":11.976000000000001,"5min":11.976000000000001,"15min":11.976000000000001},"last":0.435},{"interface":"front","average":{"1min":7.032,"5min":1.9119999999999999,"15min":1.0589999999999999},"min":{"1min":0.44600000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":23.010999999999999,"5min":23.010999999999999,"15min":23.010999999999999},"last":0.44}]},{"osd":7,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":5.8639999999999999,"5min":1.6479999999999999,"15min":0.94599999999999995},"min":{"1min":0.48699999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":11.989000000000001,"5min":11.989000000000001,"15min":11.989000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":5.157,"5min":1.528,"15min":0.92300000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":21.042000000000002,"5min":21.042000000000002,"15min":21.042000000000002},"last":0.46700000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574881,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98632,"kb_used_data":76608,"kb_used_omap":0,"kb_used_meta":22016,"kb_avail":94273208,"statfs":{"total":96636764160,"available":96535764992,"internally_reserved":0,"allocated":78446592,"data_stored":78257758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22544384},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:31:32 2023","interfaces":[{"interface":"back","average":{"1min":5.5410000000000004,"5min":1.452,"15min":0.77000000000000002},"min":{"1min":0.24199999999999999,"5min":0.223,"15min":0.223},"max":{"1min":18.954000000000001,"5min":18.954000000000001,"15min":18.954000000000001},"last":0.23499999999999999},{"interface":"front","average":{"1min":6.6689999999999996,"5min":1.8400000000000001,"15min":1.0349999999999999},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":21.981999999999999,"5min":21.981999999999999,"15min":21.981999999999999},"last":0.221}]},{"osd":2,"last update":"Wed May 24 03:31:32 2023","interfaces":[{"interface":"back","average":{"1min":4.258,"5min":1.151,"15min":0.63300000000000001},"min":{"1min":0.255,"5min":0.221,"15min":0.221},"max":{"1min":15.004,"5min":15.004,"15min":15.004},"last":0.25600000000000001},{"interface":"front","average":{"1min":6.0179999999999998,"5min":1.5680000000000001,"15min":0.82599999999999996},"min":{"1min":0.29399999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":21.885000000000002,"5min":21.885000000000002,"15min":21.885000000000002},"last":0.26800000000000002}]},{"osd":3,"last update":"Wed May 24 03:31:32 2023","interfaces":[{"interface":"back","average":{"1min":4.5700000000000003,"5min":1.3160000000000001,"15min":0.77400000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":18.167000000000002,"5min":18.167000000000002,"15min":18.167000000000002},"last":0.32700000000000001},{"interface":"front","average":{"1min":3.7869999999999999,"5min":1.089,"15min":0.63900000000000001},"min":{"1min":0.33200000000000002,"5min":0.254,"15min":0.254},"max":{"1min":11.935,"5min":11.935,"15min":11.935},"last":0.30599999999999999}]},{"osd":4,"last update":"Wed May 24 03:31:32 2023","interfaces":[{"interface":"back","average":{"1min":7.3700000000000001,"5min":1.9259999999999999,"15min":1.018},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":28.891999999999999,"5min":28.891999999999999,"15min":28.891999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":7.6630000000000003,"5min":2.044,"15min":1.1080000000000001},"min":{"1min":0.376,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":21.954999999999998,"5min":21.954999999999998,"15min":21.954999999999998},"last":0.40899999999999997}]},{"osd":5,"last update":"Wed May 24 03:31:32 2023","interfaces":[{"interface":"back","average":{"1min":8.9190000000000005,"5min":2.323,"15min":1.2230000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":21.928000000000001,"5min":21.928000000000001,"15min":21.928000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":7.6909999999999998,"5min":2.0720000000000001,"15min":1.1359999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":19.757999999999999,"5min":19.757999999999999,"15min":19.757999999999999},"last":0.49199999999999999}]},{"osd":6,"last update":"Wed May 24 03:31:32 2023","interfaces":[{"interface":"back","average":{"1min":6.984,"5min":1.9039999999999999,"15min":1.0580000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":22.033999999999999,"5min":22.033999999999999,"15min":22.033999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":7.6849999999999996,"5min":2.0339999999999998,"15min":1.0920000000000001},"min":{"1min":0.40200000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":19.734999999999999,"5min":19.734999999999999,"15min":19.734999999999999},"last":0.51600000000000001}]},{"osd":7,"last update":"Wed May 24 03:31:32 2023","interfaces":[{"interface":"back","average":{"1min":8.1940000000000008,"5min":2.2130000000000001,"15min":1.216},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":21.994,"5min":21.994,"15min":21.994},"last":0.46999999999999997},{"interface":"front","average":{"1min":7.8959999999999999,"5min":2.109,"15min":1.145},"min":{"1min":0.47999999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":21.957999999999998,"5min":21.957999999999998,"15min":21.957999999999998},"last":0.502}]}]},{"osd":0,"up_from":13,"seq":55834574881,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98008,"kb_used_data":66960,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94273832,"statfs":{"total":96636764160,"available":96536403968,"internally_reserved":0,"allocated":68567040,"data_stored":68369392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":5.6539999999999999,"5min":1.4419999999999999,"15min":0.73999999999999999},"min":{"1min":0.29099999999999998,"5min":0.253,"15min":0.253},"max":{"1min":21.216000000000001,"5min":21.216000000000001,"15min":21.216000000000001},"last":0.30599999999999999},{"interface":"front","average":{"1min":6.9509999999999996,"5min":1.6930000000000001,"15min":0.81699999999999995},"min":{"1min":0.247,"5min":0.185,"15min":0.185},"max":{"1min":29.925000000000001,"5min":29.925000000000001,"15min":29.925000000000001},"last":0.26300000000000001}]},{"osd":2,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":5.431,"5min":1.403,"15min":0.73199999999999998},"min":{"1min":0.29099999999999998,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":19.018999999999998,"5min":19.018999999999998,"15min":19.018999999999998},"last":0.88800000000000001},{"interface":"front","average":{"1min":7.6340000000000003,"5min":1.861,"15min":0.89900000000000002},"min":{"1min":0.32700000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":21.945,"5min":21.945,"15min":21.945},"last":0.378}]},{"osd":3,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":5.6120000000000001,"5min":1.4630000000000001,"15min":0.77100000000000002},"min":{"1min":0.30599999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":25.381,"5min":25.381,"15min":25.381},"last":0.47699999999999998},{"interface":"front","average":{"1min":8.2040000000000006,"5min":2.0129999999999999,"15min":0.98099999999999998},"min":{"1min":0.38900000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":21.209,"5min":21.209,"15min":21.209},"last":0.51700000000000002}]},{"osd":4,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":8.1859999999999999,"5min":2.1680000000000001,"15min":1.165},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":22.030000000000001,"5min":22.030000000000001,"15min":22.030000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":7.9889999999999999,"5min":2.113,"15min":1.1339999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":25.279,"5min":25.279,"15min":25.279},"last":0.83199999999999996}]},{"osd":5,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":7.1589999999999998,"5min":1.9690000000000001,"15min":1.1040000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":25.329999999999998,"5min":25.329999999999998,"15min":25.329999999999998},"last":0.94799999999999995},{"interface":"front","average":{"1min":7.4630000000000001,"5min":2.0110000000000001,"15min":1.103},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":28.928000000000001,"5min":28.928000000000001,"15min":28.928000000000001},"last":0.86099999999999999}]},{"osd":6,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":6.9420000000000002,"5min":1.8899999999999999,"15min":1.048},"min":{"1min":0.376,"5min":0.37,"15min":0.37},"max":{"1min":21.132000000000001,"5min":21.132000000000001,"15min":21.132000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":7.8250000000000002,"5min":2.0550000000000002,"15min":1.093},"min":{"1min":0.44400000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":22.007000000000001,"5min":22.007000000000001,"15min":22.007000000000001},"last":0.68400000000000005}]},{"osd":7,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":9.327,"5min":2.3700000000000001,"15min":1.21},"min":{"1min":0.47799999999999998,"5min":0.437,"15min":0.437},"max":{"1min":21.983000000000001,"5min":21.983000000000001,"15min":21.983000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":7.0700000000000003,"5min":1.9359999999999999,"15min":1.0800000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":25.356000000000002,"5min":25.356000000000002,"15min":25.356000000000002},"last":0.79600000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574881,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73544,"kb_used_data":55616,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94298296,"statfs":{"total":96636764160,"available":96561455104,"internally_reserved":0,"allocated":56950784,"data_stored":56761950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":2.8090000000000002,"5min":0.83899999999999997,"15min":0.51100000000000001},"min":{"1min":0.26400000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":10.821999999999999,"5min":10.821999999999999,"15min":10.821999999999999},"last":0.24199999999999999},{"interface":"front","average":{"1min":2.762,"5min":0.96099999999999997,"15min":0.66100000000000003},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":11.743,"5min":11.743,"15min":11.743},"last":0.32400000000000001}]},{"osd":1,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":2.4900000000000002,"5min":0.80600000000000005,"15min":0.52500000000000002},"min":{"1min":0.316,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":12.079000000000001,"5min":12.079000000000001,"15min":12.079000000000001},"last":0.27800000000000002},{"interface":"front","average":{"1min":3.9860000000000002,"5min":1.234,"15min":0.77600000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":19.954000000000001,"5min":19.954000000000001,"15min":19.954000000000001},"last":0.35599999999999998}]},{"osd":3,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":4.5510000000000002,"5min":1.214,"15min":0.65800000000000003},"min":{"1min":0.313,"5min":0.255,"15min":0.255},"max":{"1min":21.611000000000001,"5min":21.611000000000001,"15min":21.611000000000001},"last":0.26200000000000001},{"interface":"front","average":{"1min":3.4460000000000002,"5min":1.034,"15min":0.63200000000000001},"min":{"1min":0.34999999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":21.055,"5min":21.055,"15min":21.055},"last":0.308}]},{"osd":4,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":4.8609999999999998,"5min":1.4690000000000001,"15min":0.90400000000000003},"min":{"1min":0.39600000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":16.657,"5min":16.657,"15min":16.657},"last":0.52700000000000002},{"interface":"front","average":{"1min":4.1879999999999997,"5min":1.4319999999999999,"15min":0.97299999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":17.116,"5min":17.116,"15min":17.116},"last":0.51300000000000001}]},{"osd":5,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":5.6180000000000003,"5min":1.6100000000000001,"15min":0.94199999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":21.655000000000001,"5min":21.655000000000001,"15min":21.655000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":3.903,"5min":1.3,"15min":0.86599999999999999},"min":{"1min":0.42099999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":14.045999999999999,"5min":14.045999999999999,"15min":14.045999999999999},"last":0.46800000000000003}]},{"osd":6,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":4.8600000000000003,"5min":1.595,"15min":1.0509999999999999},"min":{"1min":0.48299999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":20.966999999999999,"5min":20.966999999999999,"15min":20.966999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":3.9710000000000001,"5min":1.2909999999999999,"15min":0.84499999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":15.119,"5min":15.119,"15min":15.119},"last":0.53900000000000003}]},{"osd":7,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":5.2690000000000001,"5min":1.6890000000000001,"15min":1.093},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":17.035,"5min":17.035,"15min":17.035},"last":0.47899999999999998},{"interface":"front","average":{"1min":5.0380000000000003,"5min":1.502,"15min":0.91200000000000003},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":18.611999999999998,"5min":18.611999999999998,"15min":18.611999999999998},"last":0.501}]}]},{"osd":3,"up_from":13,"seq":55834574880,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76620,"kb_used_data":58692,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94295220,"statfs":{"total":96636764160,"available":96558305280,"internally_reserved":0,"allocated":60100608,"data_stored":59907768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":4.7919999999999998,"5min":1.7130000000000001,"15min":1.2},"min":{"1min":0.25800000000000001,"5min":0.224,"15min":0.224},"max":{"1min":22.969000000000001,"5min":22.969000000000001,"15min":22.969000000000001},"last":0.317},{"interface":"front","average":{"1min":3.7040000000000002,"5min":1.4510000000000001,"15min":1.075},"min":{"1min":0.31,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":15.933999999999999,"5min":15.933999999999999,"15min":15.933999999999999},"last":0.28000000000000003}]},{"osd":1,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":3.2229999999999999,"5min":1.246,"15min":0.91600000000000004},"min":{"1min":0.28499999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":19.882000000000001,"5min":19.882000000000001,"15min":19.882000000000001},"last":0.29499999999999998},{"interface":"front","average":{"1min":3.5920000000000001,"5min":1.0569999999999999,"15min":0.63500000000000001},"min":{"1min":0.379,"5min":0.251,"15min":0.251},"max":{"1min":18.792000000000002,"5min":18.792000000000002,"15min":18.792000000000002},"last":0.22900000000000001}]},{"osd":2,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":5.7619999999999996,"5min":1.7709999999999999,"15min":1.1060000000000001},"min":{"1min":0.27200000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":22.922999999999998,"5min":22.922999999999998,"15min":22.922999999999998},"last":0.36399999999999999},{"interface":"front","average":{"1min":3.8540000000000001,"5min":2.3860000000000001,"15min":2.1419999999999999},"min":{"1min":0.318,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":19.645,"5min":22.919,"15min":22.919},"last":0.26200000000000001}]},{"osd":4,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":5.016,"5min":1.5069999999999999,"15min":0.92200000000000004},"min":{"1min":0.37,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":18.952000000000002,"5min":18.952000000000002,"15min":18.952000000000002},"last":0.48299999999999998},{"interface":"front","average":{"1min":6.4580000000000002,"5min":2.0539999999999998,"15min":1.3200000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":24.933,"5min":24.933,"15min":24.933},"last":0.49299999999999999}]},{"osd":5,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":5.4980000000000002,"5min":2.0209999999999999,"15min":1.4410000000000001},"min":{"1min":0.47699999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":20.056000000000001,"5min":20.056000000000001,"15min":20.056000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":5.3170000000000002,"5min":1.5649999999999999,"15min":0.93999999999999995},"min":{"1min":0.42399999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":16.013000000000002,"5min":16.013000000000002,"15min":16.013000000000002},"last":0.442}]},{"osd":6,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":4.3959999999999999,"5min":1.6759999999999999,"15min":1.222},"min":{"1min":0.433,"5min":0.379,"15min":0.379},"max":{"1min":13.986000000000001,"5min":13.986000000000001,"15min":13.986000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":4.9909999999999997,"5min":1.923,"15min":1.4119999999999999},"min":{"1min":0.43099999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":20.088000000000001,"5min":20.088000000000001,"15min":20.088000000000001},"last":0.40799999999999997}]},{"osd":7,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":5.7279999999999998,"5min":1.6639999999999999,"15min":0.98699999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":21.571000000000002,"5min":21.571000000000002,"15min":21.571000000000002},"last":0.39900000000000002},{"interface":"front","average":{"1min":4.6029999999999998,"5min":1.724,"15min":1.244},"min":{"1min":0.44400000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":13.922000000000001,"5min":13.922000000000001,"15min":13.922000000000001},"last":0.51000000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574881,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":103408,"kb_used_data":68264,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94268432,"statfs":{"total":96636764160,"available":96530874368,"internally_reserved":0,"allocated":69902336,"data_stored":69693188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:31:33 2023","interfaces":[{"interface":"back","average":{"1min":6.3440000000000003,"5min":1.663,"15min":0.88300000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":17.794,"5min":17.794,"15min":17.794},"last":0.438},{"interface":"front","average":{"1min":5.2089999999999996,"5min":1.448,"15min":0.82099999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":16.597999999999999,"5min":16.597999999999999,"15min":16.597999999999999},"last":0.504}]},{"osd":1,"last update":"Wed May 24 03:31:33 2023","interfaces":[{"interface":"back","average":{"1min":6.2549999999999999,"5min":1.6619999999999999,"15min":0.89600000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":22.933,"5min":22.933,"15min":22.933},"last":0.47699999999999998},{"interface":"front","average":{"1min":5.0650000000000004,"5min":1.4399999999999999,"15min":0.83599999999999997},"min":{"1min":0.35499999999999998,"5min":0.309,"15min":0.309},"max":{"1min":16.196000000000002,"5min":16.196000000000002,"15min":16.196000000000002},"last":0.55700000000000005}]},{"osd":2,"last update":"Wed May 24 03:31:33 2023","interfaces":[{"interface":"back","average":{"1min":5.0049999999999999,"5min":1.4119999999999999,"15min":0.81299999999999994},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":18.919,"5min":18.919,"15min":18.919},"last":0.40899999999999997},{"interface":"front","average":{"1min":5.391,"5min":1.4990000000000001,"15min":0.84999999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":16.277999999999999,"5min":16.277999999999999,"15min":16.277999999999999},"last":0.52600000000000002}]},{"osd":3,"last update":"Wed May 24 03:31:33 2023","interfaces":[{"interface":"back","average":{"1min":4.633,"5min":1.3169999999999999,"15min":0.76400000000000001},"min":{"1min":0.32000000000000001,"5min":0.312,"15min":0.312},"max":{"1min":18.956,"5min":18.956,"15min":18.956},"last":0.56999999999999995},{"interface":"front","average":{"1min":6.0899999999999999,"5min":1.651,"15min":0.91100000000000003},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":22.960000000000001,"5min":22.960000000000001,"15min":22.960000000000001},"last":0.42799999999999999}]},{"osd":5,"last update":"Wed May 24 03:31:33 2023","interfaces":[{"interface":"back","average":{"1min":4.0069999999999997,"5min":1.2230000000000001,"15min":0.75900000000000001},"min":{"1min":0.36199999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":16.231999999999999,"5min":16.231999999999999,"15min":16.231999999999999},"last":0.38900000000000001},{"interface":"front","average":{"1min":3.1560000000000001,"5min":1.0940000000000001,"15min":0.75},"min":{"1min":0.42399999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":11.904999999999999,"5min":11.904999999999999,"15min":11.904999999999999},"last":0.46100000000000002}]},{"osd":6,"last update":"Wed May 24 03:31:33 2023","interfaces":[{"interface":"back","average":{"1min":5.4790000000000001,"5min":1.492,"15min":0.82799999999999996},"min":{"1min":0.33400000000000002,"5min":0.315,"15min":0.315},"max":{"1min":22.983000000000001,"5min":22.983000000000001,"15min":22.983000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":3.2970000000000002,"5min":1.1100000000000001,"15min":0.746},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":12.367000000000001,"5min":12.367000000000001,"15min":12.367000000000001},"last":0.48699999999999999}]},{"osd":7,"last update":"Wed May 24 03:31:33 2023","interfaces":[{"interface":"back","average":{"1min":3.2090000000000001,"5min":1.085,"15min":0.73099999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":16.576000000000001,"5min":16.576000000000001,"15min":16.576000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":5.5149999999999997,"5min":1.5820000000000001,"15min":0.92600000000000005},"min":{"1min":0.432,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":22.882000000000001,"5min":22.882000000000001,"15min":22.882000000000001},"last":0.45200000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574880,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":83792,"kb_used_data":61768,"kb_used_omap":0,"kb_used_meta":22016,"kb_avail":94288048,"statfs":{"total":96636764160,"available":96550961152,"internally_reserved":0,"allocated":63250432,"data_stored":63054058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22544384},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,1,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:31:35 2023","interfaces":[{"interface":"back","average":{"1min":7.0830000000000002,"5min":1.831,"15min":0.95599999999999996},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":20.137,"5min":20.137,"15min":20.137},"last":0.93999999999999995},{"interface":"front","average":{"1min":6.6159999999999997,"5min":1.9019999999999999,"15min":1.1160000000000001},"min":{"1min":0.30499999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":25.988,"5min":25.988,"15min":25.988},"last":0.49199999999999999}]},{"osd":1,"last update":"Wed May 24 03:31:35 2023","interfaces":[{"interface":"back","average":{"1min":6.5759999999999996,"5min":1.748,"15min":0.94399999999999995},"min":{"1min":0.42799999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":22.765999999999998,"5min":22.765999999999998,"15min":22.765999999999998},"last":0.318},{"interface":"front","average":{"1min":7.2190000000000003,"5min":2.044,"15min":1.1819999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":20.161999999999999,"5min":20.161999999999999,"15min":20.161999999999999},"last":0.72999999999999998}]},{"osd":2,"last update":"Wed May 24 03:31:35 2023","interfaces":[{"interface":"back","average":{"1min":7.4820000000000002,"5min":1.929,"15min":1.0029999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":25.946000000000002,"5min":25.946000000000002,"15min":25.946000000000002},"last":0.71899999999999997},{"interface":"front","average":{"1min":5.6459999999999999,"5min":1.7490000000000001,"15min":1.099},"min":{"1min":0.45900000000000002,"5min":0.437,"15min":0.437},"max":{"1min":22.800000000000001,"5min":22.800000000000001,"15min":22.800000000000001},"last":1.0469999999999999}]},{"osd":3,"last update":"Wed May 24 03:31:35 2023","interfaces":[{"interface":"back","average":{"1min":6.093,"5min":1.9059999999999999,"15min":1.208},"min":{"1min":0.38600000000000001,"5min":0.375,"15min":0.375},"max":{"1min":26.013999999999999,"5min":26.013999999999999,"15min":26.013999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":6.2140000000000004,"5min":1.8959999999999999,"15min":1.1759999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":22.687999999999999,"5min":22.687999999999999,"15min":22.687999999999999},"last":0.42099999999999999}]},{"osd":4,"last update":"Wed May 24 03:31:35 2023","interfaces":[{"interface":"back","average":{"1min":5.6379999999999999,"5min":1.5289999999999999,"15min":0.84399999999999997},"min":{"1min":0.33500000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":19.998000000000001,"5min":19.998000000000001,"15min":19.998000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":4.3520000000000003,"5min":1.2929999999999999,"15min":0.78300000000000003},"min":{"1min":0.38800000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":17.628,"5min":17.628,"15min":17.628},"last":0.52500000000000002}]},{"osd":6,"last update":"Wed May 24 03:31:35 2023","interfaces":[{"interface":"back","average":{"1min":4.516,"5min":1.3420000000000001,"15min":0.81299999999999994},"min":{"1min":0.39600000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":19.969000000000001,"5min":19.969000000000001,"15min":19.969000000000001},"last":0.34899999999999998},{"interface":"front","average":{"1min":5.2229999999999999,"5min":1.4970000000000001,"15min":0.876},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":19.913,"5min":19.913,"15min":19.913},"last":1.117}]},{"osd":7,"last update":"Wed May 24 03:31:35 2023","interfaces":[{"interface":"back","average":{"1min":3.9180000000000001,"5min":1.274,"15min":0.83399999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":17.731000000000002,"5min":17.731000000000002,"15min":17.731000000000002},"last":0.55300000000000005},{"interface":"front","average":{"1min":4.2949999999999999,"5min":1.3620000000000001,"15min":0.873},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":20.099,"5min":20.099,"15min":20.099},"last":0.374}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":7026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1417216,"data_stored":1396902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1417216,"data_stored":1390618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":67633152,"data_stored":67633152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":78118912,"data_stored":78118912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":56623104,"data_stored":56623104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":59768832,"data_stored":59768832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":68157440,"data_stored":68157440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":62914560,"data_stored":62914560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":63438848,"data_stored":63438848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":67633152,"data_stored":67633152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-24T03:32:02.740 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-24T03:32:02.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.889+0000 7f58bcef7700 1 Processor -- start 2023-05-24T03:32:02.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.889+0000 7f58bcef7700 1 -- start start 2023-05-24T03:32:02.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.889+0000 7f58bcef7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f58b815a9c0 0x7f58b80b52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:02.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.889+0000 7f58bcef7700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58b8071e30 0x7f58b806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:02.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.890+0000 7f58bcef7700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58b80cb740 con 0x7f58b80cc500 2023-05-24T03:32:02.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.890+0000 7f58bcef7700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58b80cba20 con 0x7f58b815a9c0 2023-05-24T03:32:02.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.890+0000 7f58bcef7700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58b80cbd00 con 0x7f58b8071e30 2023-05-24T03:32:02.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.890+0000 7f58b659c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f58b815a9c0 0x7f58b80b52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:02.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.890+0000 7f58b659c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f58b815a9c0 0x7f58b80b52e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40496/0 (socket says 172.21.15.146:40496) 2023-05-24T03:32:02.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.890+0000 7f58b659c700 1 -- 172.21.15.146:0/2032429115 learned_addr learned my addr 172.21.15.146:0/2032429115 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:32:02.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.890+0000 7f58b6d9d700 1 --2- 172.21.15.146:0/2032429115 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58b8071e30 0x7f58b806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:02.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.890+0000 7f58b659c700 1 -- 172.21.15.146:0/2032429115 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58b8071e30 msgr2=0x7f58b806d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:32:02.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.890+0000 7f58b659c700 1 --2- 172.21.15.146:0/2032429115 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58b8071e30 0x7f58b806d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:02.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.890+0000 7f58b659c700 1 -- 172.21.15.146:0/2032429115 >> v1:172.21.15.151:6789/0 conn(0x7f58b80cc500 legacy=0x7f58b8071720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:02.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.890+0000 7f58b659c700 1 -- 172.21.15.146:0/2032429115 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b80cbfe0 con 0x7f58b815a9c0 2023-05-24T03:32:02.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.890+0000 7f58b659c700 1 --2- 172.21.15.146:0/2032429115 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58b815a9c0 0x7f58b80b52e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f58ac0098f0 tx=0x7f58ac009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2be4327575c966c9 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:02.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.890+0000 7f58b559a700 1 -- 172.21.15.146:0/2032429115 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58ac00b8a0 con 0x7f58b815a9c0 2023-05-24T03:32:02.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.890+0000 7f58b559a700 1 -- 172.21.15.146:0/2032429115 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58ac00ba00 con 0x7f58b815a9c0 2023-05-24T03:32:02.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.890+0000 7f58b559a700 1 -- 172.21.15.146:0/2032429115 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58ac00bd90 con 0x7f58b815a9c0 2023-05-24T03:32:02.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.891+0000 7f58bcef7700 1 -- 172.21.15.146:0/2032429115 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58b815a9c0 msgr2=0x7f58b80b52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:02.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.891+0000 7f58bcef7700 1 --2- 172.21.15.146:0/2032429115 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58b815a9c0 0x7f58b80b52e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f58ac0098f0 tx=0x7f58ac009c00 comp rx=0 tx=0).stop 2023-05-24T03:32:02.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.891+0000 7f58bcef7700 1 -- 172.21.15.146:0/2032429115 shutdown_connections 2023-05-24T03:32:02.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.891+0000 7f58bcef7700 1 --2- 172.21.15.146:0/2032429115 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58b8071e30 0x7f58b806d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:02.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.891+0000 7f58bcef7700 1 --2- 172.21.15.146:0/2032429115 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58b815a9c0 0x7f58b80b52e0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:02.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.891+0000 7f58bcef7700 1 -- 172.21.15.146:0/2032429115 >> 172.21.15.146:0/2032429115 conn(0x7f58b80cfea0 msgr2=0x7f58b80d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:32:02.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.891+0000 7f58bcef7700 1 -- 172.21.15.146:0/2032429115 shutdown_connections 2023-05-24T03:32:02.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.891+0000 7f58bcef7700 1 -- 172.21.15.146:0/2032429115 wait complete. 2023-05-24T03:32:02.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.892+0000 7f58bcef7700 1 Processor -- start 2023-05-24T03:32:02.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.892+0000 7f58bcef7700 1 -- start start 2023-05-24T03:32:02.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.893+0000 7f58bcef7700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58b8071e30 0x7f58b80b1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:02.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.893+0000 7f58bcef7700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58b80cc500 0x7f58b81f33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:02.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.893+0000 7f58bcef7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58b815a9c0 0x7f58b80b18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:02.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.893+0000 7f58bcef7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b815b300 con 0x7f58b815a9c0 2023-05-24T03:32:02.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.893+0000 7f58bcef7700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b81f3be0 con 0x7f58b80cc500 2023-05-24T03:32:02.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.893+0000 7f58bcef7700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58b81f3ec0 con 0x7f58b8071e30 2023-05-24T03:32:02.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.893+0000 7f58b6d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58b815a9c0 0x7f58b80b18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:02.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.893+0000 7f58b6d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58b815a9c0 0x7f58b80b18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40504/0 (socket says 172.21.15.146:40504) 2023-05-24T03:32:02.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.893+0000 7f58b6d9d700 1 -- 172.21.15.146:0/2123655140 learned_addr learned my addr 172.21.15.146:0/2123655140 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:32:02.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.893+0000 7f58b659c700 1 --2- 172.21.15.146:0/2123655140 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58b8071e30 0x7f58b80b1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:02.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.893+0000 7f58b5d9b700 1 --2- 172.21.15.146:0/2123655140 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58b80cc500 0x7f58b81f33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:02.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.893+0000 7f58b6d9d700 1 -- 172.21.15.146:0/2123655140 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58b8071e30 msgr2=0x7f58b80b1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:02.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.893+0000 7f58b6d9d700 1 --2- 172.21.15.146:0/2123655140 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58b8071e30 0x7f58b80b1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:02.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.893+0000 7f58b6d9d700 1 -- 172.21.15.146:0/2123655140 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58b80cc500 msgr2=0x7f58b81f33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:02.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.893+0000 7f58b6d9d700 1 --2- 172.21.15.146:0/2123655140 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58b80cc500 0x7f58b81f33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:02.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.893+0000 7f58b6d9d700 1 -- 172.21.15.146:0/2123655140 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58ac009550 con 0x7f58b815a9c0 2023-05-24T03:32:02.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.893+0000 7f58b659c700 1 --2- 172.21.15.146:0/2123655140 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58b8071e30 0x7f58b80b1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:32:02.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.893+0000 7f58b6d9d700 1 --2- 172.21.15.146:0/2123655140 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58b815a9c0 0x7f58b80b18b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f58b0007e30 tx=0x7f58b000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:02.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.894+0000 7f58a6ffd700 1 -- 172.21.15.146:0/2123655140 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b000ede0 con 0x7f58b815a9c0 2023-05-24T03:32:02.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.894+0000 7f58a6ffd700 1 -- 172.21.15.146:0/2123655140 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b0014420 con 0x7f58b815a9c0 2023-05-24T03:32:02.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.894+0000 7f58bcef7700 1 -- 172.21.15.146:0/2123655140 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58b80b5da0 con 0x7f58b815a9c0 2023-05-24T03:32:02.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.894+0000 7f58a6ffd700 1 -- 172.21.15.146:0/2123655140 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b00147d0 con 0x7f58b815a9c0 2023-05-24T03:32:02.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.894+0000 7f58bcef7700 1 -- 172.21.15.146:0/2123655140 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58b815ad90 con 0x7f58b815a9c0 2023-05-24T03:32:02.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.895+0000 7f58bcef7700 1 -- 172.21.15.146:0/2123655140 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58b815b440 con 0x7f58b815a9c0 2023-05-24T03:32:02.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.895+0000 7f58a6ffd700 1 -- 172.21.15.146:0/2123655140 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f58b0014930 con 0x7f58b815a9c0 2023-05-24T03:32:02.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.895+0000 7f58a6ffd700 1 --2- 172.21.15.146:0/2123655140 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f589806ace0 0x7f589806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:02.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.896+0000 7f58a6ffd700 1 -- 172.21.15.146:0/2123655140 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f58b0089ed0 con 0x7f58b815a9c0 2023-05-24T03:32:02.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.896+0000 7f58b659c700 1 --2- 172.21.15.146:0/2123655140 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f589806ace0 0x7f589806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:02.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.896+0000 7f58b659c700 1 --2- 172.21.15.146:0/2123655140 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f589806ace0 0x7f589806d190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f58ac014040 tx=0x7f58ac008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:02.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:02.900+0000 7f58a6ffd700 1 -- 172.21.15.146:0/2123655140 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f58b815b440 con 0x7f58b815a9c0 2023-05-24T03:32:03.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:03.092+0000 7f58bcef7700 1 -- 172.21.15.146:0/2123655140 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f58b815b440 con 0x7f58b815a9c0 2023-05-24T03:32:03.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:03.093+0000 7f58a6ffd700 1 -- 172.21.15.146:0/2123655140 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20251 (secure 0 0 0) 0x7f58b815b440 con 0x7f58b815a9c0 2023-05-24T03:32:03.098 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:32:03.098 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":30,"fsid":"11ca0adb-7672-4713-bde7-451e8b743ae9","created":"2023-05-24T03:29:19.113659+0000","modified":"2023-05-24T03:30:25.932188+0000","last_up_change":"2023-05-24T03:29:30.962339+0000","last_in_change":"2023-05-24T03:29:21.706540+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-24T03:29:32.749984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-24T03:29:37.719623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-24T03:29:42.165379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-24T03:29:43.431615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-24T03:29:46.503075+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f24b319b-fcc8-4385-b0cb-78138fc31417","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6801","nonce":3353593100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6803","nonce":3353593100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6807","nonce":3353593100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6805","nonce":3353593100}]},"public_addr":"172.21.15.146:6801/3353593100","cluster_addr":"172.21.15.146:6803/3353593100","heartbeat_back_addr":"172.21.15.146:6807/3353593100","heartbeat_front_addr":"172.21.15.146:6805/3353593100","state":["exists","up"]},{"osd":1,"uuid":"c9639ea9-8f9b-498e-92c8-aa976edbf1da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6821","nonce":2537488734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6825","nonce":2537488734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6831","nonce":2537488734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6827","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6829","nonce":2537488734}]},"public_addr":"172.21.15.146:6821/2537488734","cluster_addr":"172.21.15.146:6825/2537488734","heartbeat_back_addr":"172.21.15.146:6831/2537488734","heartbeat_front_addr":"172.21.15.146:6829/2537488734","state":["exists","up"]},{"osd":2,"uuid":"7a6cfc6d-b0ca-4cb6-a66d-4001ec184657","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6809","nonce":1800242932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6811","nonce":1800242932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6815","nonce":1800242932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6813","nonce":1800242932}]},"public_addr":"172.21.15.146:6809/1800242932","cluster_addr":"172.21.15.146:6811/1800242932","heartbeat_back_addr":"172.21.15.146:6815/1800242932","heartbeat_front_addr":"172.21.15.146:6813/1800242932","state":["exists","up"]},{"osd":3,"uuid":"401509f7-cecd-44a2-b0ae-22c81a5d93c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6817","nonce":1749783580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6820","nonce":1749783580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6828","nonce":1749783580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6824","nonce":1749783580}]},"public_addr":"172.21.15.146:6817/1749783580","cluster_addr":"172.21.15.146:6820/1749783580","heartbeat_back_addr":"172.21.15.146:6828/1749783580","heartbeat_front_addr":"172.21.15.146:6824/1749783580","state":["exists","up"]},{"osd":4,"uuid":"9d07f440-d125-4f99-a825-411fab894d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6811","nonce":163453435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6814","nonce":163453435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6819","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6821","nonce":163453435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6818","nonce":163453435}]},"public_addr":"172.21.15.151:6811/163453435","cluster_addr":"172.21.15.151:6814/163453435","heartbeat_back_addr":"172.21.15.151:6821/163453435","heartbeat_front_addr":"172.21.15.151:6818/163453435","state":["exists","up"]},{"osd":5,"uuid":"9b2266e2-9e52-4f0e-96da-e703a6c23a6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6801","nonce":3283474903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6803","nonce":3283474903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6807","nonce":3283474903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6805","nonce":3283474903}]},"public_addr":"172.21.15.151:6801/3283474903","cluster_addr":"172.21.15.151:6803/3283474903","heartbeat_back_addr":"172.21.15.151:6807/3283474903","heartbeat_front_addr":"172.21.15.151:6805/3283474903","state":["exists","up"]},{"osd":6,"uuid":"5daedf77-0a83-49e7-b497-d9ed10436972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6825","nonce":3889424178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6827","nonce":3889424178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6831","nonce":3889424178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6829","nonce":3889424178}]},"public_addr":"172.21.15.151:6825/3889424178","cluster_addr":"172.21.15.151:6827/3889424178","heartbeat_back_addr":"172.21.15.151:6831/3889424178","heartbeat_front_addr":"172.21.15.151:6829/3889424178","state":["exists","up"]},{"osd":7,"uuid":"86ae4f7e-c01f-4c3d-a0dd-98160c209309","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6810","nonce":563291208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6815","nonce":563291208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6823","nonce":563291208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6820","nonce":563291208}]},"public_addr":"172.21.15.151:6810/563291208","cluster_addr":"172.21.15.151:6815/563291208","heartbeat_back_addr":"172.21.15.151:6823/563291208","heartbeat_front_addr":"172.21.15.151:6820/563291208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.872472+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.937126+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.877234+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.884793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.881632+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.938293+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.857661+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.945883+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.9","mappings":[{"from":1,"to":5}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-24T03:32:03.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:03.095+0000 7f58bcef7700 1 -- 172.21.15.146:0/2123655140 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f589806ace0 msgr2=0x7f589806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:03.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:03.095+0000 7f58bcef7700 1 --2- 172.21.15.146:0/2123655140 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f589806ace0 0x7f589806d190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f58ac014040 tx=0x7f58ac008030 comp rx=0 tx=0).stop 2023-05-24T03:32:03.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:03.095+0000 7f58bcef7700 1 -- 172.21.15.146:0/2123655140 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58b815a9c0 msgr2=0x7f58b80b18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:03.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:03.095+0000 7f58bcef7700 1 --2- 172.21.15.146:0/2123655140 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58b815a9c0 0x7f58b80b18b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f58b0007e30 tx=0x7f58b000e3c0 comp rx=0 tx=0).stop 2023-05-24T03:32:03.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:03.095+0000 7f58bcef7700 1 -- 172.21.15.146:0/2123655140 shutdown_connections 2023-05-24T03:32:03.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:03.095+0000 7f58bcef7700 1 --2- 172.21.15.146:0/2123655140 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f589806ace0 0x7f589806d190 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:03.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:03.095+0000 7f58bcef7700 1 --2- 172.21.15.146:0/2123655140 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58b815a9c0 0x7f58b80b18b0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:03.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:03.095+0000 7f58bcef7700 1 --2- 172.21.15.146:0/2123655140 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58b8071e30 0x7f58b80b1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:03.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:03.095+0000 7f58bcef7700 1 --2- 172.21.15.146:0/2123655140 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58b80cc500 0x7f58b81f33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:03.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:03.095+0000 7f58bcef7700 1 -- 172.21.15.146:0/2123655140 >> 172.21.15.146:0/2123655140 conn(0x7f58b80cfea0 msgr2=0x7f58b80d0270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:32:03.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:03.095+0000 7f58bcef7700 1 -- 172.21.15.146:0/2123655140 shutdown_connections 2023-05-24T03:32:03.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:03.095+0000 7f58bcef7700 1 -- 172.21.15.146:0/2123655140 wait complete. 2023-05-24T03:32:04.113 INFO:tasks.ceph:Scrubbing osd.0 2023-05-24T03:32:04.114 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-05-24T03:32:04.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.250+0000 7f4e260dd700 1 Processor -- start 2023-05-24T03:32:04.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.250+0000 7f4e260dd700 1 -- start start 2023-05-24T03:32:04.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.251+0000 7f4e260dd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e2015cf60 0x7f4e200b2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:04.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.251+0000 7f4e260dd700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4e200cda40 0x7f4e200cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:04.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.251+0000 7f4e260dd700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e200cd110 con 0x7f4e20160aa0 2023-05-24T03:32:04.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.251+0000 7f4e260dd700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e200b3240 con 0x7f4e200cda40 2023-05-24T03:32:04.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.251+0000 7f4e260dd700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2006d620 con 0x7f4e2015cf60 2023-05-24T03:32:04.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.252+0000 7f4e1f7fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e2015cf60 0x7f4e200b2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:04.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.252+0000 7f4e1effd700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4e200cda40 0x7f4e200cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:04.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.252+0000 7f4e1f7fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e2015cf60 0x7f4e200b2d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:53374/0 (socket says 172.21.15.146:53374) 2023-05-24T03:32:04.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.252+0000 7f4e1f7fe700 1 -- 172.21.15.146:0/1188867955 learned_addr learned my addr 172.21.15.146:0/1188867955 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:32:04.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.252+0000 7f4e1ffff700 1 --1- 172.21.15.146:0/1188867955 >> v1:172.21.15.151:6789/0 conn(0x7f4e20160aa0 0x7f4e20160ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:46000/0 (socket says 172.21.15.146:46000) 2023-05-24T03:32:04.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.252+0000 7f4e1f7fe700 1 -- 172.21.15.146:0/1188867955 >> v2:172.21.15.151:3300/0 conn(0x7f4e200cda40 msgr2=0x7f4e200cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:32:04.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.252+0000 7f4e1f7fe700 1 --2- 172.21.15.146:0/1188867955 >> v2:172.21.15.151:3300/0 conn(0x7f4e200cda40 0x7f4e200cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:04.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.252+0000 7f4e1f7fe700 1 -- 172.21.15.146:0/1188867955 >> v1:172.21.15.151:6789/0 conn(0x7f4e20160aa0 legacy=0x7f4e20160ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:04.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.252+0000 7f4e1f7fe700 1 -- 172.21.15.146:0/1188867955 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e2015d330 con 0x7f4e2015cf60 2023-05-24T03:32:04.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.252+0000 7f4e1effd700 1 --2- 172.21.15.146:0/1188867955 >> v2:172.21.15.151:3300/0 conn(0x7f4e200cda40 0x7f4e200cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T03:32:04.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.252+0000 7f4e1f7fe700 1 --2- 172.21.15.146:0/1188867955 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e2015cf60 0x7f4e200b2d00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4e140098f0 tx=0x7f4e14009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34c4173d9893e9b3 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:04.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.252+0000 7f4e1e7fc700 1 -- 172.21.15.146:0/1188867955 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e14011830 con 0x7f4e2015cf60 2023-05-24T03:32:04.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.252+0000 7f4e1e7fc700 1 -- 172.21.15.146:0/1188867955 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e14011990 con 0x7f4e2015cf60 2023-05-24T03:32:04.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.252+0000 7f4e1e7fc700 1 -- 172.21.15.146:0/1188867955 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e14011d20 con 0x7f4e2015cf60 2023-05-24T03:32:04.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.253+0000 7f4e260dd700 1 -- 172.21.15.146:0/1188867955 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e2015cf60 msgr2=0x7f4e200b2d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:04.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.253+0000 7f4e260dd700 1 --2- 172.21.15.146:0/1188867955 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e2015cf60 0x7f4e200b2d00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4e140098f0 tx=0x7f4e14009c00 comp rx=0 tx=0).stop 2023-05-24T03:32:04.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.253+0000 7f4e260dd700 1 -- 172.21.15.146:0/1188867955 shutdown_connections 2023-05-24T03:32:04.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.253+0000 7f4e260dd700 1 --2- 172.21.15.146:0/1188867955 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e2015cf60 0x7f4e200b2d00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:04.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.253+0000 7f4e260dd700 1 --2- 172.21.15.146:0/1188867955 >> v2:172.21.15.151:3300/0 conn(0x7f4e200cda40 0x7f4e200cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:04.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.253+0000 7f4e260dd700 1 -- 172.21.15.146:0/1188867955 >> 172.21.15.146:0/1188867955 conn(0x7f4e2006e2a0 msgr2=0x7f4e2006e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:32:04.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.253+0000 7f4e260dd700 1 -- 172.21.15.146:0/1188867955 shutdown_connections 2023-05-24T03:32:04.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.253+0000 7f4e260dd700 1 -- 172.21.15.146:0/1188867955 wait complete. 2023-05-24T03:32:04.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.254+0000 7f4e260dd700 1 Processor -- start 2023-05-24T03:32:04.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.254+0000 7f4e260dd700 1 -- start start 2023-05-24T03:32:04.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.255+0000 7f4e260dd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e200cda40 0x7f4e200c5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:04.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.255+0000 7f4e260dd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e2015cf60 0x7f4e201f2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:04.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.255+0000 7f4e260dd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e20160aa0 0x7f4e200c78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:04.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.255+0000 7f4e260dd700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e201f33c0 con 0x7f4e20160aa0 2023-05-24T03:32:04.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.255+0000 7f4e260dd700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e20153b20 con 0x7f4e200cda40 2023-05-24T03:32:04.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.255+0000 7f4e260dd700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e200c7e20 con 0x7f4e2015cf60 2023-05-24T03:32:04.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.255+0000 7f4e1ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e20160aa0 0x7f4e200c78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:04.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.255+0000 7f4e1ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e20160aa0 0x7f4e200c78e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40520/0 (socket says 172.21.15.146:40520) 2023-05-24T03:32:04.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.255+0000 7f4e1ffff700 1 -- 172.21.15.146:0/3450256230 learned_addr learned my addr 172.21.15.146:0/3450256230 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:32:04.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.255+0000 7f4e1effd700 1 --2- 172.21.15.146:0/3450256230 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e2015cf60 0x7f4e201f2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:04.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.255+0000 7f4e1f7fe700 1 --2- 172.21.15.146:0/3450256230 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e200cda40 0x7f4e200c5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:04.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.256+0000 7f4e1ffff700 1 -- 172.21.15.146:0/3450256230 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e2015cf60 msgr2=0x7f4e201f2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:04.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.256+0000 7f4e1ffff700 1 --2- 172.21.15.146:0/3450256230 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e2015cf60 0x7f4e201f2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:04.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.256+0000 7f4e1ffff700 1 -- 172.21.15.146:0/3450256230 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e200cda40 msgr2=0x7f4e200c5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:04.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.256+0000 7f4e1ffff700 1 --2- 172.21.15.146:0/3450256230 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e200cda40 0x7f4e200c5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:04.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.256+0000 7f4e1ffff700 1 -- 172.21.15.146:0/3450256230 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e100094a0 con 0x7f4e20160aa0 2023-05-24T03:32:04.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.256+0000 7f4e1ffff700 1 --2- 172.21.15.146:0/3450256230 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e20160aa0 0x7f4e200c78e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4e1800cbc0 tx=0x7f4e1800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:04.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.256+0000 7f4e07fff700 1 -- 172.21.15.146:0/3450256230 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1800a9e0 con 0x7f4e20160aa0 2023-05-24T03:32:04.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.256+0000 7f4e07fff700 1 -- 172.21.15.146:0/3450256230 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e1800ab40 con 0x7f4e20160aa0 2023-05-24T03:32:04.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.256+0000 7f4e260dd700 1 -- 172.21.15.146:0/3450256230 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e14009550 con 0x7f4e20160aa0 2023-05-24T03:32:04.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.256+0000 7f4e07fff700 1 -- 172.21.15.146:0/3450256230 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e18007070 con 0x7f4e20160aa0 2023-05-24T03:32:04.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.256+0000 7f4e260dd700 1 -- 172.21.15.146:0/3450256230 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e2006c120 con 0x7f4e20160aa0 2023-05-24T03:32:04.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.257+0000 7f4e260dd700 1 -- 172.21.15.146:0/3450256230 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4e2006d340 con 0x7f4e20160aa0 2023-05-24T03:32:04.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.258+0000 7f4e07fff700 1 -- 172.21.15.146:0/3450256230 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4e180071d0 con 0x7f4e20160aa0 2023-05-24T03:32:04.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.258+0000 7f4e07fff700 1 --2- 172.21.15.146:0/3450256230 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f4e0c06ace0 0x7f4e0c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:04.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.258+0000 7f4e07fff700 1 -- 172.21.15.146:0/3450256230 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4e18089b70 con 0x7f4e20160aa0 2023-05-24T03:32:04.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.258+0000 7f4e1f7fe700 1 --2- 172.21.15.146:0/3450256230 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f4e0c06ace0 0x7f4e0c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:04.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.258+0000 7f4e07fff700 1 --2- 172.21.15.146:0/3450256230 >> [v2:172.21.15.146:6800/3353593100,v1:172.21.15.146:6801/3353593100] conn(0x7f4e0c0749f0 0x7f4e0c076e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:04.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.258+0000 7f4e07fff700 1 -- 172.21.15.146:0/3450256230 --> [v2:172.21.15.146:6800/3353593100,v1:172.21.15.146:6801/3353593100] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4e0c077530 con 0x7f4e0c0749f0 2023-05-24T03:32:04.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.258+0000 7f4e07fff700 1 -- 172.21.15.146:0/3450256230 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4e18089fc0 con 0x7f4e20160aa0 2023-05-24T03:32:04.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.258+0000 7f4e1effd700 1 --2- 172.21.15.146:0/3450256230 >> [v2:172.21.15.146:6800/3353593100,v1:172.21.15.146:6801/3353593100] conn(0x7f4e0c0749f0 0x7f4e0c076e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:04.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.259+0000 7f4e1f7fe700 1 --2- 172.21.15.146:0/3450256230 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f4e0c06ace0 0x7f4e0c06d190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4e14009c40 tx=0x7f4e14008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:04.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.259+0000 7f4e1effd700 1 --2- 172.21.15.146:0/3450256230 >> [v2:172.21.15.146:6800/3353593100,v1:172.21.15.146:6801/3353593100] conn(0x7f4e0c0749f0 0x7f4e0c076e60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:04.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.259+0000 7f4e07fff700 1 -- 172.21.15.146:0/3450256230 <== osd.0 v2:172.21.15.146:6800/3353593100 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f4e0c077530 con 0x7f4e0c0749f0 2023-05-24T03:32:04.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.273+0000 7f4e260dd700 1 -- 172.21.15.146:0/3450256230 --> [v2:172.21.15.146:6800/3353593100,v1:172.21.15.146:6801/3353593100] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4e2006c400 con 0x7f4e0c0749f0 2023-05-24T03:32:04.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.274+0000 7f4e07fff700 1 -- 172.21.15.146:0/3450256230 <== osd.0 v2:172.21.15.146:6800/3353593100 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f4e2006c400 con 0x7f4e0c0749f0 2023-05-24T03:32:04.279 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-05-24T03:32:04.279 INFO:teuthology.orchestra.run.smithi146.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-05-24T03:32:04.279 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-05-24T03:32:04.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.274+0000 7f4e260dd700 1 -- 172.21.15.146:0/3450256230 >> [v2:172.21.15.146:6800/3353593100,v1:172.21.15.146:6801/3353593100] conn(0x7f4e0c0749f0 msgr2=0x7f4e0c076e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:04.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.274+0000 7f4e260dd700 1 --2- 172.21.15.146:0/3450256230 >> [v2:172.21.15.146:6800/3353593100,v1:172.21.15.146:6801/3353593100] conn(0x7f4e0c0749f0 0x7f4e0c076e60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:04.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.274+0000 7f4e260dd700 1 -- 172.21.15.146:0/3450256230 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f4e0c06ace0 msgr2=0x7f4e0c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:04.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.274+0000 7f4e260dd700 1 --2- 172.21.15.146:0/3450256230 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f4e0c06ace0 0x7f4e0c06d190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4e14009c40 tx=0x7f4e14008030 comp rx=0 tx=0).stop 2023-05-24T03:32:04.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.274+0000 7f4e260dd700 1 -- 172.21.15.146:0/3450256230 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e20160aa0 msgr2=0x7f4e200c78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:04.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.274+0000 7f4e260dd700 1 --2- 172.21.15.146:0/3450256230 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e20160aa0 0x7f4e200c78e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4e1800cbc0 tx=0x7f4e1800ced0 comp rx=0 tx=0).stop 2023-05-24T03:32:04.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.274+0000 7f4e1ffff700 1 -- 172.21.15.146:0/3450256230 reap_dead start 2023-05-24T03:32:04.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.274+0000 7f4e260dd700 1 -- 172.21.15.146:0/3450256230 shutdown_connections 2023-05-24T03:32:04.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.274+0000 7f4e260dd700 1 -- 172.21.15.146:0/3450256230 >> 172.21.15.146:0/3450256230 conn(0x7f4e2006e2a0 msgr2=0x7f4e2006b790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:32:04.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.274+0000 7f4e260dd700 1 -- 172.21.15.146:0/3450256230 shutdown_connections 2023-05-24T03:32:04.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.274+0000 7f4e260dd700 1 -- 172.21.15.146:0/3450256230 wait complete. 2023-05-24T03:32:04.291 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-05-24T03:32:04.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.409+0000 7f0823219700 1 Processor -- start 2023-05-24T03:32:04.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.409+0000 7f0823219700 1 -- start start 2023-05-24T03:32:04.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.410+0000 7f0823219700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f081c0cb8c0 0x7f081c161030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:04.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.410+0000 7f0823219700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f081c0cc1d0 0x7f081c0b1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:04.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.410+0000 7f0823219700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f081c0cbc90 0x7f081c06a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:04.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.410+0000 7f0823219700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f081c0b27e0 con 0x7f081c0cbc90 2023-05-24T03:32:04.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.410+0000 7f0823219700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f081c0b2220 con 0x7f081c0cc1d0 2023-05-24T03:32:04.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.410+0000 7f0823219700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f081c0b2500 con 0x7f081c0cb8c0 2023-05-24T03:32:04.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.410+0000 7f08217b6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f081c0cbc90 0x7f081c06a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:04.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.410+0000 7f08217b6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f081c0cbc90 0x7f081c06a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40530/0 (socket says 172.21.15.146:40530) 2023-05-24T03:32:04.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.410+0000 7f08217b6700 1 -- 172.21.15.146:0/3975853042 learned_addr learned my addr 172.21.15.146:0/3975853042 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:32:04.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.410+0000 7f081bfff700 1 --2- 172.21.15.146:0/3975853042 >> v2:172.21.15.151:3300/0 conn(0x7f081c0cc1d0 0x7f081c0b1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:04.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.410+0000 7f0820fb5700 1 --2- 172.21.15.146:0/3975853042 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f081c0cb8c0 0x7f081c161030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:04.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.410+0000 7f08217b6700 1 -- 172.21.15.146:0/3975853042 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f081c0cb8c0 msgr2=0x7f081c161030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:32:04.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.410+0000 7f08217b6700 1 --2- 172.21.15.146:0/3975853042 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f081c0cb8c0 0x7f081c161030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:04.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.410+0000 7f08217b6700 1 -- 172.21.15.146:0/3975853042 >> v2:172.21.15.151:3300/0 conn(0x7f081c0cc1d0 msgr2=0x7f081c0b1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:32:04.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.410+0000 7f08217b6700 1 --2- 172.21.15.146:0/3975853042 >> v2:172.21.15.151:3300/0 conn(0x7f081c0cc1d0 0x7f081c0b1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:04.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.410+0000 7f08217b6700 1 -- 172.21.15.146:0/3975853042 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f081c160830 con 0x7f081c0cbc90 2023-05-24T03:32:04.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.410+0000 7f08217b6700 1 --2- 172.21.15.146:0/3975853042 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f081c0cbc90 0x7f081c06a460 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f081c070d40 tx=0x7f081400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37a4d5d7ef1414d0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:04.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.410+0000 7f081b7fe700 1 -- 172.21.15.146:0/3975853042 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081400e070 con 0x7f081c0cbc90 2023-05-24T03:32:04.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.410+0000 7f081b7fe700 1 -- 172.21.15.146:0/3975853042 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f081400b910 con 0x7f081c0cbc90 2023-05-24T03:32:04.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.410+0000 7f081b7fe700 1 -- 172.21.15.146:0/3975853042 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081400bcc0 con 0x7f081c0cbc90 2023-05-24T03:32:04.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.411+0000 7f0823219700 1 -- 172.21.15.146:0/3975853042 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f081c0cbc90 msgr2=0x7f081c06a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:04.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.411+0000 7f0823219700 1 --2- 172.21.15.146:0/3975853042 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f081c0cbc90 0x7f081c06a460 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f081c070d40 tx=0x7f081400b330 comp rx=0 tx=0).stop 2023-05-24T03:32:04.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.411+0000 7f0823219700 1 -- 172.21.15.146:0/3975853042 shutdown_connections 2023-05-24T03:32:04.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.411+0000 7f0823219700 1 --2- 172.21.15.146:0/3975853042 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f081c0cbc90 0x7f081c06a460 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:04.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.411+0000 7f0823219700 1 --2- 172.21.15.146:0/3975853042 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f081c0cb8c0 0x7f081c161030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:04.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.411+0000 7f0823219700 1 --2- 172.21.15.146:0/3975853042 >> v2:172.21.15.151:3300/0 conn(0x7f081c0cc1d0 0x7f081c0b1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:04.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.411+0000 7f0823219700 1 -- 172.21.15.146:0/3975853042 >> 172.21.15.146:0/3975853042 conn(0x7f081c0cfea0 msgr2=0x7f081c0d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:32:04.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.411+0000 7f0823219700 1 -- 172.21.15.146:0/3975853042 shutdown_connections 2023-05-24T03:32:04.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.411+0000 7f0823219700 1 -- 172.21.15.146:0/3975853042 wait complete. 2023-05-24T03:32:04.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.412+0000 7f0823219700 1 Processor -- start 2023-05-24T03:32:04.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.412+0000 7f0823219700 1 -- start start 2023-05-24T03:32:04.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.413+0000 7f0823219700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f081c0cb8c0 0x7f081c1f2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:04.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.413+0000 7f0823219700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f081c0cbc90 0x7f081c1f3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:04.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.413+0000 7f0823219700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f081c0cc1d0 0x7f081c15a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:04.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.413+0000 7f0823219700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f081c15aee0 con 0x7f081c0cb8c0 2023-05-24T03:32:04.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.413+0000 7f0823219700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f081c0add90 con 0x7f081c0cc1d0 2023-05-24T03:32:04.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.413+0000 7f0823219700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f081c0c9530 con 0x7f081c0cbc90 2023-05-24T03:32:04.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.413+0000 7f0820fb5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f081c0cb8c0 0x7f081c1f2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:04.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.413+0000 7f0820fb5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f081c0cb8c0 0x7f081c1f2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40532/0 (socket says 172.21.15.146:40532) 2023-05-24T03:32:04.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.413+0000 7f0820fb5700 1 -- 172.21.15.146:0/3818422830 learned_addr learned my addr 172.21.15.146:0/3818422830 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:32:04.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.413+0000 7f08217b6700 1 --2- 172.21.15.146:0/3818422830 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f081c0cc1d0 0x7f081c15a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:04.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.413+0000 7f081bfff700 1 --2- 172.21.15.146:0/3818422830 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f081c0cbc90 0x7f081c1f3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:04.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.413+0000 7f0820fb5700 1 -- 172.21.15.146:0/3818422830 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f081c0cbc90 msgr2=0x7f081c1f3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:04.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.413+0000 7f0820fb5700 1 --2- 172.21.15.146:0/3818422830 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f081c0cbc90 0x7f081c1f3050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:04.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.413+0000 7f0820fb5700 1 -- 172.21.15.146:0/3818422830 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f081c0cc1d0 msgr2=0x7f081c15a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:04.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.413+0000 7f0820fb5700 1 --2- 172.21.15.146:0/3818422830 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f081c0cc1d0 0x7f081c15a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:04.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.413+0000 7f0820fb5700 1 -- 172.21.15.146:0/3818422830 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0814009b30 con 0x7f081c0cb8c0 2023-05-24T03:32:04.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.414+0000 7f0820fb5700 1 --2- 172.21.15.146:0/3818422830 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f081c0cb8c0 0x7f081c1f2ab0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f081000e9b0 tx=0x7f081000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:04.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.414+0000 7f08197fa700 1 -- 172.21.15.146:0/3818422830 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0810009710 con 0x7f081c0cb8c0 2023-05-24T03:32:04.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.414+0000 7f08197fa700 1 -- 172.21.15.146:0/3818422830 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f081000c850 con 0x7f081c0cb8c0 2023-05-24T03:32:04.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.414+0000 7f0823219700 1 -- 172.21.15.146:0/3818422830 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f081c161570 con 0x7f081c0cb8c0 2023-05-24T03:32:04.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.414+0000 7f08197fa700 1 -- 172.21.15.146:0/3818422830 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081000cbc0 con 0x7f081c0cb8c0 2023-05-24T03:32:04.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.414+0000 7f0823219700 1 -- 172.21.15.146:0/3818422830 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f081c160b10 con 0x7f081c0cb8c0 2023-05-24T03:32:04.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.415+0000 7f0823219700 1 -- 172.21.15.146:0/3818422830 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f081c04e810 con 0x7f081c0cb8c0 2023-05-24T03:32:04.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.415+0000 7f08197fa700 1 -- 172.21.15.146:0/3818422830 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f081000cd20 con 0x7f081c0cb8c0 2023-05-24T03:32:04.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.416+0000 7f08197fa700 1 --2- 172.21.15.146:0/3818422830 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f080006ace0 0x7f080006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:04.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.416+0000 7f08197fa700 1 -- 172.21.15.146:0/3818422830 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f08100898c0 con 0x7f081c0cb8c0 2023-05-24T03:32:04.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.416+0000 7f081bfff700 1 --2- 172.21.15.146:0/3818422830 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f080006ace0 0x7f080006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:04.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.416+0000 7f081bfff700 1 --2- 172.21.15.146:0/3818422830 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f080006ace0 0x7f080006d190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f081c071bf0 tx=0x7f0808008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:04.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.420+0000 7f08197fa700 1 -- 172.21.15.146:0/3818422830 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f08100580d0 con 0x7f081c0cb8c0 2023-05-24T03:32:04.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.611+0000 7f0823219700 1 -- 172.21.15.146:0/3818422830 --> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f081c15f8e0 con 0x7f080006ace0 2023-05-24T03:32:04.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.611+0000 7f08197fa700 1 -- 172.21.15.146:0/3818422830 <== mgr.4104 v2:172.21.15.146:6832/1985394169 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f081c15f8e0 con 0x7f080006ace0 2023-05-24T03:32:04.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.613+0000 7f0823219700 1 -- 172.21.15.146:0/3818422830 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f080006ace0 msgr2=0x7f080006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:04.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.613+0000 7f0823219700 1 --2- 172.21.15.146:0/3818422830 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f080006ace0 0x7f080006d190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f081c071bf0 tx=0x7f0808008040 comp rx=0 tx=0).stop 2023-05-24T03:32:04.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.613+0000 7f0823219700 1 -- 172.21.15.146:0/3818422830 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f081c0cb8c0 msgr2=0x7f081c1f2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:04.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.613+0000 7f0823219700 1 --2- 172.21.15.146:0/3818422830 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f081c0cb8c0 0x7f081c1f2ab0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f081000e9b0 tx=0x7f081000ed70 comp rx=0 tx=0).stop 2023-05-24T03:32:04.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.613+0000 7f0823219700 1 -- 172.21.15.146:0/3818422830 shutdown_connections 2023-05-24T03:32:04.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.613+0000 7f0823219700 1 --2- 172.21.15.146:0/3818422830 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f080006ace0 0x7f080006d190 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:04.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.613+0000 7f0823219700 1 --2- 172.21.15.146:0/3818422830 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f081c0cc1d0 0x7f081c15a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:04.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.613+0000 7f0823219700 1 --2- 172.21.15.146:0/3818422830 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f081c0cb8c0 0x7f081c1f2ab0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:04.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.613+0000 7f0823219700 1 --2- 172.21.15.146:0/3818422830 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f081c0cbc90 0x7f081c1f3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:04.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.613+0000 7f0823219700 1 -- 172.21.15.146:0/3818422830 >> 172.21.15.146:0/3818422830 conn(0x7f081c0cfea0 msgr2=0x7f081c071100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:32:04.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.613+0000 7f0823219700 1 -- 172.21.15.146:0/3818422830 shutdown_connections 2023-05-24T03:32:04.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.613+0000 7f0823219700 1 -- 172.21.15.146:0/3818422830 wait complete. 2023-05-24T03:32:04.621 INFO:teuthology.orchestra.run.smithi146.stderr:instructed osd(s) 0 to deep-scrub 2023-05-24T03:32:04.630 INFO:tasks.ceph:Scrubbing osd.1 2023-05-24T03:32:04.630 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-05-24T03:32:04.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.750+0000 7fc7f6d9e700 1 Processor -- start 2023-05-24T03:32:04.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.750+0000 7fc7f6d9e700 1 -- start start 2023-05-24T03:32:04.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.751+0000 7fc7f6d9e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc7f00cb8c0 0x7fc7f0161030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:04.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.751+0000 7fc7f6d9e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7f00cbc90 0x7fc7f006a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:04.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.751+0000 7fc7f6d9e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7f00b27e0 con 0x7fc7f00cc1d0 2023-05-24T03:32:04.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.751+0000 7fc7f6d9e700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7f00b2030 con 0x7fc7f00cb8c0 2023-05-24T03:32:04.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.751+0000 7fc7f6d9e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f00b2220 con 0x7fc7f00cbc90 2023-05-24T03:32:04.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.751+0000 7fc7f533b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7f00cbc90 0x7fc7f006a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:04.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.751+0000 7fc7f4b3a700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc7f00cb8c0 0x7fc7f0161030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:04.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.751+0000 7fc7f533b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7f00cbc90 0x7fc7f006a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:53408/0 (socket says 172.21.15.146:53408) 2023-05-24T03:32:04.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.751+0000 7fc7f4b3a700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc7f00cb8c0 0x7fc7f0161030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:51722/0 (socket says 172.21.15.146:51722) 2023-05-24T03:32:04.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.751+0000 7fc7f533b700 1 -- 172.21.15.146:0/3924604150 learned_addr learned my addr 172.21.15.146:0/3924604150 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:32:04.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.751+0000 7fc7effff700 1 --1- 172.21.15.146:0/3924604150 >> v1:172.21.15.151:6789/0 conn(0x7fc7f00cc1d0 0x7fc7f00b1920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:46026/0 (socket says 172.21.15.146:46026) 2023-05-24T03:32:04.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.751+0000 7fc7f533b700 1 -- 172.21.15.146:0/3924604150 >> v2:172.21.15.151:3300/0 conn(0x7fc7f00cb8c0 msgr2=0x7fc7f0161030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:32:04.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.751+0000 7fc7f533b700 1 --2- 172.21.15.146:0/3924604150 >> v2:172.21.15.151:3300/0 conn(0x7fc7f00cb8c0 0x7fc7f0161030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:04.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.751+0000 7fc7f533b700 1 -- 172.21.15.146:0/3924604150 >> v1:172.21.15.151:6789/0 conn(0x7fc7f00cc1d0 legacy=0x7fc7f00b1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:04.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.751+0000 7fc7f533b700 1 -- 172.21.15.146:0/3924604150 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f00b2500 con 0x7fc7f00cbc90 2023-05-24T03:32:04.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.751+0000 7fc7f4b3a700 1 --2- 172.21.15.146:0/3924604150 >> v2:172.21.15.151:3300/0 conn(0x7fc7f00cb8c0 0x7fc7f0161030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T03:32:04.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.752+0000 7fc7f533b700 1 --2- 172.21.15.146:0/3924604150 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7f00cbc90 0x7fc7f006a460 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8009e50 tx=0x7fc7e800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a130c7170dfd042e server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:04.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.752+0000 7fc7ef7fe700 1 -- 172.21.15.146:0/3924604150 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e800e070 con 0x7fc7f00cbc90 2023-05-24T03:32:04.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.752+0000 7fc7ef7fe700 1 -- 172.21.15.146:0/3924604150 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e800b910 con 0x7fc7f00cbc90 2023-05-24T03:32:04.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.752+0000 7fc7ef7fe700 1 -- 172.21.15.146:0/3924604150 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e800bcc0 con 0x7fc7f00cbc90 2023-05-24T03:32:04.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.752+0000 7fc7f6d9e700 1 -- 172.21.15.146:0/3924604150 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7f00cbc90 msgr2=0x7fc7f006a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:04.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.752+0000 7fc7f6d9e700 1 --2- 172.21.15.146:0/3924604150 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7f00cbc90 0x7fc7f006a460 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8009e50 tx=0x7fc7e800b330 comp rx=0 tx=0).stop 2023-05-24T03:32:04.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.752+0000 7fc7f6d9e700 1 -- 172.21.15.146:0/3924604150 shutdown_connections 2023-05-24T03:32:04.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.752+0000 7fc7f6d9e700 1 --2- 172.21.15.146:0/3924604150 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7f00cbc90 0x7fc7f006a460 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:04.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.752+0000 7fc7f6d9e700 1 --2- 172.21.15.146:0/3924604150 >> v2:172.21.15.151:3300/0 conn(0x7fc7f00cb8c0 0x7fc7f0161030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:04.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.752+0000 7fc7f6d9e700 1 -- 172.21.15.146:0/3924604150 >> 172.21.15.146:0/3924604150 conn(0x7fc7f00cfea0 msgr2=0x7fc7f00d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:32:04.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.752+0000 7fc7f6d9e700 1 -- 172.21.15.146:0/3924604150 shutdown_connections 2023-05-24T03:32:04.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.752+0000 7fc7f6d9e700 1 -- 172.21.15.146:0/3924604150 wait complete. 2023-05-24T03:32:04.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.754+0000 7fc7f6d9e700 1 Processor -- start 2023-05-24T03:32:04.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.754+0000 7fc7f6d9e700 1 -- start start 2023-05-24T03:32:04.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.754+0000 7fc7f6d9e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7f00cb8c0 0x7fc7f00b19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:04.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.754+0000 7fc7f6d9e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7f00cbc90 0x7fc7f00c9580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:04.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.754+0000 7fc7f6d9e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7f00cc1d0 0x7fc7f015e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:04.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.754+0000 7fc7f6d9e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f00af750 con 0x7fc7f00cc1d0 2023-05-24T03:32:04.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.754+0000 7fc7f6d9e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f00ca410 con 0x7fc7f00cbc90 2023-05-24T03:32:04.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.754+0000 7fc7f6d9e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f00ca6f0 con 0x7fc7f00cb8c0 2023-05-24T03:32:04.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.755+0000 7fc7f533b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7f00cc1d0 0x7fc7f015e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:04.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.755+0000 7fc7f533b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7f00cc1d0 0x7fc7f015e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40550/0 (socket says 172.21.15.146:40550) 2023-05-24T03:32:04.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.755+0000 7fc7f533b700 1 -- 172.21.15.146:0/341512946 learned_addr learned my addr 172.21.15.146:0/341512946 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:32:04.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.755+0000 7fc7f4b3a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7f00cb8c0 0x7fc7f00b19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:04.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.755+0000 7fc7effff700 1 --2- 172.21.15.146:0/341512946 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7f00cbc90 0x7fc7f00c9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:04.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.755+0000 7fc7f533b700 1 -- 172.21.15.146:0/341512946 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7f00cb8c0 msgr2=0x7fc7f00b19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:04.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.755+0000 7fc7f533b700 1 --2- 172.21.15.146:0/341512946 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7f00cb8c0 0x7fc7f00b19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:04.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.755+0000 7fc7f533b700 1 -- 172.21.15.146:0/341512946 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7f00cbc90 msgr2=0x7fc7f00c9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:04.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.755+0000 7fc7f533b700 1 --2- 172.21.15.146:0/341512946 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7f00cbc90 0x7fc7f00c9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:04.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.755+0000 7fc7f533b700 1 -- 172.21.15.146:0/341512946 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e40094a0 con 0x7fc7f00cc1d0 2023-05-24T03:32:04.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.755+0000 7fc7f533b700 1 --2- 172.21.15.146:0/341512946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7f00cc1d0 0x7fc7f015e870 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc7f006b540 tx=0x7fc7e8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:04.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.755+0000 7fc7ed7fa700 1 -- 172.21.15.146:0/341512946 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e8003ea0 con 0x7fc7f00cc1d0 2023-05-24T03:32:04.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.755+0000 7fc7f6d9e700 1 -- 172.21.15.146:0/341512946 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7e8009b30 con 0x7fc7f00cc1d0 2023-05-24T03:32:04.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.755+0000 7fc7ed7fa700 1 -- 172.21.15.146:0/341512946 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e80048e0 con 0x7fc7f00cc1d0 2023-05-24T03:32:04.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.755+0000 7fc7ed7fa700 1 -- 172.21.15.146:0/341512946 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e801c680 con 0x7fc7f00cc1d0 2023-05-24T03:32:04.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.755+0000 7fc7f6d9e700 1 -- 172.21.15.146:0/341512946 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7f0160b10 con 0x7fc7f00cc1d0 2023-05-24T03:32:04.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.756+0000 7fc7f6d9e700 1 -- 172.21.15.146:0/341512946 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc7f0160830 con 0x7fc7f00cc1d0 2023-05-24T03:32:04.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.757+0000 7fc7ed7fa700 1 -- 172.21.15.146:0/341512946 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc7e801c7e0 con 0x7fc7f00cc1d0 2023-05-24T03:32:04.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.757+0000 7fc7ed7fa700 1 --2- 172.21.15.146:0/341512946 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fc7d406ace0 0x7fc7d406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:04.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.757+0000 7fc7ed7fa700 1 -- 172.21.15.146:0/341512946 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc7e808b3e0 con 0x7fc7f00cc1d0 2023-05-24T03:32:04.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.757+0000 7fc7f4b3a700 1 --2- 172.21.15.146:0/341512946 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fc7d406ace0 0x7fc7d406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:04.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.757+0000 7fc7ed7fa700 1 --2- 172.21.15.146:0/341512946 >> [v2:172.21.15.146:6818/2537488734,v1:172.21.15.146:6821/2537488734] conn(0x7fc7d4074970 0x7fc7d4076de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:04.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.757+0000 7fc7ed7fa700 1 -- 172.21.15.146:0/341512946 --> [v2:172.21.15.146:6818/2537488734,v1:172.21.15.146:6821/2537488734] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc7d40774b0 con 0x7fc7d4074970 2023-05-24T03:32:04.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.757+0000 7fc7ed7fa700 1 -- 172.21.15.146:0/341512946 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc7e808daa0 con 0x7fc7f00cc1d0 2023-05-24T03:32:04.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.757+0000 7fc7effff700 1 --2- 172.21.15.146:0/341512946 >> [v2:172.21.15.146:6818/2537488734,v1:172.21.15.146:6821/2537488734] conn(0x7fc7d4074970 0x7fc7d4076de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:04.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.757+0000 7fc7f4b3a700 1 --2- 172.21.15.146:0/341512946 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fc7d406ace0 0x7fc7d406d190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4009d70 tx=0x7fc7e4009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:04.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.758+0000 7fc7effff700 1 --2- 172.21.15.146:0/341512946 >> [v2:172.21.15.146:6818/2537488734,v1:172.21.15.146:6821/2537488734] conn(0x7fc7d4074970 0x7fc7d4076de0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:04.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.758+0000 7fc7ed7fa700 1 -- 172.21.15.146:0/341512946 <== osd.1 v2:172.21.15.146:6818/2537488734 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fc7d40774b0 con 0x7fc7d4074970 2023-05-24T03:32:04.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.772+0000 7fc7f6d9e700 1 -- 172.21.15.146:0/341512946 --> [v2:172.21.15.146:6818/2537488734,v1:172.21.15.146:6821/2537488734] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc7f0161570 con 0x7fc7d4074970 2023-05-24T03:32:04.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.773+0000 7fc7ed7fa700 1 -- 172.21.15.146:0/341512946 <== osd.1 v2:172.21.15.146:6818/2537488734 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fc7f0161570 con 0x7fc7d4074970 2023-05-24T03:32:04.778 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-05-24T03:32:04.778 INFO:teuthology.orchestra.run.smithi146.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-05-24T03:32:04.778 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-05-24T03:32:04.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.773+0000 7fc7f6d9e700 1 -- 172.21.15.146:0/341512946 >> [v2:172.21.15.146:6818/2537488734,v1:172.21.15.146:6821/2537488734] conn(0x7fc7d4074970 msgr2=0x7fc7d4076de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:04.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.773+0000 7fc7f6d9e700 1 --2- 172.21.15.146:0/341512946 >> [v2:172.21.15.146:6818/2537488734,v1:172.21.15.146:6821/2537488734] conn(0x7fc7d4074970 0x7fc7d4076de0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:04.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.773+0000 7fc7f6d9e700 1 -- 172.21.15.146:0/341512946 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fc7d406ace0 msgr2=0x7fc7d406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:04.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.773+0000 7fc7f6d9e700 1 --2- 172.21.15.146:0/341512946 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fc7d406ace0 0x7fc7d406d190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4009d70 tx=0x7fc7e4009210 comp rx=0 tx=0).stop 2023-05-24T03:32:04.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.773+0000 7fc7f6d9e700 1 -- 172.21.15.146:0/341512946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7f00cc1d0 msgr2=0x7fc7f015e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:04.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.773+0000 7fc7f6d9e700 1 --2- 172.21.15.146:0/341512946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7f00cc1d0 0x7fc7f015e870 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc7f006b540 tx=0x7fc7e8004ad0 comp rx=0 tx=0).stop 2023-05-24T03:32:04.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.773+0000 7fc7f533b700 1 -- 172.21.15.146:0/341512946 reap_dead start 2023-05-24T03:32:04.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.773+0000 7fc7f6d9e700 1 -- 172.21.15.146:0/341512946 shutdown_connections 2023-05-24T03:32:04.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.773+0000 7fc7f6d9e700 1 -- 172.21.15.146:0/341512946 >> 172.21.15.146:0/341512946 conn(0x7fc7f00cfea0 msgr2=0x7fc7f015c180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:32:04.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.773+0000 7fc7f6d9e700 1 -- 172.21.15.146:0/341512946 shutdown_connections 2023-05-24T03:32:04.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.773+0000 7fc7f6d9e700 1 -- 172.21.15.146:0/341512946 wait complete. 2023-05-24T03:32:04.789 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-05-24T03:32:04.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.908+0000 7f31a2404700 1 Processor -- start 2023-05-24T03:32:04.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.908+0000 7f31a2404700 1 -- start start 2023-05-24T03:32:04.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.909+0000 7f31a2404700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f319c15dd80 0x7f319c06dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:04.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.909+0000 7f31a2404700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f319c0cc8b0 0x7f319c0ccd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:04.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.909+0000 7f31a2404700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f319c15e150 con 0x7f319c0cbfb0 2023-05-24T03:32:04.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.909+0000 7f31a2404700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f319c0cd290 con 0x7f319c0cc8b0 2023-05-24T03:32:04.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.909+0000 7f31a2404700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f319c06e2b0 con 0x7f319c15dd80 2023-05-24T03:32:04.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.909+0000 7f319b7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f319c0cbfb0 0x7f319c0719b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47010/0 (socket says 172.21.15.146:47010) 2023-05-24T03:32:04.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.909+0000 7f319b7fe700 1 -- 172.21.15.146:0/3065361101 learned_addr learned my addr 172.21.15.146:0/3065361101 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:32:04.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.909+0000 7f319bfff700 1 --2- 172.21.15.146:0/3065361101 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f319c15dd80 0x7f319c06dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:04.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.909+0000 7f31a09a1700 1 --2- 172.21.15.146:0/3065361101 >> v2:172.21.15.151:3300/0 conn(0x7f319c0cc8b0 0x7f319c0ccd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:04.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.909+0000 7f319affd700 1 -- 172.21.15.146:0/3065361101 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1254532487 0 0) 0x7f319c15e150 con 0x7f319c0cbfb0 2023-05-24T03:32:04.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.909+0000 7f319affd700 1 -- 172.21.15.146:0/3065361101 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31880035b0 con 0x7f319c0cbfb0 2023-05-24T03:32:04.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.909+0000 7f319affd700 1 -- 172.21.15.146:0/3065361101 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1010493773 0 0) 0x7f31880035b0 con 0x7f319c0cbfb0 2023-05-24T03:32:04.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.909+0000 7f319affd700 1 -- 172.21.15.146:0/3065361101 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f319c15dd80 msgr2=0x7f319c06dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:32:04.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.909+0000 7f319affd700 1 --2- 172.21.15.146:0/3065361101 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f319c15dd80 0x7f319c06dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:04.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.910+0000 7f319affd700 1 -- 172.21.15.146:0/3065361101 >> v2:172.21.15.151:3300/0 conn(0x7f319c0cc8b0 msgr2=0x7f319c0ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:32:04.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.910+0000 7f319affd700 1 --2- 172.21.15.146:0/3065361101 >> v2:172.21.15.151:3300/0 conn(0x7f319c0cc8b0 0x7f319c0ccd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:04.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.910+0000 7f319affd700 1 -- 172.21.15.146:0/3065361101 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f319c0cc4b0 con 0x7f319c0cbfb0 2023-05-24T03:32:04.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.910+0000 7f319affd700 1 -- 172.21.15.146:0/3065361101 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1301887351 0 0) 0x7f318c001670 con 0x7f319c0cbfb0 2023-05-24T03:32:04.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.910+0000 7f319affd700 1 -- 172.21.15.146:0/3065361101 >> v1:172.21.15.146:6789/0 conn(0x7f319c0cbfb0 legacy=0x7f319c0719b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:04.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.910+0000 7f319affd700 1 --2- 172.21.15.146:0/3065361101 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f319c15dd80 0x7f3188003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:04.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.910+0000 7f319affd700 1 --2- 172.21.15.146:0/3065361101 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3188003f80 0x7f3188004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:04.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.910+0000 7f319affd700 1 --2- 172.21.15.146:0/3065361101 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3188004d90 0x7f3188005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:04.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.910+0000 7f319affd700 1 -- 172.21.15.146:0/3065361101 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319c06e2b0 con 0x7f3188003f80 2023-05-24T03:32:04.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.910+0000 7f319affd700 1 -- 172.21.15.146:0/3065361101 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318800fe20 con 0x7f3188004d90 2023-05-24T03:32:04.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.910+0000 7f319affd700 1 -- 172.21.15.146:0/3065361101 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f318800ff60 con 0x7f319c15dd80 2023-05-24T03:32:04.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.910+0000 7f319b7fe700 1 --2- 172.21.15.146:0/3065361101 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3188003f80 0x7f3188004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:04.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.910+0000 7f319bfff700 1 --2- 172.21.15.146:0/3065361101 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f319c15dd80 0x7f3188003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:04.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.910+0000 7f31a09a1700 1 --2- 172.21.15.146:0/3065361101 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3188004d90 0x7f3188005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:04.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.910+0000 7f319b7fe700 1 -- 172.21.15.146:0/3065361101 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f319c15dd80 msgr2=0x7f3188003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:32:04.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.910+0000 7f319b7fe700 1 --2- 172.21.15.146:0/3065361101 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f319c15dd80 0x7f3188003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:04.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.910+0000 7f319b7fe700 1 -- 172.21.15.146:0/3065361101 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3188004d90 msgr2=0x7f3188005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:32:04.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.910+0000 7f319b7fe700 1 --2- 172.21.15.146:0/3065361101 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3188004d90 0x7f3188005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:04.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.910+0000 7f319b7fe700 1 -- 172.21.15.146:0/3065361101 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31880035b0 con 0x7f3188003f80 2023-05-24T03:32:04.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.910+0000 7f319b7fe700 1 --2- 172.21.15.146:0/3065361101 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3188003f80 0x7f3188004850 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f319c0cc3e0 tx=0x7f3188005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a1d8f55cce4ddb6 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:04.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.910+0000 7f319affd700 1 -- 172.21.15.146:0/3065361101 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318c00ce00 con 0x7f3188003f80 2023-05-24T03:32:04.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.910+0000 7f319affd700 1 -- 172.21.15.146:0/3065361101 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f318c005960 con 0x7f3188003f80 2023-05-24T03:32:04.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.910+0000 7f319affd700 1 -- 172.21.15.146:0/3065361101 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318c005d10 con 0x7f3188003f80 2023-05-24T03:32:04.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.911+0000 7f31a2404700 1 -- 172.21.15.146:0/3065361101 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3188003f80 msgr2=0x7f3188004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:04.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.911+0000 7f31a2404700 1 --2- 172.21.15.146:0/3065361101 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3188003f80 0x7f3188004850 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f319c0cc3e0 tx=0x7f3188005880 comp rx=0 tx=0).stop 2023-05-24T03:32:04.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.911+0000 7f31a09a1700 1 -- 172.21.15.146:0/3065361101 reap_dead start 2023-05-24T03:32:04.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.911+0000 7f31a2404700 1 -- 172.21.15.146:0/3065361101 shutdown_connections 2023-05-24T03:32:04.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.911+0000 7f31a2404700 1 -- 172.21.15.146:0/3065361101 >> 172.21.15.146:0/3065361101 conn(0x7f319c06ebf0 msgr2=0x7f319c06eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:32:04.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.911+0000 7f31a2404700 1 -- 172.21.15.146:0/3065361101 shutdown_connections 2023-05-24T03:32:04.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.911+0000 7f31a2404700 1 -- 172.21.15.146:0/3065361101 wait complete. 2023-05-24T03:32:04.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.912+0000 7f31a2404700 1 Processor -- start 2023-05-24T03:32:04.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.912+0000 7f31a2404700 1 -- start start 2023-05-24T03:32:04.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.913+0000 7f31a2404700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3188003f80 0x7f319c158830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:04.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.913+0000 7f31a2404700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f319c155770 0x7f319c1549d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:04.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.913+0000 7f31a2404700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f319c147650 0x7f319c0ce960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:04.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.913+0000 7f31a2404700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319c153c50 con 0x7f319c147650 2023-05-24T03:32:04.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.913+0000 7f31a2404700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319c158d70 con 0x7f319c155770 2023-05-24T03:32:04.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.913+0000 7f31a2404700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f319c153ef0 con 0x7f3188003f80 2023-05-24T03:32:04.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.913+0000 7f31a09a1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f319c147650 0x7f319c0ce960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:04.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.913+0000 7f31a09a1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f319c147650 0x7f319c0ce960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40572/0 (socket says 172.21.15.146:40572) 2023-05-24T03:32:04.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.913+0000 7f31a09a1700 1 -- 172.21.15.146:0/3977555741 learned_addr learned my addr 172.21.15.146:0/3977555741 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:32:04.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.913+0000 7f319b7fe700 1 --2- 172.21.15.146:0/3977555741 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f319c155770 0x7f319c1549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:04.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.913+0000 7f319bfff700 1 --2- 172.21.15.146:0/3977555741 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3188003f80 0x7f319c158830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:04.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.913+0000 7f31a09a1700 1 -- 172.21.15.146:0/3977555741 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3188003f80 msgr2=0x7f319c158830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:04.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.913+0000 7f31a09a1700 1 --2- 172.21.15.146:0/3977555741 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3188003f80 0x7f319c158830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:04.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.913+0000 7f31a09a1700 1 -- 172.21.15.146:0/3977555741 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f319c155770 msgr2=0x7f319c1549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:04.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.913+0000 7f31a09a1700 1 --2- 172.21.15.146:0/3977555741 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f319c155770 0x7f319c1549d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:04.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.913+0000 7f31a09a1700 1 -- 172.21.15.146:0/3977555741 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f319c06d570 con 0x7f319c147650 2023-05-24T03:32:04.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.914+0000 7f31a09a1700 1 --2- 172.21.15.146:0/3977555741 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f319c147650 0x7f319c0ce960 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f319c06e3f0 tx=0x7f3194011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:04.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.914+0000 7f3198ff9700 1 -- 172.21.15.146:0/3977555741 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319400e040 con 0x7f319c147650 2023-05-24T03:32:04.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.914+0000 7f3198ff9700 1 -- 172.21.15.146:0/3977555741 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f319400f040 con 0x7f319c147650 2023-05-24T03:32:04.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.914+0000 7f31a2404700 1 -- 172.21.15.146:0/3977555741 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f319c06d290 con 0x7f319c147650 2023-05-24T03:32:04.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.914+0000 7f3198ff9700 1 -- 172.21.15.146:0/3977555741 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319400fc40 con 0x7f319c147650 2023-05-24T03:32:04.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.914+0000 7f31a2404700 1 -- 172.21.15.146:0/3977555741 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f319c06d850 con 0x7f319c147650 2023-05-24T03:32:04.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.915+0000 7f31a2404700 1 -- 172.21.15.146:0/3977555741 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f319c04e810 con 0x7f319c147650 2023-05-24T03:32:04.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.915+0000 7f3198ff9700 1 -- 172.21.15.146:0/3977555741 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3194022460 con 0x7f319c147650 2023-05-24T03:32:04.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.915+0000 7f3198ff9700 1 --2- 172.21.15.146:0/3977555741 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f317c06ad10 0x7f317c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:04.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.916+0000 7f3198ff9700 1 -- 172.21.15.146:0/3977555741 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3194089ca0 con 0x7f319c147650 2023-05-24T03:32:04.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.916+0000 7f319bfff700 1 --2- 172.21.15.146:0/3977555741 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f317c06ad10 0x7f317c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:04.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.916+0000 7f319bfff700 1 --2- 172.21.15.146:0/3977555741 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f317c06ad10 0x7f317c06d1c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3184009b80 tx=0x7f3184009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:04.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:04.920+0000 7f3198ff9700 1 -- 172.21.15.146:0/3977555741 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3194058420 con 0x7f319c147650 2023-05-24T03:32:05.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.109+0000 7f31a2404700 1 -- 172.21.15.146:0/3977555741 --> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f319c06a600 con 0x7f317c06ad10 2023-05-24T03:32:05.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.109+0000 7f3198ff9700 1 -- 172.21.15.146:0/3977555741 <== mgr.4104 v2:172.21.15.146:6832/1985394169 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f319c06a600 con 0x7f317c06ad10 2023-05-24T03:32:05.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.111+0000 7f31a2404700 1 -- 172.21.15.146:0/3977555741 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f317c06ad10 msgr2=0x7f317c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:05.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.111+0000 7f31a2404700 1 --2- 172.21.15.146:0/3977555741 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f317c06ad10 0x7f317c06d1c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3184009b80 tx=0x7f3184009210 comp rx=0 tx=0).stop 2023-05-24T03:32:05.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.111+0000 7f31a2404700 1 -- 172.21.15.146:0/3977555741 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f319c147650 msgr2=0x7f319c0ce960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:05.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.111+0000 7f31a2404700 1 --2- 172.21.15.146:0/3977555741 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f319c147650 0x7f319c0ce960 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f319c06e3f0 tx=0x7f3194011ed0 comp rx=0 tx=0).stop 2023-05-24T03:32:05.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.111+0000 7f31a2404700 1 -- 172.21.15.146:0/3977555741 shutdown_connections 2023-05-24T03:32:05.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.111+0000 7f31a2404700 1 --2- 172.21.15.146:0/3977555741 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f317c06ad10 0x7f317c06d1c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:05.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.111+0000 7f31a2404700 1 --2- 172.21.15.146:0/3977555741 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f319c147650 0x7f319c0ce960 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:05.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.111+0000 7f31a2404700 1 --2- 172.21.15.146:0/3977555741 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3188003f80 0x7f319c158830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:05.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.111+0000 7f31a2404700 1 --2- 172.21.15.146:0/3977555741 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f319c155770 0x7f319c1549d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:05.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.111+0000 7f31a2404700 1 -- 172.21.15.146:0/3977555741 >> 172.21.15.146:0/3977555741 conn(0x7f319c06ebf0 msgr2=0x7f319c157680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:32:05.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.112+0000 7f31a2404700 1 -- 172.21.15.146:0/3977555741 shutdown_connections 2023-05-24T03:32:05.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.112+0000 7f31a2404700 1 -- 172.21.15.146:0/3977555741 wait complete. 2023-05-24T03:32:05.121 INFO:teuthology.orchestra.run.smithi146.stderr:instructed osd(s) 1 to deep-scrub 2023-05-24T03:32:05.129 INFO:tasks.ceph:Scrubbing osd.2 2023-05-24T03:32:05.129 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-05-24T03:32:05.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.252+0000 7fafed342700 1 Processor -- start 2023-05-24T03:32:05.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.252+0000 7fafed342700 1 -- start start 2023-05-24T03:32:05.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.252+0000 7fafed342700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fafe815ac30 0x7fafe806c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:05.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.252+0000 7fafed342700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fafe80b0870 0x7fafe8071ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:05.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.252+0000 7fafed342700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fafe8072010 0x7fafe80ca860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:05.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.252+0000 7fafed342700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafe806c9a0 con 0x7fafe815ac30 2023-05-24T03:32:05.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.252+0000 7fafed342700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafe806cc80 con 0x7fafe8072010 2023-05-24T03:32:05.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.252+0000 7fafed342700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe80712d0 con 0x7fafe80b0870 2023-05-24T03:32:05.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.253+0000 7fafe6ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fafe815ac30 0x7fafe806c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:05.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.253+0000 7fafe6ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fafe815ac30 0x7fafe806c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40576/0 (socket says 172.21.15.146:40576) 2023-05-24T03:32:05.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.253+0000 7fafe6ffd700 1 -- 172.21.15.146:0/1225795861 learned_addr learned my addr 172.21.15.146:0/1225795861 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:32:05.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.253+0000 7fafe67fc700 1 --2- 172.21.15.146:0/1225795861 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fafe80b0870 0x7fafe8071ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:05.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.253+0000 7fafe77fe700 1 --2- 172.21.15.146:0/1225795861 >> v2:172.21.15.151:3300/0 conn(0x7fafe8072010 0x7fafe80ca860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:05.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.253+0000 7fafe6ffd700 1 -- 172.21.15.146:0/1225795861 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fafe80b0870 msgr2=0x7fafe8071ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:32:05.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.253+0000 7fafe6ffd700 1 --2- 172.21.15.146:0/1225795861 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fafe80b0870 0x7fafe8071ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:05.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.253+0000 7fafe6ffd700 1 -- 172.21.15.146:0/1225795861 >> v2:172.21.15.151:3300/0 conn(0x7fafe8072010 msgr2=0x7fafe80ca860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:32:05.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.253+0000 7fafe6ffd700 1 --2- 172.21.15.146:0/1225795861 >> v2:172.21.15.151:3300/0 conn(0x7fafe8072010 0x7fafe80ca860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:05.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.253+0000 7fafe6ffd700 1 -- 172.21.15.146:0/1225795861 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe80715b0 con 0x7fafe815ac30 2023-05-24T03:32:05.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.253+0000 7fafe6ffd700 1 --2- 172.21.15.146:0/1225795861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafe815ac30 0x7fafe806c030 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fafe80cecf0 tx=0x7fafdc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=845da4f2ae7c18ea server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:05.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.253+0000 7fafe5ffb700 1 -- 172.21.15.146:0/1225795861 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafdc00b870 con 0x7fafe815ac30 2023-05-24T03:32:05.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.253+0000 7fafe5ffb700 1 -- 172.21.15.146:0/1225795861 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafdc00b9d0 con 0x7fafe815ac30 2023-05-24T03:32:05.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.253+0000 7fafe5ffb700 1 -- 172.21.15.146:0/1225795861 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafdc00bd60 con 0x7fafe815ac30 2023-05-24T03:32:05.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.254+0000 7fafed342700 1 -- 172.21.15.146:0/1225795861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafe815ac30 msgr2=0x7fafe806c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:05.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.254+0000 7fafed342700 1 --2- 172.21.15.146:0/1225795861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafe815ac30 0x7fafe806c030 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fafe80cecf0 tx=0x7fafdc009bd0 comp rx=0 tx=0).stop 2023-05-24T03:32:05.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.254+0000 7fafed342700 1 -- 172.21.15.146:0/1225795861 shutdown_connections 2023-05-24T03:32:05.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.254+0000 7fafed342700 1 --2- 172.21.15.146:0/1225795861 >> v2:172.21.15.151:3300/0 conn(0x7fafe8072010 0x7fafe80ca860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:05.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.254+0000 7fafed342700 1 --2- 172.21.15.146:0/1225795861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafe815ac30 0x7fafe806c030 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:05.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.254+0000 7fafed342700 1 --2- 172.21.15.146:0/1225795861 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fafe80b0870 0x7fafe8071ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:05.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.254+0000 7fafed342700 1 -- 172.21.15.146:0/1225795861 >> 172.21.15.146:0/1225795861 conn(0x7fafe806b0a0 msgr2=0x7fafe80cb7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:32:05.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.254+0000 7fafed342700 1 -- 172.21.15.146:0/1225795861 shutdown_connections 2023-05-24T03:32:05.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.254+0000 7fafed342700 1 -- 172.21.15.146:0/1225795861 wait complete. 2023-05-24T03:32:05.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.255+0000 7fafed342700 1 Processor -- start 2023-05-24T03:32:05.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.255+0000 7fafed342700 1 -- start start 2023-05-24T03:32:05.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.256+0000 7fafed342700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafe8072010 0x7fafe8158b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:05.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.256+0000 7fafed342700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fafe80b0870 0x7fafe80c33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:05.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.256+0000 7fafed342700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fafe80ac8b0 0x7fafe80c4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:05.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.256+0000 7fafed342700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe80acd90 con 0x7fafe8072010 2023-05-24T03:32:05.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.256+0000 7fafed342700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe80ad070 con 0x7fafe80b0870 2023-05-24T03:32:05.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.256+0000 7fafed342700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe80ad350 con 0x7fafe80ac8b0 2023-05-24T03:32:05.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.256+0000 7fafe6ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafe8072010 0x7fafe8158b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:05.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.256+0000 7fafe6ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafe8072010 0x7fafe8158b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40582/0 (socket says 172.21.15.146:40582) 2023-05-24T03:32:05.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.256+0000 7fafe6ffd700 1 -- 172.21.15.146:0/1542358307 learned_addr learned my addr 172.21.15.146:0/1542358307 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:32:05.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.256+0000 7fafe67fc700 1 --2- 172.21.15.146:0/1542358307 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fafe80b0870 0x7fafe80c33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:05.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.256+0000 7fafe77fe700 1 --2- 172.21.15.146:0/1542358307 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fafe80ac8b0 0x7fafe80c4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:05.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.256+0000 7fafe6ffd700 1 -- 172.21.15.146:0/1542358307 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fafe80ac8b0 msgr2=0x7fafe80c4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:05.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.256+0000 7fafe6ffd700 1 --2- 172.21.15.146:0/1542358307 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fafe80ac8b0 0x7fafe80c4fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:05.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.256+0000 7fafe6ffd700 1 -- 172.21.15.146:0/1542358307 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fafe80b0870 msgr2=0x7fafe80c33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:05.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.256+0000 7fafe6ffd700 1 --2- 172.21.15.146:0/1542358307 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fafe80b0870 0x7fafe80c33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:05.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.256+0000 7fafe6ffd700 1 -- 172.21.15.146:0/1542358307 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafdc009550 con 0x7fafe8072010 2023-05-24T03:32:05.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.256+0000 7fafe67fc700 1 --2- 172.21.15.146:0/1542358307 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fafe80b0870 0x7fafe80c33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:32:05.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.256+0000 7fafe6ffd700 1 --2- 172.21.15.146:0/1542358307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafe8072010 0x7fafe8158b60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fafdc000c00 tx=0x7fafdc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:05.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.257+0000 7fafcf7fe700 1 -- 172.21.15.146:0/1542358307 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafdc004520 con 0x7fafe8072010 2023-05-24T03:32:05.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.257+0000 7fafcf7fe700 1 -- 172.21.15.146:0/1542358307 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafdc01e070 con 0x7fafe8072010 2023-05-24T03:32:05.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.257+0000 7fafed342700 1 -- 172.21.15.146:0/1542358307 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafe806c570 con 0x7fafe8072010 2023-05-24T03:32:05.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.257+0000 7fafcf7fe700 1 -- 172.21.15.146:0/1542358307 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafdc0038c0 con 0x7fafe8072010 2023-05-24T03:32:05.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.257+0000 7fafed342700 1 -- 172.21.15.146:0/1542358307 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafe806cf60 con 0x7fafe8072010 2023-05-24T03:32:05.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.257+0000 7fafed342700 1 -- 172.21.15.146:0/1542358307 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fafe80ad1e0 con 0x7fafe8072010 2023-05-24T03:32:05.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.258+0000 7fafcf7fe700 1 -- 172.21.15.146:0/1542358307 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fafdc003a20 con 0x7fafe8072010 2023-05-24T03:32:05.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.258+0000 7fafcf7fe700 1 --2- 172.21.15.146:0/1542358307 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fafd406ace0 0x7fafd406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:05.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.258+0000 7fafcf7fe700 1 -- 172.21.15.146:0/1542358307 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fafdc020070 con 0x7fafe8072010 2023-05-24T03:32:05.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.258+0000 7fafe67fc700 1 --2- 172.21.15.146:0/1542358307 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fafd406ace0 0x7fafd406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:05.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.258+0000 7fafcf7fe700 1 --2- 172.21.15.146:0/1542358307 >> [v2:172.21.15.146:6808/1800242932,v1:172.21.15.146:6809/1800242932] conn(0x7fafd40749f0 0x7fafd4076e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:05.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.258+0000 7fafcf7fe700 1 -- 172.21.15.146:0/1542358307 --> [v2:172.21.15.146:6808/1800242932,v1:172.21.15.146:6809/1800242932] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fafd4077530 con 0x7fafd40749f0 2023-05-24T03:32:05.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.258+0000 7fafcf7fe700 1 -- 172.21.15.146:0/1542358307 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fafdc08f2c0 con 0x7fafe8072010 2023-05-24T03:32:05.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.259+0000 7fafe77fe700 1 --2- 172.21.15.146:0/1542358307 >> [v2:172.21.15.146:6808/1800242932,v1:172.21.15.146:6809/1800242932] conn(0x7fafd40749f0 0x7fafd4076e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:05.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.259+0000 7fafe67fc700 1 --2- 172.21.15.146:0/1542358307 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fafd406ace0 0x7fafd406d190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fafe815a500 tx=0x7fafd8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:05.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.259+0000 7fafe77fe700 1 --2- 172.21.15.146:0/1542358307 >> [v2:172.21.15.146:6808/1800242932,v1:172.21.15.146:6809/1800242932] conn(0x7fafd40749f0 0x7fafd4076e60 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:05.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.259+0000 7fafcf7fe700 1 -- 172.21.15.146:0/1542358307 <== osd.2 v2:172.21.15.146:6808/1800242932 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fafd4077530 con 0x7fafd40749f0 2023-05-24T03:32:05.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.274+0000 7fafed342700 1 -- 172.21.15.146:0/1542358307 --> [v2:172.21.15.146:6808/1800242932,v1:172.21.15.146:6809/1800242932] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fafe806c700 con 0x7fafd40749f0 2023-05-24T03:32:05.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.275+0000 7fafcf7fe700 1 -- 172.21.15.146:0/1542358307 <== osd.2 v2:172.21.15.146:6808/1800242932 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fafe806c700 con 0x7fafd40749f0 2023-05-24T03:32:05.280 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-05-24T03:32:05.280 INFO:teuthology.orchestra.run.smithi146.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-05-24T03:32:05.280 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-05-24T03:32:05.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.275+0000 7fafed342700 1 -- 172.21.15.146:0/1542358307 >> [v2:172.21.15.146:6808/1800242932,v1:172.21.15.146:6809/1800242932] conn(0x7fafd40749f0 msgr2=0x7fafd4076e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:05.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.275+0000 7fafed342700 1 --2- 172.21.15.146:0/1542358307 >> [v2:172.21.15.146:6808/1800242932,v1:172.21.15.146:6809/1800242932] conn(0x7fafd40749f0 0x7fafd4076e60 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:05.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.275+0000 7fafed342700 1 -- 172.21.15.146:0/1542358307 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fafd406ace0 msgr2=0x7fafd406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:05.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.275+0000 7fafed342700 1 --2- 172.21.15.146:0/1542358307 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fafd406ace0 0x7fafd406d190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fafe815a500 tx=0x7fafd8008040 comp rx=0 tx=0).stop 2023-05-24T03:32:05.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.275+0000 7fafed342700 1 -- 172.21.15.146:0/1542358307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafe8072010 msgr2=0x7fafe8158b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:05.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.275+0000 7fafed342700 1 --2- 172.21.15.146:0/1542358307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafe8072010 0x7fafe8158b60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fafdc000c00 tx=0x7fafdc004750 comp rx=0 tx=0).stop 2023-05-24T03:32:05.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.275+0000 7fafe77fe700 1 -- 172.21.15.146:0/1542358307 reap_dead start 2023-05-24T03:32:05.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.275+0000 7fafed342700 1 -- 172.21.15.146:0/1542358307 shutdown_connections 2023-05-24T03:32:05.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.275+0000 7fafed342700 1 -- 172.21.15.146:0/1542358307 >> 172.21.15.146:0/1542358307 conn(0x7fafe806b0a0 msgr2=0x7fafe8159a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:32:05.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.275+0000 7fafed342700 1 -- 172.21.15.146:0/1542358307 shutdown_connections 2023-05-24T03:32:05.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.275+0000 7fafed342700 1 -- 172.21.15.146:0/1542358307 wait complete. 2023-05-24T03:32:05.291 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-05-24T03:32:05.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.408+0000 7fdb68660700 1 Processor -- start 2023-05-24T03:32:05.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.408+0000 7fdb68660700 1 -- start start 2023-05-24T03:32:05.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.409+0000 7fdb68660700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdb6015cb50 0x7fdb600d1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:05.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.409+0000 7fdb68660700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb600b5b90 con 0x7fdb600d2350 2023-05-24T03:32:05.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.409+0000 7fdb68660700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb6015cf20 con 0x7fdb600b67d0 2023-05-24T03:32:05.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.409+0000 7fdb68660700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb600cd960 con 0x7fdb6015cb50 2023-05-24T03:32:05.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.409+0000 7fdb663fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdb6015cb50 0x7fdb600d1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:05.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.409+0000 7fdb65bfb700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fdb600d2350 0x7fdb600b60c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47044/0 (socket says 172.21.15.146:47044) 2023-05-24T03:32:05.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.409+0000 7fdb65bfb700 1 -- 172.21.15.146:0/3564508364 learned_addr learned my addr 172.21.15.146:0/3564508364 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:32:05.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.410+0000 7fdb663fc700 1 -- 172.21.15.146:0/3564508364 >> v1:172.21.15.151:6789/0 conn(0x7fdb600b67d0 legacy=0x7fdb600b4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:32:05.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.410+0000 7fdb663fc700 1 -- 172.21.15.146:0/3564508364 >> v1:172.21.15.146:6789/0 conn(0x7fdb600d2350 legacy=0x7fdb600b60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:05.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.410+0000 7fdb653fa700 1 -- 172.21.15.146:0/3564508364 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 279514662 0 0) 0x7fdb600b5b90 con 0x7fdb600d2350 2023-05-24T03:32:05.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.410+0000 7fdb663fc700 1 -- 172.21.15.146:0/3564508364 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb600cdc40 con 0x7fdb6015cb50 2023-05-24T03:32:05.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.410+0000 7fdb663fc700 1 --2- 172.21.15.146:0/3564508364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb6015cb50 0x7fdb600d1e10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fdb50009840 tx=0x7fdb50009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=721d660307b4c32a server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:05.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.410+0000 7fdb653fa700 1 -- 172.21.15.146:0/3564508364 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb50004230 con 0x7fdb6015cb50 2023-05-24T03:32:05.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.410+0000 7fdb653fa700 1 -- 172.21.15.146:0/3564508364 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb50004390 con 0x7fdb6015cb50 2023-05-24T03:32:05.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.410+0000 7fdb653fa700 1 -- 172.21.15.146:0/3564508364 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb500036a0 con 0x7fdb6015cb50 2023-05-24T03:32:05.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.411+0000 7fdb68660700 1 -- 172.21.15.146:0/3564508364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb6015cb50 msgr2=0x7fdb600d1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:05.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.411+0000 7fdb68660700 1 --2- 172.21.15.146:0/3564508364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb6015cb50 0x7fdb600d1e10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fdb50009840 tx=0x7fdb50009b50 comp rx=0 tx=0).stop 2023-05-24T03:32:05.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.411+0000 7fdb68660700 1 -- 172.21.15.146:0/3564508364 shutdown_connections 2023-05-24T03:32:05.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.411+0000 7fdb68660700 1 --2- 172.21.15.146:0/3564508364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb6015cb50 0x7fdb600d1e10 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:05.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.411+0000 7fdb68660700 1 -- 172.21.15.146:0/3564508364 >> 172.21.15.146:0/3564508364 conn(0x7fdb6006af50 msgr2=0x7fdb6006b350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:32:05.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.411+0000 7fdb68660700 1 -- 172.21.15.146:0/3564508364 shutdown_connections 2023-05-24T03:32:05.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.411+0000 7fdb68660700 1 -- 172.21.15.146:0/3564508364 wait complete. 2023-05-24T03:32:05.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.412+0000 7fdb68660700 1 Processor -- start 2023-05-24T03:32:05.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.412+0000 7fdb68660700 1 -- start start 2023-05-24T03:32:05.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.413+0000 7fdb68660700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb600b67d0 0x7fdb60154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:05.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.413+0000 7fdb68660700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb600d2350 0x7fdb600b6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:05.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.413+0000 7fdb68660700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb6015cb50 0x7fdb600b7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:05.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.413+0000 7fdb68660700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb600cd1b0 con 0x7fdb600d2350 2023-05-24T03:32:05.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.413+0000 7fdb68660700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb600cc630 con 0x7fdb6015cb50 2023-05-24T03:32:05.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.413+0000 7fdb68660700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb600cc910 con 0x7fdb600b67d0 2023-05-24T03:32:05.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.413+0000 7fdb65bfb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb600d2350 0x7fdb600b6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:05.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.413+0000 7fdb65bfb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb600d2350 0x7fdb600b6bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40598/0 (socket says 172.21.15.146:40598) 2023-05-24T03:32:05.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.413+0000 7fdb65bfb700 1 -- 172.21.15.146:0/2772525002 learned_addr learned my addr 172.21.15.146:0/2772525002 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:32:05.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.413+0000 7fdb66bfd700 1 --2- 172.21.15.146:0/2772525002 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb6015cb50 0x7fdb600b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:05.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.413+0000 7fdb663fc700 1 --2- 172.21.15.146:0/2772525002 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb600b67d0 0x7fdb60154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:05.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.413+0000 7fdb65bfb700 1 -- 172.21.15.146:0/2772525002 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb600b67d0 msgr2=0x7fdb60154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:05.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.413+0000 7fdb65bfb700 1 --2- 172.21.15.146:0/2772525002 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb600b67d0 0x7fdb60154360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:05.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.413+0000 7fdb65bfb700 1 -- 172.21.15.146:0/2772525002 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb6015cb50 msgr2=0x7fdb600b7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:05.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.413+0000 7fdb65bfb700 1 --2- 172.21.15.146:0/2772525002 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb6015cb50 0x7fdb600b7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:05.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.413+0000 7fdb65bfb700 1 -- 172.21.15.146:0/2772525002 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb500094a0 con 0x7fdb600d2350 2023-05-24T03:32:05.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.413+0000 7fdb663fc700 1 --2- 172.21.15.146:0/2772525002 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb600b67d0 0x7fdb60154360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:32:05.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.413+0000 7fdb66bfd700 1 --2- 172.21.15.146:0/2772525002 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb6015cb50 0x7fdb600b7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:32:05.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.413+0000 7fdb65bfb700 1 --2- 172.21.15.146:0/2772525002 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb600d2350 0x7fdb600b6bc0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c00c540 tx=0x7fdb5c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:05.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.413+0000 7fdb56ffd700 1 -- 172.21.15.146:0/2772525002 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c004c80 con 0x7fdb600d2350 2023-05-24T03:32:05.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.413+0000 7fdb56ffd700 1 -- 172.21.15.146:0/2772525002 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5c004de0 con 0x7fdb600d2350 2023-05-24T03:32:05.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.413+0000 7fdb56ffd700 1 -- 172.21.15.146:0/2772525002 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c007310 con 0x7fdb600d2350 2023-05-24T03:32:05.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.413+0000 7fdb68660700 1 -- 172.21.15.146:0/2772525002 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb600cdf20 con 0x7fdb600d2350 2023-05-24T03:32:05.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.413+0000 7fdb68660700 1 -- 172.21.15.146:0/2772525002 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb600d18f0 con 0x7fdb600d2350 2023-05-24T03:32:05.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.414+0000 7fdb68660700 1 -- 172.21.15.146:0/2772525002 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb600d2da0 con 0x7fdb600d2350 2023-05-24T03:32:05.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.415+0000 7fdb56ffd700 1 -- 172.21.15.146:0/2772525002 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdb5c007470 con 0x7fdb600d2350 2023-05-24T03:32:05.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.415+0000 7fdb56ffd700 1 --2- 172.21.15.146:0/2772525002 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fdb4406ace0 0x7fdb4406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:05.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.415+0000 7fdb663fc700 1 --2- 172.21.15.146:0/2772525002 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fdb4406ace0 0x7fdb4406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:05.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.415+0000 7fdb56ffd700 1 -- 172.21.15.146:0/2772525002 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdb5c089520 con 0x7fdb600d2350 2023-05-24T03:32:05.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.415+0000 7fdb663fc700 1 --2- 172.21.15.146:0/2772525002 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fdb4406ace0 0x7fdb4406d190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdb500090b0 tx=0x7fdb50013040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:05.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.419+0000 7fdb56ffd700 1 -- 172.21.15.146:0/2772525002 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fdb5c0542a0 con 0x7fdb600d2350 2023-05-24T03:32:05.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.605+0000 7fdb68660700 1 -- 172.21.15.146:0/2772525002 --> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fdb60072ae0 con 0x7fdb4406ace0 2023-05-24T03:32:05.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.605+0000 7fdb56ffd700 1 -- 172.21.15.146:0/2772525002 <== mgr.4104 v2:172.21.15.146:6832/1985394169 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fdb60072ae0 con 0x7fdb4406ace0 2023-05-24T03:32:05.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.607+0000 7fdb68660700 1 -- 172.21.15.146:0/2772525002 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fdb4406ace0 msgr2=0x7fdb4406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:05.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.607+0000 7fdb68660700 1 --2- 172.21.15.146:0/2772525002 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fdb4406ace0 0x7fdb4406d190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdb500090b0 tx=0x7fdb50013040 comp rx=0 tx=0).stop 2023-05-24T03:32:05.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.607+0000 7fdb68660700 1 -- 172.21.15.146:0/2772525002 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb600d2350 msgr2=0x7fdb600b6bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:05.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.607+0000 7fdb68660700 1 --2- 172.21.15.146:0/2772525002 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb600d2350 0x7fdb600b6bc0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c00c540 tx=0x7fdb5c00c900 comp rx=0 tx=0).stop 2023-05-24T03:32:05.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.607+0000 7fdb68660700 1 -- 172.21.15.146:0/2772525002 shutdown_connections 2023-05-24T03:32:05.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.607+0000 7fdb68660700 1 --2- 172.21.15.146:0/2772525002 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fdb4406ace0 0x7fdb4406d190 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:05.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.607+0000 7fdb68660700 1 --2- 172.21.15.146:0/2772525002 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb6015cb50 0x7fdb600b7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:05.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.607+0000 7fdb68660700 1 --2- 172.21.15.146:0/2772525002 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb600b67d0 0x7fdb60154360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:05.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.607+0000 7fdb68660700 1 --2- 172.21.15.146:0/2772525002 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb600d2350 0x7fdb600b6bc0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:05.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.608+0000 7fdb68660700 1 -- 172.21.15.146:0/2772525002 >> 172.21.15.146:0/2772525002 conn(0x7fdb6006af50 msgr2=0x7fdb600b8220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:32:05.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.608+0000 7fdb68660700 1 -- 172.21.15.146:0/2772525002 shutdown_connections 2023-05-24T03:32:05.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.608+0000 7fdb68660700 1 -- 172.21.15.146:0/2772525002 wait complete. 2023-05-24T03:32:05.615 INFO:teuthology.orchestra.run.smithi146.stderr:instructed osd(s) 2 to deep-scrub 2023-05-24T03:32:05.624 INFO:tasks.ceph:Scrubbing osd.3 2023-05-24T03:32:05.625 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-05-24T03:32:05.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.746+0000 7efdfe0c8700 1 Processor -- start 2023-05-24T03:32:05.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.746+0000 7efdfe0c8700 1 -- start start 2023-05-24T03:32:05.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.747+0000 7efdfe0c8700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efdf80b1c00 0x7efdf80b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:05.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.747+0000 7efdfe0c8700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efdf80b0e30 0x7efdf80ca3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:05.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.747+0000 7efdfe0c8700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdf80b1860 con 0x7efdf80b0520 2023-05-24T03:32:05.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.747+0000 7efdfe0c8700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdf80b2050 con 0x7efdf80b1c00 2023-05-24T03:32:05.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.747+0000 7efdfe0c8700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf80b12a0 con 0x7efdf80b0e30 2023-05-24T03:32:05.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.747+0000 7efdf6ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efdf80b1c00 0x7efdf80b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:05.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.747+0000 7efdf77fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7efdf80b0520 0x7efdf80aed70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47056/0 (socket says 172.21.15.146:47056) 2023-05-24T03:32:05.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.747+0000 7efdf77fe700 1 -- 172.21.15.146:0/1365398391 learned_addr learned my addr 172.21.15.146:0/1365398391 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:32:05.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.748+0000 7efdf7fff700 1 --2- 172.21.15.146:0/1365398391 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efdf80b0e30 0x7efdf80ca3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:05.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.748+0000 7efdf67fc700 1 -- 172.21.15.146:0/1365398391 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3861728566 0 0) 0x7efdf80b1860 con 0x7efdf80b0520 2023-05-24T03:32:05.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.748+0000 7efdf67fc700 1 -- 172.21.15.146:0/1365398391 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efde00057c0 con 0x7efdf80b0520 2023-05-24T03:32:05.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.748+0000 7efdf6ffd700 1 -- 172.21.15.146:0/1365398391 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efdf80b0e30 msgr2=0x7efdf80ca3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:32:05.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.748+0000 7efdf6ffd700 1 --2- 172.21.15.146:0/1365398391 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efdf80b0e30 0x7efdf80ca3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:05.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.748+0000 7efdf6ffd700 1 -- 172.21.15.146:0/1365398391 >> v1:172.21.15.146:6789/0 conn(0x7efdf80b0520 legacy=0x7efdf80aed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:05.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.748+0000 7efdf6ffd700 1 -- 172.21.15.146:0/1365398391 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf80b1580 con 0x7efdf80b1c00 2023-05-24T03:32:05.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.748+0000 7efdf6ffd700 1 --2- 172.21.15.146:0/1365398391 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efdf80b1c00 0x7efdf80b08f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7efde8009840 tx=0x7efde8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29dd83cb7479e991 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:05.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.748+0000 7efdf67fc700 1 -- 172.21.15.146:0/1365398391 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde8011830 con 0x7efdf80b1c00 2023-05-24T03:32:05.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.748+0000 7efdf67fc700 1 -- 172.21.15.146:0/1365398391 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde8011990 con 0x7efdf80b1c00 2023-05-24T03:32:05.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.748+0000 7efdf67fc700 1 -- 172.21.15.146:0/1365398391 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde8011d20 con 0x7efdf80b1c00 2023-05-24T03:32:05.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.749+0000 7efdfe0c8700 1 -- 172.21.15.146:0/1365398391 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efdf80b1c00 msgr2=0x7efdf80b08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:05.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.749+0000 7efdfe0c8700 1 --2- 172.21.15.146:0/1365398391 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efdf80b1c00 0x7efdf80b08f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7efde8009840 tx=0x7efde8009b50 comp rx=0 tx=0).stop 2023-05-24T03:32:05.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.749+0000 7efdfe0c8700 1 -- 172.21.15.146:0/1365398391 shutdown_connections 2023-05-24T03:32:05.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.749+0000 7efdfe0c8700 1 --2- 172.21.15.146:0/1365398391 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efdf80b0e30 0x7efdf80ca3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:05.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.749+0000 7efdfe0c8700 1 --2- 172.21.15.146:0/1365398391 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efdf80b1c00 0x7efdf80b08f0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:05.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.749+0000 7efdfe0c8700 1 -- 172.21.15.146:0/1365398391 >> 172.21.15.146:0/1365398391 conn(0x7efdf80cf6c0 msgr2=0x7efdf80cfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:32:05.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.749+0000 7efdfe0c8700 1 -- 172.21.15.146:0/1365398391 shutdown_connections 2023-05-24T03:32:05.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.749+0000 7efdfe0c8700 1 -- 172.21.15.146:0/1365398391 wait complete. 2023-05-24T03:32:05.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.750+0000 7efdfe0c8700 1 Processor -- start 2023-05-24T03:32:05.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.750+0000 7efdfe0c8700 1 -- start start 2023-05-24T03:32:05.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.751+0000 7efdfe0c8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efdf80b0520 0x7efdf815c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:05.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.751+0000 7efdfe0c8700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efdf80b0e30 0x7efdf80b51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:05.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.751+0000 7efdfe0c8700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efdf80b1c00 0x7efdf8155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:05.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.751+0000 7efdfe0c8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf815ca90 con 0x7efdf80b0520 2023-05-24T03:32:05.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.751+0000 7efdfe0c8700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf80b5730 con 0x7efdf80b1c00 2023-05-24T03:32:05.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.751+0000 7efdfe0c8700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf80b27c0 con 0x7efdf80b0e30 2023-05-24T03:32:05.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.751+0000 7efdf77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efdf80b0520 0x7efdf815c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:05.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.751+0000 7efdf77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efdf80b0520 0x7efdf815c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40610/0 (socket says 172.21.15.146:40610) 2023-05-24T03:32:05.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.751+0000 7efdf77fe700 1 -- 172.21.15.146:0/1909797990 learned_addr learned my addr 172.21.15.146:0/1909797990 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:32:05.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.751+0000 7efdf7fff700 1 --2- 172.21.15.146:0/1909797990 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efdf80b1c00 0x7efdf8155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:05.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.751+0000 7efdf6ffd700 1 --2- 172.21.15.146:0/1909797990 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efdf80b0e30 0x7efdf80b51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:05.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.751+0000 7efdf77fe700 1 -- 172.21.15.146:0/1909797990 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efdf80b0e30 msgr2=0x7efdf80b51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:05.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.751+0000 7efdf77fe700 1 --2- 172.21.15.146:0/1909797990 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efdf80b0e30 0x7efdf80b51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:05.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.751+0000 7efdf77fe700 1 -- 172.21.15.146:0/1909797990 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efdf80b1c00 msgr2=0x7efdf8155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:05.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.751+0000 7efdf77fe700 1 --2- 172.21.15.146:0/1909797990 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efdf80b1c00 0x7efdf8155520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:05.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.751+0000 7efdf77fe700 1 -- 172.21.15.146:0/1909797990 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde80094a0 con 0x7efdf80b0520 2023-05-24T03:32:05.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.751+0000 7efdf77fe700 1 --2- 172.21.15.146:0/1909797990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efdf80b0520 0x7efdf815c550 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7efdec00c700 tx=0x7efdec00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:05.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.751+0000 7efddffff700 1 -- 172.21.15.146:0/1909797990 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdec005d70 con 0x7efdf80b0520 2023-05-24T03:32:05.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.751+0000 7efddffff700 1 -- 172.21.15.146:0/1909797990 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdec0070d0 con 0x7efdf80b0520 2023-05-24T03:32:05.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.751+0000 7efdfe0c8700 1 -- 172.21.15.146:0/1909797990 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdf8159e00 con 0x7efdf80b0520 2023-05-24T03:32:05.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.751+0000 7efddffff700 1 -- 172.21.15.146:0/1909797990 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdec007460 con 0x7efdf80b0520 2023-05-24T03:32:05.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.751+0000 7efdfe0c8700 1 -- 172.21.15.146:0/1909797990 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdf80c9eb0 con 0x7efdf80b0520 2023-05-24T03:32:05.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.752+0000 7efdfe0c8700 1 -- 172.21.15.146:0/1909797990 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efdf8159f90 con 0x7efdf80b0520 2023-05-24T03:32:05.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.753+0000 7efddffff700 1 -- 172.21.15.146:0/1909797990 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efdec0075c0 con 0x7efdf80b0520 2023-05-24T03:32:05.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.753+0000 7efddffff700 1 --2- 172.21.15.146:0/1909797990 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7efde406ace0 0x7efde406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:05.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.753+0000 7efddffff700 1 -- 172.21.15.146:0/1909797990 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7efdec088c30 con 0x7efdf80b0520 2023-05-24T03:32:05.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.753+0000 7efdf6ffd700 1 --2- 172.21.15.146:0/1909797990 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7efde406ace0 0x7efde406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:05.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.753+0000 7efddffff700 1 --2- 172.21.15.146:0/1909797990 >> [v2:172.21.15.146:6816/1749783580,v1:172.21.15.146:6817/1749783580] conn(0x7efde40749f0 0x7efde4076e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:05.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.753+0000 7efddffff700 1 -- 172.21.15.146:0/1909797990 --> [v2:172.21.15.146:6816/1749783580,v1:172.21.15.146:6817/1749783580] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efde4077530 con 0x7efde40749f0 2023-05-24T03:32:05.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.753+0000 7efddffff700 1 -- 172.21.15.146:0/1909797990 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7efdec08b270 con 0x7efdf80b0520 2023-05-24T03:32:05.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.754+0000 7efdf7fff700 1 --2- 172.21.15.146:0/1909797990 >> [v2:172.21.15.146:6816/1749783580,v1:172.21.15.146:6817/1749783580] conn(0x7efde40749f0 0x7efde4076e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:05.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.754+0000 7efdf6ffd700 1 --2- 172.21.15.146:0/1909797990 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7efde406ace0 0x7efde406d190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7efde80090b0 tx=0x7efde801c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:05.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.754+0000 7efdf7fff700 1 --2- 172.21.15.146:0/1909797990 >> [v2:172.21.15.146:6816/1749783580,v1:172.21.15.146:6817/1749783580] conn(0x7efde40749f0 0x7efde4076e60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:05.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.754+0000 7efddffff700 1 -- 172.21.15.146:0/1909797990 <== osd.3 v2:172.21.15.146:6816/1749783580 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7efde4077530 con 0x7efde40749f0 2023-05-24T03:32:05.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.769+0000 7efdfe0c8700 1 -- 172.21.15.146:0/1909797990 --> [v2:172.21.15.146:6816/1749783580,v1:172.21.15.146:6817/1749783580] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7efdf804e810 con 0x7efde40749f0 2023-05-24T03:32:05.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.769+0000 7efddffff700 1 -- 172.21.15.146:0/1909797990 <== osd.3 v2:172.21.15.146:6816/1749783580 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7efdf804e810 con 0x7efde40749f0 2023-05-24T03:32:05.774 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-05-24T03:32:05.774 INFO:teuthology.orchestra.run.smithi146.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-05-24T03:32:05.774 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-05-24T03:32:05.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.769+0000 7efdfe0c8700 1 -- 172.21.15.146:0/1909797990 >> [v2:172.21.15.146:6816/1749783580,v1:172.21.15.146:6817/1749783580] conn(0x7efde40749f0 msgr2=0x7efde4076e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:05.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.769+0000 7efdfe0c8700 1 --2- 172.21.15.146:0/1909797990 >> [v2:172.21.15.146:6816/1749783580,v1:172.21.15.146:6817/1749783580] conn(0x7efde40749f0 0x7efde4076e60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:05.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.769+0000 7efdfe0c8700 1 -- 172.21.15.146:0/1909797990 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7efde406ace0 msgr2=0x7efde406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:05.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.769+0000 7efdfe0c8700 1 --2- 172.21.15.146:0/1909797990 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7efde406ace0 0x7efde406d190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7efde80090b0 tx=0x7efde801c040 comp rx=0 tx=0).stop 2023-05-24T03:32:05.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.769+0000 7efdfe0c8700 1 -- 172.21.15.146:0/1909797990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efdf80b0520 msgr2=0x7efdf815c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:05.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.769+0000 7efdfe0c8700 1 --2- 172.21.15.146:0/1909797990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efdf80b0520 0x7efdf815c550 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7efdec00c700 tx=0x7efdec00ca10 comp rx=0 tx=0).stop 2023-05-24T03:32:05.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.769+0000 7efdf7fff700 1 -- 172.21.15.146:0/1909797990 reap_dead start 2023-05-24T03:32:05.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.769+0000 7efdfe0c8700 1 -- 172.21.15.146:0/1909797990 shutdown_connections 2023-05-24T03:32:05.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.769+0000 7efdfe0c8700 1 -- 172.21.15.146:0/1909797990 >> 172.21.15.146:0/1909797990 conn(0x7efdf80cf6c0 msgr2=0x7efdf8071290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:32:05.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.769+0000 7efdfe0c8700 1 -- 172.21.15.146:0/1909797990 shutdown_connections 2023-05-24T03:32:05.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.769+0000 7efdfe0c8700 1 -- 172.21.15.146:0/1909797990 wait complete. 2023-05-24T03:32:05.786 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-05-24T03:32:05.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.902+0000 7f94f454a700 1 Processor -- start 2023-05-24T03:32:05.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.903+0000 7f94f454a700 1 -- start start 2023-05-24T03:32:05.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.903+0000 7f94f454a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f94ec0cc500 0x7f94ec071720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:05.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.903+0000 7f94f454a700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f94ec071c60 0x7f94ec06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:05.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.904+0000 7f94f454a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94ec0cb740 con 0x7f94ec15a9c0 2023-05-24T03:32:05.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.904+0000 7f94f454a700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94ec0720d0 con 0x7f94ec071c60 2023-05-24T03:32:05.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.904+0000 7f94f454a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec0cba20 con 0x7f94ec0cc500 2023-05-24T03:32:05.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.904+0000 7f94f22e6700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f94ec15a9c0 0x7f94ec0b52e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47072/0 (socket says 172.21.15.146:47072) 2023-05-24T03:32:05.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.904+0000 7f94f22e6700 1 -- 172.21.15.146:0/64390980 learned_addr learned my addr 172.21.15.146:0/64390980 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:32:05.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.904+0000 7f94f1ae5700 1 --2- 172.21.15.146:0/64390980 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f94ec0cc500 0x7f94ec071720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:05.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.904+0000 7f94f2ae7700 1 --2- 172.21.15.146:0/64390980 >> v2:172.21.15.151:3300/0 conn(0x7f94ec071c60 0x7f94ec06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:05.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.904+0000 7f94f12e4700 1 -- 172.21.15.146:0/64390980 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 370749986 0 0) 0x7f94ec0cb740 con 0x7f94ec15a9c0 2023-05-24T03:32:05.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.904+0000 7f94f12e4700 1 -- 172.21.15.146:0/64390980 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94d80035b0 con 0x7f94ec15a9c0 2023-05-24T03:32:05.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.904+0000 7f94f12e4700 1 -- 172.21.15.146:0/64390980 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2427339570 0 0) 0x7f94d80035b0 con 0x7f94ec15a9c0 2023-05-24T03:32:05.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.904+0000 7f94f12e4700 1 -- 172.21.15.146:0/64390980 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f94ec0cc500 msgr2=0x7f94ec071720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:32:05.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.904+0000 7f94f12e4700 1 --2- 172.21.15.146:0/64390980 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f94ec0cc500 0x7f94ec071720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:05.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.904+0000 7f94f12e4700 1 -- 172.21.15.146:0/64390980 >> v2:172.21.15.151:3300/0 conn(0x7f94ec071c60 msgr2=0x7f94ec06d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:32:05.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.904+0000 7f94f12e4700 1 --2- 172.21.15.146:0/64390980 >> v2:172.21.15.151:3300/0 conn(0x7f94ec071c60 0x7f94ec06d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:05.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.904+0000 7f94f12e4700 1 -- 172.21.15.146:0/64390980 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94ec0cbd00 con 0x7f94ec15a9c0 2023-05-24T03:32:05.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.904+0000 7f94f12e4700 1 -- 172.21.15.146:0/64390980 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1301887351 0 0) 0x7f94dc001670 con 0x7f94ec15a9c0 2023-05-24T03:32:05.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.904+0000 7f94f12e4700 1 -- 172.21.15.146:0/64390980 >> v1:172.21.15.146:6789/0 conn(0x7f94ec15a9c0 legacy=0x7f94ec0b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:05.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.904+0000 7f94f12e4700 1 --2- 172.21.15.146:0/64390980 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f94d8003a00 0x7f94d8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:05.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.904+0000 7f94f12e4700 1 --2- 172.21.15.146:0/64390980 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f94ec0cc500 0x7f94d8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:05.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.904+0000 7f94f12e4700 1 --2- 172.21.15.146:0/64390980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94d8004d90 0x7f94d8005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:05.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.904+0000 7f94f12e4700 1 -- 172.21.15.146:0/64390980 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec0720d0 con 0x7f94d8004d90 2023-05-24T03:32:05.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.904+0000 7f94f12e4700 1 -- 172.21.15.146:0/64390980 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec0cba20 con 0x7f94d8003a00 2023-05-24T03:32:05.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.904+0000 7f94f12e4700 1 -- 172.21.15.146:0/64390980 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94d800ba10 con 0x7f94ec0cc500 2023-05-24T03:32:05.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.904+0000 7f94f2ae7700 1 --2- 172.21.15.146:0/64390980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94d8004d90 0x7f94d8005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:05.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.904+0000 7f94f22e6700 1 --2- 172.21.15.146:0/64390980 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f94d8003a00 0x7f94d8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:05.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.904+0000 7f94f1ae5700 1 --2- 172.21.15.146:0/64390980 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f94ec0cc500 0x7f94d8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:05.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.905+0000 7f94f2ae7700 1 -- 172.21.15.146:0/64390980 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f94ec0cc500 msgr2=0x7f94d8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:32:05.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.905+0000 7f94f2ae7700 1 --2- 172.21.15.146:0/64390980 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f94ec0cc500 0x7f94d8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:05.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.905+0000 7f94f2ae7700 1 -- 172.21.15.146:0/64390980 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f94d8003a00 msgr2=0x7f94d8003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:32:05.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.905+0000 7f94f2ae7700 1 --2- 172.21.15.146:0/64390980 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f94d8003a00 0x7f94d8003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:05.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.905+0000 7f94f2ae7700 1 -- 172.21.15.146:0/64390980 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d80035b0 con 0x7f94d8004d90 2023-05-24T03:32:05.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.905+0000 7f94f2ae7700 1 --2- 172.21.15.146:0/64390980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94d8004d90 0x7f94d8005200 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f94e4009fc0 tx=0x7f94d8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=970f386f7449c539 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:05.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.905+0000 7f94f12e4700 1 -- 172.21.15.146:0/64390980 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e400ebd0 con 0x7f94d8004d90 2023-05-24T03:32:05.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.905+0000 7f94f12e4700 1 -- 172.21.15.146:0/64390980 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e400f040 con 0x7f94d8004d90 2023-05-24T03:32:05.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.905+0000 7f94f12e4700 1 -- 172.21.15.146:0/64390980 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e4014480 con 0x7f94d8004d90 2023-05-24T03:32:05.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.905+0000 7f94f454a700 1 -- 172.21.15.146:0/64390980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94d8004d90 msgr2=0x7f94d8005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:05.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.905+0000 7f94f454a700 1 --2- 172.21.15.146:0/64390980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94d8004d90 0x7f94d8005200 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f94e4009fc0 tx=0x7f94d8005880 comp rx=0 tx=0).stop 2023-05-24T03:32:05.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.905+0000 7f94f2ae7700 1 -- 172.21.15.146:0/64390980 reap_dead start 2023-05-24T03:32:05.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.906+0000 7f94f454a700 1 -- 172.21.15.146:0/64390980 shutdown_connections 2023-05-24T03:32:05.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.906+0000 7f94f454a700 1 -- 172.21.15.146:0/64390980 >> 172.21.15.146:0/64390980 conn(0x7f94ec0cfea0 msgr2=0x7f94ec0d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:32:05.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.906+0000 7f94f454a700 1 -- 172.21.15.146:0/64390980 shutdown_connections 2023-05-24T03:32:05.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.906+0000 7f94f454a700 1 -- 172.21.15.146:0/64390980 wait complete. 2023-05-24T03:32:05.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.907+0000 7f94f454a700 1 Processor -- start 2023-05-24T03:32:05.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.907+0000 7f94f454a700 1 -- start start 2023-05-24T03:32:05.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.907+0000 7f94f454a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94d8004d90 0x7f94ec159a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:05.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.907+0000 7f94f454a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f94ec156fa0 0x7f94ec157410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:05.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.907+0000 7f94f454a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f94ec15cd60 0x7f94ec15d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:05.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.907+0000 7f94f454a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec157950 con 0x7f94d8004d90 2023-05-24T03:32:05.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.907+0000 7f94f454a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec157c70 con 0x7f94ec15cd60 2023-05-24T03:32:05.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.907+0000 7f94f454a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec157f50 con 0x7f94ec156fa0 2023-05-24T03:32:05.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.908+0000 7f94f22e6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94d8004d90 0x7f94ec159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:05.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.908+0000 7f94f22e6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94d8004d90 0x7f94ec159a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40632/0 (socket says 172.21.15.146:40632) 2023-05-24T03:32:05.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.908+0000 7f94f22e6700 1 -- 172.21.15.146:0/3603785290 learned_addr learned my addr 172.21.15.146:0/3603785290 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:32:05.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.908+0000 7f94f1ae5700 1 --2- 172.21.15.146:0/3603785290 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f94ec156fa0 0x7f94ec157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:05.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.908+0000 7f94f2ae7700 1 --2- 172.21.15.146:0/3603785290 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f94ec15cd60 0x7f94ec15d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:05.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.908+0000 7f94f22e6700 1 -- 172.21.15.146:0/3603785290 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f94ec156fa0 msgr2=0x7f94ec157410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:05.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.908+0000 7f94f22e6700 1 --2- 172.21.15.146:0/3603785290 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f94ec156fa0 0x7f94ec157410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:05.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.908+0000 7f94f22e6700 1 -- 172.21.15.146:0/3603785290 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f94ec15cd60 msgr2=0x7f94ec15d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:05.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.908+0000 7f94f22e6700 1 --2- 172.21.15.146:0/3603785290 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f94ec15cd60 0x7f94ec15d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:05.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.908+0000 7f94f22e6700 1 -- 172.21.15.146:0/3603785290 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94ec15ad90 con 0x7f94d8004d90 2023-05-24T03:32:05.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.908+0000 7f94f2ae7700 1 --2- 172.21.15.146:0/3603785290 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f94ec15cd60 0x7f94ec15d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:32:05.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.908+0000 7f94f22e6700 1 --2- 172.21.15.146:0/3603785290 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94d8004d90 0x7f94ec159a70 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f94dc000fb0 tx=0x7f94dc0076a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:05.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.908+0000 7f94e2ffd700 1 -- 172.21.15.146:0/3603785290 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94dc0077c0 con 0x7f94d8004d90 2023-05-24T03:32:05.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.908+0000 7f94f454a700 1 -- 172.21.15.146:0/3603785290 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94ec0cbfe0 con 0x7f94d8004d90 2023-05-24T03:32:05.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.908+0000 7f94f454a700 1 -- 172.21.15.146:0/3603785290 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94ec0b5da0 con 0x7f94d8004d90 2023-05-24T03:32:05.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.909+0000 7f94e2ffd700 1 -- 172.21.15.146:0/3603785290 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94dc00f8a0 con 0x7f94d8004d90 2023-05-24T03:32:05.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.909+0000 7f94e2ffd700 1 -- 172.21.15.146:0/3603785290 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94dc00fc10 con 0x7f94d8004d90 2023-05-24T03:32:05.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.909+0000 7f94f454a700 1 -- 172.21.15.146:0/3603785290 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94d40052f0 con 0x7f94d8004d90 2023-05-24T03:32:05.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.910+0000 7f94e2ffd700 1 -- 172.21.15.146:0/3603785290 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f94dc00fd70 con 0x7f94d8004d90 2023-05-24T03:32:05.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.910+0000 7f94e2ffd700 1 --2- 172.21.15.146:0/3603785290 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f94d006ace0 0x7f94d006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:05.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.910+0000 7f94e2ffd700 1 -- 172.21.15.146:0/3603785290 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f94dc0897e0 con 0x7f94d8004d90 2023-05-24T03:32:05.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.910+0000 7f94f1ae5700 1 --2- 172.21.15.146:0/3603785290 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f94d006ace0 0x7f94d006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:05.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.910+0000 7f94f1ae5700 1 --2- 172.21.15.146:0/3603785290 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f94d006ace0 0x7f94d006d190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f94ec1f5700 tx=0x7f94e8009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:05.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:05.914+0000 7f94e2ffd700 1 -- 172.21.15.146:0/3603785290 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f94dc0544d0 con 0x7f94d8004d90 2023-05-24T03:32:06.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.101+0000 7f94f454a700 1 -- 172.21.15.146:0/3603785290 --> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f94d4000bc0 con 0x7f94d006ace0 2023-05-24T03:32:06.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.101+0000 7f94e2ffd700 1 -- 172.21.15.146:0/3603785290 <== mgr.4104 v2:172.21.15.146:6832/1985394169 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f94d4000bc0 con 0x7f94d006ace0 2023-05-24T03:32:06.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.103+0000 7f94f454a700 1 -- 172.21.15.146:0/3603785290 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f94d006ace0 msgr2=0x7f94d006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:06.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.103+0000 7f94f454a700 1 --2- 172.21.15.146:0/3603785290 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f94d006ace0 0x7f94d006d190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f94ec1f5700 tx=0x7f94e8009210 comp rx=0 tx=0).stop 2023-05-24T03:32:06.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.104+0000 7f94f454a700 1 -- 172.21.15.146:0/3603785290 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94d8004d90 msgr2=0x7f94ec159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:06.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.104+0000 7f94f454a700 1 --2- 172.21.15.146:0/3603785290 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94d8004d90 0x7f94ec159a70 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f94dc000fb0 tx=0x7f94dc0076a0 comp rx=0 tx=0).stop 2023-05-24T03:32:06.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.104+0000 7f94f454a700 1 -- 172.21.15.146:0/3603785290 shutdown_connections 2023-05-24T03:32:06.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.104+0000 7f94f454a700 1 --2- 172.21.15.146:0/3603785290 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f94d006ace0 0x7f94d006d190 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:06.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.104+0000 7f94f454a700 1 --2- 172.21.15.146:0/3603785290 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f94ec15cd60 0x7f94ec15d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:06.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.104+0000 7f94f454a700 1 --2- 172.21.15.146:0/3603785290 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94d8004d90 0x7f94ec159a70 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:06.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.104+0000 7f94f454a700 1 --2- 172.21.15.146:0/3603785290 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f94ec156fa0 0x7f94ec157410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:06.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.104+0000 7f94f454a700 1 -- 172.21.15.146:0/3603785290 >> 172.21.15.146:0/3603785290 conn(0x7f94ec0cfea0 msgr2=0x7f94ec0b5230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:32:06.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.104+0000 7f94f454a700 1 -- 172.21.15.146:0/3603785290 shutdown_connections 2023-05-24T03:32:06.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.104+0000 7f94f454a700 1 -- 172.21.15.146:0/3603785290 wait complete. 2023-05-24T03:32:06.111 INFO:teuthology.orchestra.run.smithi146.stderr:instructed osd(s) 3 to deep-scrub 2023-05-24T03:32:06.120 INFO:tasks.ceph:Scrubbing osd.4 2023-05-24T03:32:06.121 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-05-24T03:32:06.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.242+0000 7fea8fb0b700 1 Processor -- start 2023-05-24T03:32:06.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.242+0000 7fea8fb0b700 1 -- start start 2023-05-24T03:32:06.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.243+0000 7fea8fb0b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fea880cb8c0 0x7fea88161030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:06.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.243+0000 7fea8fb0b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea880cbc90 0x7fea8806a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:06.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.243+0000 7fea8fb0b700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea880b27e0 con 0x7fea880cc1d0 2023-05-24T03:32:06.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.243+0000 7fea8fb0b700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea880b2030 con 0x7fea880cb8c0 2023-05-24T03:32:06.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.243+0000 7fea8fb0b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea880b2220 con 0x7fea880cbc90 2023-05-24T03:32:06.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.243+0000 7fea8e0a8700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea880cbc90 0x7fea8806a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:06.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.243+0000 7fea8d8a7700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fea880cb8c0 0x7fea88161030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:06.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.244+0000 7fea8d8a7700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fea880cb8c0 0x7fea88161030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:51822/0 (socket says 172.21.15.146:51822) 2023-05-24T03:32:06.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.244+0000 7fea8e0a8700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea880cbc90 0x7fea8806a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:53508/0 (socket says 172.21.15.146:53508) 2023-05-24T03:32:06.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.244+0000 7fea8d8a7700 1 -- 172.21.15.146:0/3583872825 learned_addr learned my addr 172.21.15.146:0/3583872825 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:32:06.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.244+0000 7fea8d0a6700 1 --1- 172.21.15.146:0/3583872825 >> v1:172.21.15.151:6789/0 conn(0x7fea880cc1d0 0x7fea880b1920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:46126/0 (socket says 172.21.15.146:46126) 2023-05-24T03:32:06.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.244+0000 7fea8c8a5700 1 -- 172.21.15.146:0/3583872825 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 752949462 0 0) 0x7fea880b27e0 con 0x7fea880cc1d0 2023-05-24T03:32:06.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.244+0000 7fea8e0a8700 1 -- 172.21.15.146:0/3583872825 >> v2:172.21.15.151:3300/0 conn(0x7fea880cb8c0 msgr2=0x7fea88161030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:32:06.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.244+0000 7fea8e0a8700 1 --2- 172.21.15.146:0/3583872825 >> v2:172.21.15.151:3300/0 conn(0x7fea880cb8c0 0x7fea88161030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:06.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.244+0000 7fea8e0a8700 1 -- 172.21.15.146:0/3583872825 >> v1:172.21.15.151:6789/0 conn(0x7fea880cc1d0 legacy=0x7fea880b1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:06.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.244+0000 7fea8e0a8700 1 -- 172.21.15.146:0/3583872825 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea880b2500 con 0x7fea880cbc90 2023-05-24T03:32:06.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.244+0000 7fea8d8a7700 1 --2- 172.21.15.146:0/3583872825 >> v2:172.21.15.151:3300/0 conn(0x7fea880cb8c0 0x7fea88161030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T03:32:06.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.244+0000 7fea8e0a8700 1 --2- 172.21.15.146:0/3583872825 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea880cbc90 0x7fea8806a460 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fea80009d90 tx=0x7fea8000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5972bfaf134357ef server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:06.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.244+0000 7fea8c8a5700 1 -- 172.21.15.146:0/3583872825 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8000e070 con 0x7fea880cbc90 2023-05-24T03:32:06.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.244+0000 7fea8c8a5700 1 -- 172.21.15.146:0/3583872825 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea8000bb20 con 0x7fea880cbc90 2023-05-24T03:32:06.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.244+0000 7fea8c8a5700 1 -- 172.21.15.146:0/3583872825 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea80012430 con 0x7fea880cbc90 2023-05-24T03:32:06.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.245+0000 7fea8fb0b700 1 -- 172.21.15.146:0/3583872825 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea880cbc90 msgr2=0x7fea8806a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:06.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.245+0000 7fea8fb0b700 1 --2- 172.21.15.146:0/3583872825 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea880cbc90 0x7fea8806a460 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fea80009d90 tx=0x7fea8000b330 comp rx=0 tx=0).stop 2023-05-24T03:32:06.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.245+0000 7fea8fb0b700 1 -- 172.21.15.146:0/3583872825 shutdown_connections 2023-05-24T03:32:06.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.245+0000 7fea8fb0b700 1 --2- 172.21.15.146:0/3583872825 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea880cbc90 0x7fea8806a460 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:06.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.245+0000 7fea8fb0b700 1 --2- 172.21.15.146:0/3583872825 >> v2:172.21.15.151:3300/0 conn(0x7fea880cb8c0 0x7fea88161030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:06.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.245+0000 7fea8fb0b700 1 -- 172.21.15.146:0/3583872825 >> 172.21.15.146:0/3583872825 conn(0x7fea880cfea0 msgr2=0x7fea880d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:32:06.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.245+0000 7fea8fb0b700 1 -- 172.21.15.146:0/3583872825 shutdown_connections 2023-05-24T03:32:06.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.245+0000 7fea8fb0b700 1 -- 172.21.15.146:0/3583872825 wait complete. 2023-05-24T03:32:06.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.246+0000 7fea8fb0b700 1 Processor -- start 2023-05-24T03:32:06.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.246+0000 7fea8fb0b700 1 -- start start 2023-05-24T03:32:06.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.247+0000 7fea8fb0b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea880cb8c0 0x7fea8815e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:06.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.247+0000 7fea8fb0b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea880cbc90 0x7fea8815ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:06.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.247+0000 7fea8fb0b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea880cc1d0 0x7fea880c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:06.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.247+0000 7fea8fb0b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea880b4070 con 0x7fea880cb8c0 2023-05-24T03:32:06.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.247+0000 7fea8fb0b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea880b3d20 con 0x7fea880cc1d0 2023-05-24T03:32:06.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.247+0000 7fea8fb0b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea880caa30 con 0x7fea880cbc90 2023-05-24T03:32:06.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.247+0000 7fea8d8a7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea880cb8c0 0x7fea8815e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:06.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.247+0000 7fea8d8a7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea880cb8c0 0x7fea8815e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40646/0 (socket says 172.21.15.146:40646) 2023-05-24T03:32:06.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.247+0000 7fea8d8a7700 1 -- 172.21.15.146:0/610613114 learned_addr learned my addr 172.21.15.146:0/610613114 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:32:06.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.247+0000 7fea8d0a6700 1 --2- 172.21.15.146:0/610613114 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea880cbc90 0x7fea8815ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:06.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.247+0000 7fea8e0a8700 1 --2- 172.21.15.146:0/610613114 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea880cc1d0 0x7fea880c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:06.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.247+0000 7fea8d8a7700 1 -- 172.21.15.146:0/610613114 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea880cbc90 msgr2=0x7fea8815ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:06.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.247+0000 7fea8d8a7700 1 --2- 172.21.15.146:0/610613114 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea880cbc90 0x7fea8815ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:06.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.247+0000 7fea8d8a7700 1 -- 172.21.15.146:0/610613114 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea880cc1d0 msgr2=0x7fea880c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:06.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.247+0000 7fea8d8a7700 1 --2- 172.21.15.146:0/610613114 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea880cc1d0 0x7fea880c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:06.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.247+0000 7fea8d8a7700 1 -- 172.21.15.146:0/610613114 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea78009550 con 0x7fea880cb8c0 2023-05-24T03:32:06.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.247+0000 7fea8e0a8700 1 --2- 172.21.15.146:0/610613114 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea880cc1d0 0x7fea880c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:32:06.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.247+0000 7fea8d8a7700 1 --2- 172.21.15.146:0/610613114 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea880cb8c0 0x7fea8815e770 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fea7800ec10 tx=0x7fea7800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:06.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.248+0000 7fea7e7fc700 1 -- 172.21.15.146:0/610613114 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea7800c850 con 0x7fea880cb8c0 2023-05-24T03:32:06.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.248+0000 7fea8fb0b700 1 -- 172.21.15.146:0/610613114 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea80009a70 con 0x7fea880cb8c0 2023-05-24T03:32:06.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.248+0000 7fea7e7fc700 1 -- 172.21.15.146:0/610613114 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea7800c9b0 con 0x7fea880cb8c0 2023-05-24T03:32:06.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.248+0000 7fea7e7fc700 1 -- 172.21.15.146:0/610613114 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea7800cd20 con 0x7fea880cb8c0 2023-05-24T03:32:06.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.248+0000 7fea8fb0b700 1 -- 172.21.15.146:0/610613114 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea88160b10 con 0x7fea880cb8c0 2023-05-24T03:32:06.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.248+0000 7fea8fb0b700 1 -- 172.21.15.146:0/610613114 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fea88160830 con 0x7fea880cb8c0 2023-05-24T03:32:06.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.249+0000 7fea7e7fc700 1 -- 172.21.15.146:0/610613114 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fea78013470 con 0x7fea880cb8c0 2023-05-24T03:32:06.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.249+0000 7fea7e7fc700 1 --2- 172.21.15.146:0/610613114 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fea6c06ace0 0x7fea6c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:06.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.249+0000 7fea7e7fc700 1 -- 172.21.15.146:0/610613114 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fea780898b0 con 0x7fea880cb8c0 2023-05-24T03:32:06.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.249+0000 7fea8d0a6700 1 --2- 172.21.15.146:0/610613114 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fea6c06ace0 0x7fea6c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:06.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.249+0000 7fea7e7fc700 1 --2- 172.21.15.146:0/610613114 >> [v2:172.21.15.151:6809/163453435,v1:172.21.15.151:6811/163453435] conn(0x7fea6c074970 0x7fea6c076de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:06.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.249+0000 7fea7e7fc700 1 -- 172.21.15.146:0/610613114 --> [v2:172.21.15.151:6809/163453435,v1:172.21.15.151:6811/163453435] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fea6c0774b0 con 0x7fea6c074970 2023-05-24T03:32:06.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.249+0000 7fea7e7fc700 1 -- 172.21.15.146:0/610613114 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea7808e2c0 con 0x7fea880cb8c0 2023-05-24T03:32:06.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.250+0000 7fea8d0a6700 1 --2- 172.21.15.146:0/610613114 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fea6c06ace0 0x7fea6c06d190 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fea88071e90 tx=0x7fea84007e70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:06.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.250+0000 7fea8e0a8700 1 --2- 172.21.15.146:0/610613114 >> [v2:172.21.15.151:6809/163453435,v1:172.21.15.151:6811/163453435] conn(0x7fea6c074970 0x7fea6c076de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:06.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.250+0000 7fea8e0a8700 1 --2- 172.21.15.146:0/610613114 >> [v2:172.21.15.151:6809/163453435,v1:172.21.15.151:6811/163453435] conn(0x7fea6c074970 0x7fea6c076de0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:06.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.251+0000 7fea7e7fc700 1 -- 172.21.15.146:0/610613114 <== osd.4 v2:172.21.15.151:6809/163453435 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fea6c0774b0 con 0x7fea6c074970 2023-05-24T03:32:06.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.265+0000 7fea8fb0b700 1 -- 172.21.15.146:0/610613114 --> [v2:172.21.15.151:6809/163453435,v1:172.21.15.151:6811/163453435] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fea88161570 con 0x7fea6c074970 2023-05-24T03:32:06.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.266+0000 7fea7e7fc700 1 -- 172.21.15.146:0/610613114 <== osd.4 v2:172.21.15.151:6809/163453435 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fea88161570 con 0x7fea6c074970 2023-05-24T03:32:06.271 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-05-24T03:32:06.271 INFO:teuthology.orchestra.run.smithi146.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-05-24T03:32:06.271 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-05-24T03:32:06.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.266+0000 7fea8fb0b700 1 -- 172.21.15.146:0/610613114 >> [v2:172.21.15.151:6809/163453435,v1:172.21.15.151:6811/163453435] conn(0x7fea6c074970 msgr2=0x7fea6c076de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:06.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.266+0000 7fea8fb0b700 1 --2- 172.21.15.146:0/610613114 >> [v2:172.21.15.151:6809/163453435,v1:172.21.15.151:6811/163453435] conn(0x7fea6c074970 0x7fea6c076de0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:06.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.266+0000 7fea8fb0b700 1 -- 172.21.15.146:0/610613114 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fea6c06ace0 msgr2=0x7fea6c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:06.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.266+0000 7fea8fb0b700 1 --2- 172.21.15.146:0/610613114 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fea6c06ace0 0x7fea6c06d190 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fea88071e90 tx=0x7fea84007e70 comp rx=0 tx=0).stop 2023-05-24T03:32:06.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.266+0000 7fea8fb0b700 1 -- 172.21.15.146:0/610613114 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea880cb8c0 msgr2=0x7fea8815e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:06.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.266+0000 7fea8fb0b700 1 --2- 172.21.15.146:0/610613114 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea880cb8c0 0x7fea8815e770 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fea7800ec10 tx=0x7fea7800ef20 comp rx=0 tx=0).stop 2023-05-24T03:32:06.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.266+0000 7fea8e0a8700 1 -- 172.21.15.146:0/610613114 reap_dead start 2023-05-24T03:32:06.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.266+0000 7fea8fb0b700 1 -- 172.21.15.146:0/610613114 shutdown_connections 2023-05-24T03:32:06.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.266+0000 7fea8fb0b700 1 -- 172.21.15.146:0/610613114 >> 172.21.15.146:0/610613114 conn(0x7fea880cfea0 msgr2=0x7fea880cf5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:32:06.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.266+0000 7fea8fb0b700 1 -- 172.21.15.146:0/610613114 shutdown_connections 2023-05-24T03:32:06.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.266+0000 7fea8fb0b700 1 -- 172.21.15.146:0/610613114 wait complete. 2023-05-24T03:32:06.282 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-05-24T03:32:06.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.401+0000 7f8fb67ff700 1 Processor -- start 2023-05-24T03:32:06.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.401+0000 7f8fb67ff700 1 -- start start 2023-05-24T03:32:06.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.401+0000 7f8fb67ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8fb00cba20 0x7f8fb01604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:06.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.401+0000 7f8fb67ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8fb00cf310 0x7f8fb00cf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:06.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.401+0000 7f8fb67ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fb00cfc90 con 0x7f8fb0071b90 2023-05-24T03:32:06.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.401+0000 7f8fb67ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fb00cebe0 con 0x7f8fb00cf310 2023-05-24T03:32:06.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.401+0000 7f8fb67ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fb0161410 con 0x7f8fb00cba20 2023-05-24T03:32:06.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.402+0000 7f8fb4d9c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8fb00cf310 0x7f8fb00cf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:06.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.402+0000 7f8faf7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8fb0071b90 0x7f8fb00cc470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47108/0 (socket says 172.21.15.146:47108) 2023-05-24T03:32:06.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.402+0000 7f8fb4d9c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8fb00cf310 0x7f8fb00cf750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40658/0 (socket says 172.21.15.146:40658) 2023-05-24T03:32:06.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.402+0000 7f8faf7fe700 1 -- 172.21.15.146:0/2419556080 learned_addr learned my addr 172.21.15.146:0/2419556080 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:32:06.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.402+0000 7f8faffff700 1 --2- 172.21.15.146:0/2419556080 >> v2:172.21.15.151:3300/0 conn(0x7f8fb00cba20 0x7f8fb01604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:06.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.402+0000 7f8fb4d9c700 1 -- 172.21.15.146:0/2419556080 >> v2:172.21.15.151:3300/0 conn(0x7f8fb00cba20 msgr2=0x7f8fb01604e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:32:06.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.402+0000 7f8fb4d9c700 1 --2- 172.21.15.146:0/2419556080 >> v2:172.21.15.151:3300/0 conn(0x7f8fb00cba20 0x7f8fb01604e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:06.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.402+0000 7f8fb4d9c700 1 -- 172.21.15.146:0/2419556080 >> v1:172.21.15.146:6789/0 conn(0x7f8fb0071b90 legacy=0x7f8fb00cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:06.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.402+0000 7f8faeffd700 1 -- 172.21.15.146:0/2419556080 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2670482738 0 0) 0x7f8fb00cfc90 con 0x7f8fb0071b90 2023-05-24T03:32:06.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.402+0000 7f8fb4d9c700 1 -- 172.21.15.146:0/2419556080 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb0160b70 con 0x7f8fb00cf310 2023-05-24T03:32:06.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.402+0000 7f8fb4d9c700 1 --2- 172.21.15.146:0/2419556080 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fb00cf310 0x7f8fb00cf750 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8fb006b2b0 tx=0x7f8fa800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a7fcb15edde4960 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:06.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.402+0000 7f8faeffd700 1 -- 172.21.15.146:0/2419556080 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa800e070 con 0x7f8fb00cf310 2023-05-24T03:32:06.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.402+0000 7f8faeffd700 1 -- 172.21.15.146:0/2419556080 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa800bbd0 con 0x7f8fb00cf310 2023-05-24T03:32:06.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.402+0000 7f8faeffd700 1 -- 172.21.15.146:0/2419556080 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa8012430 con 0x7f8fb00cf310 2023-05-24T03:32:06.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.403+0000 7f8fb67ff700 1 -- 172.21.15.146:0/2419556080 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fb00cf310 msgr2=0x7f8fb00cf750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:06.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.403+0000 7f8fb67ff700 1 --2- 172.21.15.146:0/2419556080 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fb00cf310 0x7f8fb00cf750 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8fb006b2b0 tx=0x7f8fa800b330 comp rx=0 tx=0).stop 2023-05-24T03:32:06.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.403+0000 7f8fb67ff700 1 -- 172.21.15.146:0/2419556080 shutdown_connections 2023-05-24T03:32:06.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.403+0000 7f8fb67ff700 1 --2- 172.21.15.146:0/2419556080 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fb00cf310 0x7f8fb00cf750 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:06.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.403+0000 7f8fb67ff700 1 --2- 172.21.15.146:0/2419556080 >> v2:172.21.15.151:3300/0 conn(0x7f8fb00cba20 0x7f8fb01604e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:06.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.403+0000 7f8fb67ff700 1 -- 172.21.15.146:0/2419556080 >> 172.21.15.146:0/2419556080 conn(0x7f8fb006eb70 msgr2=0x7f8fb006ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:32:06.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.403+0000 7f8fb67ff700 1 -- 172.21.15.146:0/2419556080 shutdown_connections 2023-05-24T03:32:06.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.403+0000 7f8fb67ff700 1 -- 172.21.15.146:0/2419556080 wait complete. 2023-05-24T03:32:06.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.404+0000 7f8fb67ff700 1 Processor -- start 2023-05-24T03:32:06.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.404+0000 7f8fb67ff700 1 -- start start 2023-05-24T03:32:06.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.405+0000 7f8fb67ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8fb0071b90 0x7f8fb01f5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:06.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.405+0000 7f8fb67ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fb00cba20 0x7f8fb01522e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:06.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.405+0000 7f8fb67ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8fb00cf310 0x7f8fb015dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:06.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.405+0000 7f8fb67ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb0152820 con 0x7f8fb00cba20 2023-05-24T03:32:06.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.405+0000 7f8fb67ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb00b40a0 con 0x7f8fb0071b90 2023-05-24T03:32:06.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.405+0000 7f8fb67ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb01f5b00 con 0x7f8fb00cf310 2023-05-24T03:32:06.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.405+0000 7f8faf7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fb00cba20 0x7f8fb01522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:06.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.405+0000 7f8faf7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fb00cba20 0x7f8fb01522e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40662/0 (socket says 172.21.15.146:40662) 2023-05-24T03:32:06.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.405+0000 7f8faf7fe700 1 -- 172.21.15.146:0/3532563138 learned_addr learned my addr 172.21.15.146:0/3532563138 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:32:06.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.405+0000 7f8faffff700 1 --2- 172.21.15.146:0/3532563138 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8fb0071b90 0x7f8fb01f5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:06.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.405+0000 7f8fb4d9c700 1 --2- 172.21.15.146:0/3532563138 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8fb00cf310 0x7f8fb015dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:06.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.405+0000 7f8faf7fe700 1 -- 172.21.15.146:0/3532563138 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8fb00cf310 msgr2=0x7f8fb015dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:06.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.405+0000 7f8faf7fe700 1 --2- 172.21.15.146:0/3532563138 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8fb00cf310 0x7f8fb015dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:06.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.405+0000 7f8faf7fe700 1 -- 172.21.15.146:0/3532563138 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8fb0071b90 msgr2=0x7f8fb01f5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:06.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.405+0000 7f8faf7fe700 1 --2- 172.21.15.146:0/3532563138 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8fb0071b90 0x7f8fb01f5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:06.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.405+0000 7f8faf7fe700 1 -- 172.21.15.146:0/3532563138 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa8009a70 con 0x7f8fb00cba20 2023-05-24T03:32:06.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.405+0000 7f8fb4d9c700 1 --2- 172.21.15.146:0/3532563138 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8fb00cf310 0x7f8fb015dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:32:06.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.405+0000 7f8faf7fe700 1 --2- 172.21.15.146:0/3532563138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fb00cba20 0x7f8fb01522e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8fa40011e0 tx=0x7f8fa400ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:06.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.406+0000 7f8facff9700 1 -- 172.21.15.146:0/3532563138 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa4004c80 con 0x7f8fb00cba20 2023-05-24T03:32:06.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.406+0000 7f8facff9700 1 -- 172.21.15.146:0/3532563138 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa4004de0 con 0x7f8fb00cba20 2023-05-24T03:32:06.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.406+0000 7f8fb67ff700 1 -- 172.21.15.146:0/3532563138 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fb0161130 con 0x7f8fb00cba20 2023-05-24T03:32:06.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.406+0000 7f8facff9700 1 -- 172.21.15.146:0/3532563138 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa4007310 con 0x7f8fb00cba20 2023-05-24T03:32:06.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.406+0000 7f8fb67ff700 1 -- 172.21.15.146:0/3532563138 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fb0160e50 con 0x7f8fb00cba20 2023-05-24T03:32:06.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.407+0000 7f8fb67ff700 1 -- 172.21.15.146:0/3532563138 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fb00cedf0 con 0x7f8fb00cba20 2023-05-24T03:32:06.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.407+0000 7f8facff9700 1 -- 172.21.15.146:0/3532563138 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8fa4007470 con 0x7f8fb00cba20 2023-05-24T03:32:06.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.408+0000 7f8facff9700 1 --2- 172.21.15.146:0/3532563138 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f8f9c06ace0 0x7f8f9c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:06.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.408+0000 7f8facff9700 1 -- 172.21.15.146:0/3532563138 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8fa4089ab0 con 0x7f8fb00cba20 2023-05-24T03:32:06.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.408+0000 7f8faffff700 1 --2- 172.21.15.146:0/3532563138 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f8f9c06ace0 0x7f8f9c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:06.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.408+0000 7f8faffff700 1 --2- 172.21.15.146:0/3532563138 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f8f9c06ace0 0x7f8f9c06d190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0006b20 tx=0x7f8fa0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:06.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.412+0000 7f8facff9700 1 -- 172.21.15.146:0/3532563138 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f8fa4054910 con 0x7f8fb00cba20 2023-05-24T03:32:06.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.602+0000 7f8fb67ff700 1 -- 172.21.15.146:0/3532563138 --> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f8fb00b4210 con 0x7f8f9c06ace0 2023-05-24T03:32:06.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.602+0000 7f8facff9700 1 -- 172.21.15.146:0/3532563138 <== mgr.4104 v2:172.21.15.146:6832/1985394169 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8fb00b4210 con 0x7f8f9c06ace0 2023-05-24T03:32:06.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.604+0000 7f8fb67ff700 1 -- 172.21.15.146:0/3532563138 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f8f9c06ace0 msgr2=0x7f8f9c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:06.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.604+0000 7f8fb67ff700 1 --2- 172.21.15.146:0/3532563138 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f8f9c06ace0 0x7f8f9c06d190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0006b20 tx=0x7f8fa0008040 comp rx=0 tx=0).stop 2023-05-24T03:32:06.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.604+0000 7f8fb67ff700 1 -- 172.21.15.146:0/3532563138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fb00cba20 msgr2=0x7f8fb01522e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:06.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.604+0000 7f8fb67ff700 1 --2- 172.21.15.146:0/3532563138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fb00cba20 0x7f8fb01522e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8fa40011e0 tx=0x7f8fa400ca30 comp rx=0 tx=0).stop 2023-05-24T03:32:06.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.604+0000 7f8fb67ff700 1 -- 172.21.15.146:0/3532563138 shutdown_connections 2023-05-24T03:32:06.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.604+0000 7f8fb67ff700 1 --2- 172.21.15.146:0/3532563138 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f8f9c06ace0 0x7f8f9c06d190 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:06.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.604+0000 7f8fb67ff700 1 --2- 172.21.15.146:0/3532563138 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8fb00cf310 0x7f8fb015dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:06.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.604+0000 7f8fb67ff700 1 --2- 172.21.15.146:0/3532563138 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8fb0071b90 0x7f8fb01f5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:06.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.604+0000 7f8fb67ff700 1 --2- 172.21.15.146:0/3532563138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fb00cba20 0x7f8fb01522e0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:06.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.604+0000 7f8fb67ff700 1 -- 172.21.15.146:0/3532563138 >> 172.21.15.146:0/3532563138 conn(0x7f8fb006eb70 msgr2=0x7f8fb0070eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:32:06.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.604+0000 7f8fb67ff700 1 -- 172.21.15.146:0/3532563138 shutdown_connections 2023-05-24T03:32:06.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.604+0000 7f8fb67ff700 1 -- 172.21.15.146:0/3532563138 wait complete. 2023-05-24T03:32:06.612 INFO:teuthology.orchestra.run.smithi146.stderr:instructed osd(s) 4 to deep-scrub 2023-05-24T03:32:06.621 INFO:tasks.ceph:Scrubbing osd.5 2023-05-24T03:32:06.621 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-05-24T03:32:06.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.741+0000 7efce8658700 1 Processor -- start 2023-05-24T03:32:06.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.741+0000 7efce8658700 1 -- start start 2023-05-24T03:32:06.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.742+0000 7efce8658700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efce006baa0 0x7efce00cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:06.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.742+0000 7efce8658700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efce00d0240 0x7efce00b80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:06.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.742+0000 7efce8658700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efce00cd960 con 0x7efce00d2a30 2023-05-24T03:32:06.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.742+0000 7efce8658700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efce01612b0 con 0x7efce006baa0 2023-05-24T03:32:06.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.742+0000 7efce8658700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efce00cdc00 con 0x7efce00d0240 2023-05-24T03:32:06.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.742+0000 7efce5bf3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efce006baa0 0x7efce00cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:06.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.742+0000 7efce5bf3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efce006baa0 0x7efce00cf530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40670/0 (socket says 172.21.15.146:40670) 2023-05-24T03:32:06.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.742+0000 7efce5bf3700 1 -- 172.21.15.146:0/2384338999 learned_addr learned my addr 172.21.15.146:0/2384338999 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:32:06.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.743+0000 7efce6bf5700 1 --2- 172.21.15.146:0/2384338999 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efce00d0240 0x7efce00b80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:06.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.743+0000 7efce5bf3700 1 -- 172.21.15.146:0/2384338999 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efce00d0240 msgr2=0x7efce00b80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:32:06.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.743+0000 7efce5bf3700 1 --2- 172.21.15.146:0/2384338999 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efce00d0240 0x7efce00b80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:06.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.743+0000 7efce5bf3700 1 -- 172.21.15.146:0/2384338999 >> v1:172.21.15.151:6789/0 conn(0x7efce00d2a30 legacy=0x7efce00cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:06.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.743+0000 7efce5bf3700 1 -- 172.21.15.146:0/2384338999 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce0161590 con 0x7efce006baa0 2023-05-24T03:32:06.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.743+0000 7efce5bf3700 1 --2- 172.21.15.146:0/2384338999 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efce006baa0 0x7efce00cf530 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7efcdc009920 tx=0x7efcdc009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=655b689012ef99d6 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:06.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.743+0000 7efce53f2700 1 -- 172.21.15.146:0/2384338999 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcdc011830 con 0x7efce006baa0 2023-05-24T03:32:06.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.743+0000 7efce53f2700 1 -- 172.21.15.146:0/2384338999 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcdc011990 con 0x7efce006baa0 2023-05-24T03:32:06.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.743+0000 7efce53f2700 1 -- 172.21.15.146:0/2384338999 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcdc011d20 con 0x7efce006baa0 2023-05-24T03:32:06.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.744+0000 7efce8658700 1 -- 172.21.15.146:0/2384338999 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efce006baa0 msgr2=0x7efce00cf530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:06.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.744+0000 7efce8658700 1 --2- 172.21.15.146:0/2384338999 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efce006baa0 0x7efce00cf530 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7efcdc009920 tx=0x7efcdc009c30 comp rx=0 tx=0).stop 2023-05-24T03:32:06.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.744+0000 7efce8658700 1 -- 172.21.15.146:0/2384338999 shutdown_connections 2023-05-24T03:32:06.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.744+0000 7efce8658700 1 --2- 172.21.15.146:0/2384338999 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efce00d0240 0x7efce00b80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:06.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.744+0000 7efce8658700 1 --2- 172.21.15.146:0/2384338999 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efce006baa0 0x7efce00cf530 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:06.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.744+0000 7efce8658700 1 -- 172.21.15.146:0/2384338999 >> 172.21.15.146:0/2384338999 conn(0x7efce00743a0 msgr2=0x7efce006af50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:32:06.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.744+0000 7efce8658700 1 -- 172.21.15.146:0/2384338999 shutdown_connections 2023-05-24T03:32:06.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.744+0000 7efce8658700 1 -- 172.21.15.146:0/2384338999 wait complete. 2023-05-24T03:32:06.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.745+0000 7efce8658700 1 Processor -- start 2023-05-24T03:32:06.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.745+0000 7efce8658700 1 -- start start 2023-05-24T03:32:06.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.746+0000 7efce8658700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efce006baa0 0x7efce015b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:06.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.746+0000 7efce8658700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efce00d0240 0x7efce01e6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:06.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.746+0000 7efce8658700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efce00d2a30 0x7efce00caa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:06.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.746+0000 7efce8658700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce00c6ed0 con 0x7efce00d0240 2023-05-24T03:32:06.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.746+0000 7efce8658700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce00c71b0 con 0x7efce00d2a30 2023-05-24T03:32:06.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.746+0000 7efce8658700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efce00c7490 con 0x7efce006baa0 2023-05-24T03:32:06.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.746+0000 7efce5bf3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efce00d0240 0x7efce01e6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:06.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.746+0000 7efce5bf3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efce00d0240 0x7efce01e6df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40676/0 (socket says 172.21.15.146:40676) 2023-05-24T03:32:06.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.746+0000 7efce5bf3700 1 -- 172.21.15.146:0/2207497387 learned_addr learned my addr 172.21.15.146:0/2207497387 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:32:06.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.746+0000 7efce63f4700 1 --2- 172.21.15.146:0/2207497387 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efce006baa0 0x7efce015b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:06.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.746+0000 7efce6bf5700 1 --2- 172.21.15.146:0/2207497387 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efce00d2a30 0x7efce00caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:06.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.746+0000 7efce5bf3700 1 -- 172.21.15.146:0/2207497387 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efce006baa0 msgr2=0x7efce015b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:06.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.746+0000 7efce5bf3700 1 --2- 172.21.15.146:0/2207497387 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efce006baa0 0x7efce015b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:06.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.746+0000 7efce5bf3700 1 -- 172.21.15.146:0/2207497387 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efce00d2a30 msgr2=0x7efce00caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:06.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.746+0000 7efce5bf3700 1 --2- 172.21.15.146:0/2207497387 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efce00d2a30 0x7efce00caa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:06.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.746+0000 7efce5bf3700 1 -- 172.21.15.146:0/2207497387 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcdc009550 con 0x7efce00d0240 2023-05-24T03:32:06.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.746+0000 7efce5bf3700 1 --2- 172.21.15.146:0/2207497387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efce00d0240 0x7efce01e6df0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7efcdc0098f0 tx=0x7efcdc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:06.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.746+0000 7efcd6ffd700 1 -- 172.21.15.146:0/2207497387 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcdc004300 con 0x7efce00d0240 2023-05-24T03:32:06.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.746+0000 7efcd6ffd700 1 -- 172.21.15.146:0/2207497387 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcdc01f070 con 0x7efce00d0240 2023-05-24T03:32:06.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.746+0000 7efce8658700 1 -- 172.21.15.146:0/2207497387 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efce01469e0 con 0x7efce00d0240 2023-05-24T03:32:06.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.746+0000 7efcd6ffd700 1 -- 172.21.15.146:0/2207497387 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcdc0036a0 con 0x7efce00d0240 2023-05-24T03:32:06.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.746+0000 7efce8658700 1 -- 172.21.15.146:0/2207497387 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efce0146850 con 0x7efce00d0240 2023-05-24T03:32:06.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.747+0000 7efce8658700 1 -- 172.21.15.146:0/2207497387 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efce00b8620 con 0x7efce00d0240 2023-05-24T03:32:06.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.748+0000 7efcd6ffd700 1 -- 172.21.15.146:0/2207497387 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efcdc021030 con 0x7efce00d0240 2023-05-24T03:32:06.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.748+0000 7efcd6ffd700 1 --2- 172.21.15.146:0/2207497387 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7efcc406ace0 0x7efcc406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:06.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.748+0000 7efcd6ffd700 1 -- 172.21.15.146:0/2207497387 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7efcdc08a9a0 con 0x7efce00d0240 2023-05-24T03:32:06.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.748+0000 7efce63f4700 1 --2- 172.21.15.146:0/2207497387 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7efcc406ace0 0x7efcc406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:06.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.748+0000 7efcd6ffd700 1 --2- 172.21.15.146:0/2207497387 >> [v2:172.21.15.151:6800/3283474903,v1:172.21.15.151:6801/3283474903] conn(0x7efcc40749f0 0x7efcc4076e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:06.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.748+0000 7efcd6ffd700 1 -- 172.21.15.146:0/2207497387 --> [v2:172.21.15.151:6800/3283474903,v1:172.21.15.151:6801/3283474903] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efcc4077530 con 0x7efcc40749f0 2023-05-24T03:32:06.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.748+0000 7efcd6ffd700 1 -- 172.21.15.146:0/2207497387 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7efcdc08f2c0 con 0x7efce00d0240 2023-05-24T03:32:06.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.748+0000 7efce6bf5700 1 --2- 172.21.15.146:0/2207497387 >> [v2:172.21.15.151:6800/3283474903,v1:172.21.15.151:6801/3283474903] conn(0x7efcc40749f0 0x7efcc4076e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:06.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.748+0000 7efce63f4700 1 --2- 172.21.15.146:0/2207497387 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7efcc406ace0 0x7efcc406d190 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efcd0000fb0 tx=0x7efcd0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:06.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.749+0000 7efce6bf5700 1 --2- 172.21.15.146:0/2207497387 >> [v2:172.21.15.151:6800/3283474903,v1:172.21.15.151:6801/3283474903] conn(0x7efcc40749f0 0x7efcc4076e60 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:06.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.749+0000 7efcd6ffd700 1 -- 172.21.15.146:0/2207497387 <== osd.5 v2:172.21.15.151:6800/3283474903 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7efcc4077530 con 0x7efcc40749f0 2023-05-24T03:32:06.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.764+0000 7efce8658700 1 -- 172.21.15.146:0/2207497387 --> [v2:172.21.15.151:6800/3283474903,v1:172.21.15.151:6801/3283474903] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7efce01610d0 con 0x7efcc40749f0 2023-05-24T03:32:06.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.765+0000 7efcd6ffd700 1 -- 172.21.15.146:0/2207497387 <== osd.5 v2:172.21.15.151:6800/3283474903 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7efce01610d0 con 0x7efcc40749f0 2023-05-24T03:32:06.769 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-05-24T03:32:06.770 INFO:teuthology.orchestra.run.smithi146.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-05-24T03:32:06.770 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-05-24T03:32:06.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.765+0000 7efce8658700 1 -- 172.21.15.146:0/2207497387 >> [v2:172.21.15.151:6800/3283474903,v1:172.21.15.151:6801/3283474903] conn(0x7efcc40749f0 msgr2=0x7efcc4076e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:06.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.765+0000 7efce8658700 1 --2- 172.21.15.146:0/2207497387 >> [v2:172.21.15.151:6800/3283474903,v1:172.21.15.151:6801/3283474903] conn(0x7efcc40749f0 0x7efcc4076e60 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:06.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.765+0000 7efce8658700 1 -- 172.21.15.146:0/2207497387 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7efcc406ace0 msgr2=0x7efcc406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:06.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.765+0000 7efce8658700 1 --2- 172.21.15.146:0/2207497387 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7efcc406ace0 0x7efcc406d190 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efcd0000fb0 tx=0x7efcd0009040 comp rx=0 tx=0).stop 2023-05-24T03:32:06.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.765+0000 7efce8658700 1 -- 172.21.15.146:0/2207497387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efce00d0240 msgr2=0x7efce01e6df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:06.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.765+0000 7efce8658700 1 --2- 172.21.15.146:0/2207497387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efce00d0240 0x7efce01e6df0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7efcdc0098f0 tx=0x7efcdc004750 comp rx=0 tx=0).stop 2023-05-24T03:32:06.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.765+0000 7efce6bf5700 1 -- 172.21.15.146:0/2207497387 reap_dead start 2023-05-24T03:32:06.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.765+0000 7efce8658700 1 -- 172.21.15.146:0/2207497387 shutdown_connections 2023-05-24T03:32:06.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.765+0000 7efce8658700 1 -- 172.21.15.146:0/2207497387 >> 172.21.15.146:0/2207497387 conn(0x7efce00743a0 msgr2=0x7efce00d0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:32:06.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.765+0000 7efce8658700 1 -- 172.21.15.146:0/2207497387 shutdown_connections 2023-05-24T03:32:06.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.765+0000 7efce8658700 1 -- 172.21.15.146:0/2207497387 wait complete. 2023-05-24T03:32:06.782 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-05-24T03:32:06.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.899+0000 7f79f5069700 1 Processor -- start 2023-05-24T03:32:06.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.899+0000 7f79f5069700 1 -- start start 2023-05-24T03:32:06.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.900+0000 7f79f5069700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f79f00aebc0 0x7f79f00711c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:06.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.900+0000 7f79f5069700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f79f0073760 0x7f79f00af810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:06.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.900+0000 7f79f5069700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79f00afd50 0x7f79f015e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:06.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.900+0000 7f79f5069700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79f006bce0 con 0x7f79f00aebc0 2023-05-24T03:32:06.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.900+0000 7f79f5069700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79f00aef90 con 0x7f79f0073760 2023-05-24T03:32:06.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.900+0000 7f79f5069700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79f0073bd0 con 0x7f79f00afd50 2023-05-24T03:32:06.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.900+0000 7f79eed9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f79f00aebc0 0x7f79f00711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:06.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.900+0000 7f79eed9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f79f00aebc0 0x7f79f00711c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40686/0 (socket says 172.21.15.146:40686) 2023-05-24T03:32:06.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.900+0000 7f79eed9d700 1 -- 172.21.15.146:0/3989897449 learned_addr learned my addr 172.21.15.146:0/3989897449 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:32:06.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.900+0000 7f79ef59e700 1 --2- 172.21.15.146:0/3989897449 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79f00afd50 0x7f79f015e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:06.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.900+0000 7f79ee59c700 1 --2- 172.21.15.146:0/3989897449 >> v2:172.21.15.151:3300/0 conn(0x7f79f0073760 0x7f79f00af810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:06.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.900+0000 7f79eed9d700 1 -- 172.21.15.146:0/3989897449 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79f00afd50 msgr2=0x7f79f015e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:32:06.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.900+0000 7f79eed9d700 1 --2- 172.21.15.146:0/3989897449 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79f00afd50 0x7f79f015e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:06.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.900+0000 7f79eed9d700 1 -- 172.21.15.146:0/3989897449 >> v2:172.21.15.151:3300/0 conn(0x7f79f0073760 msgr2=0x7f79f00af810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:32:06.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.900+0000 7f79eed9d700 1 --2- 172.21.15.146:0/3989897449 >> v2:172.21.15.151:3300/0 conn(0x7f79f0073760 0x7f79f00af810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:06.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.900+0000 7f79eed9d700 1 -- 172.21.15.146:0/3989897449 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f006b720 con 0x7f79f00aebc0 2023-05-24T03:32:06.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.901+0000 7f79eed9d700 1 --2- 172.21.15.146:0/3989897449 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79f00aebc0 0x7f79f00711c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f79f00cf620 tx=0x7f79e4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e222d73932381b92 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:06.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.901+0000 7f79edd9b700 1 -- 172.21.15.146:0/3989897449 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e400b870 con 0x7f79f00aebc0 2023-05-24T03:32:06.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.901+0000 7f79edd9b700 1 -- 172.21.15.146:0/3989897449 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e400b9d0 con 0x7f79f00aebc0 2023-05-24T03:32:06.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.901+0000 7f79edd9b700 1 -- 172.21.15.146:0/3989897449 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e400bd60 con 0x7f79f00aebc0 2023-05-24T03:32:06.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.901+0000 7f79f5069700 1 -- 172.21.15.146:0/3989897449 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79f00aebc0 msgr2=0x7f79f00711c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:06.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.901+0000 7f79f5069700 1 --2- 172.21.15.146:0/3989897449 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79f00aebc0 0x7f79f00711c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f79f00cf620 tx=0x7f79e4009bd0 comp rx=0 tx=0).stop 2023-05-24T03:32:06.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.901+0000 7f79f5069700 1 -- 172.21.15.146:0/3989897449 shutdown_connections 2023-05-24T03:32:06.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.901+0000 7f79f5069700 1 --2- 172.21.15.146:0/3989897449 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79f00afd50 0x7f79f015e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:06.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.901+0000 7f79f5069700 1 --2- 172.21.15.146:0/3989897449 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79f00aebc0 0x7f79f00711c0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:06.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.901+0000 7f79f5069700 1 --2- 172.21.15.146:0/3989897449 >> v2:172.21.15.151:3300/0 conn(0x7f79f0073760 0x7f79f00af810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:06.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.901+0000 7f79f5069700 1 -- 172.21.15.146:0/3989897449 >> 172.21.15.146:0/3989897449 conn(0x7f79f00cf6c0 msgr2=0x7f79f00cfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:32:06.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.901+0000 7f79f5069700 1 -- 172.21.15.146:0/3989897449 shutdown_connections 2023-05-24T03:32:06.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.901+0000 7f79f5069700 1 -- 172.21.15.146:0/3989897449 wait complete. 2023-05-24T03:32:06.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.903+0000 7f79f5069700 1 Processor -- start 2023-05-24T03:32:06.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.903+0000 7f79f5069700 1 -- start start 2023-05-24T03:32:06.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.904+0000 7f79f5069700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79f0073760 0x7f79f014dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:06.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.904+0000 7f79f5069700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79f00aebc0 0x7f79f015ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:06.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.904+0000 7f79f5069700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79f00afd50 0x7f79f015cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:06.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.904+0000 7f79f5069700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f00acc00 con 0x7f79f00aebc0 2023-05-24T03:32:06.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.904+0000 7f79f5069700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f00ac8b0 con 0x7f79f0073760 2023-05-24T03:32:06.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.904+0000 7f79f5069700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79f00cab60 con 0x7f79f00afd50 2023-05-24T03:32:06.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.904+0000 7f79ee59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79f00aebc0 0x7f79f015ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:06.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.904+0000 7f79ee59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79f00aebc0 0x7f79f015ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40692/0 (socket says 172.21.15.146:40692) 2023-05-24T03:32:06.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.904+0000 7f79ee59c700 1 -- 172.21.15.146:0/2978776722 learned_addr learned my addr 172.21.15.146:0/2978776722 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:32:06.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.904+0000 7f79eed9d700 1 --2- 172.21.15.146:0/2978776722 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79f0073760 0x7f79f014dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:06.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.904+0000 7f79ef59e700 1 --2- 172.21.15.146:0/2978776722 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79f00afd50 0x7f79f015cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:06.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.904+0000 7f79ee59c700 1 -- 172.21.15.146:0/2978776722 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79f00afd50 msgr2=0x7f79f015cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:06.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.904+0000 7f79ee59c700 1 --2- 172.21.15.146:0/2978776722 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79f00afd50 0x7f79f015cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:06.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.904+0000 7f79ee59c700 1 -- 172.21.15.146:0/2978776722 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79f0073760 msgr2=0x7f79f014dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:06.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.904+0000 7f79ee59c700 1 --2- 172.21.15.146:0/2978776722 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79f0073760 0x7f79f014dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:06.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.904+0000 7f79ee59c700 1 -- 172.21.15.146:0/2978776722 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e4009550 con 0x7f79f00aebc0 2023-05-24T03:32:06.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.904+0000 7f79ee59c700 1 --2- 172.21.15.146:0/2978776722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79f00aebc0 0x7f79f015ca50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f79e000d800 tx=0x7f79e000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:06.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.904+0000 7f79d77fe700 1 -- 172.21.15.146:0/2978776722 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e00125f0 con 0x7f79f00aebc0 2023-05-24T03:32:06.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.904+0000 7f79d77fe700 1 -- 172.21.15.146:0/2978776722 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e0012750 con 0x7f79f00aebc0 2023-05-24T03:32:06.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.904+0000 7f79d77fe700 1 -- 172.21.15.146:0/2978776722 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e0012b00 con 0x7f79f00aebc0 2023-05-24T03:32:06.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.904+0000 7f79f5069700 1 -- 172.21.15.146:0/2978776722 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79f00af2f0 con 0x7f79f00aebc0 2023-05-24T03:32:06.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.904+0000 7f79f5069700 1 -- 172.21.15.146:0/2978776722 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79f006ba00 con 0x7f79f00aebc0 2023-05-24T03:32:06.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.905+0000 7f79f5069700 1 -- 172.21.15.146:0/2978776722 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79f0071a60 con 0x7f79f00aebc0 2023-05-24T03:32:06.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.906+0000 7f79d77fe700 1 -- 172.21.15.146:0/2978776722 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f79e0012c60 con 0x7f79f00aebc0 2023-05-24T03:32:06.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.906+0000 7f79d77fe700 1 --2- 172.21.15.146:0/2978776722 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f79dc06ace0 0x7f79dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:06.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.906+0000 7f79eed9d700 1 --2- 172.21.15.146:0/2978776722 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f79dc06ace0 0x7f79dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:06.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.906+0000 7f79d77fe700 1 -- 172.21.15.146:0/2978776722 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f79e0089840 con 0x7f79f00aebc0 2023-05-24T03:32:06.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.907+0000 7f79eed9d700 1 --2- 172.21.15.146:0/2978776722 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f79dc06ace0 0x7f79dc06d190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f79e4014040 tx=0x7f79e4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:06.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:06.911+0000 7f79d77fe700 1 -- 172.21.15.146:0/2978776722 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f79e0054520 con 0x7f79f00aebc0 2023-05-24T03:32:07.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.099+0000 7f79f5069700 1 -- 172.21.15.146:0/2978776722 --> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f79f00acd40 con 0x7f79dc06ace0 2023-05-24T03:32:07.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.099+0000 7f79d77fe700 1 -- 172.21.15.146:0/2978776722 <== mgr.4104 v2:172.21.15.146:6832/1985394169 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f79f00acd40 con 0x7f79dc06ace0 2023-05-24T03:32:07.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.101+0000 7f79f5069700 1 -- 172.21.15.146:0/2978776722 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f79dc06ace0 msgr2=0x7f79dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:07.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.101+0000 7f79f5069700 1 --2- 172.21.15.146:0/2978776722 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f79dc06ace0 0x7f79dc06d190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f79e4014040 tx=0x7f79e4008030 comp rx=0 tx=0).stop 2023-05-24T03:32:07.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.101+0000 7f79f5069700 1 -- 172.21.15.146:0/2978776722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79f00aebc0 msgr2=0x7f79f015ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:07.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.101+0000 7f79f5069700 1 --2- 172.21.15.146:0/2978776722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79f00aebc0 0x7f79f015ca50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f79e000d800 tx=0x7f79e000db10 comp rx=0 tx=0).stop 2023-05-24T03:32:07.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.101+0000 7f79f5069700 1 -- 172.21.15.146:0/2978776722 shutdown_connections 2023-05-24T03:32:07.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.101+0000 7f79f5069700 1 --2- 172.21.15.146:0/2978776722 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f79dc06ace0 0x7f79dc06d190 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:07.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.101+0000 7f79f5069700 1 --2- 172.21.15.146:0/2978776722 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79f00afd50 0x7f79f015cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:07.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.101+0000 7f79f5069700 1 --2- 172.21.15.146:0/2978776722 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79f0073760 0x7f79f014dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:07.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.101+0000 7f79f5069700 1 --2- 172.21.15.146:0/2978776722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79f00aebc0 0x7f79f015ca50 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:07.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.101+0000 7f79f5069700 1 -- 172.21.15.146:0/2978776722 >> 172.21.15.146:0/2978776722 conn(0x7f79f00cf6c0 msgr2=0x7f79f015ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:32:07.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.101+0000 7f79f5069700 1 -- 172.21.15.146:0/2978776722 shutdown_connections 2023-05-24T03:32:07.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.101+0000 7f79f5069700 1 -- 172.21.15.146:0/2978776722 wait complete. 2023-05-24T03:32:07.109 INFO:teuthology.orchestra.run.smithi146.stderr:instructed osd(s) 5 to deep-scrub 2023-05-24T03:32:07.118 INFO:tasks.ceph:Scrubbing osd.6 2023-05-24T03:32:07.119 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-05-24T03:32:07.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.242+0000 7f1608c1a700 1 Processor -- start 2023-05-24T03:32:07.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.242+0000 7f1608c1a700 1 -- start start 2023-05-24T03:32:07.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.243+0000 7f1608c1a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f16040cb8c0 0x7f1604161030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:07.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.243+0000 7f1608c1a700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f16040cbc90 0x7f160406a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:07.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.243+0000 7f1608c1a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16040b27e0 con 0x7f16040cc1d0 2023-05-24T03:32:07.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.243+0000 7f1608c1a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16040b2030 con 0x7f16040cb8c0 2023-05-24T03:32:07.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.243+0000 7f1608c1a700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16040b2220 con 0x7f16040cbc90 2023-05-24T03:32:07.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.243+0000 7f160259c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f16040cb8c0 0x7f1604161030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:07.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.243+0000 7f1601d9b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f16040cc1d0 0x7f16040b1920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47150/0 (socket says 172.21.15.146:47150) 2023-05-24T03:32:07.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.243+0000 7f1601d9b700 1 -- 172.21.15.146:0/2719130217 learned_addr learned my addr 172.21.15.146:0/2719130217 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:32:07.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.243+0000 7f160259c700 1 -- 172.21.15.146:0/2719130217 >> v2:172.21.15.151:3300/0 conn(0x7f16040cbc90 msgr2=0x7f160406a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:32:07.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.243+0000 7f1602d9d700 1 --2- 172.21.15.146:0/2719130217 >> v2:172.21.15.151:3300/0 conn(0x7f16040cbc90 0x7f160406a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:07.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.243+0000 7f160259c700 1 --2- 172.21.15.146:0/2719130217 >> v2:172.21.15.151:3300/0 conn(0x7f16040cbc90 0x7f160406a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:07.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.243+0000 7f160159a700 1 -- 172.21.15.146:0/2719130217 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3810767509 0 0) 0x7f16040b27e0 con 0x7f16040cc1d0 2023-05-24T03:32:07.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.243+0000 7f160259c700 1 -- 172.21.15.146:0/2719130217 >> v1:172.21.15.146:6789/0 conn(0x7f16040cc1d0 legacy=0x7f16040b1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:07.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.243+0000 7f160259c700 1 -- 172.21.15.146:0/2719130217 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16040b2500 con 0x7f16040cb8c0 2023-05-24T03:32:07.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.243+0000 7f160259c700 1 --2- 172.21.15.146:0/2719130217 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16040cb8c0 0x7f1604161030 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f160406b540 tx=0x7f15f4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e59738783f9f7853 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:07.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.243+0000 7f160159a700 1 -- 172.21.15.146:0/2719130217 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f4011830 con 0x7f16040cb8c0 2023-05-24T03:32:07.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.243+0000 7f160159a700 1 -- 172.21.15.146:0/2719130217 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f4011990 con 0x7f16040cb8c0 2023-05-24T03:32:07.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.243+0000 7f160159a700 1 -- 172.21.15.146:0/2719130217 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f4011d20 con 0x7f16040cb8c0 2023-05-24T03:32:07.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.244+0000 7f1608c1a700 1 -- 172.21.15.146:0/2719130217 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16040cb8c0 msgr2=0x7f1604161030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:07.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.244+0000 7f1608c1a700 1 --2- 172.21.15.146:0/2719130217 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16040cb8c0 0x7f1604161030 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f160406b540 tx=0x7f15f4009b20 comp rx=0 tx=0).stop 2023-05-24T03:32:07.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.244+0000 7f1608c1a700 1 -- 172.21.15.146:0/2719130217 shutdown_connections 2023-05-24T03:32:07.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.244+0000 7f1608c1a700 1 --2- 172.21.15.146:0/2719130217 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16040cb8c0 0x7f1604161030 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:07.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.244+0000 7f1608c1a700 1 --2- 172.21.15.146:0/2719130217 >> v2:172.21.15.151:3300/0 conn(0x7f16040cbc90 0x7f160406a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:07.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.244+0000 7f1608c1a700 1 -- 172.21.15.146:0/2719130217 >> 172.21.15.146:0/2719130217 conn(0x7f16040cfea0 msgr2=0x7f16040d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:32:07.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.244+0000 7f1608c1a700 1 -- 172.21.15.146:0/2719130217 shutdown_connections 2023-05-24T03:32:07.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.244+0000 7f1608c1a700 1 -- 172.21.15.146:0/2719130217 wait complete. 2023-05-24T03:32:07.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.246+0000 7f1608c1a700 1 Processor -- start 2023-05-24T03:32:07.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.246+0000 7f1608c1a700 1 -- start start 2023-05-24T03:32:07.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.247+0000 7f1608c1a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16040cb8c0 0x7f16040b3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:07.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.247+0000 7f1608c1a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16040cbc90 0x7f16040c80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:07.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.247+0000 7f1608c1a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16040cc1d0 0x7f1604157f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:07.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.247+0000 7f1608c1a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16040b4fc0 con 0x7f16040cbc90 2023-05-24T03:32:07.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.247+0000 7f1608c1a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16040c85e0 con 0x7f16040cb8c0 2023-05-24T03:32:07.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.247+0000 7f1608c1a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16041584b0 con 0x7f16040cc1d0 2023-05-24T03:32:07.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.247+0000 7f1601d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16040cbc90 0x7f16040c80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:07.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.247+0000 7f1601d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16040cbc90 0x7f16040c80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40706/0 (socket says 172.21.15.146:40706) 2023-05-24T03:32:07.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.247+0000 7f1601d9b700 1 -- 172.21.15.146:0/323158485 learned_addr learned my addr 172.21.15.146:0/323158485 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:32:07.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.247+0000 7f160259c700 1 --2- 172.21.15.146:0/323158485 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16040cb8c0 0x7f16040b3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:07.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.247+0000 7f1602d9d700 1 --2- 172.21.15.146:0/323158485 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16040cc1d0 0x7f1604157f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:07.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.247+0000 7f1601d9b700 1 -- 172.21.15.146:0/323158485 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16040cc1d0 msgr2=0x7f1604157f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:07.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.247+0000 7f1601d9b700 1 --2- 172.21.15.146:0/323158485 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16040cc1d0 0x7f1604157f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:07.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.247+0000 7f1601d9b700 1 -- 172.21.15.146:0/323158485 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16040cb8c0 msgr2=0x7f16040b3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:07.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.247+0000 7f1601d9b700 1 --2- 172.21.15.146:0/323158485 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16040cb8c0 0x7f16040b3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:07.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.247+0000 7f1601d9b700 1 -- 172.21.15.146:0/323158485 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f40094a0 con 0x7f16040cbc90 2023-05-24T03:32:07.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.247+0000 7f1601d9b700 1 --2- 172.21.15.146:0/323158485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16040cbc90 0x7f16040c80a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f15f800c520 tx=0x7f15f800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:07.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.247+0000 7f15f2ffd700 1 -- 172.21.15.146:0/323158485 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f8004c80 con 0x7f16040cbc90 2023-05-24T03:32:07.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.247+0000 7f15f2ffd700 1 -- 172.21.15.146:0/323158485 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f8004de0 con 0x7f16040cbc90 2023-05-24T03:32:07.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.247+0000 7f1608c1a700 1 -- 172.21.15.146:0/323158485 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1604160b10 con 0x7f16040cbc90 2023-05-24T03:32:07.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.247+0000 7f15f2ffd700 1 -- 172.21.15.146:0/323158485 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f80072d0 con 0x7f16040cbc90 2023-05-24T03:32:07.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.247+0000 7f1608c1a700 1 -- 172.21.15.146:0/323158485 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1604160830 con 0x7f16040cbc90 2023-05-24T03:32:07.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.248+0000 7f1608c1a700 1 -- 172.21.15.146:0/323158485 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1604161570 con 0x7f16040cbc90 2023-05-24T03:32:07.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.249+0000 7f15f2ffd700 1 -- 172.21.15.146:0/323158485 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f15f8007430 con 0x7f16040cbc90 2023-05-24T03:32:07.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.249+0000 7f15f2ffd700 1 --2- 172.21.15.146:0/323158485 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f15e406ace0 0x7f15e406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:07.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.249+0000 7f15f2ffd700 1 -- 172.21.15.146:0/323158485 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f15f8089380 con 0x7f16040cbc90 2023-05-24T03:32:07.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.249+0000 7f160259c700 1 --2- 172.21.15.146:0/323158485 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f15e406ace0 0x7f15e406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:07.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.249+0000 7f15f2ffd700 1 --2- 172.21.15.146:0/323158485 >> [v2:172.21.15.151:6824/3889424178,v1:172.21.15.151:6825/3889424178] conn(0x7f15e40749f0 0x7f15e4076e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:07.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.249+0000 7f15f2ffd700 1 -- 172.21.15.146:0/323158485 --> [v2:172.21.15.151:6824/3889424178,v1:172.21.15.151:6825/3889424178] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f15e4077530 con 0x7f15e40749f0 2023-05-24T03:32:07.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.249+0000 7f15f2ffd700 1 -- 172.21.15.146:0/323158485 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15f808ba40 con 0x7f16040cbc90 2023-05-24T03:32:07.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.249+0000 7f160259c700 1 --2- 172.21.15.146:0/323158485 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f15e406ace0 0x7f15e406d190 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f15f40090b0 tx=0x7f15f4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:07.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.249+0000 7f1602d9d700 1 --2- 172.21.15.146:0/323158485 >> [v2:172.21.15.151:6824/3889424178,v1:172.21.15.151:6825/3889424178] conn(0x7f15e40749f0 0x7f15e4076e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:07.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.250+0000 7f1602d9d700 1 --2- 172.21.15.146:0/323158485 >> [v2:172.21.15.151:6824/3889424178,v1:172.21.15.151:6825/3889424178] conn(0x7f15e40749f0 0x7f15e4076e60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:07.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.251+0000 7f15f2ffd700 1 -- 172.21.15.146:0/323158485 <== osd.6 v2:172.21.15.151:6824/3889424178 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f15e4077530 con 0x7f15e40749f0 2023-05-24T03:32:07.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.265+0000 7f1608c1a700 1 -- 172.21.15.146:0/323158485 --> [v2:172.21.15.151:6824/3889424178,v1:172.21.15.151:6825/3889424178] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f160404e810 con 0x7f15e40749f0 2023-05-24T03:32:07.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.265+0000 7f15f2ffd700 1 -- 172.21.15.146:0/323158485 <== osd.6 v2:172.21.15.151:6824/3889424178 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f160404e810 con 0x7f15e40749f0 2023-05-24T03:32:07.270 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-05-24T03:32:07.271 INFO:teuthology.orchestra.run.smithi146.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-05-24T03:32:07.271 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-05-24T03:32:07.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.266+0000 7f1608c1a700 1 -- 172.21.15.146:0/323158485 >> [v2:172.21.15.151:6824/3889424178,v1:172.21.15.151:6825/3889424178] conn(0x7f15e40749f0 msgr2=0x7f15e4076e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:07.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.266+0000 7f1608c1a700 1 --2- 172.21.15.146:0/323158485 >> [v2:172.21.15.151:6824/3889424178,v1:172.21.15.151:6825/3889424178] conn(0x7f15e40749f0 0x7f15e4076e60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:07.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.266+0000 7f1608c1a700 1 -- 172.21.15.146:0/323158485 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f15e406ace0 msgr2=0x7f15e406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:07.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.266+0000 7f1608c1a700 1 --2- 172.21.15.146:0/323158485 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f15e406ace0 0x7f15e406d190 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f15f40090b0 tx=0x7f15f4008030 comp rx=0 tx=0).stop 2023-05-24T03:32:07.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.266+0000 7f1608c1a700 1 -- 172.21.15.146:0/323158485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16040cbc90 msgr2=0x7f16040c80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:07.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.266+0000 7f1608c1a700 1 --2- 172.21.15.146:0/323158485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16040cbc90 0x7f16040c80a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f15f800c520 tx=0x7f15f800c830 comp rx=0 tx=0).stop 2023-05-24T03:32:07.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.266+0000 7f1602d9d700 1 -- 172.21.15.146:0/323158485 reap_dead start 2023-05-24T03:32:07.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.266+0000 7f1608c1a700 1 -- 172.21.15.146:0/323158485 shutdown_connections 2023-05-24T03:32:07.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.266+0000 7f1608c1a700 1 -- 172.21.15.146:0/323158485 >> 172.21.15.146:0/323158485 conn(0x7f16040cfea0 msgr2=0x7f160406a460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:32:07.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.266+0000 7f1608c1a700 1 -- 172.21.15.146:0/323158485 shutdown_connections 2023-05-24T03:32:07.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.266+0000 7f1608c1a700 1 -- 172.21.15.146:0/323158485 wait complete. 2023-05-24T03:32:07.282 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-05-24T03:32:07.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.399+0000 7f22ff0ef700 1 Processor -- start 2023-05-24T03:32:07.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.400+0000 7f22ff0ef700 1 -- start start 2023-05-24T03:32:07.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.400+0000 7f22ff0ef700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f22f80cdf10 0x7f22f8159c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:07.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.400+0000 7f22ff0ef700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22f8070f50 0x7f22f806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:07.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.400+0000 7f22ff0ef700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22f815a3c0 con 0x7f22f815dcf0 2023-05-24T03:32:07.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.400+0000 7f22ff0ef700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22f815a1c0 con 0x7f22f80cdf10 2023-05-24T03:32:07.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.400+0000 7f22ff0ef700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22f815a6a0 con 0x7f22f8070f50 2023-05-24T03:32:07.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.401+0000 7f22f7fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f22f815dcf0 0x7f22f80ce2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47168/0 (socket says 172.21.15.146:47168) 2023-05-24T03:32:07.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.401+0000 7f22f7fff700 1 -- 172.21.15.146:0/3064785005 learned_addr learned my addr 172.21.15.146:0/3064785005 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:32:07.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.401+0000 7f22fd68c700 1 --2- 172.21.15.146:0/3064785005 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22f8070f50 0x7f22f806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:07.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.401+0000 7f22fce8b700 1 --2- 172.21.15.146:0/3064785005 >> v2:172.21.15.151:3300/0 conn(0x7f22f80cdf10 0x7f22f8159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:07.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.401+0000 7f22f77fe700 1 -- 172.21.15.146:0/3064785005 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2972543069 0 0) 0x7f22f815a3c0 con 0x7f22f815dcf0 2023-05-24T03:32:07.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.401+0000 7f22f77fe700 1 -- 172.21.15.146:0/3064785005 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22e80035b0 con 0x7f22f815dcf0 2023-05-24T03:32:07.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.401+0000 7f22fd68c700 1 -- 172.21.15.146:0/3064785005 >> v2:172.21.15.151:3300/0 conn(0x7f22f80cdf10 msgr2=0x7f22f8159c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:32:07.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.401+0000 7f22fd68c700 1 --2- 172.21.15.146:0/3064785005 >> v2:172.21.15.151:3300/0 conn(0x7f22f80cdf10 0x7f22f8159c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:07.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.401+0000 7f22f77fe700 1 -- 172.21.15.146:0/3064785005 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4111943007 0 0) 0x7f22e80035b0 con 0x7f22f815dcf0 2023-05-24T03:32:07.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.401+0000 7f22fd68c700 1 -- 172.21.15.146:0/3064785005 >> v1:172.21.15.146:6789/0 conn(0x7f22f815dcf0 legacy=0x7f22f80ce2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:07.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.401+0000 7f22fd68c700 1 -- 172.21.15.146:0/3064785005 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f815a980 con 0x7f22f8070f50 2023-05-24T03:32:07.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.401+0000 7f22fce8b700 1 --2- 172.21.15.146:0/3064785005 >> v2:172.21.15.151:3300/0 conn(0x7f22f80cdf10 0x7f22f8159c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T03:32:07.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.401+0000 7f22fd68c700 1 --2- 172.21.15.146:0/3064785005 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22f8070f50 0x7f22f806d6b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f22f0009d90 tx=0x7f22f000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ba00e3083879b91 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:07.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.401+0000 7f22f77fe700 1 -- 172.21.15.146:0/3064785005 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f000e070 con 0x7f22f8070f50 2023-05-24T03:32:07.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.401+0000 7f22f77fe700 1 -- 172.21.15.146:0/3064785005 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f0003a20 con 0x7f22f8070f50 2023-05-24T03:32:07.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.401+0000 7f22f77fe700 1 -- 172.21.15.146:0/3064785005 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e4001670 con 0x7f22f8070f50 2023-05-24T03:32:07.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.402+0000 7f22ff0ef700 1 -- 172.21.15.146:0/3064785005 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22f8070f50 msgr2=0x7f22f806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:07.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.402+0000 7f22ff0ef700 1 --2- 172.21.15.146:0/3064785005 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22f8070f50 0x7f22f806d6b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f22f0009d90 tx=0x7f22f000b330 comp rx=0 tx=0).stop 2023-05-24T03:32:07.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.402+0000 7f22ff0ef700 1 -- 172.21.15.146:0/3064785005 shutdown_connections 2023-05-24T03:32:07.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.402+0000 7f22ff0ef700 1 --2- 172.21.15.146:0/3064785005 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22f8070f50 0x7f22f806d6b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:07.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.402+0000 7f22ff0ef700 1 --2- 172.21.15.146:0/3064785005 >> v2:172.21.15.151:3300/0 conn(0x7f22f80cdf10 0x7f22f8159c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:07.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.402+0000 7f22ff0ef700 1 -- 172.21.15.146:0/3064785005 >> 172.21.15.146:0/3064785005 conn(0x7f22f80cfea0 msgr2=0x7f22f80d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:32:07.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.402+0000 7f22ff0ef700 1 -- 172.21.15.146:0/3064785005 shutdown_connections 2023-05-24T03:32:07.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.402+0000 7f22ff0ef700 1 -- 172.21.15.146:0/3064785005 wait complete. 2023-05-24T03:32:07.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.403+0000 7f22ff0ef700 1 Processor -- start 2023-05-24T03:32:07.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.403+0000 7f22ff0ef700 1 -- start start 2023-05-24T03:32:07.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.404+0000 7f22ff0ef700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22f8070f50 0x7f22f80b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:07.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.404+0000 7f22ff0ef700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22f80cdf10 0x7f22f80c9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:07.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.404+0000 7f22ff0ef700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22f815dcf0 0x7f22f80b0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:07.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.404+0000 7f22ff0ef700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f80c5180 con 0x7f22f80cdf10 2023-05-24T03:32:07.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.404+0000 7f22ff0ef700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f80b2730 con 0x7f22f8070f50 2023-05-24T03:32:07.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.404+0000 7f22ff0ef700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22f80c4500 con 0x7f22f815dcf0 2023-05-24T03:32:07.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.404+0000 7f22f7fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22f80cdf10 0x7f22f80c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:07.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.404+0000 7f22f7fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22f80cdf10 0x7f22f80c9160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40720/0 (socket says 172.21.15.146:40720) 2023-05-24T03:32:07.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.404+0000 7f22f7fff700 1 -- 172.21.15.146:0/3509992662 learned_addr learned my addr 172.21.15.146:0/3509992662 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:32:07.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.404+0000 7f22fd68c700 1 --2- 172.21.15.146:0/3509992662 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22f815dcf0 0x7f22f80b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:07.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.404+0000 7f22fce8b700 1 --2- 172.21.15.146:0/3509992662 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22f8070f50 0x7f22f80b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:07.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.405+0000 7f22f7fff700 1 -- 172.21.15.146:0/3509992662 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22f815dcf0 msgr2=0x7f22f80b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:07.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.405+0000 7f22f7fff700 1 --2- 172.21.15.146:0/3509992662 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22f815dcf0 0x7f22f80b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:07.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.405+0000 7f22f7fff700 1 -- 172.21.15.146:0/3509992662 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22f8070f50 msgr2=0x7f22f80b21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:07.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.405+0000 7f22f7fff700 1 --2- 172.21.15.146:0/3509992662 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22f8070f50 0x7f22f80b21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:07.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.405+0000 7f22f7fff700 1 -- 172.21.15.146:0/3509992662 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ec0094a0 con 0x7f22f80cdf10 2023-05-24T03:32:07.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.405+0000 7f22f7fff700 1 --2- 172.21.15.146:0/3509992662 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22f80cdf10 0x7f22f80c9160 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f22e400c520 tx=0x7f22e400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:07.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.405+0000 7f22f57fa700 1 -- 172.21.15.146:0/3509992662 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e4004c80 con 0x7f22f80cdf10 2023-05-24T03:32:07.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.405+0000 7f22f57fa700 1 -- 172.21.15.146:0/3509992662 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e4004de0 con 0x7f22f80cdf10 2023-05-24T03:32:07.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.405+0000 7f22ff0ef700 1 -- 172.21.15.146:0/3509992662 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22f0009a70 con 0x7f22f80cdf10 2023-05-24T03:32:07.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.405+0000 7f22f57fa700 1 -- 172.21.15.146:0/3509992662 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e4007310 con 0x7f22f80cdf10 2023-05-24T03:32:07.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.405+0000 7f22ff0ef700 1 -- 172.21.15.146:0/3509992662 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22f806d190 con 0x7f22f80cdf10 2023-05-24T03:32:07.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.406+0000 7f22ff0ef700 1 -- 172.21.15.146:0/3509992662 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22f815ac60 con 0x7f22f80cdf10 2023-05-24T03:32:07.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.406+0000 7f22f57fa700 1 -- 172.21.15.146:0/3509992662 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f22e4007470 con 0x7f22f80cdf10 2023-05-24T03:32:07.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.407+0000 7f22f57fa700 1 --2- 172.21.15.146:0/3509992662 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f22dc06ace0 0x7f22dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:07.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.407+0000 7f22f57fa700 1 -- 172.21.15.146:0/3509992662 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f22e40893d0 con 0x7f22f80cdf10 2023-05-24T03:32:07.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.407+0000 7f22fce8b700 1 --2- 172.21.15.146:0/3509992662 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f22dc06ace0 0x7f22dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:07.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.407+0000 7f22fce8b700 1 --2- 172.21.15.146:0/3509992662 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f22dc06ace0 0x7f22dc06d190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f22ec009cd0 tx=0x7f22ec009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:07.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.411+0000 7f22f57fa700 1 -- 172.21.15.146:0/3509992662 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f22e40541e0 con 0x7f22f80cdf10 2023-05-24T03:32:07.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.596+0000 7f22ff0ef700 1 -- 172.21.15.146:0/3509992662 --> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f22f815e190 con 0x7f22dc06ace0 2023-05-24T03:32:07.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.596+0000 7f22f57fa700 1 -- 172.21.15.146:0/3509992662 <== mgr.4104 v2:172.21.15.146:6832/1985394169 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f22f815e190 con 0x7f22dc06ace0 2023-05-24T03:32:07.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.598+0000 7f22ff0ef700 1 -- 172.21.15.146:0/3509992662 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f22dc06ace0 msgr2=0x7f22dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:07.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.598+0000 7f22ff0ef700 1 --2- 172.21.15.146:0/3509992662 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f22dc06ace0 0x7f22dc06d190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f22ec009cd0 tx=0x7f22ec009210 comp rx=0 tx=0).stop 2023-05-24T03:32:07.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.598+0000 7f22ff0ef700 1 -- 172.21.15.146:0/3509992662 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22f80cdf10 msgr2=0x7f22f80c9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:07.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.598+0000 7f22ff0ef700 1 --2- 172.21.15.146:0/3509992662 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22f80cdf10 0x7f22f80c9160 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f22e400c520 tx=0x7f22e400c830 comp rx=0 tx=0).stop 2023-05-24T03:32:07.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.598+0000 7f22ff0ef700 1 -- 172.21.15.146:0/3509992662 shutdown_connections 2023-05-24T03:32:07.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.598+0000 7f22ff0ef700 1 --2- 172.21.15.146:0/3509992662 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f22dc06ace0 0x7f22dc06d190 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:07.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.598+0000 7f22ff0ef700 1 --2- 172.21.15.146:0/3509992662 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22f815dcf0 0x7f22f80b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:07.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.598+0000 7f22ff0ef700 1 --2- 172.21.15.146:0/3509992662 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22f8070f50 0x7f22f80b21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:07.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.598+0000 7f22ff0ef700 1 --2- 172.21.15.146:0/3509992662 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22f80cdf10 0x7f22f80c9160 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:07.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.598+0000 7f22ff0ef700 1 -- 172.21.15.146:0/3509992662 >> 172.21.15.146:0/3509992662 conn(0x7f22f80cfea0 msgr2=0x7f22f80ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:32:07.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.598+0000 7f22ff0ef700 1 -- 172.21.15.146:0/3509992662 shutdown_connections 2023-05-24T03:32:07.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.598+0000 7f22ff0ef700 1 -- 172.21.15.146:0/3509992662 wait complete. 2023-05-24T03:32:07.606 INFO:teuthology.orchestra.run.smithi146.stderr:instructed osd(s) 6 to deep-scrub 2023-05-24T03:32:07.615 INFO:tasks.ceph:Scrubbing osd.7 2023-05-24T03:32:07.616 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-05-24T03:32:07.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.736+0000 7fd51d6a4700 1 Processor -- start 2023-05-24T03:32:07.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.736+0000 7fd51d6a4700 1 -- start start 2023-05-24T03:32:07.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.737+0000 7fd51d6a4700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd51806aab0 0x7fd5181612a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:07.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.737+0000 7fd51d6a4700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd5180af0b0 0x7fd5180ced50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:07.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.737+0000 7fd51d6a4700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd518160ae0 con 0x7fd518071960 2023-05-24T03:32:07.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.737+0000 7fd51d6a4700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5180cfc20 con 0x7fd51806aab0 2023-05-24T03:32:07.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.737+0000 7fd51d6a4700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5180cf660 con 0x7fd5180af0b0 2023-05-24T03:32:07.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.737+0000 7fd5167fc700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd5180af0b0 0x7fd5180ced50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:07.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.737+0000 7fd5167fc700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd5180af0b0 0x7fd5180ced50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:53590/0 (socket says 172.21.15.146:53590) 2023-05-24T03:32:07.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.737+0000 7fd5167fc700 1 -- 172.21.15.146:0/1623823040 learned_addr learned my addr 172.21.15.146:0/1623823040 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:32:07.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.737+0000 7fd516ffd700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd51806aab0 0x7fd5181612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:07.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.737+0000 7fd5167fc700 1 -- 172.21.15.146:0/1623823040 >> v2:172.21.15.151:3300/0 conn(0x7fd51806aab0 msgr2=0x7fd5181612a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:32:07.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.737+0000 7fd5167fc700 1 --2- 172.21.15.146:0/1623823040 >> v2:172.21.15.151:3300/0 conn(0x7fd51806aab0 0x7fd5181612a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:07.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.737+0000 7fd5167fc700 1 -- 172.21.15.146:0/1623823040 >> v1:172.21.15.151:6789/0 conn(0x7fd518071960 legacy=0x7fd51806d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:07.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.737+0000 7fd5167fc700 1 -- 172.21.15.146:0/1623823040 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5180cf940 con 0x7fd5180af0b0 2023-05-24T03:32:07.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.737+0000 7fd5167fc700 1 --2- 172.21.15.146:0/1623823040 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd5180af0b0 0x7fd5180ced50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd50c0098f0 tx=0x7fd50c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=412fe760db408cdb server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:07.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.738+0000 7fd515ffb700 1 -- 172.21.15.146:0/1623823040 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c011830 con 0x7fd5180af0b0 2023-05-24T03:32:07.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.738+0000 7fd515ffb700 1 -- 172.21.15.146:0/1623823040 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50c011990 con 0x7fd5180af0b0 2023-05-24T03:32:07.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.738+0000 7fd515ffb700 1 -- 172.21.15.146:0/1623823040 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c011d20 con 0x7fd5180af0b0 2023-05-24T03:32:07.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.738+0000 7fd51d6a4700 1 -- 172.21.15.146:0/1623823040 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd5180af0b0 msgr2=0x7fd5180ced50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:07.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.738+0000 7fd51d6a4700 1 --2- 172.21.15.146:0/1623823040 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd5180af0b0 0x7fd5180ced50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd50c0098f0 tx=0x7fd50c009c00 comp rx=0 tx=0).stop 2023-05-24T03:32:07.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.738+0000 7fd51d6a4700 1 -- 172.21.15.146:0/1623823040 shutdown_connections 2023-05-24T03:32:07.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.738+0000 7fd51d6a4700 1 --2- 172.21.15.146:0/1623823040 >> v2:172.21.15.151:3300/0 conn(0x7fd51806aab0 0x7fd5181612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:07.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.738+0000 7fd51d6a4700 1 --2- 172.21.15.146:0/1623823040 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd5180af0b0 0x7fd5180ced50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:07.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.738+0000 7fd51d6a4700 1 -- 172.21.15.146:0/1623823040 >> 172.21.15.146:0/1623823040 conn(0x7fd51806ebb0 msgr2=0x7fd51806ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:32:07.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.738+0000 7fd51d6a4700 1 -- 172.21.15.146:0/1623823040 shutdown_connections 2023-05-24T03:32:07.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.738+0000 7fd51d6a4700 1 -- 172.21.15.146:0/1623823040 wait complete. 2023-05-24T03:32:07.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.740+0000 7fd51d6a4700 1 Processor -- start 2023-05-24T03:32:07.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.740+0000 7fd51d6a4700 1 -- start start 2023-05-24T03:32:07.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.740+0000 7fd51d6a4700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd51806aab0 0x7fd518149370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:07.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.740+0000 7fd51d6a4700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd518071960 0x7fd5180b1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:07.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.740+0000 7fd51d6a4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5180af0b0 0x7fd5180b1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:07.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.740+0000 7fd51d6a4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5180b51d0 con 0x7fd5180af0b0 2023-05-24T03:32:07.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.740+0000 7fd51d6a4700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5180c6870 con 0x7fd518071960 2023-05-24T03:32:07.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.740+0000 7fd51d6a4700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5180b2d50 con 0x7fd51806aab0 2023-05-24T03:32:07.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.741+0000 7fd5177fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5180af0b0 0x7fd5180b1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:07.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.741+0000 7fd5177fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5180af0b0 0x7fd5180b1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40736/0 (socket says 172.21.15.146:40736) 2023-05-24T03:32:07.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.741+0000 7fd5177fe700 1 -- 172.21.15.146:0/1655420215 learned_addr learned my addr 172.21.15.146:0/1655420215 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:32:07.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.741+0000 7fd516ffd700 1 --2- 172.21.15.146:0/1655420215 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd51806aab0 0x7fd518149370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:07.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.741+0000 7fd5167fc700 1 --2- 172.21.15.146:0/1655420215 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd518071960 0x7fd5180b1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:07.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.741+0000 7fd5177fe700 1 -- 172.21.15.146:0/1655420215 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd51806aab0 msgr2=0x7fd518149370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:07.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.741+0000 7fd5177fe700 1 --2- 172.21.15.146:0/1655420215 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd51806aab0 0x7fd518149370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:07.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.741+0000 7fd5177fe700 1 -- 172.21.15.146:0/1655420215 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd518071960 msgr2=0x7fd5180b1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:07.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.741+0000 7fd5177fe700 1 --2- 172.21.15.146:0/1655420215 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd518071960 0x7fd5180b1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:07.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.741+0000 7fd5177fe700 1 -- 172.21.15.146:0/1655420215 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd50c009550 con 0x7fd5180af0b0 2023-05-24T03:32:07.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.741+0000 7fd516ffd700 1 --2- 172.21.15.146:0/1655420215 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd51806aab0 0x7fd518149370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T03:32:07.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.741+0000 7fd5177fe700 1 --2- 172.21.15.146:0/1655420215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5180af0b0 0x7fd5180b1aa0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd51000cc50 tx=0x7fd51000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:07.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.741+0000 7fd4ff7fe700 1 -- 172.21.15.146:0/1655420215 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd510003c00 con 0x7fd5180af0b0 2023-05-24T03:32:07.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.741+0000 7fd4ff7fe700 1 -- 172.21.15.146:0/1655420215 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd510003d60 con 0x7fd5180af0b0 2023-05-24T03:32:07.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.741+0000 7fd51d6a4700 1 -- 172.21.15.146:0/1655420215 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5181617e0 con 0x7fd5180af0b0 2023-05-24T03:32:07.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.741+0000 7fd4ff7fe700 1 -- 172.21.15.146:0/1655420215 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51000aab0 con 0x7fd5180af0b0 2023-05-24T03:32:07.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.741+0000 7fd51d6a4700 1 -- 172.21.15.146:0/1655420215 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd518160d80 con 0x7fd5180af0b0 2023-05-24T03:32:07.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.742+0000 7fd51d6a4700 1 -- 172.21.15.146:0/1655420215 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd5180cf290 con 0x7fd5180af0b0 2023-05-24T03:32:07.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.743+0000 7fd4ff7fe700 1 -- 172.21.15.146:0/1655420215 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd51000ac10 con 0x7fd5180af0b0 2023-05-24T03:32:07.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.743+0000 7fd4ff7fe700 1 --2- 172.21.15.146:0/1655420215 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fd50406ace0 0x7fd50406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:07.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.743+0000 7fd4ff7fe700 1 -- 172.21.15.146:0/1655420215 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd510089760 con 0x7fd5180af0b0 2023-05-24T03:32:07.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.743+0000 7fd516ffd700 1 --2- 172.21.15.146:0/1655420215 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fd50406ace0 0x7fd50406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:07.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.743+0000 7fd4ff7fe700 1 --2- 172.21.15.146:0/1655420215 >> [v2:172.21.15.151:6808/563291208,v1:172.21.15.151:6810/563291208] conn(0x7fd504074970 0x7fd504076de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:07.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.743+0000 7fd4ff7fe700 1 -- 172.21.15.146:0/1655420215 --> [v2:172.21.15.151:6808/563291208,v1:172.21.15.151:6810/563291208] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd5040774b0 con 0x7fd504074970 2023-05-24T03:32:07.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.743+0000 7fd4ff7fe700 1 -- 172.21.15.146:0/1655420215 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd51008be20 con 0x7fd5180af0b0 2023-05-24T03:32:07.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.743+0000 7fd5167fc700 1 --2- 172.21.15.146:0/1655420215 >> [v2:172.21.15.151:6808/563291208,v1:172.21.15.151:6810/563291208] conn(0x7fd504074970 0x7fd504076de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:07.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.743+0000 7fd516ffd700 1 --2- 172.21.15.146:0/1655420215 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fd50406ace0 0x7fd50406d190 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd508009f30 tx=0x7fd508009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:07.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.744+0000 7fd5167fc700 1 --2- 172.21.15.146:0/1655420215 >> [v2:172.21.15.151:6808/563291208,v1:172.21.15.151:6810/563291208] conn(0x7fd504074970 0x7fd504076de0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:07.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.745+0000 7fd4ff7fe700 1 -- 172.21.15.146:0/1655420215 <== osd.7 v2:172.21.15.151:6808/563291208 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fd5040774b0 con 0x7fd504074970 2023-05-24T03:32:07.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.759+0000 7fd51d6a4700 1 -- 172.21.15.146:0/1655420215 --> [v2:172.21.15.151:6808/563291208,v1:172.21.15.151:6810/563291208] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd5180b3270 con 0x7fd504074970 2023-05-24T03:32:07.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.759+0000 7fd4ff7fe700 1 -- 172.21.15.146:0/1655420215 <== osd.7 v2:172.21.15.151:6808/563291208 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd5180b3270 con 0x7fd504074970 2023-05-24T03:32:07.769 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-05-24T03:32:07.769 INFO:teuthology.orchestra.run.smithi146.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-05-24T03:32:07.770 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-05-24T03:32:07.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.760+0000 7fd51d6a4700 1 -- 172.21.15.146:0/1655420215 >> [v2:172.21.15.151:6808/563291208,v1:172.21.15.151:6810/563291208] conn(0x7fd504074970 msgr2=0x7fd504076de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:07.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.760+0000 7fd51d6a4700 1 --2- 172.21.15.146:0/1655420215 >> [v2:172.21.15.151:6808/563291208,v1:172.21.15.151:6810/563291208] conn(0x7fd504074970 0x7fd504076de0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:07.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.760+0000 7fd51d6a4700 1 -- 172.21.15.146:0/1655420215 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fd50406ace0 msgr2=0x7fd50406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:07.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.760+0000 7fd51d6a4700 1 --2- 172.21.15.146:0/1655420215 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fd50406ace0 0x7fd50406d190 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd508009f30 tx=0x7fd508009210 comp rx=0 tx=0).stop 2023-05-24T03:32:07.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.760+0000 7fd51d6a4700 1 -- 172.21.15.146:0/1655420215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5180af0b0 msgr2=0x7fd5180b1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:07.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.760+0000 7fd51d6a4700 1 --2- 172.21.15.146:0/1655420215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5180af0b0 0x7fd5180b1aa0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd51000cc50 tx=0x7fd51000cf60 comp rx=0 tx=0).stop 2023-05-24T03:32:07.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.760+0000 7fd5177fe700 1 -- 172.21.15.146:0/1655420215 reap_dead start 2023-05-24T03:32:07.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.760+0000 7fd51d6a4700 1 -- 172.21.15.146:0/1655420215 shutdown_connections 2023-05-24T03:32:07.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.760+0000 7fd51d6a4700 1 -- 172.21.15.146:0/1655420215 >> 172.21.15.146:0/1655420215 conn(0x7fd51806ebb0 msgr2=0x7fd5180ac8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:32:07.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.760+0000 7fd51d6a4700 1 -- 172.21.15.146:0/1655420215 shutdown_connections 2023-05-24T03:32:07.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.760+0000 7fd51d6a4700 1 -- 172.21.15.146:0/1655420215 wait complete. 2023-05-24T03:32:07.776 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-05-24T03:32:07.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.895+0000 7f14dc668700 1 Processor -- start 2023-05-24T03:32:07.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.895+0000 7f14dc668700 1 -- start start 2023-05-24T03:32:07.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.896+0000 7f14dc668700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f14d40cdf10 0x7f14d4159c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:07.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.896+0000 7f14dc668700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f14d4070f50 0x7f14d406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:07.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.896+0000 7f14dc668700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14d415a3c0 con 0x7f14d415dcf0 2023-05-24T03:32:07.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.896+0000 7f14dc668700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14d415a1c0 con 0x7f14d40cdf10 2023-05-24T03:32:07.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.896+0000 7f14dc668700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14d415a6a0 con 0x7f14d4070f50 2023-05-24T03:32:07.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.896+0000 7f14da404700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f14d40cdf10 0x7f14d4159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:07.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.896+0000 7f14dac05700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f14d4070f50 0x7f14d406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:07.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.896+0000 7f14d9c03700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f14d415dcf0 0x7f14d40ce2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:46228/0 (socket says 172.21.15.146:46228) 2023-05-24T03:32:07.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.896+0000 7f14da404700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f14d40cdf10 0x7f14d4159c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40742/0 (socket says 172.21.15.146:40742) 2023-05-24T03:32:07.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.896+0000 7f14dac05700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f14d4070f50 0x7f14d406d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:51928/0 (socket says 172.21.15.146:51928) 2023-05-24T03:32:07.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.896+0000 7f14d9c03700 1 -- 172.21.15.146:0/3335711705 learned_addr learned my addr 172.21.15.146:0/3335711705 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:32:07.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.897+0000 7f14da404700 1 -- 172.21.15.146:0/3335711705 >> v2:172.21.15.151:3300/0 conn(0x7f14d4070f50 msgr2=0x7f14d406d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:32:07.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.897+0000 7f14da404700 1 --2- 172.21.15.146:0/3335711705 >> v2:172.21.15.151:3300/0 conn(0x7f14d4070f50 0x7f14d406d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:07.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.897+0000 7f14da404700 1 -- 172.21.15.146:0/3335711705 >> v1:172.21.15.151:6789/0 conn(0x7f14d415dcf0 legacy=0x7f14d40ce2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:07.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.897+0000 7f14da404700 1 -- 172.21.15.146:0/3335711705 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d415a980 con 0x7f14d40cdf10 2023-05-24T03:32:07.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.897+0000 7f14da404700 1 --2- 172.21.15.146:0/3335711705 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14d40cdf10 0x7f14d4159c80 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f14d4066c50 tx=0x7f14c4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2778654a04a2d12d server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:07.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.897+0000 7f14d9402700 1 -- 172.21.15.146:0/3335711705 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c4011830 con 0x7f14d40cdf10 2023-05-24T03:32:07.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.897+0000 7f14d9402700 1 -- 172.21.15.146:0/3335711705 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c4011990 con 0x7f14d40cdf10 2023-05-24T03:32:07.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.897+0000 7f14d9402700 1 -- 172.21.15.146:0/3335711705 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c4011d20 con 0x7f14d40cdf10 2023-05-24T03:32:07.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.898+0000 7f14dc668700 1 -- 172.21.15.146:0/3335711705 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14d40cdf10 msgr2=0x7f14d4159c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:07.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.898+0000 7f14dc668700 1 --2- 172.21.15.146:0/3335711705 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14d40cdf10 0x7f14d4159c80 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f14d4066c50 tx=0x7f14c4009b20 comp rx=0 tx=0).stop 2023-05-24T03:32:07.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.898+0000 7f14dc668700 1 -- 172.21.15.146:0/3335711705 shutdown_connections 2023-05-24T03:32:07.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.898+0000 7f14dc668700 1 --2- 172.21.15.146:0/3335711705 >> v2:172.21.15.151:3300/0 conn(0x7f14d4070f50 0x7f14d406d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:07.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.898+0000 7f14dc668700 1 --2- 172.21.15.146:0/3335711705 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14d40cdf10 0x7f14d4159c80 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:07.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.898+0000 7f14dc668700 1 -- 172.21.15.146:0/3335711705 >> 172.21.15.146:0/3335711705 conn(0x7f14d40cfea0 msgr2=0x7f14d40d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:32:07.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.898+0000 7f14dc668700 1 -- 172.21.15.146:0/3335711705 shutdown_connections 2023-05-24T03:32:07.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.898+0000 7f14dc668700 1 -- 172.21.15.146:0/3335711705 wait complete. 2023-05-24T03:32:07.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.899+0000 7f14dc668700 1 Processor -- start 2023-05-24T03:32:07.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.899+0000 7f14dc668700 1 -- start start 2023-05-24T03:32:07.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.900+0000 7f14dc668700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14d4070f50 0x7f14d41ed8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:07.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.900+0000 7f14dc668700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14d40cdf10 0x7f14d4158920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:07.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.900+0000 7f14dc668700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14d415dcf0 0x7f14d4158e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:07.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.900+0000 7f14dc668700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d41ee490 con 0x7f14d4070f50 2023-05-24T03:32:07.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.900+0000 7f14dc668700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d40b3950 con 0x7f14d415dcf0 2023-05-24T03:32:07.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.900+0000 7f14dc668700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14d40b3c30 con 0x7f14d40cdf10 2023-05-24T03:32:07.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.900+0000 7f14da404700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14d4070f50 0x7f14d41ed8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:07.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.900+0000 7f14da404700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14d4070f50 0x7f14d41ed8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40748/0 (socket says 172.21.15.146:40748) 2023-05-24T03:32:07.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.900+0000 7f14da404700 1 -- 172.21.15.146:0/2876452698 learned_addr learned my addr 172.21.15.146:0/2876452698 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:32:07.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.900+0000 7f14d9c03700 1 --2- 172.21.15.146:0/2876452698 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14d40cdf10 0x7f14d4158920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:07.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.900+0000 7f14dac05700 1 --2- 172.21.15.146:0/2876452698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14d415dcf0 0x7f14d4158e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:07.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.900+0000 7f14da404700 1 -- 172.21.15.146:0/2876452698 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14d40cdf10 msgr2=0x7f14d4158920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:07.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.900+0000 7f14da404700 1 --2- 172.21.15.146:0/2876452698 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14d40cdf10 0x7f14d4158920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:07.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.900+0000 7f14da404700 1 -- 172.21.15.146:0/2876452698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14d415dcf0 msgr2=0x7f14d4158e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:07.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.900+0000 7f14da404700 1 --2- 172.21.15.146:0/2876452698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14d415dcf0 0x7f14d4158e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:07.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.900+0000 7f14da404700 1 -- 172.21.15.146:0/2876452698 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c40094a0 con 0x7f14d4070f50 2023-05-24T03:32:07.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.900+0000 7f14d9c03700 1 --2- 172.21.15.146:0/2876452698 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14d40cdf10 0x7f14d4158920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:32:07.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.900+0000 7f14da404700 1 --2- 172.21.15.146:0/2876452698 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14d4070f50 0x7f14d41ed8b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f14c4000c00 tx=0x7f14c4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:07.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.900+0000 7f14caffd700 1 -- 172.21.15.146:0/2876452698 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c40036a0 con 0x7f14d4070f50 2023-05-24T03:32:07.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.900+0000 7f14caffd700 1 -- 172.21.15.146:0/2876452698 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c401e070 con 0x7f14d4070f50 2023-05-24T03:32:07.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.900+0000 7f14dc668700 1 -- 172.21.15.146:0/2876452698 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14d406d190 con 0x7f14d4070f50 2023-05-24T03:32:07.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.900+0000 7f14caffd700 1 -- 172.21.15.146:0/2876452698 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c4003a60 con 0x7f14d4070f50 2023-05-24T03:32:07.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.901+0000 7f14dc668700 1 -- 172.21.15.146:0/2876452698 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14d415ac60 con 0x7f14d4070f50 2023-05-24T03:32:07.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.902+0000 7f14dc668700 1 -- 172.21.15.146:0/2876452698 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14d415e190 con 0x7f14d4070f50 2023-05-24T03:32:07.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.902+0000 7f14caffd700 1 -- 172.21.15.146:0/2876452698 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f14c4003bc0 con 0x7f14d4070f50 2023-05-24T03:32:07.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.902+0000 7f14caffd700 1 --2- 172.21.15.146:0/2876452698 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f14b806ace0 0x7f14b806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:07.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.902+0000 7f14caffd700 1 -- 172.21.15.146:0/2876452698 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f14c408a770 con 0x7f14d4070f50 2023-05-24T03:32:07.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.902+0000 7f14d9c03700 1 --2- 172.21.15.146:0/2876452698 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f14b806ace0 0x7f14b806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:07.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.903+0000 7f14d9c03700 1 --2- 172.21.15.146:0/2876452698 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f14b806ace0 0x7f14b806d190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f14d0007fd0 tx=0x7f14d0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:07.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:07.907+0000 7f14caffd700 1 -- 172.21.15.146:0/2876452698 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f14c4055580 con 0x7f14d4070f50 2023-05-24T03:32:08.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.093+0000 7f14dc668700 1 -- 172.21.15.146:0/2876452698 --> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f14d404e810 con 0x7f14b806ace0 2023-05-24T03:32:08.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.094+0000 7f14caffd700 1 -- 172.21.15.146:0/2876452698 <== mgr.4104 v2:172.21.15.146:6832/1985394169 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f14d404e810 con 0x7f14b806ace0 2023-05-24T03:32:08.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.096+0000 7f14dc668700 1 -- 172.21.15.146:0/2876452698 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f14b806ace0 msgr2=0x7f14b806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:08.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.096+0000 7f14dc668700 1 --2- 172.21.15.146:0/2876452698 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f14b806ace0 0x7f14b806d190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f14d0007fd0 tx=0x7f14d0009040 comp rx=0 tx=0).stop 2023-05-24T03:32:08.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.096+0000 7f14dc668700 1 -- 172.21.15.146:0/2876452698 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14d4070f50 msgr2=0x7f14d41ed8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:08.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.096+0000 7f14dc668700 1 --2- 172.21.15.146:0/2876452698 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14d4070f50 0x7f14d41ed8b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f14c4000c00 tx=0x7f14c4004750 comp rx=0 tx=0).stop 2023-05-24T03:32:08.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.096+0000 7f14dc668700 1 -- 172.21.15.146:0/2876452698 shutdown_connections 2023-05-24T03:32:08.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.096+0000 7f14dc668700 1 --2- 172.21.15.146:0/2876452698 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f14b806ace0 0x7f14b806d190 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:08.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.096+0000 7f14dc668700 1 --2- 172.21.15.146:0/2876452698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14d415dcf0 0x7f14d4158e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:08.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.096+0000 7f14dc668700 1 --2- 172.21.15.146:0/2876452698 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14d4070f50 0x7f14d41ed8b0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:08.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.096+0000 7f14dc668700 1 --2- 172.21.15.146:0/2876452698 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14d40cdf10 0x7f14d4158920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:08.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.096+0000 7f14dc668700 1 -- 172.21.15.146:0/2876452698 >> 172.21.15.146:0/2876452698 conn(0x7f14d40cfea0 msgr2=0x7f14d40ca4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:32:08.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.096+0000 7f14dc668700 1 -- 172.21.15.146:0/2876452698 shutdown_connections 2023-05-24T03:32:08.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.096+0000 7f14dc668700 1 -- 172.21.15.146:0/2876452698 wait complete. 2023-05-24T03:32:08.103 INFO:teuthology.orchestra.run.smithi146.stderr:instructed osd(s) 7 to deep-scrub 2023-05-24T03:32:08.113 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-24T03:32:08.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.230+0000 7fa28ae14700 1 Processor -- start 2023-05-24T03:32:08.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.230+0000 7fa28ae14700 1 -- start start 2023-05-24T03:32:08.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.231+0000 7fa28ae14700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa2840cdf10 0x7fa284159c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:08.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.231+0000 7fa28ae14700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa28415dcf0 0x7fa2840ce2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:08.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.231+0000 7fa28ae14700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa284070f50 0x7fa28406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:08.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.231+0000 7fa28ae14700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa28415a1c0 con 0x7fa2840cdf10 2023-05-24T03:32:08.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.231+0000 7fa28ae14700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2840ce820 con 0x7fa28415dcf0 2023-05-24T03:32:08.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.231+0000 7fa28ae14700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa28415a3c0 con 0x7fa284070f50 2023-05-24T03:32:08.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.231+0000 7fa288bb0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa2840cdf10 0x7fa284159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:08.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.231+0000 7fa288bb0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa2840cdf10 0x7fa284159c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40756/0 (socket says 172.21.15.146:40756) 2023-05-24T03:32:08.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.231+0000 7fa288bb0700 1 -- 172.21.15.146:0/2656013724 learned_addr learned my addr 172.21.15.146:0/2656013724 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:32:08.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.232+0000 7fa2893b1700 1 --2- 172.21.15.146:0/2656013724 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa284070f50 0x7fa28406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:08.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.232+0000 7fa288bb0700 1 -- 172.21.15.146:0/2656013724 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa284070f50 msgr2=0x7fa28406d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:32:08.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.232+0000 7fa283fff700 1 --2- 172.21.15.146:0/2656013724 >> v2:172.21.15.151:3300/0 conn(0x7fa28415dcf0 0x7fa2840ce2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:08.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.232+0000 7fa288bb0700 1 --2- 172.21.15.146:0/2656013724 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa284070f50 0x7fa28406d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:08.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.232+0000 7fa288bb0700 1 -- 172.21.15.146:0/2656013724 >> v2:172.21.15.151:3300/0 conn(0x7fa28415dcf0 msgr2=0x7fa2840ce2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:32:08.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.232+0000 7fa288bb0700 1 --2- 172.21.15.146:0/2656013724 >> v2:172.21.15.151:3300/0 conn(0x7fa28415dcf0 0x7fa2840ce2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:08.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.232+0000 7fa288bb0700 1 -- 172.21.15.146:0/2656013724 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa28415a6a0 con 0x7fa2840cdf10 2023-05-24T03:32:08.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.232+0000 7fa283fff700 1 --2- 172.21.15.146:0/2656013724 >> v2:172.21.15.151:3300/0 conn(0x7fa28415dcf0 0x7fa2840ce2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:32:08.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.232+0000 7fa288bb0700 1 --2- 172.21.15.146:0/2656013724 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2840cdf10 0x7fa284159c80 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa284070d40 tx=0x7fa27800be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ebced84f0290ecf server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:08.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.232+0000 7fa2837fe700 1 -- 172.21.15.146:0/2656013724 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27800dd30 con 0x7fa2840cdf10 2023-05-24T03:32:08.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.232+0000 7fa2837fe700 1 -- 172.21.15.146:0/2656013724 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa27800de90 con 0x7fa2840cdf10 2023-05-24T03:32:08.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.232+0000 7fa2837fe700 1 -- 172.21.15.146:0/2656013724 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa278010690 con 0x7fa2840cdf10 2023-05-24T03:32:08.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.232+0000 7fa28ae14700 1 -- 172.21.15.146:0/2656013724 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2840cdf10 msgr2=0x7fa284159c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:08.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.232+0000 7fa28ae14700 1 --2- 172.21.15.146:0/2656013724 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2840cdf10 0x7fa284159c80 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa284070d40 tx=0x7fa27800be70 comp rx=0 tx=0).stop 2023-05-24T03:32:08.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.233+0000 7fa28ae14700 1 -- 172.21.15.146:0/2656013724 shutdown_connections 2023-05-24T03:32:08.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.233+0000 7fa28ae14700 1 --2- 172.21.15.146:0/2656013724 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa284070f50 0x7fa28406d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:08.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.233+0000 7fa28ae14700 1 --2- 172.21.15.146:0/2656013724 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2840cdf10 0x7fa284159c80 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:08.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.233+0000 7fa28ae14700 1 --2- 172.21.15.146:0/2656013724 >> v2:172.21.15.151:3300/0 conn(0x7fa28415dcf0 0x7fa2840ce2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:08.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.233+0000 7fa28ae14700 1 -- 172.21.15.146:0/2656013724 >> 172.21.15.146:0/2656013724 conn(0x7fa2840cfea0 msgr2=0x7fa2840d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:32:08.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.233+0000 7fa28ae14700 1 -- 172.21.15.146:0/2656013724 shutdown_connections 2023-05-24T03:32:08.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.233+0000 7fa28ae14700 1 -- 172.21.15.146:0/2656013724 wait complete. 2023-05-24T03:32:08.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.234+0000 7fa28ae14700 1 Processor -- start 2023-05-24T03:32:08.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.234+0000 7fa28ae14700 1 -- start start 2023-05-24T03:32:08.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.235+0000 7fa28ae14700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa284070f50 0x7fa284151140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:08.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.235+0000 7fa28ae14700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2840cdf10 0x7fa2840b1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:08.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.235+0000 7fa28ae14700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa28415dcf0 0x7fa2840b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:08.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.235+0000 7fa28ae14700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2840b1150 con 0x7fa2840cdf10 2023-05-24T03:32:08.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.235+0000 7fa28ae14700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2840b1ff0 con 0x7fa284070f50 2023-05-24T03:32:08.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.235+0000 7fa28ae14700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2840b04d0 con 0x7fa28415dcf0 2023-05-24T03:32:08.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.235+0000 7fa283fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2840cdf10 0x7fa2840b1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:08.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.235+0000 7fa283fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2840cdf10 0x7fa2840b1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40764/0 (socket says 172.21.15.146:40764) 2023-05-24T03:32:08.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.235+0000 7fa283fff700 1 -- 172.21.15.146:0/881830006 learned_addr learned my addr 172.21.15.146:0/881830006 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:32:08.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.235+0000 7fa288bb0700 1 --2- 172.21.15.146:0/881830006 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa284070f50 0x7fa284151140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:08.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.236+0000 7fa2893b1700 1 --2- 172.21.15.146:0/881830006 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa28415dcf0 0x7fa2840b1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:08.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.236+0000 7fa283fff700 1 -- 172.21.15.146:0/881830006 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa28415dcf0 msgr2=0x7fa2840b1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:08.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.236+0000 7fa283fff700 1 --2- 172.21.15.146:0/881830006 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa28415dcf0 0x7fa2840b1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:08.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.236+0000 7fa283fff700 1 -- 172.21.15.146:0/881830006 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa284070f50 msgr2=0x7fa284151140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:08.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.236+0000 7fa283fff700 1 --2- 172.21.15.146:0/881830006 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa284070f50 0x7fa284151140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:08.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.236+0000 7fa283fff700 1 -- 172.21.15.146:0/881830006 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa27800b7f0 con 0x7fa2840cdf10 2023-05-24T03:32:08.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.236+0000 7fa288bb0700 1 --2- 172.21.15.146:0/881830006 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa284070f50 0x7fa284151140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:32:08.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.236+0000 7fa283fff700 1 --2- 172.21.15.146:0/881830006 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2840cdf10 0x7fa2840b1570 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa27000c7f0 tx=0x7fa27000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:08.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.236+0000 7fa2817fa700 1 -- 172.21.15.146:0/881830006 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa270011800 con 0x7fa2840cdf10 2023-05-24T03:32:08.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.236+0000 7fa2817fa700 1 -- 172.21.15.146:0/881830006 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa270011960 con 0x7fa2840cdf10 2023-05-24T03:32:08.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.236+0000 7fa28ae14700 1 -- 172.21.15.146:0/881830006 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa28415ac60 con 0x7fa2840cdf10 2023-05-24T03:32:08.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.236+0000 7fa2817fa700 1 -- 172.21.15.146:0/881830006 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa270011d10 con 0x7fa2840cdf10 2023-05-24T03:32:08.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.236+0000 7fa28ae14700 1 -- 172.21.15.146:0/881830006 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa28415a980 con 0x7fa2840cdf10 2023-05-24T03:32:08.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.237+0000 7fa28ae14700 1 -- 172.21.15.146:0/881830006 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa28406d190 con 0x7fa2840cdf10 2023-05-24T03:32:08.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.237+0000 7fa2817fa700 1 -- 172.21.15.146:0/881830006 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa270018360 con 0x7fa2840cdf10 2023-05-24T03:32:08.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.238+0000 7fa2817fa700 1 --2- 172.21.15.146:0/881830006 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fa26806ace0 0x7fa26806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:08.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.238+0000 7fa2817fa700 1 -- 172.21.15.146:0/881830006 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa270089700 con 0x7fa2840cdf10 2023-05-24T03:32:08.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.238+0000 7fa288bb0700 1 --2- 172.21.15.146:0/881830006 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fa26806ace0 0x7fa26806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:08.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.238+0000 7fa288bb0700 1 --2- 172.21.15.146:0/881830006 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fa26806ace0 0x7fa26806d190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa27800beb0 tx=0x7fa278012000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:08.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.242+0000 7fa2817fa700 1 -- 172.21.15.146:0/881830006 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fa270054510 con 0x7fa2840cdf10 2023-05-24T03:32:08.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.428+0000 7fa28ae14700 1 -- 172.21.15.146:0/881830006 --> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa2840b1290 con 0x7fa26806ace0 2023-05-24T03:32:08.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.438+0000 7fa2817fa700 1 -- 172.21.15.146:0/881830006 <== mgr.4104 v2:172.21.15.146:6832/1985394169 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+391884 (secure 0 0 0) 0x7fa2840b1290 con 0x7fa26806ace0 2023-05-24T03:32:08.446 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:32:08.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.442+0000 7fa28ae14700 1 -- 172.21.15.146:0/881830006 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fa26806ace0 msgr2=0x7fa26806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:08.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.442+0000 7fa28ae14700 1 --2- 172.21.15.146:0/881830006 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fa26806ace0 0x7fa26806d190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa27800beb0 tx=0x7fa278012000 comp rx=0 tx=0).stop 2023-05-24T03:32:08.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.442+0000 7fa28ae14700 1 -- 172.21.15.146:0/881830006 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2840cdf10 msgr2=0x7fa2840b1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:08.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.442+0000 7fa28ae14700 1 --2- 172.21.15.146:0/881830006 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2840cdf10 0x7fa2840b1570 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa27000c7f0 tx=0x7fa27000cbb0 comp rx=0 tx=0).stop 2023-05-24T03:32:08.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.442+0000 7fa28ae14700 1 -- 172.21.15.146:0/881830006 shutdown_connections 2023-05-24T03:32:08.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.442+0000 7fa28ae14700 1 --2- 172.21.15.146:0/881830006 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fa26806ace0 0x7fa26806d190 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:08.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.442+0000 7fa28ae14700 1 --2- 172.21.15.146:0/881830006 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa28415dcf0 0x7fa2840b1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:08.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.442+0000 7fa28ae14700 1 --2- 172.21.15.146:0/881830006 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa284070f50 0x7fa284151140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:08.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.442+0000 7fa28ae14700 1 --2- 172.21.15.146:0/881830006 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2840cdf10 0x7fa2840b1570 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:08.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.442+0000 7fa28ae14700 1 -- 172.21.15.146:0/881830006 >> 172.21.15.146:0/881830006 conn(0x7fa2840cfea0 msgr2=0x7fa2840d0270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:32:08.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.442+0000 7fa28ae14700 1 -- 172.21.15.146:0/881830006 shutdown_connections 2023-05-24T03:32:08.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:08.442+0000 7fa28ae14700 1 -- 172.21.15.146:0/881830006 wait complete. 2023-05-24T03:32:08.450 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-05-24T03:32:08.459 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":101,"stamp":"2023-05-24T03:32:06.792776+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":102708194,"num_objects":49,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":131,"num_read_kb":119,"num_write":1149,"num_write_kb":1158170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17567,"ondisk_log_size":17567,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":534296,"kb_used_data":317912,"kb_used_omap":0,"kb_used_meta":216320,"kb_avail":754440424,"statfs":{"total":773094113280,"available":772546994176,"internally_reserved":0,"allocated":325541888,"data_stored":323967559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":221511680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,3,2,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":65,"apply_latency_ms":65,"commit_latency_ns":65000000,"apply_latency_ns":65000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-502065266,"num_objects":-123,"num_object_clones":0,"num_object_copies":-492,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-123,"num_whiteouts":0,"num_read":9,"num_read_kb":11,"num_write":484,"num_write_kb":565494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002511"},"pg_stats":[{"pgid":"4.3f","version":"30'28","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.751724+0000","last_change":"2023-05-24T03:29:44.490120+0000","last_active":"2023-05-24T03:32:00.751724+0000","last_peered":"2023-05-24T03:32:00.751724+0000","last_clean":"2023-05-24T03:32:00.751724+0000","last_became_active":"2023-05-24T03:29:44.489854+0000","last_became_peered":"2023-05-24T03:29:44.489854+0000","last_unstale":"2023-05-24T03:32:00.751724+0000","last_undegraded":"2023-05-24T03:32:00.751724+0000","last_fullsized":"2023-05-24T03:32:00.751724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:27:13.487917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"30'27","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.743996+0000","last_change":"2023-05-24T03:29:44.495973+0000","last_active":"2023-05-24T03:32:00.743996+0000","last_peered":"2023-05-24T03:32:00.743996+0000","last_clean":"2023-05-24T03:32:00.743996+0000","last_became_active":"2023-05-24T03:29:44.495700+0000","last_became_peered":"2023-05-24T03:29:44.495700+0000","last_unstale":"2023-05-24T03:32:00.743996+0000","last_undegraded":"2023-05-24T03:32:00.743996+0000","last_fullsized":"2023-05-24T03:32:00.743996+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:46:55.999454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"30'43","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.739469+0000","last_change":"2023-05-24T03:29:44.499947+0000","last_active":"2023-05-24T03:32:00.739469+0000","last_peered":"2023-05-24T03:32:00.739469+0000","last_clean":"2023-05-24T03:32:00.739469+0000","last_became_active":"2023-05-24T03:29:44.499663+0000","last_became_peered":"2023-05-24T03:29:44.499663+0000","last_unstale":"2023-05-24T03:32:00.739469+0000","last_undegraded":"2023-05-24T03:32:00.739469+0000","last_fullsized":"2023-05-24T03:32:00.739469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:31:12.011318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"30'24","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.733828+0000","last_change":"2023-05-24T03:29:44.498790+0000","last_active":"2023-05-24T03:32:00.733828+0000","last_peered":"2023-05-24T03:32:00.733828+0000","last_clean":"2023-05-24T03:32:00.733828+0000","last_became_active":"2023-05-24T03:29:44.498528+0000","last_became_peered":"2023-05-24T03:29:44.498528+0000","last_unstale":"2023-05-24T03:32:00.733828+0000","last_undegraded":"2023-05-24T03:32:00.733828+0000","last_fullsized":"2023-05-24T03:32:00.733828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:14:55.806370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"30'34","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.744674+0000","last_change":"2023-05-24T03:29:44.504225+0000","last_active":"2023-05-24T03:32:00.744674+0000","last_peered":"2023-05-24T03:32:00.744674+0000","last_clean":"2023-05-24T03:32:00.744674+0000","last_became_active":"2023-05-24T03:29:44.503998+0000","last_became_peered":"2023-05-24T03:29:44.503998+0000","last_unstale":"2023-05-24T03:32:00.744674+0000","last_undegraded":"2023-05-24T03:32:00.744674+0000","last_fullsized":"2023-05-24T03:32:00.744674+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:10:14.605046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"30'39","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.747017+0000","last_change":"2023-05-24T03:29:44.500355+0000","last_active":"2023-05-24T03:32:00.747017+0000","last_peered":"2023-05-24T03:32:00.747017+0000","last_clean":"2023-05-24T03:32:00.747017+0000","last_became_active":"2023-05-24T03:29:44.500065+0000","last_became_peered":"2023-05-24T03:29:44.500065+0000","last_unstale":"2023-05-24T03:32:00.747017+0000","last_undegraded":"2023-05-24T03:32:00.747017+0000","last_fullsized":"2023-05-24T03:32:00.747017+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T03:45:21.255320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"30'27","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.749955+0000","last_change":"2023-05-24T03:29:44.499607+0000","last_active":"2023-05-24T03:32:00.749955+0000","last_peered":"2023-05-24T03:32:00.749955+0000","last_clean":"2023-05-24T03:32:00.749955+0000","last_became_active":"2023-05-24T03:29:44.499324+0000","last_became_peered":"2023-05-24T03:29:44.499324+0000","last_unstale":"2023-05-24T03:32:00.749955+0000","last_undegraded":"2023-05-24T03:32:00.749955+0000","last_fullsized":"2023-05-24T03:32:00.749955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:11:59.800632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"30'31","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.736650+0000","last_change":"2023-05-24T03:29:44.500576+0000","last_active":"2023-05-24T03:32:00.736650+0000","last_peered":"2023-05-24T03:32:00.736650+0000","last_clean":"2023-05-24T03:32:00.736650+0000","last_became_active":"2023-05-24T03:29:44.500260+0000","last_became_peered":"2023-05-24T03:29:44.500260+0000","last_unstale":"2023-05-24T03:32:00.736650+0000","last_undegraded":"2023-05-24T03:32:00.736650+0000","last_fullsized":"2023-05-24T03:32:00.736650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:52:06.913754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"30'38","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.744845+0000","last_change":"2023-05-24T03:29:44.502655+0000","last_active":"2023-05-24T03:32:00.744845+0000","last_peered":"2023-05-24T03:32:00.744845+0000","last_clean":"2023-05-24T03:32:00.744845+0000","last_became_active":"2023-05-24T03:29:44.502341+0000","last_became_peered":"2023-05-24T03:29:44.502341+0000","last_unstale":"2023-05-24T03:32:00.744845+0000","last_undegraded":"2023-05-24T03:32:00.744845+0000","last_fullsized":"2023-05-24T03:32:00.744845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:28:43.398723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"30'44","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.742067+0000","last_change":"2023-05-24T03:29:44.500505+0000","last_active":"2023-05-24T03:32:00.742067+0000","last_peered":"2023-05-24T03:32:00.742067+0000","last_clean":"2023-05-24T03:32:00.742067+0000","last_became_active":"2023-05-24T03:29:44.500156+0000","last_became_peered":"2023-05-24T03:29:44.500156+0000","last_unstale":"2023-05-24T03:32:00.742067+0000","last_undegraded":"2023-05-24T03:32:00.742067+0000","last_fullsized":"2023-05-24T03:32:00.742067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:34:40.725013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"30'25","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.742414+0000","last_change":"2023-05-24T03:29:44.492850+0000","last_active":"2023-05-24T03:32:00.742414+0000","last_peered":"2023-05-24T03:32:00.742414+0000","last_clean":"2023-05-24T03:32:00.742414+0000","last_became_active":"2023-05-24T03:29:44.492573+0000","last_became_peered":"2023-05-24T03:29:44.492573+0000","last_unstale":"2023-05-24T03:32:00.742414+0000","last_undegraded":"2023-05-24T03:32:00.742414+0000","last_fullsized":"2023-05-24T03:32:00.742414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:25:03.563573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"30'30","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.738427+0000","last_change":"2023-05-24T03:29:44.501565+0000","last_active":"2023-05-24T03:32:00.738427+0000","last_peered":"2023-05-24T03:32:00.738427+0000","last_clean":"2023-05-24T03:32:00.738427+0000","last_became_active":"2023-05-24T03:29:44.501371+0000","last_became_peered":"2023-05-24T03:29:44.501371+0000","last_unstale":"2023-05-24T03:32:00.738427+0000","last_undegraded":"2023-05-24T03:32:00.738427+0000","last_fullsized":"2023-05-24T03:32:00.738427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:31:52.511256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"30'30","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.750186+0000","last_change":"2023-05-24T03:29:44.490972+0000","last_active":"2023-05-24T03:32:00.750186+0000","last_peered":"2023-05-24T03:32:00.750186+0000","last_clean":"2023-05-24T03:32:00.750186+0000","last_became_active":"2023-05-24T03:29:44.490411+0000","last_became_peered":"2023-05-24T03:29:44.490411+0000","last_unstale":"2023-05-24T03:32:00.750186+0000","last_undegraded":"2023-05-24T03:32:00.750186+0000","last_fullsized":"2023-05-24T03:32:00.750186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:20:09.308993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"30'32","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.740648+0000","last_change":"2023-05-24T03:29:44.495213+0000","last_active":"2023-05-24T03:32:00.740648+0000","last_peered":"2023-05-24T03:32:00.740648+0000","last_clean":"2023-05-24T03:32:00.740648+0000","last_became_active":"2023-05-24T03:29:44.494879+0000","last_became_peered":"2023-05-24T03:29:44.494879+0000","last_unstale":"2023-05-24T03:32:00.740648+0000","last_undegraded":"2023-05-24T03:32:00.740648+0000","last_fullsized":"2023-05-24T03:32:00.740648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:21:01.901695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"30'31","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.749664+0000","last_change":"2023-05-24T03:29:44.499673+0000","last_active":"2023-05-24T03:32:00.749664+0000","last_peered":"2023-05-24T03:32:00.749664+0000","last_clean":"2023-05-24T03:32:00.749664+0000","last_became_active":"2023-05-24T03:29:44.499393+0000","last_became_peered":"2023-05-24T03:29:44.499393+0000","last_unstale":"2023-05-24T03:32:00.749664+0000","last_undegraded":"2023-05-24T03:32:00.749664+0000","last_fullsized":"2023-05-24T03:32:00.749664+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:36:39.587451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"30'39","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.746885+0000","last_change":"2023-05-24T03:29:44.501101+0000","last_active":"2023-05-24T03:32:00.746885+0000","last_peered":"2023-05-24T03:32:00.746885+0000","last_clean":"2023-05-24T03:32:00.746885+0000","last_became_active":"2023-05-24T03:29:44.500818+0000","last_became_peered":"2023-05-24T03:29:44.500818+0000","last_unstale":"2023-05-24T03:32:00.746885+0000","last_undegraded":"2023-05-24T03:32:00.746885+0000","last_fullsized":"2023-05-24T03:32:00.746885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:13:18.627969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"30'34","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.745073+0000","last_change":"2023-05-24T03:29:44.500209+0000","last_active":"2023-05-24T03:32:00.745073+0000","last_peered":"2023-05-24T03:32:00.745073+0000","last_clean":"2023-05-24T03:32:00.745073+0000","last_became_active":"2023-05-24T03:29:44.499543+0000","last_became_peered":"2023-05-24T03:29:44.499543+0000","last_unstale":"2023-05-24T03:32:00.745073+0000","last_undegraded":"2023-05-24T03:32:00.745073+0000","last_fullsized":"2023-05-24T03:32:00.745073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:29:00.326985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"30'29","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.746321+0000","last_change":"2023-05-24T03:29:44.492545+0000","last_active":"2023-05-24T03:32:00.746321+0000","last_peered":"2023-05-24T03:32:00.746321+0000","last_clean":"2023-05-24T03:32:00.746321+0000","last_became_active":"2023-05-24T03:29:44.492109+0000","last_became_peered":"2023-05-24T03:29:44.492109+0000","last_unstale":"2023-05-24T03:32:00.746321+0000","last_undegraded":"2023-05-24T03:32:00.746321+0000","last_fullsized":"2023-05-24T03:32:00.746321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:22:07.073049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"30'31","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.741395+0000","last_change":"2023-05-24T03:29:44.480834+0000","last_active":"2023-05-24T03:32:00.741395+0000","last_peered":"2023-05-24T03:32:00.741395+0000","last_clean":"2023-05-24T03:32:00.741395+0000","last_became_active":"2023-05-24T03:29:44.480597+0000","last_became_peered":"2023-05-24T03:29:44.480597+0000","last_unstale":"2023-05-24T03:32:00.741395+0000","last_undegraded":"2023-05-24T03:32:00.741395+0000","last_fullsized":"2023-05-24T03:32:00.741395+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:44:17.635928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"30'34","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.748114+0000","last_change":"2023-05-24T03:29:44.501003+0000","last_active":"2023-05-24T03:32:00.748114+0000","last_peered":"2023-05-24T03:32:00.748114+0000","last_clean":"2023-05-24T03:32:00.748114+0000","last_became_active":"2023-05-24T03:29:44.499405+0000","last_became_peered":"2023-05-24T03:29:44.499405+0000","last_unstale":"2023-05-24T03:32:00.748114+0000","last_undegraded":"2023-05-24T03:32:00.748114+0000","last_fullsized":"2023-05-24T03:32:00.748114+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:32:47.250786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"30'40","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.748721+0000","last_change":"2023-05-24T03:30:26.106086+0000","last_active":"2023-05-24T03:32:00.748721+0000","last_peered":"2023-05-24T03:32:00.748721+0000","last_clean":"2023-05-24T03:32:00.748721+0000","last_became_active":"2023-05-24T03:30:26.105858+0000","last_became_peered":"2023-05-24T03:30:26.105858+0000","last_unstale":"2023-05-24T03:32:00.748721+0000","last_undegraded":"2023-05-24T03:32:00.748721+0000","last_fullsized":"2023-05-24T03:32:00.748721+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:03:29.813763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"30'32","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.745276+0000","last_change":"2023-05-24T03:29:44.498675+0000","last_active":"2023-05-24T03:32:00.745276+0000","last_peered":"2023-05-24T03:32:00.745276+0000","last_clean":"2023-05-24T03:32:00.745276+0000","last_became_active":"2023-05-24T03:29:44.498463+0000","last_became_peered":"2023-05-24T03:29:44.498463+0000","last_unstale":"2023-05-24T03:32:00.745276+0000","last_undegraded":"2023-05-24T03:32:00.745276+0000","last_fullsized":"2023-05-24T03:32:00.745276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:36:39.587451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"30'36","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.749416+0000","last_change":"2023-05-24T03:29:44.500169+0000","last_active":"2023-05-24T03:32:00.749416+0000","last_peered":"2023-05-24T03:32:00.749416+0000","last_clean":"2023-05-24T03:32:00.749416+0000","last_became_active":"2023-05-24T03:29:44.499960+0000","last_became_peered":"2023-05-24T03:29:44.499960+0000","last_unstale":"2023-05-24T03:32:00.749416+0000","last_undegraded":"2023-05-24T03:32:00.749416+0000","last_fullsized":"2023-05-24T03:32:00.749416+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:06:19.223766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"30'31","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.752782+0000","last_change":"2023-05-24T03:29:44.499015+0000","last_active":"2023-05-24T03:32:00.752782+0000","last_peered":"2023-05-24T03:32:00.752782+0000","last_clean":"2023-05-24T03:32:00.752782+0000","last_became_active":"2023-05-24T03:29:44.498437+0000","last_became_peered":"2023-05-24T03:29:44.498437+0000","last_unstale":"2023-05-24T03:32:00.752782+0000","last_undegraded":"2023-05-24T03:32:00.752782+0000","last_fullsized":"2023-05-24T03:32:00.752782+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:00:20.978451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"30'25","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.743061+0000","last_change":"2023-05-24T03:29:44.481162+0000","last_active":"2023-05-24T03:32:00.743061+0000","last_peered":"2023-05-24T03:32:00.743061+0000","last_clean":"2023-05-24T03:32:00.743061+0000","last_became_active":"2023-05-24T03:29:44.481004+0000","last_became_peered":"2023-05-24T03:29:44.481004+0000","last_unstale":"2023-05-24T03:32:00.743061+0000","last_undegraded":"2023-05-24T03:32:00.743061+0000","last_fullsized":"2023-05-24T03:32:00.743061+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:36:39.587451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"30'38","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.748661+0000","last_change":"2023-05-24T03:29:44.481942+0000","last_active":"2023-05-24T03:32:00.748661+0000","last_peered":"2023-05-24T03:32:00.748661+0000","last_clean":"2023-05-24T03:32:00.748661+0000","last_became_active":"2023-05-24T03:29:44.481686+0000","last_became_peered":"2023-05-24T03:29:44.481686+0000","last_unstale":"2023-05-24T03:32:00.748661+0000","last_undegraded":"2023-05-24T03:32:00.748661+0000","last_fullsized":"2023-05-24T03:32:00.748661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:24:47.939385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"30'26","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.742808+0000","last_change":"2023-05-24T03:29:44.502948+0000","last_active":"2023-05-24T03:32:00.742808+0000","last_peered":"2023-05-24T03:32:00.742808+0000","last_clean":"2023-05-24T03:32:00.742808+0000","last_became_active":"2023-05-24T03:29:44.502669+0000","last_became_peered":"2023-05-24T03:29:44.502669+0000","last_unstale":"2023-05-24T03:32:00.742808+0000","last_undegraded":"2023-05-24T03:32:00.742808+0000","last_fullsized":"2023-05-24T03:32:00.742808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:03:29.813763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"30'474","reported_seq":491,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:59.028339+0000","last_change":"2023-05-24T03:29:48.523138+0000","last_active":"2023-05-24T03:31:59.028339+0000","last_peered":"2023-05-24T03:31:59.028339+0000","last_clean":"2023-05-24T03:31:59.028339+0000","last_became_active":"2023-05-24T03:29:48.522749+0000","last_became_peered":"2023-05-24T03:29:48.522749+0000","last_unstale":"2023-05-24T03:31:59.028339+0000","last_undegraded":"2023-05-24T03:31:59.028339+0000","last_fullsized":"2023-05-24T03:31:59.028339+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:02:45.564369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.945993+0000","last_change":"2023-05-24T03:29:44.086543+0000","last_active":"2023-05-24T03:30:25.945993+0000","last_peered":"2023-05-24T03:30:25.945993+0000","last_clean":"2023-05-24T03:30:25.945993+0000","last_became_active":"2023-05-24T03:29:44.086143+0000","last_became_peered":"2023-05-24T03:29:44.086143+0000","last_unstale":"2023-05-24T03:30:25.945993+0000","last_undegraded":"2023-05-24T03:30:25.945993+0000","last_fullsized":"2023-05-24T03:30:25.945993+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:45:41.681638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'39","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.749473+0000","last_change":"2023-05-24T03:29:44.491005+0000","last_active":"2023-05-24T03:32:00.749473+0000","last_peered":"2023-05-24T03:32:00.749473+0000","last_clean":"2023-05-24T03:32:00.749473+0000","last_became_active":"2023-05-24T03:29:44.490772+0000","last_became_peered":"2023-05-24T03:29:44.490772+0000","last_unstale":"2023-05-24T03:32:00.749473+0000","last_undegraded":"2023-05-24T03:32:00.749473+0000","last_fullsized":"2023-05-24T03:32:00.749473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:52:06.913754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"30'444","reported_seq":462,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:59.634721+0000","last_change":"2023-05-24T03:29:48.523521+0000","last_active":"2023-05-24T03:31:59.634721+0000","last_peered":"2023-05-24T03:31:59.634721+0000","last_clean":"2023-05-24T03:31:59.634721+0000","last_became_active":"2023-05-24T03:29:48.523125+0000","last_became_peered":"2023-05-24T03:29:48.523125+0000","last_unstale":"2023-05-24T03:31:59.634721+0000","last_undegraded":"2023-05-24T03:31:59.634721+0000","last_fullsized":"2023-05-24T03:31:59.634721+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:55:49.240935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.945583+0000","last_change":"2023-05-24T03:29:44.084408+0000","last_active":"2023-05-24T03:30:25.945583+0000","last_peered":"2023-05-24T03:30:25.945583+0000","last_clean":"2023-05-24T03:30:25.945583+0000","last_became_active":"2023-05-24T03:29:44.084099+0000","last_became_peered":"2023-05-24T03:29:44.084099+0000","last_unstale":"2023-05-24T03:30:25.945583+0000","last_undegraded":"2023-05-24T03:30:25.945583+0000","last_fullsized":"2023-05-24T03:30:25.945583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:55:17.269834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"30'31","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.738470+0000","last_change":"2023-05-24T03:29:44.503346+0000","last_active":"2023-05-24T03:32:00.738470+0000","last_peered":"2023-05-24T03:32:00.738470+0000","last_clean":"2023-05-24T03:32:00.738470+0000","last_became_active":"2023-05-24T03:29:44.503039+0000","last_became_peered":"2023-05-24T03:29:44.503039+0000","last_unstale":"2023-05-24T03:32:00.738470+0000","last_undegraded":"2023-05-24T03:32:00.738470+0000","last_fullsized":"2023-05-24T03:32:00.738470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:06:19.223766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"30'454","reported_seq":472,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:01.640774+0000","last_change":"2023-05-24T03:29:48.529615+0000","last_active":"2023-05-24T03:32:01.640774+0000","last_peered":"2023-05-24T03:32:01.640774+0000","last_clean":"2023-05-24T03:32:01.640774+0000","last_became_active":"2023-05-24T03:29:48.529142+0000","last_became_peered":"2023-05-24T03:29:48.529142+0000","last_unstale":"2023-05-24T03:32:01.640774+0000","last_undegraded":"2023-05-24T03:32:01.640774+0000","last_fullsized":"2023-05-24T03:32:01.640774+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:09:06.504119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"30'1","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:26.804992+0000","last_change":"2023-05-24T03:29:44.085410+0000","last_active":"2023-05-24T03:30:26.804992+0000","last_peered":"2023-05-24T03:30:26.804992+0000","last_clean":"2023-05-24T03:30:26.804992+0000","last_became_active":"2023-05-24T03:29:44.084907+0000","last_became_peered":"2023-05-24T03:29:44.084907+0000","last_unstale":"2023-05-24T03:30:26.804992+0000","last_undegraded":"2023-05-24T03:30:26.804992+0000","last_fullsized":"2023-05-24T03:30:26.804992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:46:54.993008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"30'30","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.736938+0000","last_change":"2023-05-24T03:29:44.497128+0000","last_active":"2023-05-24T03:32:00.736938+0000","last_peered":"2023-05-24T03:32:00.736938+0000","last_clean":"2023-05-24T03:32:00.736938+0000","last_became_active":"2023-05-24T03:29:44.496746+0000","last_became_peered":"2023-05-24T03:29:44.496746+0000","last_unstale":"2023-05-24T03:32:00.736938+0000","last_undegraded":"2023-05-24T03:32:00.736938+0000","last_fullsized":"2023-05-24T03:32:00.736938+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:27:24.810532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"30'468","reported_seq":485,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:59.644596+0000","last_change":"2023-05-24T03:29:48.520693+0000","last_active":"2023-05-24T03:31:59.644596+0000","last_peered":"2023-05-24T03:31:59.644596+0000","last_clean":"2023-05-24T03:31:59.644596+0000","last_became_active":"2023-05-24T03:29:48.520319+0000","last_became_peered":"2023-05-24T03:29:48.520319+0000","last_unstale":"2023-05-24T03:31:59.644596+0000","last_undegraded":"2023-05-24T03:31:59.644596+0000","last_fullsized":"2023-05-24T03:31:59.644596+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:32:35.981956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"30'1","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:26.131959+0000","last_change":"2023-05-24T03:29:44.088769+0000","last_active":"2023-05-24T03:30:26.131959+0000","last_peered":"2023-05-24T03:30:26.131959+0000","last_clean":"2023-05-24T03:30:26.131959+0000","last_became_active":"2023-05-24T03:29:44.088267+0000","last_became_peered":"2023-05-24T03:29:44.088267+0000","last_unstale":"2023-05-24T03:30:26.131959+0000","last_undegraded":"2023-05-24T03:30:26.131959+0000","last_fullsized":"2023-05-24T03:30:26.131959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:46:54.993008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"30'27","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.744104+0000","last_change":"2023-05-24T03:29:44.489309+0000","last_active":"2023-05-24T03:32:00.744104+0000","last_peered":"2023-05-24T03:32:00.744104+0000","last_clean":"2023-05-24T03:32:00.744104+0000","last_became_active":"2023-05-24T03:29:44.488666+0000","last_became_peered":"2023-05-24T03:29:44.488666+0000","last_unstale":"2023-05-24T03:32:00.744104+0000","last_undegraded":"2023-05-24T03:32:00.744104+0000","last_fullsized":"2023-05-24T03:32:00.744104+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:29:00.326985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"30'453","reported_seq":470,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:01.644784+0000","last_change":"2023-05-24T03:29:48.518108+0000","last_active":"2023-05-24T03:32:01.644784+0000","last_peered":"2023-05-24T03:32:01.644784+0000","last_clean":"2023-05-24T03:32:01.644784+0000","last_became_active":"2023-05-24T03:29:48.517771+0000","last_became_peered":"2023-05-24T03:29:48.517771+0000","last_unstale":"2023-05-24T03:32:01.644784+0000","last_undegraded":"2023-05-24T03:32:01.644784+0000","last_fullsized":"2023-05-24T03:32:01.644784+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:53:39.929296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.948014+0000","last_change":"2023-05-24T03:29:44.087910+0000","last_active":"2023-05-24T03:30:25.948014+0000","last_peered":"2023-05-24T03:30:25.948014+0000","last_clean":"2023-05-24T03:30:25.948014+0000","last_became_active":"2023-05-24T03:29:44.087601+0000","last_became_peered":"2023-05-24T03:29:44.087601+0000","last_unstale":"2023-05-24T03:30:25.948014+0000","last_undegraded":"2023-05-24T03:30:25.948014+0000","last_fullsized":"2023-05-24T03:30:25.948014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:47:02.508699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"30'36","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.751117+0000","last_change":"2023-05-24T03:29:44.496020+0000","last_active":"2023-05-24T03:32:00.751117+0000","last_peered":"2023-05-24T03:32:00.751117+0000","last_clean":"2023-05-24T03:32:00.751117+0000","last_became_active":"2023-05-24T03:29:44.495752+0000","last_became_peered":"2023-05-24T03:29:44.495752+0000","last_unstale":"2023-05-24T03:32:00.751117+0000","last_undegraded":"2023-05-24T03:32:00.751117+0000","last_fullsized":"2023-05-24T03:32:00.751117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:28:24.448757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"30'480","reported_seq":497,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:59.654797+0000","last_change":"2023-05-24T03:29:48.529893+0000","last_active":"2023-05-24T03:31:59.654797+0000","last_peered":"2023-05-24T03:31:59.654797+0000","last_clean":"2023-05-24T03:31:59.654797+0000","last_became_active":"2023-05-24T03:29:48.529514+0000","last_became_peered":"2023-05-24T03:29:48.529514+0000","last_unstale":"2023-05-24T03:31:59.654797+0000","last_undegraded":"2023-05-24T03:31:59.654797+0000","last_fullsized":"2023-05-24T03:31:59.654797+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:17:12.538446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"30'12","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:59.666061+0000","last_change":"2023-05-24T03:29:44.091648+0000","last_active":"2023-05-24T03:31:59.666061+0000","last_peered":"2023-05-24T03:31:59.666061+0000","last_clean":"2023-05-24T03:31:59.666061+0000","last_became_active":"2023-05-24T03:29:44.091390+0000","last_became_peered":"2023-05-24T03:29:44.091390+0000","last_unstale":"2023-05-24T03:31:59.666061+0000","last_undegraded":"2023-05-24T03:31:59.666061+0000","last_fullsized":"2023-05-24T03:31:59.666061+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:28:23.442311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"30'42","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.750218+0000","last_change":"2023-05-24T03:29:44.481629+0000","last_active":"2023-05-24T03:32:00.750218+0000","last_peered":"2023-05-24T03:32:00.750218+0000","last_clean":"2023-05-24T03:32:00.750218+0000","last_became_active":"2023-05-24T03:29:44.481385+0000","last_became_peered":"2023-05-24T03:29:44.481385+0000","last_unstale":"2023-05-24T03:32:00.750218+0000","last_undegraded":"2023-05-24T03:32:00.750218+0000","last_fullsized":"2023-05-24T03:32:00.750218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:15:01.553262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"30'471","reported_seq":488,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:01.646597+0000","last_change":"2023-05-24T03:29:48.524712+0000","last_active":"2023-05-24T03:32:01.646597+0000","last_peered":"2023-05-24T03:32:01.646597+0000","last_clean":"2023-05-24T03:32:01.646597+0000","last_became_active":"2023-05-24T03:29:48.524312+0000","last_became_peered":"2023-05-24T03:29:48.524312+0000","last_unstale":"2023-05-24T03:32:01.646597+0000","last_undegraded":"2023-05-24T03:32:01.646597+0000","last_fullsized":"2023-05-24T03:32:01.646597+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:09:53.803718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"30'359","reported_seq":384,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.710320+0000","last_change":"2023-05-24T03:29:44.079067+0000","last_active":"2023-05-24T03:32:00.710320+0000","last_peered":"2023-05-24T03:32:00.710320+0000","last_clean":"2023-05-24T03:32:00.710320+0000","last_became_active":"2023-05-24T03:29:44.078785+0000","last_became_peered":"2023-05-24T03:29:44.078785+0000","last_unstale":"2023-05-24T03:32:00.710320+0000","last_undegraded":"2023-05-24T03:32:00.710320+0000","last_fullsized":"2023-05-24T03:32:00.710320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:07:01.888999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1445980,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":1655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"30'41","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.747619+0000","last_change":"2023-05-24T03:29:44.497603+0000","last_active":"2023-05-24T03:32:00.747619+0000","last_peered":"2023-05-24T03:32:00.747619+0000","last_clean":"2023-05-24T03:32:00.747619+0000","last_became_active":"2023-05-24T03:29:44.497120+0000","last_became_peered":"2023-05-24T03:29:44.497120+0000","last_unstale":"2023-05-24T03:32:00.747619+0000","last_undegraded":"2023-05-24T03:32:00.747619+0000","last_fullsized":"2023-05-24T03:32:00.747619+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:29:14.482310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"30'438","reported_seq":455,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:01.652073+0000","last_change":"2023-05-24T03:29:48.531846+0000","last_active":"2023-05-24T03:32:01.652073+0000","last_peered":"2023-05-24T03:32:01.652073+0000","last_clean":"2023-05-24T03:32:01.652073+0000","last_became_active":"2023-05-24T03:29:48.531538+0000","last_became_peered":"2023-05-24T03:29:48.531538+0000","last_unstale":"2023-05-24T03:32:01.652073+0000","last_undegraded":"2023-05-24T03:32:01.652073+0000","last_fullsized":"2023-05-24T03:32:01.652073+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:26:45.584372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"30'3","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.949502+0000","last_change":"2023-05-24T03:29:44.087315+0000","last_active":"2023-05-24T03:30:25.949502+0000","last_peered":"2023-05-24T03:30:25.949502+0000","last_clean":"2023-05-24T03:30:25.949502+0000","last_became_active":"2023-05-24T03:29:44.086997+0000","last_became_peered":"2023-05-24T03:29:44.086997+0000","last_unstale":"2023-05-24T03:30:25.949502+0000","last_undegraded":"2023-05-24T03:30:25.949502+0000","last_fullsized":"2023-05-24T03:30:25.949502+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:28:59.320540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"30'29","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.749936+0000","last_change":"2023-05-24T03:29:44.487497+0000","last_active":"2023-05-24T03:32:00.749936+0000","last_peered":"2023-05-24T03:32:00.749936+0000","last_clean":"2023-05-24T03:32:00.749936+0000","last_became_active":"2023-05-24T03:29:44.487257+0000","last_became_peered":"2023-05-24T03:29:44.487257+0000","last_unstale":"2023-05-24T03:32:00.749936+0000","last_undegraded":"2023-05-24T03:32:00.749936+0000","last_fullsized":"2023-05-24T03:32:00.749936+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:34:40.725013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"30'470","reported_seq":487,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:01.652260+0000","last_change":"2023-05-24T03:29:48.526115+0000","last_active":"2023-05-24T03:32:01.652260+0000","last_peered":"2023-05-24T03:32:01.652260+0000","last_clean":"2023-05-24T03:32:01.652260+0000","last_became_active":"2023-05-24T03:29:48.525726+0000","last_became_peered":"2023-05-24T03:29:48.525726+0000","last_unstale":"2023-05-24T03:32:01.652260+0000","last_undegraded":"2023-05-24T03:32:01.652260+0000","last_fullsized":"2023-05-24T03:32:01.652260+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:15:16.805837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:26.131470+0000","last_change":"2023-05-24T03:29:44.084599+0000","last_active":"2023-05-24T03:30:26.131470+0000","last_peered":"2023-05-24T03:30:26.131470+0000","last_clean":"2023-05-24T03:30:26.131470+0000","last_became_active":"2023-05-24T03:29:44.084278+0000","last_became_peered":"2023-05-24T03:29:44.084278+0000","last_unstale":"2023-05-24T03:30:26.131470+0000","last_undegraded":"2023-05-24T03:30:26.131470+0000","last_fullsized":"2023-05-24T03:30:26.131470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:00:19.972006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"30'33","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.743241+0000","last_change":"2023-05-24T03:29:44.498378+0000","last_active":"2023-05-24T03:32:00.743241+0000","last_peered":"2023-05-24T03:32:00.743241+0000","last_clean":"2023-05-24T03:32:00.743241+0000","last_became_active":"2023-05-24T03:29:44.498097+0000","last_became_peered":"2023-05-24T03:29:44.498097+0000","last_unstale":"2023-05-24T03:32:00.743241+0000","last_undegraded":"2023-05-24T03:32:00.743241+0000","last_fullsized":"2023-05-24T03:32:00.743241+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:28:43.398723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"30'446","reported_seq":463,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:54.907546+0000","last_change":"2023-05-24T03:29:48.525018+0000","last_active":"2023-05-24T03:31:54.907546+0000","last_peered":"2023-05-24T03:31:54.907546+0000","last_clean":"2023-05-24T03:31:54.907546+0000","last_became_active":"2023-05-24T03:29:48.524602+0000","last_became_peered":"2023-05-24T03:29:48.524602+0000","last_unstale":"2023-05-24T03:31:54.907546+0000","last_undegraded":"2023-05-24T03:31:54.907546+0000","last_fullsized":"2023-05-24T03:31:54.907546+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:32:16.657149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"30'1","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.948925+0000","last_change":"2023-05-24T03:29:44.085212+0000","last_active":"2023-05-24T03:30:25.948925+0000","last_peered":"2023-05-24T03:30:25.948925+0000","last_clean":"2023-05-24T03:30:25.948925+0000","last_became_active":"2023-05-24T03:29:44.085001+0000","last_became_peered":"2023-05-24T03:29:44.085001+0000","last_unstale":"2023-05-24T03:30:25.948925+0000","last_undegraded":"2023-05-24T03:30:25.948925+0000","last_fullsized":"2023-05-24T03:30:25.948925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:57:48.715216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"30'40","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.751799+0000","last_change":"2023-05-24T03:29:44.500883+0000","last_active":"2023-05-24T03:32:00.751799+0000","last_peered":"2023-05-24T03:32:00.751799+0000","last_clean":"2023-05-24T03:32:00.751799+0000","last_became_active":"2023-05-24T03:29:44.500631+0000","last_became_peered":"2023-05-24T03:29:44.500631+0000","last_unstale":"2023-05-24T03:32:00.751799+0000","last_undegraded":"2023-05-24T03:32:00.751799+0000","last_fullsized":"2023-05-24T03:32:00.751799+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:03:29.813763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"30'491","reported_seq":508,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:01.657523+0000","last_change":"2023-05-24T03:29:48.523523+0000","last_active":"2023-05-24T03:32:01.657523+0000","last_peered":"2023-05-24T03:32:01.657523+0000","last_clean":"2023-05-24T03:32:01.657523+0000","last_became_active":"2023-05-24T03:29:48.523138+0000","last_became_peered":"2023-05-24T03:29:48.523138+0000","last_unstale":"2023-05-24T03:32:01.657523+0000","last_undegraded":"2023-05-24T03:32:01.657523+0000","last_fullsized":"2023-05-24T03:32:01.657523+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:06:22.646046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:26.804069+0000","last_change":"2023-05-24T03:29:44.085229+0000","last_active":"2023-05-24T03:30:26.804069+0000","last_peered":"2023-05-24T03:30:26.804069+0000","last_clean":"2023-05-24T03:30:26.804069+0000","last_became_active":"2023-05-24T03:29:44.084914+0000","last_became_peered":"2023-05-24T03:29:44.084914+0000","last_unstale":"2023-05-24T03:30:26.804069+0000","last_undegraded":"2023-05-24T03:30:26.804069+0000","last_fullsized":"2023-05-24T03:30:26.804069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:26:25.494471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"30'32","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.740689+0000","last_change":"2023-05-24T03:29:44.496038+0000","last_active":"2023-05-24T03:32:00.740689+0000","last_peered":"2023-05-24T03:32:00.740689+0000","last_clean":"2023-05-24T03:32:00.740689+0000","last_became_active":"2023-05-24T03:29:44.495795+0000","last_became_peered":"2023-05-24T03:29:44.495795+0000","last_unstale":"2023-05-24T03:32:00.740689+0000","last_undegraded":"2023-05-24T03:32:00.740689+0000","last_fullsized":"2023-05-24T03:32:00.740689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:01:21.417593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"30'445","reported_seq":463,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:01.654969+0000","last_change":"2023-05-24T03:29:48.518930+0000","last_active":"2023-05-24T03:32:01.654969+0000","last_peered":"2023-05-24T03:32:01.654969+0000","last_clean":"2023-05-24T03:32:01.654969+0000","last_became_active":"2023-05-24T03:29:48.518531+0000","last_became_peered":"2023-05-24T03:29:48.518531+0000","last_unstale":"2023-05-24T03:32:01.654969+0000","last_undegraded":"2023-05-24T03:32:01.654969+0000","last_fullsized":"2023-05-24T03:32:01.654969+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:37:48.684803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.949811+0000","last_change":"2023-05-24T03:29:44.089650+0000","last_active":"2023-05-24T03:30:25.949811+0000","last_peered":"2023-05-24T03:30:25.949811+0000","last_clean":"2023-05-24T03:30:25.949811+0000","last_became_active":"2023-05-24T03:29:44.089340+0000","last_became_peered":"2023-05-24T03:29:44.089340+0000","last_unstale":"2023-05-24T03:30:25.949811+0000","last_undegraded":"2023-05-24T03:30:25.949811+0000","last_fullsized":"2023-05-24T03:30:25.949811+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:46:54.993008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"30'29","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.745873+0000","last_change":"2023-05-24T03:29:44.498089+0000","last_active":"2023-05-24T03:32:00.745873+0000","last_peered":"2023-05-24T03:32:00.745873+0000","last_clean":"2023-05-24T03:32:00.745873+0000","last_became_active":"2023-05-24T03:29:44.497795+0000","last_became_peered":"2023-05-24T03:29:44.497795+0000","last_unstale":"2023-05-24T03:32:00.745873+0000","last_undegraded":"2023-05-24T03:32:00.745873+0000","last_fullsized":"2023-05-24T03:32:00.745873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:11:59.800632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"30'418","reported_seq":436,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:59.661483+0000","last_change":"2023-05-24T03:29:48.521349+0000","last_active":"2023-05-24T03:31:59.661483+0000","last_peered":"2023-05-24T03:31:59.661483+0000","last_clean":"2023-05-24T03:31:59.661483+0000","last_became_active":"2023-05-24T03:29:48.520899+0000","last_became_peered":"2023-05-24T03:29:48.520899+0000","last_unstale":"2023-05-24T03:31:59.661483+0000","last_undegraded":"2023-05-24T03:31:59.661483+0000","last_fullsized":"2023-05-24T03:31:59.661483+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:59:08.584090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.949247+0000","last_change":"2023-05-24T03:29:44.086355+0000","last_active":"2023-05-24T03:30:25.949247+0000","last_peered":"2023-05-24T03:30:25.949247+0000","last_clean":"2023-05-24T03:30:25.949247+0000","last_became_active":"2023-05-24T03:29:44.086054+0000","last_became_peered":"2023-05-24T03:29:44.086054+0000","last_unstale":"2023-05-24T03:30:25.949247+0000","last_undegraded":"2023-05-24T03:30:25.949247+0000","last_fullsized":"2023-05-24T03:30:25.949247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:56:15.394098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"30'32","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.739622+0000","last_change":"2023-05-24T03:30:25.949869+0000","last_active":"2023-05-24T03:32:00.739622+0000","last_peered":"2023-05-24T03:32:00.739622+0000","last_clean":"2023-05-24T03:32:00.739622+0000","last_became_active":"2023-05-24T03:30:25.949461+0000","last_became_peered":"2023-05-24T03:30:25.949461+0000","last_unstale":"2023-05-24T03:32:00.739622+0000","last_undegraded":"2023-05-24T03:32:00.739622+0000","last_fullsized":"2023-05-24T03:32:00.739622+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:59:01.497346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"30'464","reported_seq":481,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:01.660142+0000","last_change":"2023-05-24T03:29:48.522128+0000","last_active":"2023-05-24T03:32:01.660142+0000","last_peered":"2023-05-24T03:32:01.660142+0000","last_clean":"2023-05-24T03:32:01.660142+0000","last_became_active":"2023-05-24T03:29:48.521729+0000","last_became_peered":"2023-05-24T03:29:48.521729+0000","last_unstale":"2023-05-24T03:32:01.660142+0000","last_undegraded":"2023-05-24T03:32:01.660142+0000","last_fullsized":"2023-05-24T03:32:01.660142+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:43:08.142518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.949563+0000","last_change":"2023-05-24T03:29:44.088761+0000","last_active":"2023-05-24T03:30:25.949563+0000","last_peered":"2023-05-24T03:30:25.949563+0000","last_clean":"2023-05-24T03:30:25.949563+0000","last_became_active":"2023-05-24T03:29:44.088459+0000","last_became_peered":"2023-05-24T03:29:44.088459+0000","last_unstale":"2023-05-24T03:30:25.949563+0000","last_undegraded":"2023-05-24T03:30:25.949563+0000","last_fullsized":"2023-05-24T03:30:25.949563+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:28:42.392277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"30'32","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.746489+0000","last_change":"2023-05-24T03:29:44.490252+0000","last_active":"2023-05-24T03:32:00.746489+0000","last_peered":"2023-05-24T03:32:00.746489+0000","last_clean":"2023-05-24T03:32:00.746489+0000","last_became_active":"2023-05-24T03:29:44.489975+0000","last_became_peered":"2023-05-24T03:29:44.489975+0000","last_unstale":"2023-05-24T03:32:00.746489+0000","last_undegraded":"2023-05-24T03:32:00.746489+0000","last_fullsized":"2023-05-24T03:32:00.746489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:27:13.487917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"30'485","reported_seq":503,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:01.664542+0000","last_change":"2023-05-24T03:29:48.523911+0000","last_active":"2023-05-24T03:32:01.664542+0000","last_peered":"2023-05-24T03:32:01.664542+0000","last_clean":"2023-05-24T03:32:01.664542+0000","last_became_active":"2023-05-24T03:29:48.523545+0000","last_became_peered":"2023-05-24T03:29:48.523545+0000","last_unstale":"2023-05-24T03:32:01.664542+0000","last_undegraded":"2023-05-24T03:32:01.664542+0000","last_fullsized":"2023-05-24T03:32:01.664542+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:10:18.150623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"30'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:52.028721+0000","last_change":"2023-05-24T03:29:44.091185+0000","last_active":"2023-05-24T03:31:52.028721+0000","last_peered":"2023-05-24T03:31:52.028721+0000","last_clean":"2023-05-24T03:31:52.028721+0000","last_became_active":"2023-05-24T03:29:44.090887+0000","last_became_peered":"2023-05-24T03:29:44.090887+0000","last_unstale":"2023-05-24T03:31:52.028721+0000","last_undegraded":"2023-05-24T03:31:52.028721+0000","last_fullsized":"2023-05-24T03:31:52.028721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:28:59.320540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"30'32","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.748407+0000","last_change":"2023-05-24T03:29:44.502570+0000","last_active":"2023-05-24T03:32:00.748407+0000","last_peered":"2023-05-24T03:32:00.748407+0000","last_clean":"2023-05-24T03:32:00.748407+0000","last_became_active":"2023-05-24T03:29:44.502286+0000","last_became_peered":"2023-05-24T03:29:44.502286+0000","last_unstale":"2023-05-24T03:32:00.748407+0000","last_undegraded":"2023-05-24T03:32:00.748407+0000","last_fullsized":"2023-05-24T03:32:00.748407+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:56:16.400543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"30'465","reported_seq":482,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:01.654263+0000","last_change":"2023-05-24T03:29:48.521750+0000","last_active":"2023-05-24T03:32:01.654263+0000","last_peered":"2023-05-24T03:32:01.654263+0000","last_clean":"2023-05-24T03:32:01.654263+0000","last_became_active":"2023-05-24T03:29:48.520960+0000","last_became_peered":"2023-05-24T03:29:48.520960+0000","last_unstale":"2023-05-24T03:32:01.654263+0000","last_undegraded":"2023-05-24T03:32:01.654263+0000","last_fullsized":"2023-05-24T03:32:01.654263+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:18:50.657657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"30'4","reported_seq":30,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:48.624303+0000","last_change":"2023-05-24T03:29:44.088157+0000","last_active":"2023-05-24T03:31:48.624303+0000","last_peered":"2023-05-24T03:31:48.624303+0000","last_clean":"2023-05-24T03:31:48.624303+0000","last_became_active":"2023-05-24T03:29:44.087869+0000","last_became_peered":"2023-05-24T03:29:44.087869+0000","last_unstale":"2023-05-24T03:31:48.624303+0000","last_undegraded":"2023-05-24T03:31:48.624303+0000","last_fullsized":"2023-05-24T03:31:48.624303+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:30:53.298174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"30'27","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.751783+0000","last_change":"2023-05-24T03:29:44.501176+0000","last_active":"2023-05-24T03:32:00.751783+0000","last_peered":"2023-05-24T03:32:00.751783+0000","last_clean":"2023-05-24T03:32:00.751783+0000","last_became_active":"2023-05-24T03:29:44.499700+0000","last_became_peered":"2023-05-24T03:29:44.499700+0000","last_unstale":"2023-05-24T03:32:00.751783+0000","last_undegraded":"2023-05-24T03:32:00.751783+0000","last_fullsized":"2023-05-24T03:32:00.751783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:08:22.507011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"30'454","reported_seq":471,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:59.648768+0000","last_change":"2023-05-24T03:29:48.522778+0000","last_active":"2023-05-24T03:31:59.648768+0000","last_peered":"2023-05-24T03:31:59.648768+0000","last_clean":"2023-05-24T03:31:59.648768+0000","last_became_active":"2023-05-24T03:29:48.522104+0000","last_became_peered":"2023-05-24T03:29:48.522104+0000","last_unstale":"2023-05-24T03:31:59.648768+0000","last_undegraded":"2023-05-24T03:31:59.648768+0000","last_fullsized":"2023-05-24T03:31:59.648768+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:25:58.928535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"30'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:52.027142+0000","last_change":"2023-05-24T03:29:44.085211+0000","last_active":"2023-05-24T03:31:52.027142+0000","last_peered":"2023-05-24T03:31:52.027142+0000","last_clean":"2023-05-24T03:31:52.027142+0000","last_became_active":"2023-05-24T03:29:44.084894+0000","last_became_peered":"2023-05-24T03:29:44.084894+0000","last_unstale":"2023-05-24T03:31:52.027142+0000","last_undegraded":"2023-05-24T03:31:52.027142+0000","last_fullsized":"2023-05-24T03:31:52.027142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T03:40:04.765492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"30'30","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.746330+0000","last_change":"2023-05-24T03:29:44.492807+0000","last_active":"2023-05-24T03:32:00.746330+0000","last_peered":"2023-05-24T03:32:00.746330+0000","last_clean":"2023-05-24T03:32:00.746330+0000","last_became_active":"2023-05-24T03:29:44.492462+0000","last_became_peered":"2023-05-24T03:29:44.492462+0000","last_unstale":"2023-05-24T03:32:00.746330+0000","last_undegraded":"2023-05-24T03:32:00.746330+0000","last_fullsized":"2023-05-24T03:32:00.746330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T03:34:42.017206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'486","reported_seq":503,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.707353+0000","last_change":"2023-05-24T03:29:48.524960+0000","last_active":"2023-05-24T03:32:00.707353+0000","last_peered":"2023-05-24T03:32:00.707353+0000","last_clean":"2023-05-24T03:32:00.707353+0000","last_became_active":"2023-05-24T03:29:48.524023+0000","last_became_peered":"2023-05-24T03:29:48.524023+0000","last_unstale":"2023-05-24T03:32:00.707353+0000","last_undegraded":"2023-05-24T03:32:00.707353+0000","last_fullsized":"2023-05-24T03:32:00.707353+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:17:12.538446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.945352+0000","last_change":"2023-05-24T03:29:44.082700+0000","last_active":"2023-05-24T03:30:25.945352+0000","last_peered":"2023-05-24T03:30:25.945352+0000","last_clean":"2023-05-24T03:30:25.945352+0000","last_became_active":"2023-05-24T03:29:44.082382+0000","last_became_peered":"2023-05-24T03:29:44.082382+0000","last_unstale":"2023-05-24T03:30:25.945352+0000","last_undegraded":"2023-05-24T03:30:25.945352+0000","last_fullsized":"2023-05-24T03:30:25.945352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:32:47.076800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"30'17","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.747804+0000","last_change":"2023-05-24T03:29:44.501409+0000","last_active":"2023-05-24T03:32:00.747804+0000","last_peered":"2023-05-24T03:32:00.747804+0000","last_clean":"2023-05-24T03:32:00.747804+0000","last_became_active":"2023-05-24T03:29:44.501080+0000","last_became_peered":"2023-05-24T03:29:44.501080+0000","last_unstale":"2023-05-24T03:32:00.747804+0000","last_undegraded":"2023-05-24T03:32:00.747804+0000","last_fullsized":"2023-05-24T03:32:00.747804+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:32:22.255614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"30'494","reported_seq":511,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:01.658461+0000","last_change":"2023-05-24T03:29:48.519383+0000","last_active":"2023-05-24T03:32:01.658461+0000","last_peered":"2023-05-24T03:32:01.658461+0000","last_clean":"2023-05-24T03:32:01.658461+0000","last_became_active":"2023-05-24T03:29:48.519046+0000","last_became_peered":"2023-05-24T03:29:48.519046+0000","last_unstale":"2023-05-24T03:32:01.658461+0000","last_undegraded":"2023-05-24T03:32:01.658461+0000","last_fullsized":"2023-05-24T03:32:01.658461+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:02:44.132422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:26.804947+0000","last_change":"2023-05-24T03:29:44.085771+0000","last_active":"2023-05-24T03:30:26.804947+0000","last_peered":"2023-05-24T03:30:26.804947+0000","last_clean":"2023-05-24T03:30:26.804947+0000","last_became_active":"2023-05-24T03:29:44.085420+0000","last_became_peered":"2023-05-24T03:29:44.085420+0000","last_unstale":"2023-05-24T03:30:26.804947+0000","last_undegraded":"2023-05-24T03:30:26.804947+0000","last_fullsized":"2023-05-24T03:30:26.804947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:26:41.155647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"30'28","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.749974+0000","last_change":"2023-05-24T03:29:44.491345+0000","last_active":"2023-05-24T03:32:00.749974+0000","last_peered":"2023-05-24T03:32:00.749974+0000","last_clean":"2023-05-24T03:32:00.749974+0000","last_became_active":"2023-05-24T03:29:44.491089+0000","last_became_peered":"2023-05-24T03:29:44.491089+0000","last_unstale":"2023-05-24T03:32:00.749974+0000","last_undegraded":"2023-05-24T03:32:00.749974+0000","last_fullsized":"2023-05-24T03:32:00.749974+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:11:59.800632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"30'503","reported_seq":521,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:01.636721+0000","last_change":"2023-05-24T03:29:48.530105+0000","last_active":"2023-05-24T03:32:01.636721+0000","last_peered":"2023-05-24T03:32:01.636721+0000","last_clean":"2023-05-24T03:32:01.636721+0000","last_became_active":"2023-05-24T03:29:48.529157+0000","last_became_peered":"2023-05-24T03:29:48.529157+0000","last_unstale":"2023-05-24T03:32:01.636721+0000","last_undegraded":"2023-05-24T03:32:01.636721+0000","last_fullsized":"2023-05-24T03:32:01.636721+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:57:53.143941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.946193+0000","last_change":"2023-05-24T03:29:39.143199+0000","last_active":"2023-05-24T03:30:25.946193+0000","last_peered":"2023-05-24T03:30:25.946193+0000","last_clean":"2023-05-24T03:30:25.946193+0000","last_became_active":"2023-05-24T03:29:39.142867+0000","last_became_peered":"2023-05-24T03:29:39.142867+0000","last_unstale":"2023-05-24T03:30:25.946193+0000","last_undegraded":"2023-05-24T03:30:25.946193+0000","last_fullsized":"2023-05-24T03:30:25.946193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:53:30.482418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"30'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:51.927110+0000","last_change":"2023-05-24T03:29:44.087790+0000","last_active":"2023-05-24T03:31:51.927110+0000","last_peered":"2023-05-24T03:31:51.927110+0000","last_clean":"2023-05-24T03:31:51.927110+0000","last_became_active":"2023-05-24T03:29:44.087475+0000","last_became_peered":"2023-05-24T03:29:44.087475+0000","last_unstale":"2023-05-24T03:31:51.927110+0000","last_undegraded":"2023-05-24T03:31:51.927110+0000","last_fullsized":"2023-05-24T03:31:51.927110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:56:15.394098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"30'30","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.749590+0000","last_change":"2023-05-24T03:29:44.497235+0000","last_active":"2023-05-24T03:32:00.749590+0000","last_peered":"2023-05-24T03:32:00.749590+0000","last_clean":"2023-05-24T03:32:00.749590+0000","last_became_active":"2023-05-24T03:29:44.497015+0000","last_became_peered":"2023-05-24T03:29:44.497015+0000","last_unstale":"2023-05-24T03:32:00.749590+0000","last_undegraded":"2023-05-24T03:32:00.749590+0000","last_fullsized":"2023-05-24T03:32:00.749590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:34:36.957340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"30'446","reported_seq":464,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:01.635600+0000","last_change":"2023-05-24T03:29:48.527805+0000","last_active":"2023-05-24T03:32:01.635600+0000","last_peered":"2023-05-24T03:32:01.635600+0000","last_clean":"2023-05-24T03:32:01.635600+0000","last_became_active":"2023-05-24T03:29:48.527010+0000","last_became_peered":"2023-05-24T03:29:48.527010+0000","last_unstale":"2023-05-24T03:32:01.635600+0000","last_undegraded":"2023-05-24T03:32:01.635600+0000","last_fullsized":"2023-05-24T03:32:01.635600+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:24:51.361665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.947589+0000","last_change":"2023-05-24T03:29:39.048516+0000","last_active":"2023-05-24T03:30:25.947589+0000","last_peered":"2023-05-24T03:30:25.947589+0000","last_clean":"2023-05-24T03:30:25.947589+0000","last_became_active":"2023-05-24T03:29:39.048141+0000","last_became_peered":"2023-05-24T03:29:39.048141+0000","last_unstale":"2023-05-24T03:30:25.947589+0000","last_undegraded":"2023-05-24T03:30:25.947589+0000","last_fullsized":"2023-05-24T03:30:25.947589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:37:39.237924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.945952+0000","last_change":"2023-05-24T03:29:44.085282+0000","last_active":"2023-05-24T03:30:25.945952+0000","last_peered":"2023-05-24T03:30:25.945952+0000","last_clean":"2023-05-24T03:30:25.945952+0000","last_became_active":"2023-05-24T03:29:44.084944+0000","last_became_peered":"2023-05-24T03:29:44.084944+0000","last_unstale":"2023-05-24T03:30:25.945952+0000","last_undegraded":"2023-05-24T03:30:25.945952+0000","last_fullsized":"2023-05-24T03:30:25.945952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:06:01.227379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"30'30","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.748904+0000","last_change":"2023-05-24T03:29:44.483553+0000","last_active":"2023-05-24T03:32:00.748904+0000","last_peered":"2023-05-24T03:32:00.748904+0000","last_clean":"2023-05-24T03:32:00.748904+0000","last_became_active":"2023-05-24T03:29:44.483134+0000","last_became_peered":"2023-05-24T03:29:44.483134+0000","last_unstale":"2023-05-24T03:32:00.748904+0000","last_undegraded":"2023-05-24T03:32:00.748904+0000","last_fullsized":"2023-05-24T03:32:00.748904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:00:20.978451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'483","reported_seq":501,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:01.666585+0000","last_change":"2023-05-24T03:29:48.519249+0000","last_active":"2023-05-24T03:32:01.666585+0000","last_peered":"2023-05-24T03:32:01.666585+0000","last_clean":"2023-05-24T03:32:01.666585+0000","last_became_active":"2023-05-24T03:29:48.518546+0000","last_became_peered":"2023-05-24T03:29:48.518546+0000","last_unstale":"2023-05-24T03:32:01.666585+0000","last_undegraded":"2023-05-24T03:32:01.666585+0000","last_fullsized":"2023-05-24T03:32:01.666585+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:26:29.923197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:26.105101+0000","last_change":"2023-05-24T03:29:39.310351+0000","last_active":"2023-05-24T03:30:26.105101+0000","last_peered":"2023-05-24T03:30:26.105101+0000","last_clean":"2023-05-24T03:30:26.105101+0000","last_became_active":"2023-05-24T03:29:39.310070+0000","last_became_peered":"2023-05-24T03:29:39.310070+0000","last_unstale":"2023-05-24T03:30:26.105101+0000","last_undegraded":"2023-05-24T03:30:26.105101+0000","last_fullsized":"2023-05-24T03:30:26.105101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:21:55.168531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.945636+0000","last_change":"2023-05-24T03:29:44.075504+0000","last_active":"2023-05-24T03:30:25.945636+0000","last_peered":"2023-05-24T03:30:25.945636+0000","last_clean":"2023-05-24T03:30:25.945636+0000","last_became_active":"2023-05-24T03:29:44.074551+0000","last_became_peered":"2023-05-24T03:29:44.074551+0000","last_unstale":"2023-05-24T03:30:25.945636+0000","last_undegraded":"2023-05-24T03:30:25.945636+0000","last_fullsized":"2023-05-24T03:30:25.945636+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:12:11.445050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"30'29","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.745926+0000","last_change":"2023-05-24T03:29:44.496225+0000","last_active":"2023-05-24T03:32:00.745926+0000","last_peered":"2023-05-24T03:32:00.745926+0000","last_clean":"2023-05-24T03:32:00.745926+0000","last_became_active":"2023-05-24T03:29:44.496030+0000","last_became_peered":"2023-05-24T03:29:44.496030+0000","last_unstale":"2023-05-24T03:32:00.745926+0000","last_undegraded":"2023-05-24T03:32:00.745926+0000","last_fullsized":"2023-05-24T03:32:00.745926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:53:00.715123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"30'473","reported_seq":491,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:59.052224+0000","last_change":"2023-05-24T03:29:48.523816+0000","last_active":"2023-05-24T03:31:59.052224+0000","last_peered":"2023-05-24T03:31:59.052224+0000","last_clean":"2023-05-24T03:31:59.052224+0000","last_became_active":"2023-05-24T03:29:48.523380+0000","last_became_peered":"2023-05-24T03:29:48.523380+0000","last_unstale":"2023-05-24T03:31:59.052224+0000","last_undegraded":"2023-05-24T03:31:59.052224+0000","last_fullsized":"2023-05-24T03:31:59.052224+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:24:51.361665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.948180+0000","last_change":"2023-05-24T03:29:39.051113+0000","last_active":"2023-05-24T03:30:25.948180+0000","last_peered":"2023-05-24T03:30:25.948180+0000","last_clean":"2023-05-24T03:30:25.948180+0000","last_became_active":"2023-05-24T03:29:39.050751+0000","last_became_peered":"2023-05-24T03:29:39.050751+0000","last_unstale":"2023-05-24T03:30:25.948180+0000","last_undegraded":"2023-05-24T03:30:25.948180+0000","last_fullsized":"2023-05-24T03:30:25.948180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:30:48.280021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":188,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.948889+0000","last_change":"2023-05-24T03:29:34.025679+0000","last_active":"2023-05-24T03:30:25.948889+0000","last_peered":"2023-05-24T03:30:25.948889+0000","last_clean":"2023-05-24T03:30:25.948889+0000","last_became_active":"2023-05-24T03:29:34.024728+0000","last_became_peered":"2023-05-24T03:29:34.024728+0000","last_unstale":"2023-05-24T03:30:25.948889+0000","last_undegraded":"2023-05-24T03:30:25.948889+0000","last_fullsized":"2023-05-24T03:30:25.948889+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:32.968348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:32.968348+0000","last_clean_scrub_stamp":"2023-05-24T03:29:32.968348+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:52:49.623148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:26.804884+0000","last_change":"2023-05-24T03:29:44.086373+0000","last_active":"2023-05-24T03:30:26.804884+0000","last_peered":"2023-05-24T03:30:26.804884+0000","last_clean":"2023-05-24T03:30:26.804884+0000","last_became_active":"2023-05-24T03:29:44.086125+0000","last_became_peered":"2023-05-24T03:29:44.086125+0000","last_unstale":"2023-05-24T03:30:26.804884+0000","last_undegraded":"2023-05-24T03:30:26.804884+0000","last_fullsized":"2023-05-24T03:30:26.804884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:03:28.807318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"30'32","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.740528+0000","last_change":"2023-05-24T03:29:44.492654+0000","last_active":"2023-05-24T03:32:00.740528+0000","last_peered":"2023-05-24T03:32:00.740528+0000","last_clean":"2023-05-24T03:32:00.740528+0000","last_became_active":"2023-05-24T03:29:44.492375+0000","last_became_peered":"2023-05-24T03:29:44.492375+0000","last_unstale":"2023-05-24T03:32:00.740528+0000","last_undegraded":"2023-05-24T03:32:00.740528+0000","last_fullsized":"2023-05-24T03:32:00.740528+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:14:30.274935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"30'444","reported_seq":462,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:01.646373+0000","last_change":"2023-05-24T03:29:48.525206+0000","last_active":"2023-05-24T03:32:01.646373+0000","last_peered":"2023-05-24T03:32:01.646373+0000","last_clean":"2023-05-24T03:32:01.646373+0000","last_became_active":"2023-05-24T03:29:48.524615+0000","last_became_peered":"2023-05-24T03:29:48.524615+0000","last_unstale":"2023-05-24T03:32:01.646373+0000","last_undegraded":"2023-05-24T03:32:01.646373+0000","last_fullsized":"2023-05-24T03:32:01.646373+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:15:16.805837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.949105+0000","last_change":"2023-05-24T03:29:39.054117+0000","last_active":"2023-05-24T03:30:25.949105+0000","last_peered":"2023-05-24T03:30:25.949105+0000","last_clean":"2023-05-24T03:30:25.949105+0000","last_became_active":"2023-05-24T03:29:39.053813+0000","last_became_peered":"2023-05-24T03:29:39.053813+0000","last_unstale":"2023-05-24T03:30:25.949105+0000","last_undegraded":"2023-05-24T03:30:25.949105+0000","last_fullsized":"2023-05-24T03:30:25.949105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:20:55.877097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"30'16","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:01.629246+0000","last_change":"2023-05-24T03:29:44.090147+0000","last_active":"2023-05-24T03:32:01.629246+0000","last_peered":"2023-05-24T03:32:01.629246+0000","last_clean":"2023-05-24T03:32:01.629246+0000","last_became_active":"2023-05-24T03:29:44.089943+0000","last_became_peered":"2023-05-24T03:29:44.089943+0000","last_unstale":"2023-05-24T03:32:01.629246+0000","last_undegraded":"2023-05-24T03:32:01.629246+0000","last_fullsized":"2023-05-24T03:32:01.629246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:52:59.708678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7752,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":19,"num_write":15,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"30'28","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.748212+0000","last_change":"2023-05-24T03:29:44.498467+0000","last_active":"2023-05-24T03:32:00.748212+0000","last_peered":"2023-05-24T03:32:00.748212+0000","last_clean":"2023-05-24T03:32:00.748212+0000","last_became_active":"2023-05-24T03:29:44.498130+0000","last_became_peered":"2023-05-24T03:29:44.498130+0000","last_unstale":"2023-05-24T03:32:00.748212+0000","last_undegraded":"2023-05-24T03:32:00.748212+0000","last_fullsized":"2023-05-24T03:32:00.748212+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:37:45.262523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"30'496","reported_seq":514,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:01.652128+0000","last_change":"2023-05-24T03:29:48.520034+0000","last_active":"2023-05-24T03:32:01.652128+0000","last_peered":"2023-05-24T03:32:01.652128+0000","last_clean":"2023-05-24T03:32:01.652128+0000","last_became_active":"2023-05-24T03:29:48.519673+0000","last_became_peered":"2023-05-24T03:29:48.519673+0000","last_unstale":"2023-05-24T03:32:01.652128+0000","last_undegraded":"2023-05-24T03:32:01.652128+0000","last_fullsized":"2023-05-24T03:32:01.652128+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:17:11.019561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.949461+0000","last_change":"2023-05-24T03:29:39.143215+0000","last_active":"2023-05-24T03:30:25.949461+0000","last_peered":"2023-05-24T03:30:25.949461+0000","last_clean":"2023-05-24T03:30:25.949461+0000","last_became_active":"2023-05-24T03:29:39.142949+0000","last_became_peered":"2023-05-24T03:29:39.142949+0000","last_unstale":"2023-05-24T03:30:25.949461+0000","last_undegraded":"2023-05-24T03:30:25.949461+0000","last_fullsized":"2023-05-24T03:30:25.949461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:06:13.199168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"30'2","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:51.960970+0000","last_change":"2023-05-24T03:29:44.074869+0000","last_active":"2023-05-24T03:31:51.960970+0000","last_peered":"2023-05-24T03:31:51.960970+0000","last_clean":"2023-05-24T03:31:51.960970+0000","last_became_active":"2023-05-24T03:29:44.074374+0000","last_became_peered":"2023-05-24T03:29:44.074374+0000","last_unstale":"2023-05-24T03:31:51.960970+0000","last_undegraded":"2023-05-24T03:31:51.960970+0000","last_fullsized":"2023-05-24T03:31:51.960970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:37:44.256077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"30'34","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.738473+0000","last_change":"2023-05-24T03:29:44.499979+0000","last_active":"2023-05-24T03:32:00.738473+0000","last_peered":"2023-05-24T03:32:00.738473+0000","last_clean":"2023-05-24T03:32:00.738473+0000","last_became_active":"2023-05-24T03:29:44.499768+0000","last_became_peered":"2023-05-24T03:29:44.499768+0000","last_unstale":"2023-05-24T03:32:00.738473+0000","last_undegraded":"2023-05-24T03:32:00.738473+0000","last_fullsized":"2023-05-24T03:32:00.738473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:11:59.800632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"30'483","reported_seq":501,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:59.649119+0000","last_change":"2023-05-24T03:29:48.530781+0000","last_active":"2023-05-24T03:31:59.649119+0000","last_peered":"2023-05-24T03:31:59.649119+0000","last_clean":"2023-05-24T03:31:59.649119+0000","last_became_active":"2023-05-24T03:29:48.530401+0000","last_became_peered":"2023-05-24T03:29:48.530401+0000","last_unstale":"2023-05-24T03:31:59.649119+0000","last_undegraded":"2023-05-24T03:31:59.649119+0000","last_fullsized":"2023-05-24T03:31:59.649119+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:28:34.171252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"30'3","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:52.027244+0000","last_change":"2023-05-24T03:29:44.084278+0000","last_active":"2023-05-24T03:31:52.027244+0000","last_peered":"2023-05-24T03:31:52.027244+0000","last_clean":"2023-05-24T03:31:52.027244+0000","last_became_active":"2023-05-24T03:29:44.083929+0000","last_became_peered":"2023-05-24T03:29:44.083929+0000","last_unstale":"2023-05-24T03:31:52.027244+0000","last_undegraded":"2023-05-24T03:31:52.027244+0000","last_fullsized":"2023-05-24T03:31:52.027244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:08:29.969550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.946231+0000","last_change":"2023-05-24T03:29:39.045821+0000","last_active":"2023-05-24T03:30:25.946231+0000","last_peered":"2023-05-24T03:30:25.946231+0000","last_clean":"2023-05-24T03:30:25.946231+0000","last_became_active":"2023-05-24T03:29:39.045543+0000","last_became_peered":"2023-05-24T03:29:39.045543+0000","last_unstale":"2023-05-24T03:30:25.946231+0000","last_undegraded":"2023-05-24T03:30:25.946231+0000","last_fullsized":"2023-05-24T03:30:25.946231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:57:43.697063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"30'25","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.750570+0000","last_change":"2023-05-24T03:29:44.496106+0000","last_active":"2023-05-24T03:32:00.750570+0000","last_peered":"2023-05-24T03:32:00.750570+0000","last_clean":"2023-05-24T03:32:00.750570+0000","last_became_active":"2023-05-24T03:29:44.495816+0000","last_became_peered":"2023-05-24T03:29:44.495816+0000","last_unstale":"2023-05-24T03:32:00.750570+0000","last_undegraded":"2023-05-24T03:32:00.750570+0000","last_fullsized":"2023-05-24T03:32:00.750570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:56:16.400543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"30'447","reported_seq":465,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:01.658722+0000","last_change":"2023-05-24T03:29:48.527602+0000","last_active":"2023-05-24T03:32:01.658722+0000","last_peered":"2023-05-24T03:32:01.658722+0000","last_clean":"2023-05-24T03:32:01.658722+0000","last_became_active":"2023-05-24T03:29:48.527196+0000","last_became_peered":"2023-05-24T03:29:48.527196+0000","last_unstale":"2023-05-24T03:32:01.658722+0000","last_undegraded":"2023-05-24T03:32:01.658722+0000","last_fullsized":"2023-05-24T03:32:01.658722+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:37:48.684803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:26.804512+0000","last_change":"2023-05-24T03:29:39.046445+0000","last_active":"2023-05-24T03:30:26.804512+0000","last_peered":"2023-05-24T03:30:26.804512+0000","last_clean":"2023-05-24T03:30:26.804512+0000","last_became_active":"2023-05-24T03:29:39.046149+0000","last_became_peered":"2023-05-24T03:29:39.046149+0000","last_unstale":"2023-05-24T03:30:26.804512+0000","last_undegraded":"2023-05-24T03:30:26.804512+0000","last_fullsized":"2023-05-24T03:30:26.804512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:38.035725+0000","last_clean_scrub_stamp":"2023-05-24T03:29:38.035725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:09:38.768895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"30'10","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:56.943822+0000","last_change":"2023-05-24T03:29:44.088780+0000","last_active":"2023-05-24T03:31:56.943822+0000","last_peered":"2023-05-24T03:31:56.943822+0000","last_clean":"2023-05-24T03:31:56.943822+0000","last_became_active":"2023-05-24T03:29:44.088495+0000","last_became_peered":"2023-05-24T03:29:44.088495+0000","last_unstale":"2023-05-24T03:31:56.943822+0000","last_undegraded":"2023-05-24T03:31:56.943822+0000","last_fullsized":"2023-05-24T03:31:56.943822+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:28:23.442311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"30'21","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.739387+0000","last_change":"2023-05-24T03:29:44.496966+0000","last_active":"2023-05-24T03:32:00.739387+0000","last_peered":"2023-05-24T03:32:00.739387+0000","last_clean":"2023-05-24T03:32:00.739387+0000","last_became_active":"2023-05-24T03:29:44.496597+0000","last_became_peered":"2023-05-24T03:29:44.496597+0000","last_unstale":"2023-05-24T03:32:00.739387+0000","last_undegraded":"2023-05-24T03:32:00.739387+0000","last_fullsized":"2023-05-24T03:32:00.739387+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:32:09.391394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"30'469","reported_seq":486,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:01.643944+0000","last_change":"2023-05-24T03:29:48.524541+0000","last_active":"2023-05-24T03:32:01.643944+0000","last_peered":"2023-05-24T03:32:01.643944+0000","last_clean":"2023-05-24T03:32:01.643944+0000","last_became_active":"2023-05-24T03:29:48.524170+0000","last_became_peered":"2023-05-24T03:29:48.524170+0000","last_unstale":"2023-05-24T03:32:01.643944+0000","last_undegraded":"2023-05-24T03:32:01.643944+0000","last_fullsized":"2023-05-24T03:32:01.643944+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:21:05.323975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:26.131668+0000","last_change":"2023-05-24T03:29:44.090259+0000","last_active":"2023-05-24T03:30:26.131668+0000","last_peered":"2023-05-24T03:30:26.131668+0000","last_clean":"2023-05-24T03:30:26.131668+0000","last_became_active":"2023-05-24T03:29:44.089993+0000","last_became_peered":"2023-05-24T03:29:44.089993+0000","last_unstale":"2023-05-24T03:30:26.131668+0000","last_undegraded":"2023-05-24T03:30:26.131668+0000","last_fullsized":"2023-05-24T03:30:26.131668+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:21:00.895250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"30'32","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.745042+0000","last_change":"2023-05-24T03:29:44.481933+0000","last_active":"2023-05-24T03:32:00.745042+0000","last_peered":"2023-05-24T03:32:00.745042+0000","last_clean":"2023-05-24T03:32:00.745042+0000","last_became_active":"2023-05-24T03:29:44.481655+0000","last_became_peered":"2023-05-24T03:29:44.481655+0000","last_unstale":"2023-05-24T03:32:00.745042+0000","last_undegraded":"2023-05-24T03:32:00.745042+0000","last_fullsized":"2023-05-24T03:32:00.745042+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:32:32.559676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"30'475","reported_seq":492,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:59.051510+0000","last_change":"2023-05-24T03:29:48.516800+0000","last_active":"2023-05-24T03:31:59.051510+0000","last_peered":"2023-05-24T03:31:59.051510+0000","last_clean":"2023-05-24T03:31:59.051510+0000","last_became_active":"2023-05-24T03:29:48.516366+0000","last_became_peered":"2023-05-24T03:29:48.516366+0000","last_unstale":"2023-05-24T03:31:59.051510+0000","last_undegraded":"2023-05-24T03:31:59.051510+0000","last_fullsized":"2023-05-24T03:31:59.051510+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:10:18.027326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.947901+0000","last_change":"2023-05-24T03:29:44.094179+0000","last_active":"2023-05-24T03:30:25.947901+0000","last_peered":"2023-05-24T03:30:25.947901+0000","last_clean":"2023-05-24T03:30:25.947901+0000","last_became_active":"2023-05-24T03:29:44.093909+0000","last_became_peered":"2023-05-24T03:29:44.093909+0000","last_unstale":"2023-05-24T03:30:25.947901+0000","last_undegraded":"2023-05-24T03:30:25.947901+0000","last_fullsized":"2023-05-24T03:30:25.947901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:09:02.075394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"30'24","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.749675+0000","last_change":"2023-05-24T03:29:44.497379+0000","last_active":"2023-05-24T03:32:00.749675+0000","last_peered":"2023-05-24T03:32:00.749675+0000","last_clean":"2023-05-24T03:32:00.749675+0000","last_became_active":"2023-05-24T03:29:44.496679+0000","last_became_peered":"2023-05-24T03:29:44.496679+0000","last_unstale":"2023-05-24T03:32:00.749675+0000","last_undegraded":"2023-05-24T03:32:00.749675+0000","last_fullsized":"2023-05-24T03:32:00.749675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:14:25.131724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"30'459","reported_seq":476,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:58.646589+0000","last_change":"2023-05-24T03:29:48.529231+0000","last_active":"2023-05-24T03:31:58.646589+0000","last_peered":"2023-05-24T03:31:58.646589+0000","last_clean":"2023-05-24T03:31:58.646589+0000","last_became_active":"2023-05-24T03:29:48.528862+0000","last_became_peered":"2023-05-24T03:29:48.528862+0000","last_unstale":"2023-05-24T03:31:58.646589+0000","last_undegraded":"2023-05-24T03:31:58.646589+0000","last_fullsized":"2023-05-24T03:31:58.646589+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:28:27.871037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"30'3","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:25.947544+0000","last_change":"2023-05-24T03:29:44.090289+0000","last_active":"2023-05-24T03:30:25.947544+0000","last_peered":"2023-05-24T03:30:25.947544+0000","last_clean":"2023-05-24T03:30:25.947544+0000","last_became_active":"2023-05-24T03:29:44.089949+0000","last_became_peered":"2023-05-24T03:29:44.089949+0000","last_unstale":"2023-05-24T03:30:25.947544+0000","last_undegraded":"2023-05-24T03:30:25.947544+0000","last_fullsized":"2023-05-24T03:30:25.947544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:24:46.932939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'23","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.752267+0000","last_change":"2023-05-24T03:29:44.498632+0000","last_active":"2023-05-24T03:32:00.752267+0000","last_peered":"2023-05-24T03:32:00.752267+0000","last_clean":"2023-05-24T03:32:00.752267+0000","last_became_active":"2023-05-24T03:29:44.498350+0000","last_became_peered":"2023-05-24T03:29:44.498350+0000","last_unstale":"2023-05-24T03:32:00.752267+0000","last_undegraded":"2023-05-24T03:32:00.752267+0000","last_fullsized":"2023-05-24T03:32:00.752267+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:22:26.333903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"30'482","reported_seq":499,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:59.658595+0000","last_change":"2023-05-24T03:29:48.523434+0000","last_active":"2023-05-24T03:31:59.658595+0000","last_peered":"2023-05-24T03:31:59.658595+0000","last_clean":"2023-05-24T03:31:59.658595+0000","last_became_active":"2023-05-24T03:29:48.522228+0000","last_became_peered":"2023-05-24T03:29:48.522228+0000","last_unstale":"2023-05-24T03:31:59.658595+0000","last_undegraded":"2023-05-24T03:31:59.658595+0000","last_fullsized":"2023-05-24T03:31:59.658595+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:40:50.804869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:30:26.805353+0000","last_change":"2023-05-24T03:29:44.083178+0000","last_active":"2023-05-24T03:30:26.805353+0000","last_peered":"2023-05-24T03:30:26.805353+0000","last_clean":"2023-05-24T03:30:26.805353+0000","last_became_active":"2023-05-24T03:29:44.082903+0000","last_became_peered":"2023-05-24T03:29:44.082903+0000","last_unstale":"2023-05-24T03:30:26.805353+0000","last_undegraded":"2023-05-24T03:30:26.805353+0000","last_fullsized":"2023-05-24T03:30:26.805353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:56:27.514130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"30'32","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.750442+0000","last_change":"2023-05-24T03:29:44.488206+0000","last_active":"2023-05-24T03:32:00.750442+0000","last_peered":"2023-05-24T03:32:00.750442+0000","last_clean":"2023-05-24T03:32:00.750442+0000","last_became_active":"2023-05-24T03:29:44.487925+0000","last_became_peered":"2023-05-24T03:29:44.487925+0000","last_unstale":"2023-05-24T03:32:00.750442+0000","last_undegraded":"2023-05-24T03:32:00.750442+0000","last_fullsized":"2023-05-24T03:32:00.750442+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:28:43.398723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"30'490","reported_seq":507,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:01.665871+0000","last_change":"2023-05-24T03:29:48.519899+0000","last_active":"2023-05-24T03:32:01.665871+0000","last_peered":"2023-05-24T03:32:01.665871+0000","last_clean":"2023-05-24T03:32:01.665871+0000","last_became_active":"2023-05-24T03:29:48.519517+0000","last_became_peered":"2023-05-24T03:29:48.519517+0000","last_unstale":"2023-05-24T03:32:01.665871+0000","last_undegraded":"2023-05-24T03:32:01.665871+0000","last_fullsized":"2023-05-24T03:32:01.665871+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:21:09.342432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"30'5","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:51.943205+0000","last_change":"2023-05-24T03:29:44.088545+0000","last_active":"2023-05-24T03:31:51.943205+0000","last_peered":"2023-05-24T03:31:51.943205+0000","last_clean":"2023-05-24T03:31:51.943205+0000","last_became_active":"2023-05-24T03:29:44.087891+0000","last_became_peered":"2023-05-24T03:29:44.087891+0000","last_unstale":"2023-05-24T03:31:51.943205+0000","last_undegraded":"2023-05-24T03:31:51.943205+0000","last_fullsized":"2023-05-24T03:31:51.943205+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:26:41.155647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"30'42","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.749121+0000","last_change":"2023-05-24T03:29:44.493246+0000","last_active":"2023-05-24T03:32:00.749121+0000","last_peered":"2023-05-24T03:32:00.749121+0000","last_clean":"2023-05-24T03:32:00.749121+0000","last_became_active":"2023-05-24T03:29:44.492923+0000","last_became_peered":"2023-05-24T03:29:44.492923+0000","last_unstale":"2023-05-24T03:32:00.749121+0000","last_undegraded":"2023-05-24T03:32:00.749121+0000","last_fullsized":"2023-05-24T03:32:00.749121+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:11:24.300717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"30'50","reported_seq":74,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.747403+0000","last_change":"2023-05-24T03:29:44.486961+0000","last_active":"2023-05-24T03:32:00.747403+0000","last_peered":"2023-05-24T03:32:00.747403+0000","last_clean":"2023-05-24T03:32:00.747403+0000","last_became_active":"2023-05-24T03:29:44.483898+0000","last_became_peered":"2023-05-24T03:29:44.483898+0000","last_unstale":"2023-05-24T03:32:00.747403+0000","last_undegraded":"2023-05-24T03:32:00.747403+0000","last_fullsized":"2023-05-24T03:32:00.747403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:58:20.689097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"30'46","reported_seq":70,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.750154+0000","last_change":"2023-05-24T03:29:44.494451+0000","last_active":"2023-05-24T03:32:00.750154+0000","last_peered":"2023-05-24T03:32:00.750154+0000","last_clean":"2023-05-24T03:32:00.750154+0000","last_became_active":"2023-05-24T03:29:44.494073+0000","last_became_peered":"2023-05-24T03:29:44.494073+0000","last_unstale":"2023-05-24T03:32:00.750154+0000","last_undegraded":"2023-05-24T03:32:00.750154+0000","last_fullsized":"2023-05-24T03:32:00.750154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:09:03.081839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"30'34","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.742373+0000","last_change":"2023-05-24T03:29:44.498119+0000","last_active":"2023-05-24T03:32:00.742373+0000","last_peered":"2023-05-24T03:32:00.742373+0000","last_clean":"2023-05-24T03:32:00.742373+0000","last_became_active":"2023-05-24T03:29:44.497832+0000","last_became_peered":"2023-05-24T03:29:44.497832+0000","last_unstale":"2023-05-24T03:32:00.742373+0000","last_undegraded":"2023-05-24T03:32:00.742373+0000","last_fullsized":"2023-05-24T03:32:00.742373+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:29:45.352536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"30'31","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.740426+0000","last_change":"2023-05-24T03:29:44.496468+0000","last_active":"2023-05-24T03:32:00.740426+0000","last_peered":"2023-05-24T03:32:00.740426+0000","last_clean":"2023-05-24T03:32:00.740426+0000","last_became_active":"2023-05-24T03:29:44.496197+0000","last_became_peered":"2023-05-24T03:29:44.496197+0000","last_unstale":"2023-05-24T03:32:00.740426+0000","last_undegraded":"2023-05-24T03:32:00.740426+0000","last_fullsized":"2023-05-24T03:32:00.740426+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:47:03.515144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"30'32","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.747797+0000","last_change":"2023-05-24T03:29:44.495194+0000","last_active":"2023-05-24T03:32:00.747797+0000","last_peered":"2023-05-24T03:32:00.747797+0000","last_clean":"2023-05-24T03:32:00.747797+0000","last_became_active":"2023-05-24T03:29:44.494928+0000","last_became_peered":"2023-05-24T03:29:44.494928+0000","last_unstale":"2023-05-24T03:32:00.747797+0000","last_undegraded":"2023-05-24T03:32:00.747797+0000","last_fullsized":"2023-05-24T03:32:00.747797+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:10:14.605046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":552,"num_write_kb":1154048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":201326592,"data_stored":201326592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14950,"ondisk_log_size":14950,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2060,"ondisk_log_size":2060,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1454530,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":15,"num_read_kb":19,"num_write":438,"num_write_kb":1706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2965504,"data_stored":2909060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":440,"ondisk_log_size":440,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574882,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68200,"kb_used_data":33056,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94303640,"statfs":{"total":96636764160,"available":96566927360,"internally_reserved":0,"allocated":33849344,"data_stored":33632690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":4.7569999999999997,"5min":1.3480000000000001,"15min":0.78000000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":14.757999999999999,"5min":14.757999999999999,"15min":14.757999999999999},"last":0.35599999999999998},{"interface":"front","average":{"1min":6.2599999999999998,"5min":1.663,"15min":0.89700000000000002},"min":{"1min":0.307,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":17.954000000000001,"5min":17.954000000000001,"15min":17.954000000000001},"last":0.42899999999999999}]},{"osd":1,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":4.8380000000000001,"5min":1.3740000000000001,"15min":0.79600000000000004},"min":{"1min":0.35599999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":16.939,"5min":16.939,"15min":16.939},"last":0.44500000000000001},{"interface":"front","average":{"1min":6.6909999999999998,"5min":1.766,"15min":0.94499999999999995},"min":{"1min":0.35599999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":17.981999999999999,"5min":17.981999999999999,"15min":17.981999999999999},"last":0.379}]},{"osd":2,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":6.1429999999999998,"5min":1.641,"15min":0.89100000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":14.720000000000001,"5min":14.720000000000001,"15min":14.720000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":5.6150000000000002,"5min":1.5469999999999999,"15min":0.86899999999999999},"min":{"1min":0.40799999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":14.814,"5min":14.814,"15min":14.814},"last":0.46600000000000003}]},{"osd":3,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":6.3620000000000001,"5min":1.7150000000000001,"15min":0.94099999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":22.977,"5min":22.977,"15min":22.977},"last":0.48499999999999999},{"interface":"front","average":{"1min":4.742,"5min":1.3779999999999999,"15min":0.81699999999999995},"min":{"1min":0.47099999999999997,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":14.836,"5min":14.836,"15min":14.836},"last":0.39000000000000001}]},{"osd":4,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":4.8449999999999998,"5min":1.345,"15min":0.76200000000000001},"min":{"1min":0.35099999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":18.027000000000001,"5min":18.027000000000001,"15min":18.027000000000001},"last":0.34100000000000003},{"interface":"front","average":{"1min":3.347,"5min":1.077,"15min":0.69899999999999995},"min":{"1min":0.36299999999999999,"5min":0.307,"15min":0.307},"max":{"1min":22.922000000000001,"5min":22.922000000000001,"15min":22.922000000000001},"last":0.45600000000000002}]},{"osd":5,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":3.512,"5min":1.1579999999999999,"15min":0.76600000000000001},"min":{"1min":0.39700000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":17.925999999999998,"5min":17.925999999999998,"15min":17.925999999999998},"last":0.41799999999999998},{"interface":"front","average":{"1min":3.79,"5min":1.206,"15min":0.77600000000000002},"min":{"1min":0.42099999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":18.004999999999999,"5min":18.004999999999999,"15min":18.004999999999999},"last":0.47499999999999998}]},{"osd":6,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":5.5069999999999997,"5min":1.5609999999999999,"15min":0.90300000000000002},"min":{"1min":0.45900000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":23.933,"5min":23.933,"15min":23.933},"last":0.496},{"interface":"front","average":{"1min":5.3019999999999996,"5min":1.534,"15min":0.90600000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":22.954000000000001,"5min":22.954000000000001,"15min":22.954000000000001},"last":0.50600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574882,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":79688,"kb_used_data":57664,"kb_used_omap":0,"kb_used_meta":22016,"kb_avail":94292152,"statfs":{"total":96636764160,"available":96555163648,"internally_reserved":0,"allocated":59047936,"data_stored":58859102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22544384},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,3,2,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":8.5820000000000007,"5min":2.4780000000000002,"15min":1.46},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":22.922999999999998,"5min":22.922999999999998,"15min":22.922999999999998},"last":0.68899999999999995},{"interface":"front","average":{"1min":7.4909999999999997,"5min":1.952,"15min":1.0289999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":28.870000000000001,"5min":28.870000000000001,"15min":28.870000000000001},"last":0.46600000000000003}]},{"osd":1,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":7.5229999999999997,"5min":2.3090000000000002,"15min":1.4399999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":22.984999999999999,"5min":22.984999999999999,"15min":22.984999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":6.492,"5min":2.0910000000000002,"15min":1.357},"min":{"1min":0.434,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":21.984999999999999,"5min":21.984999999999999,"15min":21.984999999999999},"last":0.433}]},{"osd":2,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":5.6580000000000004,"5min":1.6020000000000001,"15min":0.92600000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":22.649999999999999,"5min":22.649999999999999,"15min":22.649999999999999},"last":1.323},{"interface":"front","average":{"1min":7.5709999999999997,"5min":2.3199999999999998,"15min":1.4450000000000001},"min":{"1min":0.40100000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":23.035,"5min":23.035,"15min":23.035},"last":0.66700000000000004}]},{"osd":3,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":6.4699999999999998,"5min":1.8380000000000001,"15min":1.0660000000000001},"min":{"1min":0.42699999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":18.056000000000001,"5min":18.056000000000001,"15min":18.056000000000001},"last":1.248},{"interface":"front","average":{"1min":6.2069999999999999,"5min":1.7749999999999999,"15min":1.036},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":19.963999999999999,"5min":19.963999999999999,"15min":19.963999999999999},"last":1.2809999999999999}]},{"osd":4,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":5.3230000000000004,"5min":1.4830000000000001,"15min":0.84299999999999997},"min":{"1min":0.372,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":18.056000000000001,"5min":18.056000000000001,"15min":18.056000000000001},"last":7.29},{"interface":"front","average":{"1min":5.1360000000000001,"5min":1.476,"15min":0.86599999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":21.943999999999999,"5min":21.943999999999999,"15min":21.943999999999999},"last":7.5090000000000003}]},{"osd":5,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":4.7370000000000001,"5min":1.3799999999999999,"15min":0.81999999999999995},"min":{"1min":0.36599999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":11.976000000000001,"5min":11.976000000000001,"15min":11.976000000000001},"last":1.347},{"interface":"front","average":{"1min":7.032,"5min":1.9119999999999999,"15min":1.0589999999999999},"min":{"1min":0.44600000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":23.010999999999999,"5min":23.010999999999999,"15min":23.010999999999999},"last":0.64100000000000001}]},{"osd":7,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":5.8639999999999999,"5min":1.6479999999999999,"15min":0.94599999999999995},"min":{"1min":0.48699999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":11.989000000000001,"5min":11.989000000000001,"15min":11.989000000000001},"last":1.393},{"interface":"front","average":{"1min":5.157,"5min":1.528,"15min":0.92300000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":21.042000000000002,"5min":21.042000000000002,"15min":21.042000000000002},"last":1.381}]}]},{"osd":1,"up_from":13,"seq":55834574882,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53896,"kb_used_data":22848,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94317944,"statfs":{"total":96636764160,"available":96581574656,"internally_reserved":0,"allocated":23396352,"data_stored":23207518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:31:32 2023","interfaces":[{"interface":"back","average":{"1min":5.5410000000000004,"5min":1.452,"15min":0.77000000000000002},"min":{"1min":0.24199999999999999,"5min":0.223,"15min":0.223},"max":{"1min":18.954000000000001,"5min":18.954000000000001,"15min":18.954000000000001},"last":0.28000000000000003},{"interface":"front","average":{"1min":6.6689999999999996,"5min":1.8400000000000001,"15min":1.0349999999999999},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":21.981999999999999,"5min":21.981999999999999,"15min":21.981999999999999},"last":0.443}]},{"osd":2,"last update":"Wed May 24 03:31:32 2023","interfaces":[{"interface":"back","average":{"1min":4.258,"5min":1.151,"15min":0.63300000000000001},"min":{"1min":0.255,"5min":0.221,"15min":0.221},"max":{"1min":15.004,"5min":15.004,"15min":15.004},"last":0.32100000000000001},{"interface":"front","average":{"1min":6.0179999999999998,"5min":1.5680000000000001,"15min":0.82599999999999996},"min":{"1min":0.29399999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":21.885000000000002,"5min":21.885000000000002,"15min":21.885000000000002},"last":0.34699999999999998}]},{"osd":3,"last update":"Wed May 24 03:31:32 2023","interfaces":[{"interface":"back","average":{"1min":4.5700000000000003,"5min":1.3160000000000001,"15min":0.77400000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":18.167000000000002,"5min":18.167000000000002,"15min":18.167000000000002},"last":0.46000000000000002},{"interface":"front","average":{"1min":3.7869999999999999,"5min":1.089,"15min":0.63900000000000001},"min":{"1min":0.33200000000000002,"5min":0.254,"15min":0.254},"max":{"1min":11.935,"5min":11.935,"15min":11.935},"last":0.40899999999999997}]},{"osd":4,"last update":"Wed May 24 03:31:32 2023","interfaces":[{"interface":"back","average":{"1min":7.3700000000000001,"5min":1.9259999999999999,"15min":1.018},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":28.891999999999999,"5min":28.891999999999999,"15min":28.891999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":7.6630000000000003,"5min":2.044,"15min":1.1080000000000001},"min":{"1min":0.376,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":21.954999999999998,"5min":21.954999999999998,"15min":21.954999999999998},"last":0.94899999999999995}]},{"osd":5,"last update":"Wed May 24 03:31:32 2023","interfaces":[{"interface":"back","average":{"1min":8.9190000000000005,"5min":2.323,"15min":1.2230000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":21.928000000000001,"5min":21.928000000000001,"15min":21.928000000000001},"last":0.97799999999999998},{"interface":"front","average":{"1min":7.6909999999999998,"5min":2.0720000000000001,"15min":1.1359999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":19.757999999999999,"5min":19.757999999999999,"15min":19.757999999999999},"last":0.89900000000000002}]},{"osd":6,"last update":"Wed May 24 03:31:32 2023","interfaces":[{"interface":"back","average":{"1min":6.984,"5min":1.9039999999999999,"15min":1.0580000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":22.033999999999999,"5min":22.033999999999999,"15min":22.033999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":7.6849999999999996,"5min":2.0339999999999998,"15min":1.0920000000000001},"min":{"1min":0.40200000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":19.734999999999999,"5min":19.734999999999999,"15min":19.734999999999999},"last":0.92600000000000005}]},{"osd":7,"last update":"Wed May 24 03:31:32 2023","interfaces":[{"interface":"back","average":{"1min":8.1940000000000008,"5min":2.2130000000000001,"15min":1.216},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":21.994,"5min":21.994,"15min":21.994},"last":0.98799999999999999},{"interface":"front","average":{"1min":7.8959999999999999,"5min":2.109,"15min":1.145},"min":{"1min":0.47999999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":21.957999999999998,"5min":21.957999999999998,"15min":21.957999999999998},"last":0.91100000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574882,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":83160,"kb_used_data":52112,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94288680,"statfs":{"total":96636764160,"available":96551608320,"internally_reserved":0,"allocated":53362688,"data_stored":53166239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":5.6539999999999999,"5min":1.4419999999999999,"15min":0.73999999999999999},"min":{"1min":0.29099999999999998,"5min":0.253,"15min":0.253},"max":{"1min":21.216000000000001,"5min":21.216000000000001,"15min":21.216000000000001},"last":0.246},{"interface":"front","average":{"1min":6.9509999999999996,"5min":1.6930000000000001,"15min":0.81699999999999995},"min":{"1min":0.247,"5min":0.185,"15min":0.185},"max":{"1min":29.925000000000001,"5min":29.925000000000001,"15min":29.925000000000001},"last":0.39400000000000002}]},{"osd":2,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":5.431,"5min":1.403,"15min":0.73199999999999998},"min":{"1min":0.29099999999999998,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":19.018999999999998,"5min":19.018999999999998,"15min":19.018999999999998},"last":0.29299999999999998},{"interface":"front","average":{"1min":7.6340000000000003,"5min":1.861,"15min":0.89900000000000002},"min":{"1min":0.32700000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":21.945,"5min":21.945,"15min":21.945},"last":0.314}]},{"osd":3,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":5.6120000000000001,"5min":1.4630000000000001,"15min":0.77100000000000002},"min":{"1min":0.30599999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":25.381,"5min":25.381,"15min":25.381},"last":0.33000000000000002},{"interface":"front","average":{"1min":8.2040000000000006,"5min":2.0129999999999999,"15min":0.98099999999999998},"min":{"1min":0.38900000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":21.209,"5min":21.209,"15min":21.209},"last":0.34999999999999998}]},{"osd":4,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":8.1859999999999999,"5min":2.1680000000000001,"15min":1.165},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":22.030000000000001,"5min":22.030000000000001,"15min":22.030000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":7.9889999999999999,"5min":2.113,"15min":1.1339999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":25.279,"5min":25.279,"15min":25.279},"last":0.495}]},{"osd":5,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":7.1589999999999998,"5min":1.9690000000000001,"15min":1.1040000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":25.329999999999998,"5min":25.329999999999998,"15min":25.329999999999998},"last":0.52500000000000002},{"interface":"front","average":{"1min":7.4630000000000001,"5min":2.0110000000000001,"15min":1.103},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":28.928000000000001,"5min":28.928000000000001,"15min":28.928000000000001},"last":0.48799999999999999}]},{"osd":6,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":6.9420000000000002,"5min":1.8899999999999999,"15min":1.048},"min":{"1min":0.376,"5min":0.37,"15min":0.37},"max":{"1min":21.132000000000001,"5min":21.132000000000001,"15min":21.132000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":7.8250000000000002,"5min":2.0550000000000002,"15min":1.093},"min":{"1min":0.44400000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":22.007000000000001,"5min":22.007000000000001,"15min":22.007000000000001},"last":0.47499999999999998}]},{"osd":7,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":9.327,"5min":2.3700000000000001,"15min":1.21},"min":{"1min":0.47799999999999998,"5min":0.437,"15min":0.437},"max":{"1min":21.983000000000001,"5min":21.983000000000001,"15min":21.983000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":7.0700000000000003,"5min":1.9359999999999999,"15min":1.0800000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":25.356000000000002,"5min":25.356000000000002,"15min":25.356000000000002},"last":0.44}]}]},{"osd":2,"up_from":13,"seq":55834574882,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67400,"kb_used_data":45376,"kb_used_omap":0,"kb_used_meta":22016,"kb_avail":94304440,"statfs":{"total":96636764160,"available":96567746560,"internally_reserved":0,"allocated":46465024,"data_stored":46276190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22544384},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":2.8090000000000002,"5min":0.83899999999999997,"15min":0.51100000000000001},"min":{"1min":0.26400000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":10.821999999999999,"5min":10.821999999999999,"15min":10.821999999999999},"last":0.42799999999999999},{"interface":"front","average":{"1min":2.762,"5min":0.96099999999999997,"15min":0.66100000000000003},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":11.743,"5min":11.743,"15min":11.743},"last":0.48299999999999998}]},{"osd":1,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":2.4900000000000002,"5min":0.80600000000000005,"15min":0.52500000000000002},"min":{"1min":0.316,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":12.079000000000001,"5min":12.079000000000001,"15min":12.079000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":3.9860000000000002,"5min":1.234,"15min":0.77600000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":19.954000000000001,"5min":19.954000000000001,"15min":19.954000000000001},"last":0.55200000000000005}]},{"osd":3,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":4.5510000000000002,"5min":1.214,"15min":0.65800000000000003},"min":{"1min":0.313,"5min":0.255,"15min":0.255},"max":{"1min":21.611000000000001,"5min":21.611000000000001,"15min":21.611000000000001},"last":0.40699999999999997},{"interface":"front","average":{"1min":3.4460000000000002,"5min":1.034,"15min":0.63200000000000001},"min":{"1min":0.34999999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":21.055,"5min":21.055,"15min":21.055},"last":0.56499999999999995}]},{"osd":4,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":4.8609999999999998,"5min":1.4690000000000001,"15min":0.90400000000000003},"min":{"1min":0.39600000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":16.657,"5min":16.657,"15min":16.657},"last":0.627},{"interface":"front","average":{"1min":4.1879999999999997,"5min":1.4319999999999999,"15min":0.97299999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":17.116,"5min":17.116,"15min":17.116},"last":0.67100000000000004}]},{"osd":5,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":5.6180000000000003,"5min":1.6100000000000001,"15min":0.94199999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":21.655000000000001,"5min":21.655000000000001,"15min":21.655000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":3.903,"5min":1.3,"15min":0.86599999999999999},"min":{"1min":0.42099999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":14.045999999999999,"5min":14.045999999999999,"15min":14.045999999999999},"last":0.66200000000000003}]},{"osd":6,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":4.8600000000000003,"5min":1.595,"15min":1.0509999999999999},"min":{"1min":0.48299999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":20.966999999999999,"5min":20.966999999999999,"15min":20.966999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":3.9710000000000001,"5min":1.2909999999999999,"15min":0.84499999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":15.119,"5min":15.119,"15min":15.119},"last":0.53800000000000003}]},{"osd":7,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":5.2690000000000001,"5min":1.6890000000000001,"15min":1.093},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":17.035,"5min":17.035,"15min":17.035},"last":0.64200000000000002},{"interface":"front","average":{"1min":5.0380000000000003,"5min":1.502,"15min":0.91200000000000003},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":18.611999999999998,"5min":18.611999999999998,"15min":18.611999999999998},"last":0.58199999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574881,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38732,"kb_used_data":20804,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94333108,"statfs":{"total":96636764160,"available":96597102592,"internally_reserved":0,"allocated":21303296,"data_stored":21110456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":4.7919999999999998,"5min":1.7130000000000001,"15min":1.2},"min":{"1min":0.25800000000000001,"5min":0.224,"15min":0.224},"max":{"1min":22.969000000000001,"5min":22.969000000000001,"15min":22.969000000000001},"last":0.38800000000000001},{"interface":"front","average":{"1min":3.7040000000000002,"5min":1.4510000000000001,"15min":1.075},"min":{"1min":0.31,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":15.933999999999999,"5min":15.933999999999999,"15min":15.933999999999999},"last":0.374}]},{"osd":1,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":3.2229999999999999,"5min":1.246,"15min":0.91600000000000004},"min":{"1min":0.28499999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":19.882000000000001,"5min":19.882000000000001,"15min":19.882000000000001},"last":0.36099999999999999},{"interface":"front","average":{"1min":3.5920000000000001,"5min":1.0569999999999999,"15min":0.63500000000000001},"min":{"1min":0.379,"5min":0.251,"15min":0.251},"max":{"1min":18.792000000000002,"5min":18.792000000000002,"15min":18.792000000000002},"last":0.34799999999999998}]},{"osd":2,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":5.7619999999999996,"5min":1.7709999999999999,"15min":1.1060000000000001},"min":{"1min":0.27200000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":22.922999999999998,"5min":22.922999999999998,"15min":22.922999999999998},"last":0.32100000000000001},{"interface":"front","average":{"1min":3.8540000000000001,"5min":2.3860000000000001,"15min":2.1419999999999999},"min":{"1min":0.318,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":19.645,"5min":22.919,"15min":22.919},"last":0.30599999999999999}]},{"osd":4,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":5.016,"5min":1.5069999999999999,"15min":0.92200000000000004},"min":{"1min":0.37,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":18.952000000000002,"5min":18.952000000000002,"15min":18.952000000000002},"last":0.61499999999999999},{"interface":"front","average":{"1min":6.4580000000000002,"5min":2.0539999999999998,"15min":1.3200000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":24.933,"5min":24.933,"15min":24.933},"last":0.55000000000000004}]},{"osd":5,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":5.4980000000000002,"5min":2.0209999999999999,"15min":1.4410000000000001},"min":{"1min":0.47699999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":20.056000000000001,"5min":20.056000000000001,"15min":20.056000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":5.3170000000000002,"5min":1.5649999999999999,"15min":0.93999999999999995},"min":{"1min":0.42399999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":16.013000000000002,"5min":16.013000000000002,"15min":16.013000000000002},"last":0.58599999999999997}]},{"osd":6,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":4.3959999999999999,"5min":1.6759999999999999,"15min":1.222},"min":{"1min":0.433,"5min":0.379,"15min":0.379},"max":{"1min":13.986000000000001,"5min":13.986000000000001,"15min":13.986000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":4.9909999999999997,"5min":1.923,"15min":1.4119999999999999},"min":{"1min":0.43099999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":20.088000000000001,"5min":20.088000000000001,"15min":20.088000000000001},"last":0.54000000000000004}]},{"osd":7,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":5.7279999999999998,"5min":1.6639999999999999,"15min":0.98699999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":21.571000000000002,"5min":21.571000000000002,"15min":21.571000000000002},"last":0.53300000000000003},{"interface":"front","average":{"1min":4.6029999999999998,"5min":1.724,"15min":1.244},"min":{"1min":0.44400000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":13.922000000000001,"5min":13.922000000000001,"15min":13.922000000000001},"last":0.63400000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574882,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71716,"kb_used_data":36572,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94300124,"statfs":{"total":96636764160,"available":96563326976,"internally_reserved":0,"allocated":37449728,"data_stored":37244218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:31:33 2023","interfaces":[{"interface":"back","average":{"1min":6.3440000000000003,"5min":1.663,"15min":0.88300000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":17.794,"5min":17.794,"15min":17.794},"last":0.55000000000000004},{"interface":"front","average":{"1min":5.2089999999999996,"5min":1.448,"15min":0.82099999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":16.597999999999999,"5min":16.597999999999999,"15min":16.597999999999999},"last":0.39400000000000002}]},{"osd":1,"last update":"Wed May 24 03:31:33 2023","interfaces":[{"interface":"back","average":{"1min":6.2549999999999999,"5min":1.6619999999999999,"15min":0.89600000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":22.933,"5min":22.933,"15min":22.933},"last":0.46700000000000003},{"interface":"front","average":{"1min":5.0650000000000004,"5min":1.4399999999999999,"15min":0.83599999999999997},"min":{"1min":0.35499999999999998,"5min":0.309,"15min":0.309},"max":{"1min":16.196000000000002,"5min":16.196000000000002,"15min":16.196000000000002},"last":0.53000000000000003}]},{"osd":2,"last update":"Wed May 24 03:31:33 2023","interfaces":[{"interface":"back","average":{"1min":5.0049999999999999,"5min":1.4119999999999999,"15min":0.81299999999999994},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":18.919,"5min":18.919,"15min":18.919},"last":0.498},{"interface":"front","average":{"1min":5.391,"5min":1.4990000000000001,"15min":0.84999999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":16.277999999999999,"5min":16.277999999999999,"15min":16.277999999999999},"last":0.434}]},{"osd":3,"last update":"Wed May 24 03:31:33 2023","interfaces":[{"interface":"back","average":{"1min":4.633,"5min":1.3169999999999999,"15min":0.76400000000000001},"min":{"1min":0.32000000000000001,"5min":0.312,"15min":0.312},"max":{"1min":18.956,"5min":18.956,"15min":18.956},"last":0.45200000000000001},{"interface":"front","average":{"1min":6.0899999999999999,"5min":1.651,"15min":0.91100000000000003},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":22.960000000000001,"5min":22.960000000000001,"15min":22.960000000000001},"last":0.55800000000000005}]},{"osd":5,"last update":"Wed May 24 03:31:33 2023","interfaces":[{"interface":"back","average":{"1min":4.0069999999999997,"5min":1.2230000000000001,"15min":0.75900000000000001},"min":{"1min":0.36199999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":16.231999999999999,"5min":16.231999999999999,"15min":16.231999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":3.1560000000000001,"5min":1.0940000000000001,"15min":0.75},"min":{"1min":0.42399999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":11.904999999999999,"5min":11.904999999999999,"15min":11.904999999999999},"last":0.56799999999999995}]},{"osd":6,"last update":"Wed May 24 03:31:33 2023","interfaces":[{"interface":"back","average":{"1min":5.4790000000000001,"5min":1.492,"15min":0.82799999999999996},"min":{"1min":0.33400000000000002,"5min":0.315,"15min":0.315},"max":{"1min":22.983000000000001,"5min":22.983000000000001,"15min":22.983000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":3.2970000000000002,"5min":1.1100000000000001,"15min":0.746},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":12.367000000000001,"5min":12.367000000000001,"15min":12.367000000000001},"last":0.48599999999999999}]},{"osd":7,"last update":"Wed May 24 03:31:33 2023","interfaces":[{"interface":"back","average":{"1min":3.2090000000000001,"5min":1.085,"15min":0.73099999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":16.576000000000001,"5min":16.576000000000001,"15min":16.576000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":5.5149999999999997,"5min":1.5820000000000001,"15min":0.92600000000000005},"min":{"1min":0.432,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":22.882000000000001,"5min":22.882000000000001,"15min":22.882000000000001},"last":0.57999999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574881,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71504,"kb_used_data":49480,"kb_used_omap":0,"kb_used_meta":22016,"kb_avail":94300336,"statfs":{"total":96636764160,"available":96563544064,"internally_reserved":0,"allocated":50667520,"data_stored":50471146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22544384},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:31:35 2023","interfaces":[{"interface":"back","average":{"1min":7.0830000000000002,"5min":1.831,"15min":0.95599999999999996},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":20.137,"5min":20.137,"15min":20.137},"last":0.66500000000000004},{"interface":"front","average":{"1min":6.6159999999999997,"5min":1.9019999999999999,"15min":1.1160000000000001},"min":{"1min":0.30499999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":25.988,"5min":25.988,"15min":25.988},"last":0.52500000000000002}]},{"osd":1,"last update":"Wed May 24 03:31:35 2023","interfaces":[{"interface":"back","average":{"1min":6.5759999999999996,"5min":1.748,"15min":0.94399999999999995},"min":{"1min":0.42799999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":22.765999999999998,"5min":22.765999999999998,"15min":22.765999999999998},"last":0.499},{"interface":"front","average":{"1min":7.2190000000000003,"5min":2.044,"15min":1.1819999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":20.161999999999999,"5min":20.161999999999999,"15min":20.161999999999999},"last":0.58899999999999997}]},{"osd":2,"last update":"Wed May 24 03:31:35 2023","interfaces":[{"interface":"back","average":{"1min":7.4820000000000002,"5min":1.929,"15min":1.0029999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":25.946000000000002,"5min":25.946000000000002,"15min":25.946000000000002},"last":0.55700000000000005},{"interface":"front","average":{"1min":5.6459999999999999,"5min":1.7490000000000001,"15min":1.099},"min":{"1min":0.45900000000000002,"5min":0.437,"15min":0.437},"max":{"1min":22.800000000000001,"5min":22.800000000000001,"15min":22.800000000000001},"last":0.68799999999999994}]},{"osd":3,"last update":"Wed May 24 03:31:35 2023","interfaces":[{"interface":"back","average":{"1min":6.093,"5min":1.9059999999999999,"15min":1.208},"min":{"1min":0.38600000000000001,"5min":0.375,"15min":0.375},"max":{"1min":26.013999999999999,"5min":26.013999999999999,"15min":26.013999999999999},"last":2.0990000000000002},{"interface":"front","average":{"1min":6.2140000000000004,"5min":1.8959999999999999,"15min":1.1759999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":22.687999999999999,"5min":22.687999999999999,"15min":22.687999999999999},"last":0.53800000000000003}]},{"osd":4,"last update":"Wed May 24 03:31:35 2023","interfaces":[{"interface":"back","average":{"1min":5.6379999999999999,"5min":1.5289999999999999,"15min":0.84399999999999997},"min":{"1min":0.33500000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":19.998000000000001,"5min":19.998000000000001,"15min":19.998000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":4.3520000000000003,"5min":1.2929999999999999,"15min":0.78300000000000003},"min":{"1min":0.38800000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":17.628,"5min":17.628,"15min":17.628},"last":0.38600000000000001}]},{"osd":6,"last update":"Wed May 24 03:31:35 2023","interfaces":[{"interface":"back","average":{"1min":4.516,"5min":1.3420000000000001,"15min":0.81299999999999994},"min":{"1min":0.39600000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":19.969000000000001,"5min":19.969000000000001,"15min":19.969000000000001},"last":0.40400000000000003},{"interface":"front","average":{"1min":5.2229999999999999,"5min":1.4970000000000001,"15min":0.876},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":19.913,"5min":19.913,"15min":19.913},"last":0.42199999999999999}]},{"osd":7,"last update":"Wed May 24 03:31:35 2023","interfaces":[{"interface":"back","average":{"1min":3.9180000000000001,"5min":1.274,"15min":0.83399999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":17.731000000000002,"5min":17.731000000000002,"15min":17.731000000000002},"last":0.44},{"interface":"front","average":{"1min":4.2949999999999999,"5min":1.3620000000000001,"15min":0.873},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":20.099,"5min":20.099,"15min":20.099},"last":0.57299999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":8334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1470464,"data_stored":1453788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1470464,"data_stored":1446196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23068672,"data_stored":23068672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23068672,"data_stored":23068672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":27262976,"data_stored":27262976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":31457280,"data_stored":31457280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-24T03:32:08.470 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.470 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.471 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.471 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.471 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.471 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.472 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.472 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.472 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.473 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.473 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.473 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.473 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.474 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.474 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.474 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.475 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.475 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.475 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.475 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.476 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.476 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.476 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.477 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.477 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.477 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.477 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.478 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.478 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-05-24T03:29:43.053877+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.478 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.479 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.479 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-05-24T03:29:43.053877+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.479 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.479 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.480 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-05-24T03:29:43.053877+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.480 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.480 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.481 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-05-24T03:29:43.053877+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.481 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.481 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.481 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-05-24T03:29:43.053877+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.482 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.482 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.482 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-05-24T03:29:43.053877+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.483 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.483 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.483 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-05-24T03:29:43.053877+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.483 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.484 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.484 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-05-24T03:29:43.053877+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.484 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.485 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.485 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-05-24T03:29:43.053877+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.485 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.485 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.486 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-05-24T03:29:43.053877+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.486 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.486 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.487 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-05-24T03:29:43.053877+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.487 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.487 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.487 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-05-24T03:29:43.053877+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.488 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.488 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.488 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-05-24T03:29:43.053877+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.489 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.489 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.489 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-05-24T03:29:43.053877+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.489 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.490 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.490 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-05-24T03:29:43.053877+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.490 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.491 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.491 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-05-24T03:29:43.053877+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.491 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.491 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.492 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-05-24T03:29:43.053877+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.492 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.492 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.493 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-05-24T03:29:43.053877+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.493 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.493 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.493 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-05-24T03:29:43.053877+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.494 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.494 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.494 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-05-24T03:29:38.035725+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=38, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.495 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-05-24T03:29:43.053877+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.495 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.495 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.495 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-05-24T03:29:38.035725+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=38, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.496 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-05-24T03:29:43.053877+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.496 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.496 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.497 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-05-24T03:29:38.035725+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=38, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.497 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-05-24T03:29:43.053877+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.497 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.497 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.498 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-05-24T03:29:38.035725+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=38, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.498 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-05-24T03:29:32.968348+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=32, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.498 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-05-24T03:29:43.053877+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.499 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.499 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.499 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-05-24T03:29:38.035725+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=38, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.499 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-05-24T03:29:43.053877+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.500 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.500 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.500 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-05-24T03:29:38.035725+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=38, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.501 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-05-24T03:29:43.053877+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.501 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.501 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.501 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-05-24T03:29:43.053877+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.502 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-05-24T03:29:38.035725+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=38, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.502 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.502 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.503 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-05-24T03:29:38.035725+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=38, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.503 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-05-24T03:29:43.053877+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.503 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.503 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.504 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-05-24T03:29:43.053877+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.504 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.504 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.505 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-05-24T03:29:43.053877+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.505 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.505 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.505 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-05-24T03:29:43.053877+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.506 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.506 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.506 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-05-24T03:29:43.053877+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.507 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.507 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.507 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-05-24T03:29:43.053877+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.507 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.508 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.508 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.508 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.508 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.509 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:08.509 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-05-24T03:32:14.361 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T03:32:14.415 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T03:32:28.510 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-24T03:32:28.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.644+0000 7fad39345700 1 Processor -- start 2023-05-24T03:32:28.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.644+0000 7fad39345700 1 -- start start 2023-05-24T03:32:28.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.645+0000 7fad39345700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad340b8a50 0x7fad3415daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:28.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.645+0000 7fad39345700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fad3406bb40 0x7fad340cfe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:28.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.645+0000 7fad39345700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fad340d03a0 0x7fad340b4c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:28.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.645+0000 7fad39345700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad340cd790 con 0x7fad3406bb40 2023-05-24T03:32:28.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.645+0000 7fad39345700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad340cf9d0 con 0x7fad340d03a0 2023-05-24T03:32:28.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.645+0000 7fad39345700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad3415e030 con 0x7fad340b8a50 2023-05-24T03:32:28.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.645+0000 7fad327fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fad3406bb40 0x7fad340cfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:28.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.645+0000 7fad327fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fad3406bb40 0x7fad340cfe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40772/0 (socket says 172.21.15.146:40772) 2023-05-24T03:32:28.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.645+0000 7fad327fc700 1 -- 172.21.15.146:0/3119920172 learned_addr learned my addr 172.21.15.146:0/3119920172 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:32:28.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.646+0000 7fad327fc700 1 -- 172.21.15.146:0/3119920172 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad340b8a50 msgr2=0x7fad3415daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:32:28.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.646+0000 7fad327fc700 1 --2- 172.21.15.146:0/3119920172 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad340b8a50 0x7fad3415daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:28.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.646+0000 7fad327fc700 1 -- 172.21.15.146:0/3119920172 >> v2:172.21.15.151:3300/0 conn(0x7fad340d03a0 msgr2=0x7fad340b4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:32:28.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.646+0000 7fad337fe700 1 --2- 172.21.15.146:0/3119920172 >> v2:172.21.15.151:3300/0 conn(0x7fad340d03a0 0x7fad340b4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:28.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.646+0000 7fad327fc700 1 --2- 172.21.15.146:0/3119920172 >> v2:172.21.15.151:3300/0 conn(0x7fad340d03a0 0x7fad340b4c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:28.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.646+0000 7fad327fc700 1 -- 172.21.15.146:0/3119920172 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad340cf400 con 0x7fad3406bb40 2023-05-24T03:32:28.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.646+0000 7fad327fc700 1 --2- 172.21.15.146:0/3119920172 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad3406bb40 0x7fad340cfe60 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fad340d0ca0 tx=0x7fad24009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b08d33c94a53d709 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:28.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.646+0000 7fad31ffb700 1 -- 172.21.15.146:0/3119920172 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2400b870 con 0x7fad3406bb40 2023-05-24T03:32:28.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.646+0000 7fad31ffb700 1 -- 172.21.15.146:0/3119920172 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad2400b9d0 con 0x7fad3406bb40 2023-05-24T03:32:28.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.646+0000 7fad31ffb700 1 -- 172.21.15.146:0/3119920172 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2400bd60 con 0x7fad3406bb40 2023-05-24T03:32:28.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.646+0000 7fad39345700 1 -- 172.21.15.146:0/3119920172 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad3406bb40 msgr2=0x7fad340cfe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:28.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.646+0000 7fad39345700 1 --2- 172.21.15.146:0/3119920172 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad3406bb40 0x7fad340cfe60 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fad340d0ca0 tx=0x7fad24009bd0 comp rx=0 tx=0).stop 2023-05-24T03:32:28.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.646+0000 7fad39345700 1 -- 172.21.15.146:0/3119920172 shutdown_connections 2023-05-24T03:32:28.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.646+0000 7fad39345700 1 --2- 172.21.15.146:0/3119920172 >> v2:172.21.15.151:3300/0 conn(0x7fad340d03a0 0x7fad340b4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:28.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.646+0000 7fad39345700 1 --2- 172.21.15.146:0/3119920172 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad340b8a50 0x7fad3415daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:28.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.646+0000 7fad39345700 1 --2- 172.21.15.146:0/3119920172 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad3406bb40 0x7fad340cfe60 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:28.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.646+0000 7fad39345700 1 -- 172.21.15.146:0/3119920172 >> 172.21.15.146:0/3119920172 conn(0x7fad3406af30 msgr2=0x7fad3406b330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:32:28.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.647+0000 7fad39345700 1 -- 172.21.15.146:0/3119920172 shutdown_connections 2023-05-24T03:32:28.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.647+0000 7fad39345700 1 -- 172.21.15.146:0/3119920172 wait complete. 2023-05-24T03:32:28.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.648+0000 7fad39345700 1 Processor -- start 2023-05-24T03:32:28.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.648+0000 7fad39345700 1 -- start start 2023-05-24T03:32:28.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.649+0000 7fad39345700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad3406bb40 0x7fad340ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:28.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.649+0000 7fad39345700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad340b8a50 0x7fad341e5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:28.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.649+0000 7fad39345700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad340d03a0 0x7fad341e6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:28.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.649+0000 7fad39345700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad340cb7e0 con 0x7fad340b8a50 2023-05-24T03:32:28.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.649+0000 7fad39345700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad340cd170 con 0x7fad3406bb40 2023-05-24T03:32:28.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.649+0000 7fad39345700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad34159410 con 0x7fad340d03a0 2023-05-24T03:32:28.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.649+0000 7fad327fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad340b8a50 0x7fad341e5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:28.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.649+0000 7fad327fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad340b8a50 0x7fad341e5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40778/0 (socket says 172.21.15.146:40778) 2023-05-24T03:32:28.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.649+0000 7fad327fc700 1 -- 172.21.15.146:0/1020451896 learned_addr learned my addr 172.21.15.146:0/1020451896 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:32:28.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.649+0000 7fad337fe700 1 --2- 172.21.15.146:0/1020451896 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad340d03a0 0x7fad341e6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:28.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.649+0000 7fad32ffd700 1 --2- 172.21.15.146:0/1020451896 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad3406bb40 0x7fad340ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:28.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.649+0000 7fad327fc700 1 -- 172.21.15.146:0/1020451896 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad340d03a0 msgr2=0x7fad341e6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:28.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.649+0000 7fad327fc700 1 --2- 172.21.15.146:0/1020451896 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad340d03a0 0x7fad341e6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:28.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.649+0000 7fad327fc700 1 -- 172.21.15.146:0/1020451896 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad3406bb40 msgr2=0x7fad340ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:28.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.649+0000 7fad327fc700 1 --2- 172.21.15.146:0/1020451896 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad3406bb40 0x7fad340ccc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:28.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.649+0000 7fad327fc700 1 -- 172.21.15.146:0/1020451896 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad24009550 con 0x7fad340b8a50 2023-05-24T03:32:28.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.649+0000 7fad337fe700 1 --2- 172.21.15.146:0/1020451896 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad340d03a0 0x7fad341e6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:32:28.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.649+0000 7fad32ffd700 1 --2- 172.21.15.146:0/1020451896 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad3406bb40 0x7fad340ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:32:28.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.649+0000 7fad327fc700 1 --2- 172.21.15.146:0/1020451896 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad340b8a50 0x7fad341e5e30 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fad24009fd0 tx=0x7fad24004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:28.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.649+0000 7fad1b7fe700 1 -- 172.21.15.146:0/1020451896 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad24004310 con 0x7fad340b8a50 2023-05-24T03:32:28.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.649+0000 7fad1b7fe700 1 -- 172.21.15.146:0/1020451896 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad2401f070 con 0x7fad340b8a50 2023-05-24T03:32:28.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.649+0000 7fad1b7fe700 1 -- 172.21.15.146:0/1020451896 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad240036a0 con 0x7fad340b8a50 2023-05-24T03:32:28.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.649+0000 7fad39345700 1 -- 172.21.15.146:0/1020451896 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad340cdf60 con 0x7fad340b8a50 2023-05-24T03:32:28.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.650+0000 7fad39345700 1 -- 172.21.15.146:0/1020451896 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad340cf6a0 con 0x7fad340b8a50 2023-05-24T03:32:28.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.651+0000 7fad39345700 1 -- 172.21.15.146:0/1020451896 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad340cd9a0 con 0x7fad340b8a50 2023-05-24T03:32:28.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.651+0000 7fad1b7fe700 1 -- 172.21.15.146:0/1020451896 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fad24021030 con 0x7fad340b8a50 2023-05-24T03:32:28.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.651+0000 7fad1b7fe700 1 --2- 172.21.15.146:0/1020451896 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fad2006ace0 0x7fad2006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:28.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.652+0000 7fad32ffd700 1 --2- 172.21.15.146:0/1020451896 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fad2006ace0 0x7fad2006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:28.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.652+0000 7fad1b7fe700 1 -- 172.21.15.146:0/1020451896 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fad2408ab50 con 0x7fad340b8a50 2023-05-24T03:32:28.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.652+0000 7fad32ffd700 1 --2- 172.21.15.146:0/1020451896 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fad2006ace0 0x7fad2006d190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fad340b8110 tx=0x7fad28008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:28.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.656+0000 7fad1b7fe700 1 -- 172.21.15.146:0/1020451896 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fad24055960 con 0x7fad340b8a50 2023-05-24T03:32:28.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.840+0000 7fad39345700 1 -- 172.21.15.146:0/1020451896 --> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fad34072ae0 con 0x7fad2006ace0 2023-05-24T03:32:28.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.850+0000 7fad1b7fe700 1 -- 172.21.15.146:0/1020451896 <== mgr.4104 v2:172.21.15.146:6832/1985394169 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+389604 (secure 0 0 0) 0x7fad34072ae0 con 0x7fad2006ace0 2023-05-24T03:32:28.858 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:32:28.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.854+0000 7fad39345700 1 -- 172.21.15.146:0/1020451896 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fad2006ace0 msgr2=0x7fad2006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:28.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.854+0000 7fad39345700 1 --2- 172.21.15.146:0/1020451896 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fad2006ace0 0x7fad2006d190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fad340b8110 tx=0x7fad28008040 comp rx=0 tx=0).stop 2023-05-24T03:32:28.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.854+0000 7fad39345700 1 -- 172.21.15.146:0/1020451896 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad340b8a50 msgr2=0x7fad341e5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:28.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.854+0000 7fad39345700 1 --2- 172.21.15.146:0/1020451896 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad340b8a50 0x7fad341e5e30 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fad24009fd0 tx=0x7fad24004750 comp rx=0 tx=0).stop 2023-05-24T03:32:28.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.854+0000 7fad39345700 1 -- 172.21.15.146:0/1020451896 shutdown_connections 2023-05-24T03:32:28.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.854+0000 7fad39345700 1 --2- 172.21.15.146:0/1020451896 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fad2006ace0 0x7fad2006d190 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:28.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.854+0000 7fad39345700 1 --2- 172.21.15.146:0/1020451896 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad340d03a0 0x7fad341e6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:28.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.854+0000 7fad39345700 1 --2- 172.21.15.146:0/1020451896 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad3406bb40 0x7fad340ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:28.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.854+0000 7fad39345700 1 --2- 172.21.15.146:0/1020451896 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad340b8a50 0x7fad341e5e30 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:28.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.854+0000 7fad39345700 1 -- 172.21.15.146:0/1020451896 >> 172.21.15.146:0/1020451896 conn(0x7fad3406af30 msgr2=0x7fad341e76a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:32:28.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.854+0000 7fad39345700 1 -- 172.21.15.146:0/1020451896 shutdown_connections 2023-05-24T03:32:28.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:28.854+0000 7fad39345700 1 -- 172.21.15.146:0/1020451896 wait complete. 2023-05-24T03:32:28.863 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-05-24T03:32:28.870 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":112,"stamp":"2023-05-24T03:32:28.798770+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":102806948,"num_objects":49,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":131,"num_read_kb":119,"num_write":1195,"num_write_kb":1158288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17622,"ondisk_log_size":17622,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":419800,"kb_used_data":203416,"kb_used_omap":0,"kb_used_meta":216320,"kb_avail":754554920,"statfs":{"total":773094113280,"available":772664238080,"internally_reserved":0,"allocated":208297984,"data_stored":206724664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":221511680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":31974,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003513"},"pg_stats":[{"pgid":"4.3f","version":"30'28","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:13.677466+0000","last_change":"2023-05-24T03:32:13.677538+0000","last_active":"2023-05-24T03:32:13.677466+0000","last_peered":"2023-05-24T03:32:13.677466+0000","last_clean":"2023-05-24T03:32:13.677466+0000","last_became_active":"2023-05-24T03:29:44.489854+0000","last_became_peered":"2023-05-24T03:29:44.489854+0000","last_unstale":"2023-05-24T03:32:13.677466+0000","last_undegraded":"2023-05-24T03:32:13.677466+0000","last_fullsized":"2023-05-24T03:32:13.677466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'28","last_scrub_stamp":"2023-05-24T03:32:13.677364+0000","last_deep_scrub":"30'28","last_deep_scrub_stamp":"2023-05-24T03:32:13.677364+0000","last_clean_scrub_stamp":"2023-05-24T03:32:13.677364+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T03:41:35.361181+0000","scrub_duration":0.001818166,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"30'27","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.744662+0000","last_change":"2023-05-24T03:29:44.495973+0000","last_active":"2023-05-24T03:32:00.744662+0000","last_peered":"2023-05-24T03:32:00.744662+0000","last_clean":"2023-05-24T03:32:00.744662+0000","last_became_active":"2023-05-24T03:29:44.495700+0000","last_became_peered":"2023-05-24T03:29:44.495700+0000","last_unstale":"2023-05-24T03:32:00.744662+0000","last_undegraded":"2023-05-24T03:32:00.744662+0000","last_fullsized":"2023-05-24T03:32:00.744662+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"30'43","reported_seq":76,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:10.490334+0000","last_change":"2023-05-24T03:32:10.490388+0000","last_active":"2023-05-24T03:32:10.490334+0000","last_peered":"2023-05-24T03:32:10.490334+0000","last_clean":"2023-05-24T03:32:10.490334+0000","last_became_active":"2023-05-24T03:29:44.499663+0000","last_became_peered":"2023-05-24T03:29:44.499663+0000","last_unstale":"2023-05-24T03:32:10.490334+0000","last_undegraded":"2023-05-24T03:32:10.490334+0000","last_fullsized":"2023-05-24T03:32:10.490334+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'43","last_scrub_stamp":"2023-05-24T03:32:10.490217+0000","last_deep_scrub":"30'43","last_deep_scrub_stamp":"2023-05-24T03:32:10.490217+0000","last_clean_scrub_stamp":"2023-05-24T03:32:10.490217+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:07:18.348127+0000","scrub_duration":0.002187207,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"30'24","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:19.940238+0000","last_change":"2023-05-24T03:32:19.940327+0000","last_active":"2023-05-24T03:32:19.940238+0000","last_peered":"2023-05-24T03:32:19.940238+0000","last_clean":"2023-05-24T03:32:19.940238+0000","last_became_active":"2023-05-24T03:29:44.498528+0000","last_became_peered":"2023-05-24T03:29:44.498528+0000","last_unstale":"2023-05-24T03:32:19.940238+0000","last_undegraded":"2023-05-24T03:32:19.940238+0000","last_fullsized":"2023-05-24T03:32:19.940238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2023-05-24T03:32:19.940111+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2023-05-24T03:32:19.940111+0000","last_clean_scrub_stamp":"2023-05-24T03:32:19.940111+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:12:46.316536+0000","scrub_duration":0.002509664,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"30'34","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:04.613136+0000","last_change":"2023-05-24T03:29:44.504225+0000","last_active":"2023-05-24T03:32:04.613136+0000","last_peered":"2023-05-24T03:32:04.613136+0000","last_clean":"2023-05-24T03:32:04.613136+0000","last_became_active":"2023-05-24T03:29:44.503998+0000","last_became_peered":"2023-05-24T03:29:44.503998+0000","last_unstale":"2023-05-24T03:32:04.613136+0000","last_undegraded":"2023-05-24T03:32:04.613136+0000","last_fullsized":"2023-05-24T03:32:04.613136+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"30'39","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:06.604507+0000","last_change":"2023-05-24T03:29:44.500355+0000","last_active":"2023-05-24T03:32:06.604507+0000","last_peered":"2023-05-24T03:32:06.604507+0000","last_clean":"2023-05-24T03:32:06.604507+0000","last_became_active":"2023-05-24T03:29:44.500065+0000","last_became_peered":"2023-05-24T03:29:44.500065+0000","last_unstale":"2023-05-24T03:32:06.604507+0000","last_undegraded":"2023-05-24T03:32:06.604507+0000","last_fullsized":"2023-05-24T03:32:06.604507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"30'27","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:08.096140+0000","last_change":"2023-05-24T03:29:44.499607+0000","last_active":"2023-05-24T03:32:08.096140+0000","last_peered":"2023-05-24T03:32:08.096140+0000","last_clean":"2023-05-24T03:32:08.096140+0000","last_became_active":"2023-05-24T03:29:44.499324+0000","last_became_peered":"2023-05-24T03:29:44.499324+0000","last_unstale":"2023-05-24T03:32:08.096140+0000","last_undegraded":"2023-05-24T03:32:08.096140+0000","last_fullsized":"2023-05-24T03:32:08.096140+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"30'31","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:07.551920+0000","last_change":"2023-05-24T03:32:07.551920+0000","last_active":"2023-05-24T03:32:07.551920+0000","last_peered":"2023-05-24T03:32:07.551920+0000","last_clean":"2023-05-24T03:32:07.551920+0000","last_became_active":"2023-05-24T03:29:44.500260+0000","last_became_peered":"2023-05-24T03:29:44.500260+0000","last_unstale":"2023-05-24T03:32:07.551920+0000","last_undegraded":"2023-05-24T03:32:07.551920+0000","last_fullsized":"2023-05-24T03:32:07.551920+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'31","last_scrub_stamp":"2023-05-24T03:32:07.551774+0000","last_deep_scrub":"30'31","last_deep_scrub_stamp":"2023-05-24T03:32:07.551774+0000","last_clean_scrub_stamp":"2023-05-24T03:32:07.551774+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:05:30.767531+0000","scrub_duration":0.001406902,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"30'38","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:04.613114+0000","last_change":"2023-05-24T03:29:44.502655+0000","last_active":"2023-05-24T03:32:04.613114+0000","last_peered":"2023-05-24T03:32:04.613114+0000","last_clean":"2023-05-24T03:32:04.613114+0000","last_became_active":"2023-05-24T03:29:44.502341+0000","last_became_peered":"2023-05-24T03:29:44.502341+0000","last_unstale":"2023-05-24T03:32:04.613114+0000","last_undegraded":"2023-05-24T03:32:04.613114+0000","last_fullsized":"2023-05-24T03:32:04.613114+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"30'44","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:07.101435+0000","last_change":"2023-05-24T03:29:44.500505+0000","last_active":"2023-05-24T03:32:07.101435+0000","last_peered":"2023-05-24T03:32:07.101435+0000","last_clean":"2023-05-24T03:32:07.101435+0000","last_became_active":"2023-05-24T03:29:44.500156+0000","last_became_peered":"2023-05-24T03:29:44.500156+0000","last_unstale":"2023-05-24T03:32:07.101435+0000","last_undegraded":"2023-05-24T03:32:07.101435+0000","last_fullsized":"2023-05-24T03:32:07.101435+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"30'25","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:06.604469+0000","last_change":"2023-05-24T03:29:44.492850+0000","last_active":"2023-05-24T03:32:06.604469+0000","last_peered":"2023-05-24T03:32:06.604469+0000","last_clean":"2023-05-24T03:32:06.604469+0000","last_became_active":"2023-05-24T03:29:44.492573+0000","last_became_peered":"2023-05-24T03:29:44.492573+0000","last_unstale":"2023-05-24T03:32:06.604469+0000","last_undegraded":"2023-05-24T03:32:06.604469+0000","last_fullsized":"2023-05-24T03:32:06.604469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"30'30","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:21.771720+0000","last_change":"2023-05-24T03:32:21.771773+0000","last_active":"2023-05-24T03:32:21.771720+0000","last_peered":"2023-05-24T03:32:21.771720+0000","last_clean":"2023-05-24T03:32:21.771720+0000","last_became_active":"2023-05-24T03:29:44.501371+0000","last_became_peered":"2023-05-24T03:29:44.501371+0000","last_unstale":"2023-05-24T03:32:21.771720+0000","last_undegraded":"2023-05-24T03:32:21.771720+0000","last_fullsized":"2023-05-24T03:32:21.771720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2023-05-24T03:32:21.771619+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2023-05-24T03:32:21.771619+0000","last_clean_scrub_stamp":"2023-05-24T03:32:21.771619+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:46:03.786320+0000","scrub_duration":0.0021789000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"30'30","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:10.688054+0000","last_change":"2023-05-24T03:32:10.688054+0000","last_active":"2023-05-24T03:32:10.688054+0000","last_peered":"2023-05-24T03:32:10.688054+0000","last_clean":"2023-05-24T03:32:10.688054+0000","last_became_active":"2023-05-24T03:29:44.490411+0000","last_became_peered":"2023-05-24T03:29:44.490411+0000","last_unstale":"2023-05-24T03:32:10.688054+0000","last_undegraded":"2023-05-24T03:32:10.688054+0000","last_fullsized":"2023-05-24T03:32:10.688054+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2023-05-24T03:32:10.687867+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2023-05-24T03:32:10.687867+0000","last_clean_scrub_stamp":"2023-05-24T03:32:10.687867+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:41:09.062399+0000","scrub_duration":0.0014586079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:08.559425+0000","last_change":"2023-05-24T03:32:08.559478+0000","last_active":"2023-05-24T03:32:08.559425+0000","last_peered":"2023-05-24T03:32:08.559425+0000","last_clean":"2023-05-24T03:32:08.559425+0000","last_became_active":"2023-05-24T03:29:44.494879+0000","last_became_peered":"2023-05-24T03:29:44.494879+0000","last_unstale":"2023-05-24T03:32:08.559425+0000","last_undegraded":"2023-05-24T03:32:08.559425+0000","last_fullsized":"2023-05-24T03:32:08.559425+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-05-24T03:32:08.559327+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-05-24T03:32:08.559327+0000","last_clean_scrub_stamp":"2023-05-24T03:32:08.559327+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:39:20.496878+0000","scrub_duration":0.0018937559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"30'31","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:06.944874+0000","last_change":"2023-05-24T03:29:44.499673+0000","last_active":"2023-05-24T03:32:06.944874+0000","last_peered":"2023-05-24T03:32:06.944874+0000","last_clean":"2023-05-24T03:32:06.944874+0000","last_became_active":"2023-05-24T03:29:44.499393+0000","last_became_peered":"2023-05-24T03:29:44.499393+0000","last_unstale":"2023-05-24T03:32:06.944874+0000","last_undegraded":"2023-05-24T03:32:06.944874+0000","last_fullsized":"2023-05-24T03:32:06.944874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"30'39","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:06.604549+0000","last_change":"2023-05-24T03:29:44.501101+0000","last_active":"2023-05-24T03:32:06.604549+0000","last_peered":"2023-05-24T03:32:06.604549+0000","last_clean":"2023-05-24T03:32:06.604549+0000","last_became_active":"2023-05-24T03:29:44.500818+0000","last_became_peered":"2023-05-24T03:29:44.500818+0000","last_unstale":"2023-05-24T03:32:06.604549+0000","last_undegraded":"2023-05-24T03:32:06.604549+0000","last_fullsized":"2023-05-24T03:32:06.604549+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"30'34","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:05.266534+0000","last_change":"2023-05-24T03:32:05.266534+0000","last_active":"2023-05-24T03:32:05.266534+0000","last_peered":"2023-05-24T03:32:05.266534+0000","last_clean":"2023-05-24T03:32:05.266534+0000","last_became_active":"2023-05-24T03:29:44.499543+0000","last_became_peered":"2023-05-24T03:29:44.499543+0000","last_unstale":"2023-05-24T03:32:05.266534+0000","last_undegraded":"2023-05-24T03:32:05.266534+0000","last_fullsized":"2023-05-24T03:32:05.266534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'34","last_scrub_stamp":"2023-05-24T03:32:05.266373+0000","last_deep_scrub":"30'34","last_deep_scrub_stamp":"2023-05-24T03:32:05.266373+0000","last_clean_scrub_stamp":"2023-05-24T03:32:05.266373+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:30:44.837013+0000","scrub_duration":0.001465926,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"30'29","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:14.450147+0000","last_change":"2023-05-24T03:32:14.450198+0000","last_active":"2023-05-24T03:32:14.450147+0000","last_peered":"2023-05-24T03:32:14.450147+0000","last_clean":"2023-05-24T03:32:14.450147+0000","last_became_active":"2023-05-24T03:29:44.492109+0000","last_became_peered":"2023-05-24T03:29:44.492109+0000","last_unstale":"2023-05-24T03:32:14.450147+0000","last_undegraded":"2023-05-24T03:32:14.450147+0000","last_fullsized":"2023-05-24T03:32:14.450147+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'29","last_scrub_stamp":"2023-05-24T03:32:14.450045+0000","last_deep_scrub":"30'29","last_deep_scrub_stamp":"2023-05-24T03:32:14.450045+0000","last_clean_scrub_stamp":"2023-05-24T03:32:14.450045+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:29:13.731044+0000","scrub_duration":0.0018316579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"30'31","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:12.709356+0000","last_change":"2023-05-24T03:32:12.709408+0000","last_active":"2023-05-24T03:32:12.709356+0000","last_peered":"2023-05-24T03:32:12.709356+0000","last_clean":"2023-05-24T03:32:12.709356+0000","last_became_active":"2023-05-24T03:29:44.480597+0000","last_became_peered":"2023-05-24T03:29:44.480597+0000","last_unstale":"2023-05-24T03:32:12.709356+0000","last_undegraded":"2023-05-24T03:32:12.709356+0000","last_fullsized":"2023-05-24T03:32:12.709356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'31","last_scrub_stamp":"2023-05-24T03:32:12.709240+0000","last_deep_scrub":"30'31","last_deep_scrub_stamp":"2023-05-24T03:32:12.709240+0000","last_clean_scrub_stamp":"2023-05-24T03:32:12.709240+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:30:46.981383+0000","scrub_duration":0.001799042,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"30'34","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:21.334467+0000","last_change":"2023-05-24T03:32:21.334516+0000","last_active":"2023-05-24T03:32:21.334467+0000","last_peered":"2023-05-24T03:32:21.334467+0000","last_clean":"2023-05-24T03:32:21.334467+0000","last_became_active":"2023-05-24T03:29:44.499405+0000","last_became_peered":"2023-05-24T03:29:44.499405+0000","last_unstale":"2023-05-24T03:32:21.334467+0000","last_undegraded":"2023-05-24T03:32:21.334467+0000","last_fullsized":"2023-05-24T03:32:21.334467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'34","last_scrub_stamp":"2023-05-24T03:32:21.334367+0000","last_deep_scrub":"30'34","last_deep_scrub_stamp":"2023-05-24T03:32:21.334367+0000","last_clean_scrub_stamp":"2023-05-24T03:32:21.334367+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:18:40.971078+0000","scrub_duration":0.001550711,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"30'40","reported_seq":70,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:01.944373+0000","last_change":"2023-05-24T03:30:26.106086+0000","last_active":"2023-05-24T03:32:01.944373+0000","last_peered":"2023-05-24T03:32:01.944373+0000","last_clean":"2023-05-24T03:32:01.944373+0000","last_became_active":"2023-05-24T03:30:26.105858+0000","last_became_peered":"2023-05-24T03:30:26.105858+0000","last_unstale":"2023-05-24T03:32:01.944373+0000","last_undegraded":"2023-05-24T03:32:01.944373+0000","last_fullsized":"2023-05-24T03:32:01.944373+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"30'32","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:01.944247+0000","last_change":"2023-05-24T03:29:44.498675+0000","last_active":"2023-05-24T03:32:01.944247+0000","last_peered":"2023-05-24T03:32:01.944247+0000","last_clean":"2023-05-24T03:32:01.944247+0000","last_became_active":"2023-05-24T03:29:44.498463+0000","last_became_peered":"2023-05-24T03:29:44.498463+0000","last_unstale":"2023-05-24T03:32:01.944247+0000","last_undegraded":"2023-05-24T03:32:01.944247+0000","last_fullsized":"2023-05-24T03:32:01.944247+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"30'36","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:18.872950+0000","last_change":"2023-05-24T03:32:18.872998+0000","last_active":"2023-05-24T03:32:18.872950+0000","last_peered":"2023-05-24T03:32:18.872950+0000","last_clean":"2023-05-24T03:32:18.872950+0000","last_became_active":"2023-05-24T03:29:44.499960+0000","last_became_peered":"2023-05-24T03:29:44.499960+0000","last_unstale":"2023-05-24T03:32:18.872950+0000","last_undegraded":"2023-05-24T03:32:18.872950+0000","last_fullsized":"2023-05-24T03:32:18.872950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'36","last_scrub_stamp":"2023-05-24T03:32:18.872839+0000","last_deep_scrub":"30'36","last_deep_scrub_stamp":"2023-05-24T03:32:18.872839+0000","last_clean_scrub_stamp":"2023-05-24T03:32:18.872839+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:53:45.834893+0000","scrub_duration":0.001506446,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"30'31","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.752872+0000","last_change":"2023-05-24T03:29:44.499015+0000","last_active":"2023-05-24T03:32:00.752872+0000","last_peered":"2023-05-24T03:32:00.752872+0000","last_clean":"2023-05-24T03:32:00.752872+0000","last_became_active":"2023-05-24T03:29:44.498437+0000","last_became_peered":"2023-05-24T03:29:44.498437+0000","last_unstale":"2023-05-24T03:32:00.752872+0000","last_undegraded":"2023-05-24T03:32:00.752872+0000","last_fullsized":"2023-05-24T03:32:00.752872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"30'25","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.749017+0000","last_change":"2023-05-24T03:29:44.481162+0000","last_active":"2023-05-24T03:32:00.749017+0000","last_peered":"2023-05-24T03:32:00.749017+0000","last_clean":"2023-05-24T03:32:00.749017+0000","last_became_active":"2023-05-24T03:29:44.481004+0000","last_became_peered":"2023-05-24T03:29:44.481004+0000","last_unstale":"2023-05-24T03:32:00.749017+0000","last_undegraded":"2023-05-24T03:32:00.749017+0000","last_fullsized":"2023-05-24T03:32:00.749017+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"30'38","reported_seq":71,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:12.991958+0000","last_change":"2023-05-24T03:32:12.992009+0000","last_active":"2023-05-24T03:32:12.991958+0000","last_peered":"2023-05-24T03:32:12.991958+0000","last_clean":"2023-05-24T03:32:12.991958+0000","last_became_active":"2023-05-24T03:29:44.481686+0000","last_became_peered":"2023-05-24T03:29:44.481686+0000","last_unstale":"2023-05-24T03:32:12.991958+0000","last_undegraded":"2023-05-24T03:32:12.991958+0000","last_fullsized":"2023-05-24T03:32:12.991958+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'38","last_scrub_stamp":"2023-05-24T03:32:12.991844+0000","last_deep_scrub":"30'38","last_deep_scrub_stamp":"2023-05-24T03:32:12.991844+0000","last_clean_scrub_stamp":"2023-05-24T03:32:12.991844+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:11:02.613201+0000","scrub_duration":0.0013478520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"30'26","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.743036+0000","last_change":"2023-05-24T03:29:44.502948+0000","last_active":"2023-05-24T03:32:00.743036+0000","last_peered":"2023-05-24T03:32:00.743036+0000","last_clean":"2023-05-24T03:32:00.743036+0000","last_became_active":"2023-05-24T03:29:44.502669+0000","last_became_peered":"2023-05-24T03:29:44.502669+0000","last_unstale":"2023-05-24T03:32:00.743036+0000","last_undegraded":"2023-05-24T03:32:00.743036+0000","last_fullsized":"2023-05-24T03:32:00.743036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"30'474","reported_seq":493,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:06.604588+0000","last_change":"2023-05-24T03:29:48.523138+0000","last_active":"2023-05-24T03:32:06.604588+0000","last_peered":"2023-05-24T03:32:06.604588+0000","last_clean":"2023-05-24T03:32:06.604588+0000","last_became_active":"2023-05-24T03:29:48.522749+0000","last_became_peered":"2023-05-24T03:29:48.522749+0000","last_unstale":"2023-05-24T03:32:06.604588+0000","last_undegraded":"2023-05-24T03:32:06.604588+0000","last_fullsized":"2023-05-24T03:32:06.604588+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:06.604224+0000","last_change":"2023-05-24T03:29:44.086543+0000","last_active":"2023-05-24T03:32:06.604224+0000","last_peered":"2023-05-24T03:32:06.604224+0000","last_clean":"2023-05-24T03:32:06.604224+0000","last_became_active":"2023-05-24T03:29:44.086143+0000","last_became_peered":"2023-05-24T03:29:44.086143+0000","last_unstale":"2023-05-24T03:32:06.604224+0000","last_undegraded":"2023-05-24T03:32:06.604224+0000","last_fullsized":"2023-05-24T03:32:06.604224+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'39","reported_seq":72,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:06.778805+0000","last_change":"2023-05-24T03:32:06.778805+0000","last_active":"2023-05-24T03:32:06.778805+0000","last_peered":"2023-05-24T03:32:06.778805+0000","last_clean":"2023-05-24T03:32:06.778805+0000","last_became_active":"2023-05-24T03:29:44.490772+0000","last_became_peered":"2023-05-24T03:29:44.490772+0000","last_unstale":"2023-05-24T03:32:06.778805+0000","last_undegraded":"2023-05-24T03:32:06.778805+0000","last_fullsized":"2023-05-24T03:32:06.778805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'39","last_scrub_stamp":"2023-05-24T03:32:06.778698+0000","last_deep_scrub":"30'39","last_deep_scrub_stamp":"2023-05-24T03:32:06.778698+0000","last_clean_scrub_stamp":"2023-05-24T03:32:06.778698+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:31:15.880804+0000","scrub_duration":0.0014151050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"30'444","reported_seq":463,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:59.663416+0000","last_change":"2023-05-24T03:29:48.523521+0000","last_active":"2023-05-24T03:31:59.663416+0000","last_peered":"2023-05-24T03:31:59.663416+0000","last_clean":"2023-05-24T03:31:59.663416+0000","last_became_active":"2023-05-24T03:29:48.523125+0000","last_became_peered":"2023-05-24T03:29:48.523125+0000","last_unstale":"2023-05-24T03:31:59.663416+0000","last_undegraded":"2023-05-24T03:31:59.663416+0000","last_fullsized":"2023-05-24T03:31:59.663416+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:05.111133+0000","last_change":"2023-05-24T03:29:44.084408+0000","last_active":"2023-05-24T03:32:05.111133+0000","last_peered":"2023-05-24T03:32:05.111133+0000","last_clean":"2023-05-24T03:32:05.111133+0000","last_became_active":"2023-05-24T03:29:44.084099+0000","last_became_peered":"2023-05-24T03:29:44.084099+0000","last_unstale":"2023-05-24T03:32:05.111133+0000","last_undegraded":"2023-05-24T03:32:05.111133+0000","last_fullsized":"2023-05-24T03:32:05.111133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"30'31","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.739898+0000","last_change":"2023-05-24T03:29:44.503346+0000","last_active":"2023-05-24T03:32:00.739898+0000","last_peered":"2023-05-24T03:32:00.739898+0000","last_clean":"2023-05-24T03:32:00.739898+0000","last_became_active":"2023-05-24T03:29:44.503039+0000","last_became_peered":"2023-05-24T03:29:44.503039+0000","last_unstale":"2023-05-24T03:32:00.739898+0000","last_undegraded":"2023-05-24T03:32:00.739898+0000","last_fullsized":"2023-05-24T03:32:00.739898+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"30'454","reported_seq":473,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:01.666380+0000","last_change":"2023-05-24T03:29:48.529615+0000","last_active":"2023-05-24T03:32:01.666380+0000","last_peered":"2023-05-24T03:32:01.666380+0000","last_clean":"2023-05-24T03:32:01.666380+0000","last_became_active":"2023-05-24T03:29:48.529142+0000","last_became_peered":"2023-05-24T03:29:48.529142+0000","last_unstale":"2023-05-24T03:32:01.666380+0000","last_undegraded":"2023-05-24T03:32:01.666380+0000","last_fullsized":"2023-05-24T03:32:01.666380+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"30'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:21.861680+0000","last_change":"2023-05-24T03:32:21.861728+0000","last_active":"2023-05-24T03:32:21.861680+0000","last_peered":"2023-05-24T03:32:21.861680+0000","last_clean":"2023-05-24T03:32:21.861680+0000","last_became_active":"2023-05-24T03:29:44.084907+0000","last_became_peered":"2023-05-24T03:29:44.084907+0000","last_unstale":"2023-05-24T03:32:21.861680+0000","last_undegraded":"2023-05-24T03:32:21.861680+0000","last_fullsized":"2023-05-24T03:32:21.861680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-05-24T03:32:21.861585+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-05-24T03:32:21.861585+0000","last_clean_scrub_stamp":"2023-05-24T03:32:21.861585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:59:22.498081+0000","scrub_duration":0.0014618840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"30'30","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.737000+0000","last_change":"2023-05-24T03:29:44.497128+0000","last_active":"2023-05-24T03:32:00.737000+0000","last_peered":"2023-05-24T03:32:00.737000+0000","last_clean":"2023-05-24T03:32:00.737000+0000","last_became_active":"2023-05-24T03:29:44.496746+0000","last_became_peered":"2023-05-24T03:29:44.496746+0000","last_unstale":"2023-05-24T03:32:00.737000+0000","last_undegraded":"2023-05-24T03:32:00.737000+0000","last_fullsized":"2023-05-24T03:32:00.737000+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"30'468","reported_seq":487,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:07.598528+0000","last_change":"2023-05-24T03:29:48.520693+0000","last_active":"2023-05-24T03:32:07.598528+0000","last_peered":"2023-05-24T03:32:07.598528+0000","last_clean":"2023-05-24T03:32:07.598528+0000","last_became_active":"2023-05-24T03:29:48.520319+0000","last_became_peered":"2023-05-24T03:29:48.520319+0000","last_unstale":"2023-05-24T03:32:07.598528+0000","last_undegraded":"2023-05-24T03:32:07.598528+0000","last_fullsized":"2023-05-24T03:32:07.598528+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"30'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:16.397784+0000","last_change":"2023-05-24T03:32:16.397828+0000","last_active":"2023-05-24T03:32:16.397784+0000","last_peered":"2023-05-24T03:32:16.397784+0000","last_clean":"2023-05-24T03:32:16.397784+0000","last_became_active":"2023-05-24T03:29:44.088267+0000","last_became_peered":"2023-05-24T03:29:44.088267+0000","last_unstale":"2023-05-24T03:32:16.397784+0000","last_undegraded":"2023-05-24T03:32:16.397784+0000","last_fullsized":"2023-05-24T03:32:16.397784+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-05-24T03:32:16.397687+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-05-24T03:32:16.397687+0000","last_clean_scrub_stamp":"2023-05-24T03:32:16.397687+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:36:49.030839+0000","scrub_duration":0.0020232230000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"30'27","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:10.842423+0000","last_change":"2023-05-24T03:32:10.842496+0000","last_active":"2023-05-24T03:32:10.842423+0000","last_peered":"2023-05-24T03:32:10.842423+0000","last_clean":"2023-05-24T03:32:10.842423+0000","last_became_active":"2023-05-24T03:29:44.488666+0000","last_became_peered":"2023-05-24T03:29:44.488666+0000","last_unstale":"2023-05-24T03:32:10.842423+0000","last_undegraded":"2023-05-24T03:32:10.842423+0000","last_fullsized":"2023-05-24T03:32:10.842423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'27","last_scrub_stamp":"2023-05-24T03:32:10.842313+0000","last_deep_scrub":"30'27","last_deep_scrub_stamp":"2023-05-24T03:32:10.842313+0000","last_clean_scrub_stamp":"2023-05-24T03:32:10.842313+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:36:43.475465+0000","scrub_duration":0.001460512,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"30'453","reported_seq":472,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:08.096211+0000","last_change":"2023-05-24T03:29:48.518108+0000","last_active":"2023-05-24T03:32:08.096211+0000","last_peered":"2023-05-24T03:32:08.096211+0000","last_clean":"2023-05-24T03:32:08.096211+0000","last_became_active":"2023-05-24T03:29:48.517771+0000","last_became_peered":"2023-05-24T03:29:48.517771+0000","last_unstale":"2023-05-24T03:32:08.096211+0000","last_undegraded":"2023-05-24T03:32:08.096211+0000","last_fullsized":"2023-05-24T03:32:08.096211+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:07.101379+0000","last_change":"2023-05-24T03:29:44.087910+0000","last_active":"2023-05-24T03:32:07.101379+0000","last_peered":"2023-05-24T03:32:07.101379+0000","last_clean":"2023-05-24T03:32:07.101379+0000","last_became_active":"2023-05-24T03:29:44.087601+0000","last_became_peered":"2023-05-24T03:29:44.087601+0000","last_unstale":"2023-05-24T03:32:07.101379+0000","last_undegraded":"2023-05-24T03:32:07.101379+0000","last_fullsized":"2023-05-24T03:32:07.101379+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"30'36","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:06.103382+0000","last_change":"2023-05-24T03:29:44.496020+0000","last_active":"2023-05-24T03:32:06.103382+0000","last_peered":"2023-05-24T03:32:06.103382+0000","last_clean":"2023-05-24T03:32:06.103382+0000","last_became_active":"2023-05-24T03:29:44.495752+0000","last_became_peered":"2023-05-24T03:29:44.495752+0000","last_unstale":"2023-05-24T03:32:06.103382+0000","last_undegraded":"2023-05-24T03:32:06.103382+0000","last_fullsized":"2023-05-24T03:32:06.103382+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"30'480","reported_seq":499,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:06.103520+0000","last_change":"2023-05-24T03:29:48.529893+0000","last_active":"2023-05-24T03:32:06.103520+0000","last_peered":"2023-05-24T03:32:06.103520+0000","last_clean":"2023-05-24T03:32:06.103520+0000","last_became_active":"2023-05-24T03:29:48.529514+0000","last_became_peered":"2023-05-24T03:29:48.529514+0000","last_unstale":"2023-05-24T03:32:06.103520+0000","last_undegraded":"2023-05-24T03:32:06.103520+0000","last_fullsized":"2023-05-24T03:32:06.103520+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"30'12","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:08.096201+0000","last_change":"2023-05-24T03:29:44.091648+0000","last_active":"2023-05-24T03:32:08.096201+0000","last_peered":"2023-05-24T03:32:08.096201+0000","last_clean":"2023-05-24T03:32:08.096201+0000","last_became_active":"2023-05-24T03:29:44.091390+0000","last_became_peered":"2023-05-24T03:29:44.091390+0000","last_unstale":"2023-05-24T03:32:08.096201+0000","last_undegraded":"2023-05-24T03:32:08.096201+0000","last_fullsized":"2023-05-24T03:32:08.096201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"30'42","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:05.111158+0000","last_change":"2023-05-24T03:29:44.481629+0000","last_active":"2023-05-24T03:32:05.111158+0000","last_peered":"2023-05-24T03:32:05.111158+0000","last_clean":"2023-05-24T03:32:05.111158+0000","last_became_active":"2023-05-24T03:29:44.481385+0000","last_became_peered":"2023-05-24T03:29:44.481385+0000","last_unstale":"2023-05-24T03:32:05.111158+0000","last_undegraded":"2023-05-24T03:32:05.111158+0000","last_fullsized":"2023-05-24T03:32:05.111158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"30'471","reported_seq":490,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:05.111244+0000","last_change":"2023-05-24T03:29:48.524712+0000","last_active":"2023-05-24T03:32:05.111244+0000","last_peered":"2023-05-24T03:32:05.111244+0000","last_clean":"2023-05-24T03:32:05.111244+0000","last_became_active":"2023-05-24T03:29:48.524312+0000","last_became_peered":"2023-05-24T03:29:48.524312+0000","last_unstale":"2023-05-24T03:32:05.111244+0000","last_undegraded":"2023-05-24T03:32:05.111244+0000","last_fullsized":"2023-05-24T03:32:05.111244+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"30'400","reported_seq":427,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:14.194161+0000","last_change":"2023-05-24T03:29:44.079067+0000","last_active":"2023-05-24T03:32:14.194161+0000","last_peered":"2023-05-24T03:32:14.194161+0000","last_clean":"2023-05-24T03:32:14.194161+0000","last_became_active":"2023-05-24T03:29:44.078785+0000","last_became_peered":"2023-05-24T03:29:44.078785+0000","last_unstale":"2023-05-24T03:32:14.194161+0000","last_undegraded":"2023-05-24T03:32:14.194161+0000","last_fullsized":"2023-05-24T03:32:14.194161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1544734,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":399,"num_write_kb":1772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"30'41","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:06.604332+0000","last_change":"2023-05-24T03:29:44.497603+0000","last_active":"2023-05-24T03:32:06.604332+0000","last_peered":"2023-05-24T03:32:06.604332+0000","last_clean":"2023-05-24T03:32:06.604332+0000","last_became_active":"2023-05-24T03:29:44.497120+0000","last_became_peered":"2023-05-24T03:29:44.497120+0000","last_unstale":"2023-05-24T03:32:06.604332+0000","last_undegraded":"2023-05-24T03:32:06.604332+0000","last_fullsized":"2023-05-24T03:32:06.604332+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"30'438","reported_seq":457,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:07.101570+0000","last_change":"2023-05-24T03:29:48.531846+0000","last_active":"2023-05-24T03:32:07.101570+0000","last_peered":"2023-05-24T03:32:07.101570+0000","last_clean":"2023-05-24T03:32:07.101570+0000","last_became_active":"2023-05-24T03:29:48.531538+0000","last_became_peered":"2023-05-24T03:29:48.531538+0000","last_unstale":"2023-05-24T03:32:07.101570+0000","last_undegraded":"2023-05-24T03:32:07.101570+0000","last_fullsized":"2023-05-24T03:32:07.101570+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"30'3","reported_seq":30,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:06.944943+0000","last_change":"2023-05-24T03:29:44.087315+0000","last_active":"2023-05-24T03:32:06.944943+0000","last_peered":"2023-05-24T03:32:06.944943+0000","last_clean":"2023-05-24T03:32:06.944943+0000","last_became_active":"2023-05-24T03:29:44.086997+0000","last_became_peered":"2023-05-24T03:29:44.086997+0000","last_unstale":"2023-05-24T03:32:06.944943+0000","last_undegraded":"2023-05-24T03:32:06.944943+0000","last_fullsized":"2023-05-24T03:32:06.944943+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"30'29","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:06.103445+0000","last_change":"2023-05-24T03:29:44.487497+0000","last_active":"2023-05-24T03:32:06.103445+0000","last_peered":"2023-05-24T03:32:06.103445+0000","last_clean":"2023-05-24T03:32:06.103445+0000","last_became_active":"2023-05-24T03:29:44.487257+0000","last_became_peered":"2023-05-24T03:29:44.487257+0000","last_unstale":"2023-05-24T03:32:06.103445+0000","last_undegraded":"2023-05-24T03:32:06.103445+0000","last_fullsized":"2023-05-24T03:32:06.103445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"30'470","reported_seq":489,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:06.103472+0000","last_change":"2023-05-24T03:29:48.526115+0000","last_active":"2023-05-24T03:32:06.103472+0000","last_peered":"2023-05-24T03:32:06.103472+0000","last_clean":"2023-05-24T03:32:06.103472+0000","last_became_active":"2023-05-24T03:29:48.525726+0000","last_became_peered":"2023-05-24T03:29:48.525726+0000","last_unstale":"2023-05-24T03:32:06.103472+0000","last_undegraded":"2023-05-24T03:32:06.103472+0000","last_fullsized":"2023-05-24T03:32:06.103472+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:13.389468+0000","last_change":"2023-05-24T03:32:13.389511+0000","last_active":"2023-05-24T03:32:13.389468+0000","last_peered":"2023-05-24T03:32:13.389468+0000","last_clean":"2023-05-24T03:32:13.389468+0000","last_became_active":"2023-05-24T03:29:44.084278+0000","last_became_peered":"2023-05-24T03:29:44.084278+0000","last_unstale":"2023-05-24T03:32:13.389468+0000","last_undegraded":"2023-05-24T03:32:13.389468+0000","last_fullsized":"2023-05-24T03:32:13.389468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:13.389382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:13.389382+0000","last_clean_scrub_stamp":"2023-05-24T03:32:13.389382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:05:36.605139+0000","scrub_duration":0.0019599439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"30'33","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:10.564131+0000","last_change":"2023-05-24T03:32:10.564131+0000","last_active":"2023-05-24T03:32:10.564131+0000","last_peered":"2023-05-24T03:32:10.564131+0000","last_clean":"2023-05-24T03:32:10.564131+0000","last_became_active":"2023-05-24T03:29:44.498097+0000","last_became_peered":"2023-05-24T03:29:44.498097+0000","last_unstale":"2023-05-24T03:32:10.564131+0000","last_undegraded":"2023-05-24T03:32:10.564131+0000","last_fullsized":"2023-05-24T03:32:10.564131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'33","last_scrub_stamp":"2023-05-24T03:32:10.563952+0000","last_deep_scrub":"30'33","last_deep_scrub_stamp":"2023-05-24T03:32:10.563952+0000","last_clean_scrub_stamp":"2023-05-24T03:32:10.563952+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:36:43.197104+0000","scrub_duration":0.001462594,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"30'446","reported_seq":465,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:06.103453+0000","last_change":"2023-05-24T03:29:48.525018+0000","last_active":"2023-05-24T03:32:06.103453+0000","last_peered":"2023-05-24T03:32:06.103453+0000","last_clean":"2023-05-24T03:32:06.103453+0000","last_became_active":"2023-05-24T03:29:48.524602+0000","last_became_peered":"2023-05-24T03:29:48.524602+0000","last_unstale":"2023-05-24T03:32:06.103453+0000","last_undegraded":"2023-05-24T03:32:06.103453+0000","last_fullsized":"2023-05-24T03:32:06.103453+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"30'1","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:06.944894+0000","last_change":"2023-05-24T03:29:44.085212+0000","last_active":"2023-05-24T03:32:06.944894+0000","last_peered":"2023-05-24T03:32:06.944894+0000","last_clean":"2023-05-24T03:32:06.944894+0000","last_became_active":"2023-05-24T03:29:44.085001+0000","last_became_peered":"2023-05-24T03:29:44.085001+0000","last_unstale":"2023-05-24T03:32:06.944894+0000","last_undegraded":"2023-05-24T03:32:06.944894+0000","last_fullsized":"2023-05-24T03:32:06.944894+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"30'40","reported_seq":73,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:10.302878+0000","last_change":"2023-05-24T03:32:10.302878+0000","last_active":"2023-05-24T03:32:10.302878+0000","last_peered":"2023-05-24T03:32:10.302878+0000","last_clean":"2023-05-24T03:32:10.302878+0000","last_became_active":"2023-05-24T03:29:44.500631+0000","last_became_peered":"2023-05-24T03:29:44.500631+0000","last_unstale":"2023-05-24T03:32:10.302878+0000","last_undegraded":"2023-05-24T03:32:10.302878+0000","last_fullsized":"2023-05-24T03:32:10.302878+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'40","last_scrub_stamp":"2023-05-24T03:32:10.302703+0000","last_deep_scrub":"30'40","last_deep_scrub_stamp":"2023-05-24T03:32:10.302703+0000","last_clean_scrub_stamp":"2023-05-24T03:32:10.302703+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:05:46.791081+0000","scrub_duration":0.0016110149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"30'491","reported_seq":510,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:07.101564+0000","last_change":"2023-05-24T03:29:48.523523+0000","last_active":"2023-05-24T03:32:07.101564+0000","last_peered":"2023-05-24T03:32:07.101564+0000","last_clean":"2023-05-24T03:32:07.101564+0000","last_became_active":"2023-05-24T03:29:48.523138+0000","last_became_peered":"2023-05-24T03:29:48.523138+0000","last_unstale":"2023-05-24T03:32:07.101564+0000","last_undegraded":"2023-05-24T03:32:07.101564+0000","last_fullsized":"2023-05-24T03:32:07.101564+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"30'12","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:08.888415+0000","last_change":"2023-05-24T03:32:08.888472+0000","last_active":"2023-05-24T03:32:08.888415+0000","last_peered":"2023-05-24T03:32:08.888415+0000","last_clean":"2023-05-24T03:32:08.888415+0000","last_became_active":"2023-05-24T03:29:44.084914+0000","last_became_peered":"2023-05-24T03:29:44.084914+0000","last_unstale":"2023-05-24T03:32:08.888415+0000","last_undegraded":"2023-05-24T03:32:08.888415+0000","last_fullsized":"2023-05-24T03:32:08.888415+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'12","last_scrub_stamp":"2023-05-24T03:32:08.888326+0000","last_deep_scrub":"30'12","last_deep_scrub_stamp":"2023-05-24T03:32:08.888326+0000","last_clean_scrub_stamp":"2023-05-24T03:32:08.888326+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:48:53.009441+0000","scrub_duration":0.0042668330000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"30'32","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:06.103389+0000","last_change":"2023-05-24T03:29:44.496038+0000","last_active":"2023-05-24T03:32:06.103389+0000","last_peered":"2023-05-24T03:32:06.103389+0000","last_clean":"2023-05-24T03:32:06.103389+0000","last_became_active":"2023-05-24T03:29:44.495795+0000","last_became_peered":"2023-05-24T03:29:44.495795+0000","last_unstale":"2023-05-24T03:32:06.103389+0000","last_undegraded":"2023-05-24T03:32:06.103389+0000","last_fullsized":"2023-05-24T03:32:06.103389+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"30'445","reported_seq":464,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:01.944326+0000","last_change":"2023-05-24T03:29:48.518930+0000","last_active":"2023-05-24T03:32:01.944326+0000","last_peered":"2023-05-24T03:32:01.944326+0000","last_clean":"2023-05-24T03:32:01.944326+0000","last_became_active":"2023-05-24T03:29:48.518531+0000","last_became_peered":"2023-05-24T03:29:48.518531+0000","last_unstale":"2023-05-24T03:32:01.944326+0000","last_undegraded":"2023-05-24T03:32:01.944326+0000","last_fullsized":"2023-05-24T03:32:01.944326+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"30'2","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:09.895065+0000","last_change":"2023-05-24T03:32:09.895117+0000","last_active":"2023-05-24T03:32:09.895065+0000","last_peered":"2023-05-24T03:32:09.895065+0000","last_clean":"2023-05-24T03:32:09.895065+0000","last_became_active":"2023-05-24T03:29:44.089340+0000","last_became_peered":"2023-05-24T03:29:44.089340+0000","last_unstale":"2023-05-24T03:32:09.895065+0000","last_undegraded":"2023-05-24T03:32:09.895065+0000","last_fullsized":"2023-05-24T03:32:09.895065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2023-05-24T03:32:09.894975+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2023-05-24T03:32:09.894975+0000","last_clean_scrub_stamp":"2023-05-24T03:32:09.894975+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:10:59.516332+0000","scrub_duration":0.0029320729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"30'29","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.748054+0000","last_change":"2023-05-24T03:29:44.498089+0000","last_active":"2023-05-24T03:32:00.748054+0000","last_peered":"2023-05-24T03:32:00.748054+0000","last_clean":"2023-05-24T03:32:00.748054+0000","last_became_active":"2023-05-24T03:29:44.497795+0000","last_became_peered":"2023-05-24T03:29:44.497795+0000","last_unstale":"2023-05-24T03:32:00.748054+0000","last_undegraded":"2023-05-24T03:32:00.748054+0000","last_fullsized":"2023-05-24T03:32:00.748054+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"30'418","reported_seq":437,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:01.943276+0000","last_change":"2023-05-24T03:29:48.521349+0000","last_active":"2023-05-24T03:32:01.943276+0000","last_peered":"2023-05-24T03:32:01.943276+0000","last_clean":"2023-05-24T03:32:01.943276+0000","last_became_active":"2023-05-24T03:29:48.520899+0000","last_became_peered":"2023-05-24T03:29:48.520899+0000","last_unstale":"2023-05-24T03:32:01.943276+0000","last_undegraded":"2023-05-24T03:32:01.943276+0000","last_fullsized":"2023-05-24T03:32:01.943276+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"30'3","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:22.959017+0000","last_change":"2023-05-24T03:32:22.959064+0000","last_active":"2023-05-24T03:32:22.959017+0000","last_peered":"2023-05-24T03:32:22.959017+0000","last_clean":"2023-05-24T03:32:22.959017+0000","last_became_active":"2023-05-24T03:29:44.086054+0000","last_became_peered":"2023-05-24T03:29:44.086054+0000","last_unstale":"2023-05-24T03:32:22.959017+0000","last_undegraded":"2023-05-24T03:32:22.959017+0000","last_fullsized":"2023-05-24T03:32:22.959017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2023-05-24T03:32:22.958938+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2023-05-24T03:32:22.958938+0000","last_clean_scrub_stamp":"2023-05-24T03:32:22.958938+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:33:49.647593+0000","scrub_duration":0.0025152360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"30'32","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.739820+0000","last_change":"2023-05-24T03:30:25.949869+0000","last_active":"2023-05-24T03:32:00.739820+0000","last_peered":"2023-05-24T03:32:00.739820+0000","last_clean":"2023-05-24T03:32:00.739820+0000","last_became_active":"2023-05-24T03:30:25.949461+0000","last_became_peered":"2023-05-24T03:30:25.949461+0000","last_unstale":"2023-05-24T03:32:00.739820+0000","last_undegraded":"2023-05-24T03:32:00.739820+0000","last_fullsized":"2023-05-24T03:32:00.739820+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"30'464","reported_seq":483,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:05.607254+0000","last_change":"2023-05-24T03:29:48.522128+0000","last_active":"2023-05-24T03:32:05.607254+0000","last_peered":"2023-05-24T03:32:05.607254+0000","last_clean":"2023-05-24T03:32:05.607254+0000","last_became_active":"2023-05-24T03:29:48.521729+0000","last_became_peered":"2023-05-24T03:29:48.521729+0000","last_unstale":"2023-05-24T03:32:05.607254+0000","last_undegraded":"2023-05-24T03:32:05.607254+0000","last_fullsized":"2023-05-24T03:32:05.607254+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:01.944425+0000","last_change":"2023-05-24T03:29:44.088761+0000","last_active":"2023-05-24T03:32:01.944425+0000","last_peered":"2023-05-24T03:32:01.944425+0000","last_clean":"2023-05-24T03:32:01.944425+0000","last_became_active":"2023-05-24T03:29:44.088459+0000","last_became_peered":"2023-05-24T03:29:44.088459+0000","last_unstale":"2023-05-24T03:32:01.944425+0000","last_undegraded":"2023-05-24T03:32:01.944425+0000","last_fullsized":"2023-05-24T03:32:01.944425+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"30'32","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.747188+0000","last_change":"2023-05-24T03:29:44.490252+0000","last_active":"2023-05-24T03:32:00.747188+0000","last_peered":"2023-05-24T03:32:00.747188+0000","last_clean":"2023-05-24T03:32:00.747188+0000","last_became_active":"2023-05-24T03:29:44.489975+0000","last_became_peered":"2023-05-24T03:29:44.489975+0000","last_unstale":"2023-05-24T03:32:00.747188+0000","last_undegraded":"2023-05-24T03:32:00.747188+0000","last_fullsized":"2023-05-24T03:32:00.747188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"30'485","reported_seq":504,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:01.943319+0000","last_change":"2023-05-24T03:29:48.523911+0000","last_active":"2023-05-24T03:32:01.943319+0000","last_peered":"2023-05-24T03:32:01.943319+0000","last_clean":"2023-05-24T03:32:01.943319+0000","last_became_active":"2023-05-24T03:29:48.523545+0000","last_became_peered":"2023-05-24T03:29:48.523545+0000","last_unstale":"2023-05-24T03:32:01.943319+0000","last_undegraded":"2023-05-24T03:32:01.943319+0000","last_fullsized":"2023-05-24T03:32:01.943319+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"30'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:26.389741+0000","last_change":"2023-05-24T03:32:26.389791+0000","last_active":"2023-05-24T03:32:26.389741+0000","last_peered":"2023-05-24T03:32:26.389741+0000","last_clean":"2023-05-24T03:32:26.389741+0000","last_became_active":"2023-05-24T03:29:44.090887+0000","last_became_peered":"2023-05-24T03:29:44.090887+0000","last_unstale":"2023-05-24T03:32:26.389741+0000","last_undegraded":"2023-05-24T03:32:26.389741+0000","last_fullsized":"2023-05-24T03:32:26.389741+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-05-24T03:32:26.389638+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-05-24T03:32:26.389638+0000","last_clean_scrub_stamp":"2023-05-24T03:32:26.389638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:24:45.305781+0000","scrub_duration":0.0020604579999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"30'32","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:01.944316+0000","last_change":"2023-05-24T03:29:44.502570+0000","last_active":"2023-05-24T03:32:01.944316+0000","last_peered":"2023-05-24T03:32:01.944316+0000","last_clean":"2023-05-24T03:32:01.944316+0000","last_became_active":"2023-05-24T03:29:44.502286+0000","last_became_peered":"2023-05-24T03:29:44.502286+0000","last_unstale":"2023-05-24T03:32:01.944316+0000","last_undegraded":"2023-05-24T03:32:01.944316+0000","last_fullsized":"2023-05-24T03:32:01.944316+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"30'465","reported_seq":492,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:22.800201+0000","last_change":"2023-05-24T03:32:22.800291+0000","last_active":"2023-05-24T03:32:22.800201+0000","last_peered":"2023-05-24T03:32:22.800201+0000","last_clean":"2023-05-24T03:32:22.800201+0000","last_became_active":"2023-05-24T03:29:48.520960+0000","last_became_peered":"2023-05-24T03:29:48.520960+0000","last_unstale":"2023-05-24T03:32:22.800201+0000","last_undegraded":"2023-05-24T03:32:22.800201+0000","last_fullsized":"2023-05-24T03:32:22.800201+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'465","last_scrub_stamp":"2023-05-24T03:32:22.800112+0000","last_deep_scrub":"30'465","last_deep_scrub_stamp":"2023-05-24T03:32:22.800112+0000","last_clean_scrub_stamp":"2023-05-24T03:32:22.800112+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:12:49.176537+0000","scrub_duration":0.002159808,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"30'4","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:01.928272+0000","last_change":"2023-05-24T03:29:44.088157+0000","last_active":"2023-05-24T03:32:01.928272+0000","last_peered":"2023-05-24T03:32:01.928272+0000","last_clean":"2023-05-24T03:32:01.928272+0000","last_became_active":"2023-05-24T03:29:44.087869+0000","last_became_peered":"2023-05-24T03:29:44.087869+0000","last_unstale":"2023-05-24T03:32:01.928272+0000","last_undegraded":"2023-05-24T03:32:01.928272+0000","last_fullsized":"2023-05-24T03:32:01.928272+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"30'27","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:01.934141+0000","last_change":"2023-05-24T03:29:44.501176+0000","last_active":"2023-05-24T03:32:01.934141+0000","last_peered":"2023-05-24T03:32:01.934141+0000","last_clean":"2023-05-24T03:32:01.934141+0000","last_became_active":"2023-05-24T03:29:44.499700+0000","last_became_peered":"2023-05-24T03:29:44.499700+0000","last_unstale":"2023-05-24T03:32:01.934141+0000","last_undegraded":"2023-05-24T03:32:01.934141+0000","last_fullsized":"2023-05-24T03:32:01.934141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"30'454","reported_seq":473,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:05.111223+0000","last_change":"2023-05-24T03:29:48.522778+0000","last_active":"2023-05-24T03:32:05.111223+0000","last_peered":"2023-05-24T03:32:05.111223+0000","last_clean":"2023-05-24T03:32:05.111223+0000","last_became_active":"2023-05-24T03:29:48.522104+0000","last_became_peered":"2023-05-24T03:29:48.522104+0000","last_unstale":"2023-05-24T03:32:05.111223+0000","last_undegraded":"2023-05-24T03:32:05.111223+0000","last_fullsized":"2023-05-24T03:32:05.111223+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"30'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:18.901139+0000","last_change":"2023-05-24T03:32:18.901206+0000","last_active":"2023-05-24T03:32:18.901139+0000","last_peered":"2023-05-24T03:32:18.901139+0000","last_clean":"2023-05-24T03:32:18.901139+0000","last_became_active":"2023-05-24T03:29:44.084894+0000","last_became_peered":"2023-05-24T03:29:44.084894+0000","last_unstale":"2023-05-24T03:32:18.901139+0000","last_undegraded":"2023-05-24T03:32:18.901139+0000","last_fullsized":"2023-05-24T03:32:18.901139+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-05-24T03:32:18.900978+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-05-24T03:32:18.900978+0000","last_clean_scrub_stamp":"2023-05-24T03:32:18.900978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:46:00.915679+0000","scrub_duration":0.001606307,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"30'30","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:11.477819+0000","last_change":"2023-05-24T03:32:11.477870+0000","last_active":"2023-05-24T03:32:11.477819+0000","last_peered":"2023-05-24T03:32:11.477819+0000","last_clean":"2023-05-24T03:32:11.477819+0000","last_became_active":"2023-05-24T03:29:44.492462+0000","last_became_peered":"2023-05-24T03:29:44.492462+0000","last_unstale":"2023-05-24T03:32:11.477819+0000","last_undegraded":"2023-05-24T03:32:11.477819+0000","last_fullsized":"2023-05-24T03:32:11.477819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2023-05-24T03:32:11.477715+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2023-05-24T03:32:11.477715+0000","last_clean_scrub_stamp":"2023-05-24T03:32:11.477715+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:30:24.753635+0000","scrub_duration":0.0019852670000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'486","reported_seq":505,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:06.929077+0000","last_change":"2023-05-24T03:29:48.524960+0000","last_active":"2023-05-24T03:32:06.929077+0000","last_peered":"2023-05-24T03:32:06.929077+0000","last_clean":"2023-05-24T03:32:06.929077+0000","last_became_active":"2023-05-24T03:29:48.524023+0000","last_became_peered":"2023-05-24T03:29:48.524023+0000","last_unstale":"2023-05-24T03:32:06.929077+0000","last_undegraded":"2023-05-24T03:32:06.929077+0000","last_fullsized":"2023-05-24T03:32:06.929077+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:56.933401+0000","last_change":"2023-05-24T03:29:44.082700+0000","last_active":"2023-05-24T03:31:56.933401+0000","last_peered":"2023-05-24T03:31:56.933401+0000","last_clean":"2023-05-24T03:31:56.933401+0000","last_became_active":"2023-05-24T03:29:44.082382+0000","last_became_peered":"2023-05-24T03:29:44.082382+0000","last_unstale":"2023-05-24T03:31:56.933401+0000","last_undegraded":"2023-05-24T03:31:56.933401+0000","last_fullsized":"2023-05-24T03:31:56.933401+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"30'17","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:01.934217+0000","last_change":"2023-05-24T03:29:44.501409+0000","last_active":"2023-05-24T03:32:01.934217+0000","last_peered":"2023-05-24T03:32:01.934217+0000","last_clean":"2023-05-24T03:32:01.934217+0000","last_became_active":"2023-05-24T03:29:44.501080+0000","last_became_peered":"2023-05-24T03:29:44.501080+0000","last_unstale":"2023-05-24T03:32:01.934217+0000","last_undegraded":"2023-05-24T03:32:01.934217+0000","last_fullsized":"2023-05-24T03:32:01.934217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"30'494","reported_seq":513,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:06.604511+0000","last_change":"2023-05-24T03:29:48.519383+0000","last_active":"2023-05-24T03:32:06.604511+0000","last_peered":"2023-05-24T03:32:06.604511+0000","last_clean":"2023-05-24T03:32:06.604511+0000","last_became_active":"2023-05-24T03:29:48.519046+0000","last_became_peered":"2023-05-24T03:29:48.519046+0000","last_unstale":"2023-05-24T03:32:06.604511+0000","last_undegraded":"2023-05-24T03:32:06.604511+0000","last_fullsized":"2023-05-24T03:32:06.604511+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:23.923628+0000","last_change":"2023-05-24T03:32:23.923670+0000","last_active":"2023-05-24T03:32:23.923628+0000","last_peered":"2023-05-24T03:32:23.923628+0000","last_clean":"2023-05-24T03:32:23.923628+0000","last_became_active":"2023-05-24T03:29:44.085420+0000","last_became_peered":"2023-05-24T03:29:44.085420+0000","last_unstale":"2023-05-24T03:32:23.923628+0000","last_undegraded":"2023-05-24T03:32:23.923628+0000","last_fullsized":"2023-05-24T03:32:23.923628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:23.923533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:23.923533+0000","last_clean_scrub_stamp":"2023-05-24T03:32:23.923533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:07:31.781443+0000","scrub_duration":0.0013943619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"30'28","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:01.962292+0000","last_change":"2023-05-24T03:29:44.491345+0000","last_active":"2023-05-24T03:32:01.962292+0000","last_peered":"2023-05-24T03:32:01.962292+0000","last_clean":"2023-05-24T03:32:01.962292+0000","last_became_active":"2023-05-24T03:29:44.491089+0000","last_became_peered":"2023-05-24T03:29:44.491089+0000","last_unstale":"2023-05-24T03:32:01.962292+0000","last_undegraded":"2023-05-24T03:32:01.962292+0000","last_fullsized":"2023-05-24T03:32:01.962292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"30'503","reported_seq":522,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:01.666282+0000","last_change":"2023-05-24T03:29:48.530105+0000","last_active":"2023-05-24T03:32:01.666282+0000","last_peered":"2023-05-24T03:32:01.666282+0000","last_clean":"2023-05-24T03:32:01.666282+0000","last_became_active":"2023-05-24T03:29:48.529157+0000","last_became_peered":"2023-05-24T03:29:48.529157+0000","last_unstale":"2023-05-24T03:32:01.666282+0000","last_undegraded":"2023-05-24T03:32:01.666282+0000","last_fullsized":"2023-05-24T03:32:01.666282+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:16.946886+0000","last_change":"2023-05-24T03:32:16.946931+0000","last_active":"2023-05-24T03:32:16.946886+0000","last_peered":"2023-05-24T03:32:16.946886+0000","last_clean":"2023-05-24T03:32:16.946886+0000","last_became_active":"2023-05-24T03:29:39.142867+0000","last_became_peered":"2023-05-24T03:29:39.142867+0000","last_unstale":"2023-05-24T03:32:16.946886+0000","last_undegraded":"2023-05-24T03:32:16.946886+0000","last_fullsized":"2023-05-24T03:32:16.946886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:16.946787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:16.946787+0000","last_clean_scrub_stamp":"2023-05-24T03:32:16.946787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:05:40.162544+0000","scrub_duration":0.0014754880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"30'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:24.411219+0000","last_change":"2023-05-24T03:32:24.411266+0000","last_active":"2023-05-24T03:32:24.411219+0000","last_peered":"2023-05-24T03:32:24.411219+0000","last_clean":"2023-05-24T03:32:24.411219+0000","last_became_active":"2023-05-24T03:29:44.087475+0000","last_became_peered":"2023-05-24T03:29:44.087475+0000","last_unstale":"2023-05-24T03:32:24.411219+0000","last_undegraded":"2023-05-24T03:32:24.411219+0000","last_fullsized":"2023-05-24T03:32:24.411219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-05-24T03:32:24.411126+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-05-24T03:32:24.411126+0000","last_clean_scrub_stamp":"2023-05-24T03:32:24.411126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:07:32.269036+0000","scrub_duration":0.0017507200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"30'30","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.749680+0000","last_change":"2023-05-24T03:29:44.497235+0000","last_active":"2023-05-24T03:32:00.749680+0000","last_peered":"2023-05-24T03:32:00.749680+0000","last_clean":"2023-05-24T03:32:00.749680+0000","last_became_active":"2023-05-24T03:29:44.497015+0000","last_became_peered":"2023-05-24T03:29:44.497015+0000","last_unstale":"2023-05-24T03:32:00.749680+0000","last_undegraded":"2023-05-24T03:32:00.749680+0000","last_fullsized":"2023-05-24T03:32:00.749680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"30'446","reported_seq":465,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:01.641624+0000","last_change":"2023-05-24T03:29:48.527805+0000","last_active":"2023-05-24T03:32:01.641624+0000","last_peered":"2023-05-24T03:32:01.641624+0000","last_clean":"2023-05-24T03:32:01.641624+0000","last_became_active":"2023-05-24T03:29:48.527010+0000","last_became_peered":"2023-05-24T03:29:48.527010+0000","last_unstale":"2023-05-24T03:32:01.641624+0000","last_undegraded":"2023-05-24T03:32:01.641624+0000","last_fullsized":"2023-05-24T03:32:01.641624+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:16.419663+0000","last_change":"2023-05-24T03:32:16.419711+0000","last_active":"2023-05-24T03:32:16.419663+0000","last_peered":"2023-05-24T03:32:16.419663+0000","last_clean":"2023-05-24T03:32:16.419663+0000","last_became_active":"2023-05-24T03:29:39.048141+0000","last_became_peered":"2023-05-24T03:29:39.048141+0000","last_unstale":"2023-05-24T03:32:16.419663+0000","last_undegraded":"2023-05-24T03:32:16.419663+0000","last_fullsized":"2023-05-24T03:32:16.419663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:16.419576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:16.419576+0000","last_clean_scrub_stamp":"2023-05-24T03:32:16.419576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:04:44.737412+0000","scrub_duration":0.0017607219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:51.932727+0000","last_change":"2023-05-24T03:29:44.085282+0000","last_active":"2023-05-24T03:31:51.932727+0000","last_peered":"2023-05-24T03:31:51.932727+0000","last_clean":"2023-05-24T03:31:51.932727+0000","last_became_active":"2023-05-24T03:29:44.084944+0000","last_became_peered":"2023-05-24T03:29:44.084944+0000","last_unstale":"2023-05-24T03:31:51.932727+0000","last_undegraded":"2023-05-24T03:31:51.932727+0000","last_fullsized":"2023-05-24T03:31:51.932727+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"30'30","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.749005+0000","last_change":"2023-05-24T03:29:44.483553+0000","last_active":"2023-05-24T03:32:00.749005+0000","last_peered":"2023-05-24T03:32:00.749005+0000","last_clean":"2023-05-24T03:32:00.749005+0000","last_became_active":"2023-05-24T03:29:44.483134+0000","last_became_peered":"2023-05-24T03:29:44.483134+0000","last_unstale":"2023-05-24T03:32:00.749005+0000","last_undegraded":"2023-05-24T03:32:00.749005+0000","last_fullsized":"2023-05-24T03:32:00.749005+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'483","reported_seq":510,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:23.782504+0000","last_change":"2023-05-24T03:32:23.782578+0000","last_active":"2023-05-24T03:32:23.782504+0000","last_peered":"2023-05-24T03:32:23.782504+0000","last_clean":"2023-05-24T03:32:23.782504+0000","last_became_active":"2023-05-24T03:29:48.518546+0000","last_became_peered":"2023-05-24T03:29:48.518546+0000","last_unstale":"2023-05-24T03:32:23.782504+0000","last_undegraded":"2023-05-24T03:32:23.782504+0000","last_fullsized":"2023-05-24T03:32:23.782504+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'483","last_scrub_stamp":"2023-05-24T03:32:23.782396+0000","last_deep_scrub":"30'483","last_deep_scrub_stamp":"2023-05-24T03:32:23.782396+0000","last_clean_scrub_stamp":"2023-05-24T03:32:23.782396+0000","objects_scrubbed":2,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:25:09.865806+0000","scrub_duration":0.0096269460000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:07.643826+0000","last_change":"2023-05-24T03:32:07.643860+0000","last_active":"2023-05-24T03:32:07.643826+0000","last_peered":"2023-05-24T03:32:07.643826+0000","last_clean":"2023-05-24T03:32:07.643826+0000","last_became_active":"2023-05-24T03:29:39.310070+0000","last_became_peered":"2023-05-24T03:29:39.310070+0000","last_unstale":"2023-05-24T03:32:07.643826+0000","last_undegraded":"2023-05-24T03:32:07.643826+0000","last_fullsized":"2023-05-24T03:32:07.643826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:07.643745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:07.643745+0000","last_clean_scrub_stamp":"2023-05-24T03:32:07.643745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:58:52.005449+0000","scrub_duration":0.0012050990000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:19.948337+0000","last_change":"2023-05-24T03:32:19.948384+0000","last_active":"2023-05-24T03:32:19.948337+0000","last_peered":"2023-05-24T03:32:19.948337+0000","last_clean":"2023-05-24T03:32:19.948337+0000","last_became_active":"2023-05-24T03:29:44.074551+0000","last_became_peered":"2023-05-24T03:29:44.074551+0000","last_unstale":"2023-05-24T03:32:19.948337+0000","last_undegraded":"2023-05-24T03:32:19.948337+0000","last_fullsized":"2023-05-24T03:32:19.948337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:19.948200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:19.948200+0000","last_clean_scrub_stamp":"2023-05-24T03:32:19.948200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:36:52.581352+0000","scrub_duration":0.0016279319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"30'29","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.746028+0000","last_change":"2023-05-24T03:29:44.496225+0000","last_active":"2023-05-24T03:32:00.746028+0000","last_peered":"2023-05-24T03:32:00.746028+0000","last_clean":"2023-05-24T03:32:00.746028+0000","last_became_active":"2023-05-24T03:29:44.496030+0000","last_became_peered":"2023-05-24T03:29:44.496030+0000","last_unstale":"2023-05-24T03:32:00.746028+0000","last_undegraded":"2023-05-24T03:32:00.746028+0000","last_fullsized":"2023-05-24T03:32:00.746028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"30'473","reported_seq":492,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:01.660137+0000","last_change":"2023-05-24T03:29:48.523816+0000","last_active":"2023-05-24T03:32:01.660137+0000","last_peered":"2023-05-24T03:32:01.660137+0000","last_clean":"2023-05-24T03:32:01.660137+0000","last_became_active":"2023-05-24T03:29:48.523380+0000","last_became_peered":"2023-05-24T03:29:48.523380+0000","last_unstale":"2023-05-24T03:32:01.660137+0000","last_undegraded":"2023-05-24T03:32:01.660137+0000","last_fullsized":"2023-05-24T03:32:01.660137+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:22.404970+0000","last_change":"2023-05-24T03:32:22.405017+0000","last_active":"2023-05-24T03:32:22.404970+0000","last_peered":"2023-05-24T03:32:22.404970+0000","last_clean":"2023-05-24T03:32:22.404970+0000","last_became_active":"2023-05-24T03:29:39.050751+0000","last_became_peered":"2023-05-24T03:29:39.050751+0000","last_unstale":"2023-05-24T03:32:22.404970+0000","last_undegraded":"2023-05-24T03:32:22.404970+0000","last_fullsized":"2023-05-24T03:32:22.404970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:22.404884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:22.404884+0000","last_clean_scrub_stamp":"2023-05-24T03:32:22.404884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:59:23.041380+0000","scrub_duration":0.001963167,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"30'119","reported_seq":199,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:13.842759+0000","last_change":"2023-05-24T03:32:13.842821+0000","last_active":"2023-05-24T03:32:13.842759+0000","last_peered":"2023-05-24T03:32:13.842759+0000","last_clean":"2023-05-24T03:32:13.842759+0000","last_became_active":"2023-05-24T03:29:34.024728+0000","last_became_peered":"2023-05-24T03:29:34.024728+0000","last_unstale":"2023-05-24T03:32:13.842759+0000","last_undegraded":"2023-05-24T03:32:13.842759+0000","last_fullsized":"2023-05-24T03:32:13.842759+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'119","last_scrub_stamp":"2023-05-24T03:32:13.842676+0000","last_deep_scrub":"30'119","last_deep_scrub_stamp":"2023-05-24T03:32:13.842676+0000","last_clean_scrub_stamp":"2023-05-24T03:32:13.842676+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:42:28.083910+0000","scrub_duration":0.0058238170000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:22.880053+0000","last_change":"2023-05-24T03:32:22.880113+0000","last_active":"2023-05-24T03:32:22.880053+0000","last_peered":"2023-05-24T03:32:22.880053+0000","last_clean":"2023-05-24T03:32:22.880053+0000","last_became_active":"2023-05-24T03:29:44.086125+0000","last_became_peered":"2023-05-24T03:29:44.086125+0000","last_unstale":"2023-05-24T03:32:22.880053+0000","last_undegraded":"2023-05-24T03:32:22.880053+0000","last_fullsized":"2023-05-24T03:32:22.880053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:22.879929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:22.879929+0000","last_clean_scrub_stamp":"2023-05-24T03:32:22.879929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:00:18.800309+0000","scrub_duration":0.002203432,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:20.988892+0000","last_change":"2023-05-24T03:32:20.988943+0000","last_active":"2023-05-24T03:32:20.988892+0000","last_peered":"2023-05-24T03:32:20.988892+0000","last_clean":"2023-05-24T03:32:20.988892+0000","last_became_active":"2023-05-24T03:29:44.492375+0000","last_became_peered":"2023-05-24T03:29:44.492375+0000","last_unstale":"2023-05-24T03:32:20.988892+0000","last_undegraded":"2023-05-24T03:32:20.988892+0000","last_fullsized":"2023-05-24T03:32:20.988892+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-05-24T03:32:20.988784+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-05-24T03:32:20.988784+0000","last_clean_scrub_stamp":"2023-05-24T03:32:20.988784+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:25:07.072195+0000","scrub_duration":0.001550034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"30'444","reported_seq":463,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:01.928519+0000","last_change":"2023-05-24T03:29:48.525206+0000","last_active":"2023-05-24T03:32:01.928519+0000","last_peered":"2023-05-24T03:32:01.928519+0000","last_clean":"2023-05-24T03:32:01.928519+0000","last_became_active":"2023-05-24T03:29:48.524615+0000","last_became_peered":"2023-05-24T03:29:48.524615+0000","last_unstale":"2023-05-24T03:32:01.928519+0000","last_undegraded":"2023-05-24T03:32:01.928519+0000","last_fullsized":"2023-05-24T03:32:01.928519+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:14.823133+0000","last_change":"2023-05-24T03:32:14.823177+0000","last_active":"2023-05-24T03:32:14.823133+0000","last_peered":"2023-05-24T03:32:14.823133+0000","last_clean":"2023-05-24T03:32:14.823133+0000","last_became_active":"2023-05-24T03:29:39.053813+0000","last_became_peered":"2023-05-24T03:29:39.053813+0000","last_unstale":"2023-05-24T03:32:14.823133+0000","last_undegraded":"2023-05-24T03:32:14.823133+0000","last_fullsized":"2023-05-24T03:32:14.823133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:14.823047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:14.823047+0000","last_clean_scrub_stamp":"2023-05-24T03:32:14.823047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:39:26.760598+0000","scrub_duration":0.0020759749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"30'16","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:01.629615+0000","last_change":"2023-05-24T03:29:44.090147+0000","last_active":"2023-05-24T03:32:01.629615+0000","last_peered":"2023-05-24T03:32:01.629615+0000","last_clean":"2023-05-24T03:32:01.629615+0000","last_became_active":"2023-05-24T03:29:44.089943+0000","last_became_peered":"2023-05-24T03:29:44.089943+0000","last_unstale":"2023-05-24T03:32:01.629615+0000","last_undegraded":"2023-05-24T03:32:01.629615+0000","last_fullsized":"2023-05-24T03:32:01.629615+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7752,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":19,"num_write":15,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"30'28","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.748946+0000","last_change":"2023-05-24T03:29:44.498467+0000","last_active":"2023-05-24T03:32:00.748946+0000","last_peered":"2023-05-24T03:32:00.748946+0000","last_clean":"2023-05-24T03:32:00.748946+0000","last_became_active":"2023-05-24T03:29:44.498130+0000","last_became_peered":"2023-05-24T03:29:44.498130+0000","last_unstale":"2023-05-24T03:32:00.748946+0000","last_undegraded":"2023-05-24T03:32:00.748946+0000","last_fullsized":"2023-05-24T03:32:00.748946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"30'496","reported_seq":515,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:01.660295+0000","last_change":"2023-05-24T03:29:48.520034+0000","last_active":"2023-05-24T03:32:01.660295+0000","last_peered":"2023-05-24T03:32:01.660295+0000","last_clean":"2023-05-24T03:32:01.660295+0000","last_became_active":"2023-05-24T03:29:48.519673+0000","last_became_peered":"2023-05-24T03:29:48.519673+0000","last_unstale":"2023-05-24T03:32:01.660295+0000","last_undegraded":"2023-05-24T03:32:01.660295+0000","last_fullsized":"2023-05-24T03:32:01.660295+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:16.859220+0000","last_change":"2023-05-24T03:32:16.859267+0000","last_active":"2023-05-24T03:32:16.859220+0000","last_peered":"2023-05-24T03:32:16.859220+0000","last_clean":"2023-05-24T03:32:16.859220+0000","last_became_active":"2023-05-24T03:29:39.142949+0000","last_became_peered":"2023-05-24T03:29:39.142949+0000","last_unstale":"2023-05-24T03:32:16.859220+0000","last_undegraded":"2023-05-24T03:32:16.859220+0000","last_fullsized":"2023-05-24T03:32:16.859220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:16.859110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:16.859110+0000","last_clean_scrub_stamp":"2023-05-24T03:32:16.859110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:36:49.492263+0000","scrub_duration":0.0019863950000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"30'2","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:25.922071+0000","last_change":"2023-05-24T03:32:25.922120+0000","last_active":"2023-05-24T03:32:25.922071+0000","last_peered":"2023-05-24T03:32:25.922071+0000","last_clean":"2023-05-24T03:32:25.922071+0000","last_became_active":"2023-05-24T03:29:44.074374+0000","last_became_peered":"2023-05-24T03:29:44.074374+0000","last_unstale":"2023-05-24T03:32:25.922071+0000","last_undegraded":"2023-05-24T03:32:25.922071+0000","last_fullsized":"2023-05-24T03:32:25.922071+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2023-05-24T03:32:25.921971+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2023-05-24T03:32:25.921971+0000","last_clean_scrub_stamp":"2023-05-24T03:32:25.921971+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:33:52.610626+0000","scrub_duration":0.001416947,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"30'34","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.738551+0000","last_change":"2023-05-24T03:29:44.499979+0000","last_active":"2023-05-24T03:32:00.738551+0000","last_peered":"2023-05-24T03:32:00.738551+0000","last_clean":"2023-05-24T03:32:00.738551+0000","last_became_active":"2023-05-24T03:29:44.499768+0000","last_became_peered":"2023-05-24T03:29:44.499768+0000","last_unstale":"2023-05-24T03:32:00.738551+0000","last_undegraded":"2023-05-24T03:32:00.738551+0000","last_fullsized":"2023-05-24T03:32:00.738551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"30'483","reported_seq":502,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:01.656979+0000","last_change":"2023-05-24T03:29:48.530781+0000","last_active":"2023-05-24T03:32:01.656979+0000","last_peered":"2023-05-24T03:32:01.656979+0000","last_clean":"2023-05-24T03:32:01.656979+0000","last_became_active":"2023-05-24T03:29:48.530401+0000","last_became_peered":"2023-05-24T03:29:48.530401+0000","last_unstale":"2023-05-24T03:32:01.656979+0000","last_undegraded":"2023-05-24T03:32:01.656979+0000","last_fullsized":"2023-05-24T03:32:01.656979+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"30'4","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:25.935295+0000","last_change":"2023-05-24T03:32:25.935385+0000","last_active":"2023-05-24T03:32:25.935295+0000","last_peered":"2023-05-24T03:32:25.935295+0000","last_clean":"2023-05-24T03:32:25.935295+0000","last_became_active":"2023-05-24T03:29:44.083929+0000","last_became_peered":"2023-05-24T03:29:44.083929+0000","last_unstale":"2023-05-24T03:32:25.935295+0000","last_undegraded":"2023-05-24T03:32:25.935295+0000","last_fullsized":"2023-05-24T03:32:25.935295+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2023-05-24T03:32:25.935195+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2023-05-24T03:32:25.935195+0000","last_clean_scrub_stamp":"2023-05-24T03:32:25.935195+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:24:44.851338+0000","scrub_duration":0.0036091059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:17.913709+0000","last_change":"2023-05-24T03:32:17.913792+0000","last_active":"2023-05-24T03:32:17.913709+0000","last_peered":"2023-05-24T03:32:17.913709+0000","last_clean":"2023-05-24T03:32:17.913709+0000","last_became_active":"2023-05-24T03:29:39.045543+0000","last_became_peered":"2023-05-24T03:29:39.045543+0000","last_unstale":"2023-05-24T03:32:17.913709+0000","last_undegraded":"2023-05-24T03:32:17.913709+0000","last_fullsized":"2023-05-24T03:32:17.913709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:17.913581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:17.913581+0000","last_clean_scrub_stamp":"2023-05-24T03:32:17.913581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:39:29.851131+0000","scrub_duration":0.0019810409999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"30'25","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.750661+0000","last_change":"2023-05-24T03:29:44.496106+0000","last_active":"2023-05-24T03:32:00.750661+0000","last_peered":"2023-05-24T03:32:00.750661+0000","last_clean":"2023-05-24T03:32:00.750661+0000","last_became_active":"2023-05-24T03:29:44.495816+0000","last_became_peered":"2023-05-24T03:29:44.495816+0000","last_unstale":"2023-05-24T03:32:00.750661+0000","last_undegraded":"2023-05-24T03:32:00.750661+0000","last_fullsized":"2023-05-24T03:32:00.750661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"30'447","reported_seq":466,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:01.659996+0000","last_change":"2023-05-24T03:29:48.527602+0000","last_active":"2023-05-24T03:32:01.659996+0000","last_peered":"2023-05-24T03:32:01.659996+0000","last_clean":"2023-05-24T03:32:01.659996+0000","last_became_active":"2023-05-24T03:29:48.527196+0000","last_became_peered":"2023-05-24T03:29:48.527196+0000","last_unstale":"2023-05-24T03:32:01.659996+0000","last_undegraded":"2023-05-24T03:32:01.659996+0000","last_fullsized":"2023-05-24T03:32:01.659996+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:07.895608+0000","last_change":"2023-05-24T03:32:07.895654+0000","last_active":"2023-05-24T03:32:07.895608+0000","last_peered":"2023-05-24T03:32:07.895608+0000","last_clean":"2023-05-24T03:32:07.895608+0000","last_became_active":"2023-05-24T03:29:39.046149+0000","last_became_peered":"2023-05-24T03:29:39.046149+0000","last_unstale":"2023-05-24T03:32:07.895608+0000","last_undegraded":"2023-05-24T03:32:07.895608+0000","last_fullsized":"2023-05-24T03:32:07.895608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:07.895507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:07.895507+0000","last_clean_scrub_stamp":"2023-05-24T03:32:07.895507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:19:25.177961+0000","scrub_duration":0.0013301140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"30'12","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:22.444476+0000","last_change":"2023-05-24T03:32:22.444544+0000","last_active":"2023-05-24T03:32:22.444476+0000","last_peered":"2023-05-24T03:32:22.444476+0000","last_clean":"2023-05-24T03:32:22.444476+0000","last_became_active":"2023-05-24T03:29:44.088495+0000","last_became_peered":"2023-05-24T03:29:44.088495+0000","last_unstale":"2023-05-24T03:32:22.444476+0000","last_undegraded":"2023-05-24T03:32:22.444476+0000","last_fullsized":"2023-05-24T03:32:22.444476+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'12","last_scrub_stamp":"2023-05-24T03:32:22.444366+0000","last_deep_scrub":"30'12","last_deep_scrub_stamp":"2023-05-24T03:32:22.444366+0000","last_clean_scrub_stamp":"2023-05-24T03:32:22.444366+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:33:49.133021+0000","scrub_duration":0.0019648030000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"30'21","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.739723+0000","last_change":"2023-05-24T03:29:44.496966+0000","last_active":"2023-05-24T03:32:00.739723+0000","last_peered":"2023-05-24T03:32:00.739723+0000","last_clean":"2023-05-24T03:32:00.739723+0000","last_became_active":"2023-05-24T03:29:44.496597+0000","last_became_peered":"2023-05-24T03:29:44.496597+0000","last_unstale":"2023-05-24T03:32:00.739723+0000","last_undegraded":"2023-05-24T03:32:00.739723+0000","last_fullsized":"2023-05-24T03:32:00.739723+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"30'469","reported_seq":488,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:05.111203+0000","last_change":"2023-05-24T03:29:48.524541+0000","last_active":"2023-05-24T03:32:05.111203+0000","last_peered":"2023-05-24T03:32:05.111203+0000","last_clean":"2023-05-24T03:32:05.111203+0000","last_became_active":"2023-05-24T03:29:48.524170+0000","last_became_peered":"2023-05-24T03:29:48.524170+0000","last_unstale":"2023-05-24T03:32:05.111203+0000","last_undegraded":"2023-05-24T03:32:05.111203+0000","last_fullsized":"2023-05-24T03:32:05.111203+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:04.613076+0000","last_change":"2023-05-24T03:29:44.090259+0000","last_active":"2023-05-24T03:32:04.613076+0000","last_peered":"2023-05-24T03:32:04.613076+0000","last_clean":"2023-05-24T03:32:04.613076+0000","last_became_active":"2023-05-24T03:29:44.089993+0000","last_became_peered":"2023-05-24T03:29:44.089993+0000","last_unstale":"2023-05-24T03:32:04.613076+0000","last_undegraded":"2023-05-24T03:32:04.613076+0000","last_fullsized":"2023-05-24T03:32:04.613076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:11.669985+0000","last_change":"2023-05-24T03:32:11.669985+0000","last_active":"2023-05-24T03:32:11.669985+0000","last_peered":"2023-05-24T03:32:11.669985+0000","last_clean":"2023-05-24T03:32:11.669985+0000","last_became_active":"2023-05-24T03:29:44.481655+0000","last_became_peered":"2023-05-24T03:29:44.481655+0000","last_unstale":"2023-05-24T03:32:11.669985+0000","last_undegraded":"2023-05-24T03:32:11.669985+0000","last_fullsized":"2023-05-24T03:32:11.669985+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-05-24T03:32:11.669801+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-05-24T03:32:11.669801+0000","last_clean_scrub_stamp":"2023-05-24T03:32:11.669801+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:19:28.952256+0000","scrub_duration":0.0015085610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"30'475","reported_seq":494,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:08.096199+0000","last_change":"2023-05-24T03:29:48.516800+0000","last_active":"2023-05-24T03:32:08.096199+0000","last_peered":"2023-05-24T03:32:08.096199+0000","last_clean":"2023-05-24T03:32:08.096199+0000","last_became_active":"2023-05-24T03:29:48.516366+0000","last_became_peered":"2023-05-24T03:29:48.516366+0000","last_unstale":"2023-05-24T03:32:08.096199+0000","last_undegraded":"2023-05-24T03:32:08.096199+0000","last_fullsized":"2023-05-24T03:32:08.096199+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:07.101496+0000","last_change":"2023-05-24T03:29:44.094179+0000","last_active":"2023-05-24T03:32:07.101496+0000","last_peered":"2023-05-24T03:32:07.101496+0000","last_clean":"2023-05-24T03:32:07.101496+0000","last_became_active":"2023-05-24T03:29:44.093909+0000","last_became_peered":"2023-05-24T03:29:44.093909+0000","last_unstale":"2023-05-24T03:32:07.101496+0000","last_undegraded":"2023-05-24T03:32:07.101496+0000","last_fullsized":"2023-05-24T03:32:07.101496+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"30'24","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:07.504564+0000","last_change":"2023-05-24T03:32:07.504564+0000","last_active":"2023-05-24T03:32:07.504564+0000","last_peered":"2023-05-24T03:32:07.504564+0000","last_clean":"2023-05-24T03:32:07.504564+0000","last_became_active":"2023-05-24T03:29:44.496679+0000","last_became_peered":"2023-05-24T03:29:44.496679+0000","last_unstale":"2023-05-24T03:32:07.504564+0000","last_undegraded":"2023-05-24T03:32:07.504564+0000","last_fullsized":"2023-05-24T03:32:07.504564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2023-05-24T03:32:07.504421+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2023-05-24T03:32:07.504421+0000","last_clean_scrub_stamp":"2023-05-24T03:32:07.504421+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:39:43.529482+0000","scrub_duration":0.001971338,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"30'459","reported_seq":478,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:07.101578+0000","last_change":"2023-05-24T03:29:48.529231+0000","last_active":"2023-05-24T03:32:07.101578+0000","last_peered":"2023-05-24T03:32:07.101578+0000","last_clean":"2023-05-24T03:32:07.101578+0000","last_became_active":"2023-05-24T03:29:48.528862+0000","last_became_peered":"2023-05-24T03:29:48.528862+0000","last_unstale":"2023-05-24T03:32:07.101578+0000","last_undegraded":"2023-05-24T03:32:07.101578+0000","last_fullsized":"2023-05-24T03:32:07.101578+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"30'4","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:23.397701+0000","last_change":"2023-05-24T03:32:23.397749+0000","last_active":"2023-05-24T03:32:23.397701+0000","last_peered":"2023-05-24T03:32:23.397701+0000","last_clean":"2023-05-24T03:32:23.397701+0000","last_became_active":"2023-05-24T03:29:44.089949+0000","last_became_peered":"2023-05-24T03:29:44.089949+0000","last_unstale":"2023-05-24T03:32:23.397701+0000","last_undegraded":"2023-05-24T03:32:23.397701+0000","last_fullsized":"2023-05-24T03:32:23.397701+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2023-05-24T03:32:23.397608+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2023-05-24T03:32:23.397608+0000","last_clean_scrub_stamp":"2023-05-24T03:32:23.397608+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:00:19.317988+0000","scrub_duration":0.002711855,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'23","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:06.604416+0000","last_change":"2023-05-24T03:29:44.498632+0000","last_active":"2023-05-24T03:32:06.604416+0000","last_peered":"2023-05-24T03:32:06.604416+0000","last_clean":"2023-05-24T03:32:06.604416+0000","last_became_active":"2023-05-24T03:29:44.498350+0000","last_became_peered":"2023-05-24T03:29:44.498350+0000","last_unstale":"2023-05-24T03:32:06.604416+0000","last_undegraded":"2023-05-24T03:32:06.604416+0000","last_fullsized":"2023-05-24T03:32:06.604416+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"30'482","reported_seq":501,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:06.604582+0000","last_change":"2023-05-24T03:29:48.523434+0000","last_active":"2023-05-24T03:32:06.604582+0000","last_peered":"2023-05-24T03:32:06.604582+0000","last_clean":"2023-05-24T03:32:06.604582+0000","last_became_active":"2023-05-24T03:29:48.522228+0000","last_became_peered":"2023-05-24T03:29:48.522228+0000","last_unstale":"2023-05-24T03:32:06.604582+0000","last_undegraded":"2023-05-24T03:32:06.604582+0000","last_fullsized":"2023-05-24T03:32:06.604582+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:31:46.926707+0000","last_change":"2023-05-24T03:29:44.083178+0000","last_active":"2023-05-24T03:31:46.926707+0000","last_peered":"2023-05-24T03:31:46.926707+0000","last_clean":"2023-05-24T03:31:46.926707+0000","last_became_active":"2023-05-24T03:29:44.082903+0000","last_became_peered":"2023-05-24T03:29:44.082903+0000","last_unstale":"2023-05-24T03:31:46.926707+0000","last_undegraded":"2023-05-24T03:31:46.926707+0000","last_fullsized":"2023-05-24T03:31:46.926707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:43.053877+0000","last_clean_scrub_stamp":"2023-05-24T03:29:43.053877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:16.902284+0000","last_change":"2023-05-24T03:32:16.902340+0000","last_active":"2023-05-24T03:32:16.902284+0000","last_peered":"2023-05-24T03:32:16.902284+0000","last_clean":"2023-05-24T03:32:16.902284+0000","last_became_active":"2023-05-24T03:29:44.487925+0000","last_became_peered":"2023-05-24T03:29:44.487925+0000","last_unstale":"2023-05-24T03:32:16.902284+0000","last_undegraded":"2023-05-24T03:32:16.902284+0000","last_fullsized":"2023-05-24T03:32:16.902284+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-05-24T03:32:16.902188+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-05-24T03:32:16.902188+0000","last_clean_scrub_stamp":"2023-05-24T03:32:16.902188+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:04:45.220024+0000","scrub_duration":0.0014004639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"30'490","reported_seq":509,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:05.111185+0000","last_change":"2023-05-24T03:29:48.519899+0000","last_active":"2023-05-24T03:32:05.111185+0000","last_peered":"2023-05-24T03:32:05.111185+0000","last_clean":"2023-05-24T03:32:05.111185+0000","last_became_active":"2023-05-24T03:29:48.519517+0000","last_became_peered":"2023-05-24T03:29:48.519517+0000","last_unstale":"2023-05-24T03:32:05.111185+0000","last_undegraded":"2023-05-24T03:32:05.111185+0000","last_fullsized":"2023-05-24T03:32:05.111185+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"30'7","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:14.413355+0000","last_change":"2023-05-24T03:32:14.413441+0000","last_active":"2023-05-24T03:32:14.413355+0000","last_peered":"2023-05-24T03:32:14.413355+0000","last_clean":"2023-05-24T03:32:14.413355+0000","last_became_active":"2023-05-24T03:29:44.087891+0000","last_became_peered":"2023-05-24T03:29:44.087891+0000","last_unstale":"2023-05-24T03:32:14.413355+0000","last_undegraded":"2023-05-24T03:32:14.413355+0000","last_fullsized":"2023-05-24T03:32:14.413355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'7","last_scrub_stamp":"2023-05-24T03:32:14.413253+0000","last_deep_scrub":"30'7","last_deep_scrub_stamp":"2023-05-24T03:32:14.413253+0000","last_clean_scrub_stamp":"2023-05-24T03:32:14.413253+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:39:26.350804+0000","scrub_duration":0.0039696540000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"30'42","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:06.604389+0000","last_change":"2023-05-24T03:29:44.493246+0000","last_active":"2023-05-24T03:32:06.604389+0000","last_peered":"2023-05-24T03:32:06.604389+0000","last_clean":"2023-05-24T03:32:06.604389+0000","last_became_active":"2023-05-24T03:29:44.492923+0000","last_became_peered":"2023-05-24T03:29:44.492923+0000","last_unstale":"2023-05-24T03:32:06.604389+0000","last_undegraded":"2023-05-24T03:32:06.604389+0000","last_fullsized":"2023-05-24T03:32:06.604389+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"30'50","reported_seq":75,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.747503+0000","last_change":"2023-05-24T03:29:44.486961+0000","last_active":"2023-05-24T03:32:00.747503+0000","last_peered":"2023-05-24T03:32:00.747503+0000","last_clean":"2023-05-24T03:32:00.747503+0000","last_became_active":"2023-05-24T03:29:44.483898+0000","last_became_peered":"2023-05-24T03:29:44.483898+0000","last_unstale":"2023-05-24T03:32:00.747503+0000","last_undegraded":"2023-05-24T03:32:00.747503+0000","last_fullsized":"2023-05-24T03:32:00.747503+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"30'46","reported_seq":71,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.750245+0000","last_change":"2023-05-24T03:29:44.494451+0000","last_active":"2023-05-24T03:32:00.750245+0000","last_peered":"2023-05-24T03:32:00.750245+0000","last_clean":"2023-05-24T03:32:00.750245+0000","last_became_active":"2023-05-24T03:29:44.494073+0000","last_became_peered":"2023-05-24T03:29:44.494073+0000","last_unstale":"2023-05-24T03:32:00.750245+0000","last_undegraded":"2023-05-24T03:32:00.750245+0000","last_fullsized":"2023-05-24T03:32:00.750245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"30'34","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:22.339321+0000","last_change":"2023-05-24T03:32:22.339366+0000","last_active":"2023-05-24T03:32:22.339321+0000","last_peered":"2023-05-24T03:32:22.339321+0000","last_clean":"2023-05-24T03:32:22.339321+0000","last_became_active":"2023-05-24T03:29:44.497832+0000","last_became_peered":"2023-05-24T03:29:44.497832+0000","last_unstale":"2023-05-24T03:32:22.339321+0000","last_undegraded":"2023-05-24T03:32:22.339321+0000","last_fullsized":"2023-05-24T03:32:22.339321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'34","last_scrub_stamp":"2023-05-24T03:32:22.339204+0000","last_deep_scrub":"30'34","last_deep_scrub_stamp":"2023-05-24T03:32:22.339204+0000","last_clean_scrub_stamp":"2023-05-24T03:32:22.339204+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:45:42.612392+0000","scrub_duration":0.0015569990000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"30'31","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.740967+0000","last_change":"2023-05-24T03:29:44.496468+0000","last_active":"2023-05-24T03:32:00.740967+0000","last_peered":"2023-05-24T03:32:00.740967+0000","last_clean":"2023-05-24T03:32:00.740967+0000","last_became_active":"2023-05-24T03:29:44.496197+0000","last_became_peered":"2023-05-24T03:29:44.496197+0000","last_unstale":"2023-05-24T03:32:00.740967+0000","last_undegraded":"2023-05-24T03:32:00.740967+0000","last_fullsized":"2023-05-24T03:32:00.740967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"30'32","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.747872+0000","last_change":"2023-05-24T03:29:44.495194+0000","last_active":"2023-05-24T03:32:00.747872+0000","last_peered":"2023-05-24T03:32:00.747872+0000","last_clean":"2023-05-24T03:32:00.747872+0000","last_became_active":"2023-05-24T03:29:44.494928+0000","last_became_peered":"2023-05-24T03:29:44.494928+0000","last_unstale":"2023-05-24T03:32:00.747872+0000","last_undegraded":"2023-05-24T03:32:00.747872+0000","last_fullsized":"2023-05-24T03:32:00.747872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":552,"num_write_kb":1154048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":201326592,"data_stored":201326592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14950,"ondisk_log_size":14950,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2060,"ondisk_log_size":2060,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1553284,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":15,"num_read_kb":19,"num_write":484,"num_write_kb":1824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3162112,"data_stored":3106568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":493,"ondisk_log_size":493,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574887,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68296,"kb_used_data":33152,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94303544,"statfs":{"total":96636764160,"available":96566829056,"internally_reserved":0,"allocated":33947648,"data_stored":33731444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":4.7569999999999997,"5min":1.3480000000000001,"15min":0.78000000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":14.757999999999999,"5min":14.757999999999999,"15min":14.757999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":6.2599999999999998,"5min":1.663,"15min":0.89700000000000002},"min":{"1min":0.307,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":17.954000000000001,"5min":17.954000000000001,"15min":17.954000000000001},"last":0.69699999999999995}]},{"osd":1,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":4.8380000000000001,"5min":1.3740000000000001,"15min":0.79600000000000004},"min":{"1min":0.35599999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":16.939,"5min":16.939,"15min":16.939},"last":0.68600000000000005},{"interface":"front","average":{"1min":6.6909999999999998,"5min":1.766,"15min":0.94499999999999995},"min":{"1min":0.35599999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":17.981999999999999,"5min":17.981999999999999,"15min":17.981999999999999},"last":0.64400000000000002}]},{"osd":2,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":6.1429999999999998,"5min":1.641,"15min":0.89100000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":14.720000000000001,"5min":14.720000000000001,"15min":14.720000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":5.6150000000000002,"5min":1.5469999999999999,"15min":0.86899999999999999},"min":{"1min":0.40799999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":14.814,"5min":14.814,"15min":14.814},"last":0.57799999999999996}]},{"osd":3,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":6.3620000000000001,"5min":1.7150000000000001,"15min":0.94099999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":22.977,"5min":22.977,"15min":22.977},"last":0.623},{"interface":"front","average":{"1min":4.742,"5min":1.3779999999999999,"15min":0.81699999999999995},"min":{"1min":0.47099999999999997,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":14.836,"5min":14.836,"15min":14.836},"last":0.66100000000000003}]},{"osd":4,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":4.8449999999999998,"5min":1.345,"15min":0.76200000000000001},"min":{"1min":0.35099999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":18.027000000000001,"5min":18.027000000000001,"15min":18.027000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":3.347,"5min":1.077,"15min":0.69899999999999995},"min":{"1min":0.36299999999999999,"5min":0.307,"15min":0.307},"max":{"1min":22.922000000000001,"5min":22.922000000000001,"15min":22.922000000000001},"last":0.54600000000000004}]},{"osd":5,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":3.512,"5min":1.1579999999999999,"15min":0.76600000000000001},"min":{"1min":0.39700000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":17.925999999999998,"5min":17.925999999999998,"15min":17.925999999999998},"last":0.71099999999999997},{"interface":"front","average":{"1min":3.79,"5min":1.206,"15min":0.77600000000000002},"min":{"1min":0.42099999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":18.004999999999999,"5min":18.004999999999999,"15min":18.004999999999999},"last":0.60199999999999998}]},{"osd":6,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":5.5069999999999997,"5min":1.5609999999999999,"15min":0.90300000000000002},"min":{"1min":0.45900000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":23.933,"5min":23.933,"15min":23.933},"last":0.73399999999999999},{"interface":"front","average":{"1min":5.3019999999999996,"5min":1.534,"15min":0.90600000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":22.954000000000001,"5min":22.954000000000001,"15min":22.954000000000001},"last":0.65400000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574887,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48968,"kb_used_data":26944,"kb_used_omap":0,"kb_used_meta":22016,"kb_avail":94322872,"statfs":{"total":96636764160,"available":96586620928,"internally_reserved":0,"allocated":27590656,"data_stored":27401822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22544384},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":8.5820000000000007,"5min":2.4780000000000002,"15min":1.46},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":22.922999999999998,"5min":22.922999999999998,"15min":22.922999999999998},"last":0.57899999999999996},{"interface":"front","average":{"1min":7.4909999999999997,"5min":1.952,"15min":1.0289999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":28.870000000000001,"5min":28.870000000000001,"15min":28.870000000000001},"last":0.71099999999999997}]},{"osd":1,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":7.5229999999999997,"5min":2.3090000000000002,"15min":1.4399999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":22.984999999999999,"5min":22.984999999999999,"15min":22.984999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":6.492,"5min":2.0910000000000002,"15min":1.357},"min":{"1min":0.434,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":21.984999999999999,"5min":21.984999999999999,"15min":21.984999999999999},"last":0.745}]},{"osd":2,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":5.6580000000000004,"5min":1.6020000000000001,"15min":0.92600000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":22.649999999999999,"5min":22.649999999999999,"15min":22.649999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":7.5709999999999997,"5min":2.3199999999999998,"15min":1.4450000000000001},"min":{"1min":0.40100000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":23.035,"5min":23.035,"15min":23.035},"last":0.65000000000000002}]},{"osd":3,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":6.4699999999999998,"5min":1.8380000000000001,"15min":1.0660000000000001},"min":{"1min":0.42699999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":18.056000000000001,"5min":18.056000000000001,"15min":18.056000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":6.2069999999999999,"5min":1.7749999999999999,"15min":1.036},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":19.963999999999999,"5min":19.963999999999999,"15min":19.963999999999999},"last":0.60199999999999998}]},{"osd":4,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":5.3230000000000004,"5min":1.4830000000000001,"15min":0.84299999999999997},"min":{"1min":0.372,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":18.056000000000001,"5min":18.056000000000001,"15min":18.056000000000001},"last":0.42499999999999999},{"interface":"front","average":{"1min":5.1360000000000001,"5min":1.476,"15min":0.86599999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":21.943999999999999,"5min":21.943999999999999,"15min":21.943999999999999},"last":0.46000000000000002}]},{"osd":5,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":4.7370000000000001,"5min":1.3799999999999999,"15min":0.81999999999999995},"min":{"1min":0.36599999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":11.976000000000001,"5min":11.976000000000001,"15min":11.976000000000001},"last":0.443},{"interface":"front","average":{"1min":7.032,"5min":1.9119999999999999,"15min":1.0589999999999999},"min":{"1min":0.44600000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":23.010999999999999,"5min":23.010999999999999,"15min":23.010999999999999},"last":0.54600000000000004}]},{"osd":7,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":5.8639999999999999,"5min":1.6479999999999999,"15min":0.94599999999999995},"min":{"1min":0.48699999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":11.989000000000001,"5min":11.989000000000001,"15min":11.989000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":5.157,"5min":1.528,"15min":0.92300000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":21.042000000000002,"5min":21.042000000000002,"15min":21.042000000000002},"last":0.627}]}]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53896,"kb_used_data":22848,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94317944,"statfs":{"total":96636764160,"available":96581574656,"internally_reserved":0,"allocated":23396352,"data_stored":23207518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:31:32 2023","interfaces":[{"interface":"back","average":{"1min":5.5410000000000004,"5min":1.452,"15min":0.77000000000000002},"min":{"1min":0.24199999999999999,"5min":0.223,"15min":0.223},"max":{"1min":18.954000000000001,"5min":18.954000000000001,"15min":18.954000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":6.6689999999999996,"5min":1.8400000000000001,"15min":1.0349999999999999},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":21.981999999999999,"5min":21.981999999999999,"15min":21.981999999999999},"last":0.36699999999999999}]},{"osd":2,"last update":"Wed May 24 03:31:32 2023","interfaces":[{"interface":"back","average":{"1min":4.258,"5min":1.151,"15min":0.63300000000000001},"min":{"1min":0.255,"5min":0.221,"15min":0.221},"max":{"1min":15.004,"5min":15.004,"15min":15.004},"last":0.41599999999999998},{"interface":"front","average":{"1min":6.0179999999999998,"5min":1.5680000000000001,"15min":0.82599999999999996},"min":{"1min":0.29399999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":21.885000000000002,"5min":21.885000000000002,"15min":21.885000000000002},"last":0.33900000000000002}]},{"osd":3,"last update":"Wed May 24 03:31:32 2023","interfaces":[{"interface":"back","average":{"1min":4.5700000000000003,"5min":1.3160000000000001,"15min":0.77400000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":18.167000000000002,"5min":18.167000000000002,"15min":18.167000000000002},"last":0.47099999999999997},{"interface":"front","average":{"1min":3.7869999999999999,"5min":1.089,"15min":0.63900000000000001},"min":{"1min":0.33200000000000002,"5min":0.254,"15min":0.254},"max":{"1min":11.935,"5min":11.935,"15min":11.935},"last":0.45600000000000002}]},{"osd":4,"last update":"Wed May 24 03:31:32 2023","interfaces":[{"interface":"back","average":{"1min":7.3700000000000001,"5min":1.9259999999999999,"15min":1.018},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":28.891999999999999,"5min":28.891999999999999,"15min":28.891999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":7.6630000000000003,"5min":2.044,"15min":1.1080000000000001},"min":{"1min":0.376,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":21.954999999999998,"5min":21.954999999999998,"15min":21.954999999999998},"last":0.54800000000000004}]},{"osd":5,"last update":"Wed May 24 03:31:32 2023","interfaces":[{"interface":"back","average":{"1min":8.9190000000000005,"5min":2.323,"15min":1.2230000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":21.928000000000001,"5min":21.928000000000001,"15min":21.928000000000001},"last":0.499},{"interface":"front","average":{"1min":7.6909999999999998,"5min":2.0720000000000001,"15min":1.1359999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":19.757999999999999,"5min":19.757999999999999,"15min":19.757999999999999},"last":0.56899999999999995}]},{"osd":6,"last update":"Wed May 24 03:31:32 2023","interfaces":[{"interface":"back","average":{"1min":6.984,"5min":1.9039999999999999,"15min":1.0580000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":22.033999999999999,"5min":22.033999999999999,"15min":22.033999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":7.6849999999999996,"5min":2.0339999999999998,"15min":1.0920000000000001},"min":{"1min":0.40200000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":19.734999999999999,"5min":19.734999999999999,"15min":19.734999999999999},"last":0.63200000000000001}]},{"osd":7,"last update":"Wed May 24 03:31:32 2023","interfaces":[{"interface":"back","average":{"1min":8.1940000000000008,"5min":2.2130000000000001,"15min":1.216},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":21.994,"5min":21.994,"15min":21.994},"last":0.61699999999999999},{"interface":"front","average":{"1min":7.8959999999999999,"5min":2.109,"15min":1.145},"min":{"1min":0.47999999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":21.957999999999998,"5min":21.957999999999998,"15min":21.957999999999998},"last":0.64500000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574887,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54488,"kb_used_data":23440,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94317352,"statfs":{"total":96636764160,"available":96580968448,"internally_reserved":0,"allocated":24002560,"data_stored":23806220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":5.6539999999999999,"5min":1.4419999999999999,"15min":0.73999999999999999},"min":{"1min":0.29099999999999998,"5min":0.253,"15min":0.253},"max":{"1min":21.216000000000001,"5min":21.216000000000001,"15min":21.216000000000001},"last":0.432},{"interface":"front","average":{"1min":6.9509999999999996,"5min":1.6930000000000001,"15min":0.81699999999999995},"min":{"1min":0.247,"5min":0.185,"15min":0.185},"max":{"1min":29.925000000000001,"5min":29.925000000000001,"15min":29.925000000000001},"last":0.497}]},{"osd":2,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":5.431,"5min":1.403,"15min":0.73199999999999998},"min":{"1min":0.29099999999999998,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":19.018999999999998,"5min":19.018999999999998,"15min":19.018999999999998},"last":0.48199999999999998},{"interface":"front","average":{"1min":7.6340000000000003,"5min":1.861,"15min":0.89900000000000002},"min":{"1min":0.32700000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":21.945,"5min":21.945,"15min":21.945},"last":0.55300000000000005}]},{"osd":3,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":5.6120000000000001,"5min":1.4630000000000001,"15min":0.77100000000000002},"min":{"1min":0.30599999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":25.381,"5min":25.381,"15min":25.381},"last":0.58599999999999997},{"interface":"front","average":{"1min":8.2040000000000006,"5min":2.0129999999999999,"15min":0.98099999999999998},"min":{"1min":0.38900000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":21.209,"5min":21.209,"15min":21.209},"last":0.53800000000000003}]},{"osd":4,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":8.1859999999999999,"5min":2.1680000000000001,"15min":1.165},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":22.030000000000001,"5min":22.030000000000001,"15min":22.030000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":7.9889999999999999,"5min":2.113,"15min":1.1339999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":25.279,"5min":25.279,"15min":25.279},"last":0.90100000000000002}]},{"osd":5,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":7.1589999999999998,"5min":1.9690000000000001,"15min":1.1040000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":25.329999999999998,"5min":25.329999999999998,"15min":25.329999999999998},"last":0.64300000000000002},{"interface":"front","average":{"1min":7.4630000000000001,"5min":2.0110000000000001,"15min":1.103},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":28.928000000000001,"5min":28.928000000000001,"15min":28.928000000000001},"last":0.88700000000000001}]},{"osd":6,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":6.9420000000000002,"5min":1.8899999999999999,"15min":1.048},"min":{"1min":0.376,"5min":0.37,"15min":0.37},"max":{"1min":21.132000000000001,"5min":21.132000000000001,"15min":21.132000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":7.8250000000000002,"5min":2.0550000000000002,"15min":1.093},"min":{"1min":0.44400000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":22.007000000000001,"5min":22.007000000000001,"15min":22.007000000000001},"last":0.80400000000000005}]},{"osd":7,"last update":"Wed May 24 03:31:39 2023","interfaces":[{"interface":"back","average":{"1min":9.327,"5min":2.3700000000000001,"15min":1.21},"min":{"1min":0.47799999999999998,"5min":0.437,"15min":0.437},"max":{"1min":21.983000000000001,"5min":21.983000000000001,"15min":21.983000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":7.0700000000000003,"5min":1.9359999999999999,"15min":1.0800000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":25.356000000000002,"5min":25.356000000000002,"15min":25.356000000000002},"last":0.93200000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574887,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46920,"kb_used_data":24896,"kb_used_omap":0,"kb_used_meta":22016,"kb_avail":94324920,"statfs":{"total":96636764160,"available":96588718080,"internally_reserved":0,"allocated":25493504,"data_stored":25304670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22544384},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":2.8090000000000002,"5min":0.83899999999999997,"15min":0.51100000000000001},"min":{"1min":0.26400000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":10.821999999999999,"5min":10.821999999999999,"15min":10.821999999999999},"last":0.42199999999999999},{"interface":"front","average":{"1min":2.762,"5min":0.96099999999999997,"15min":0.66100000000000003},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":11.743,"5min":11.743,"15min":11.743},"last":0.34000000000000002}]},{"osd":1,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":2.4900000000000002,"5min":0.80600000000000005,"15min":0.52500000000000002},"min":{"1min":0.316,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":12.079000000000001,"5min":12.079000000000001,"15min":12.079000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":3.9860000000000002,"5min":1.234,"15min":0.77600000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":19.954000000000001,"5min":19.954000000000001,"15min":19.954000000000001},"last":0.443}]},{"osd":3,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":4.5510000000000002,"5min":1.214,"15min":0.65800000000000003},"min":{"1min":0.313,"5min":0.255,"15min":0.255},"max":{"1min":21.611000000000001,"5min":21.611000000000001,"15min":21.611000000000001},"last":0.374},{"interface":"front","average":{"1min":3.4460000000000002,"5min":1.034,"15min":0.63200000000000001},"min":{"1min":0.34999999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":21.055,"5min":21.055,"15min":21.055},"last":0.48999999999999999}]},{"osd":4,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":4.8609999999999998,"5min":1.4690000000000001,"15min":0.90400000000000003},"min":{"1min":0.39600000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":16.657,"5min":16.657,"15min":16.657},"last":0.54800000000000004},{"interface":"front","average":{"1min":4.1879999999999997,"5min":1.4319999999999999,"15min":0.97299999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":17.116,"5min":17.116,"15min":17.116},"last":0.52400000000000002}]},{"osd":5,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":5.6180000000000003,"5min":1.6100000000000001,"15min":0.94199999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":21.655000000000001,"5min":21.655000000000001,"15min":21.655000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":3.903,"5min":1.3,"15min":0.86599999999999999},"min":{"1min":0.42099999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":14.045999999999999,"5min":14.045999999999999,"15min":14.045999999999999},"last":0.629}]},{"osd":6,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":4.8600000000000003,"5min":1.595,"15min":1.0509999999999999},"min":{"1min":0.48299999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":20.966999999999999,"5min":20.966999999999999,"15min":20.966999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":3.9710000000000001,"5min":1.2909999999999999,"15min":0.84499999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":15.119,"5min":15.119,"15min":15.119},"last":0.64200000000000002}]},{"osd":7,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":5.2690000000000001,"5min":1.6890000000000001,"15min":1.093},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":17.035,"5min":17.035,"15min":17.035},"last":0.65900000000000003},{"interface":"front","average":{"1min":5.0380000000000003,"5min":1.502,"15min":0.91200000000000003},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":18.611999999999998,"5min":18.611999999999998,"15min":18.611999999999998},"last":0.70099999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574886,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38732,"kb_used_data":20804,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94333108,"statfs":{"total":96636764160,"available":96597102592,"internally_reserved":0,"allocated":21303296,"data_stored":21110456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":4.7919999999999998,"5min":1.7130000000000001,"15min":1.2},"min":{"1min":0.25800000000000001,"5min":0.224,"15min":0.224},"max":{"1min":22.969000000000001,"5min":22.969000000000001,"15min":22.969000000000001},"last":0.26900000000000002},{"interface":"front","average":{"1min":3.7040000000000002,"5min":1.4510000000000001,"15min":1.075},"min":{"1min":0.31,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":15.933999999999999,"5min":15.933999999999999,"15min":15.933999999999999},"last":0.36799999999999999}]},{"osd":1,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":3.2229999999999999,"5min":1.246,"15min":0.91600000000000004},"min":{"1min":0.28499999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":19.882000000000001,"5min":19.882000000000001,"15min":19.882000000000001},"last":0.39000000000000001},{"interface":"front","average":{"1min":3.5920000000000001,"5min":1.0569999999999999,"15min":0.63500000000000001},"min":{"1min":0.379,"5min":0.251,"15min":0.251},"max":{"1min":18.792000000000002,"5min":18.792000000000002,"15min":18.792000000000002},"last":0.313}]},{"osd":2,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":5.7619999999999996,"5min":1.7709999999999999,"15min":1.1060000000000001},"min":{"1min":0.27200000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":22.922999999999998,"5min":22.922999999999998,"15min":22.922999999999998},"last":0.42399999999999999},{"interface":"front","average":{"1min":3.8540000000000001,"5min":2.3860000000000001,"15min":2.1419999999999999},"min":{"1min":0.318,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":19.645,"5min":22.919,"15min":22.919},"last":0.35199999999999998}]},{"osd":4,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":5.016,"5min":1.5069999999999999,"15min":0.92200000000000004},"min":{"1min":0.37,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":18.952000000000002,"5min":18.952000000000002,"15min":18.952000000000002},"last":0.67500000000000004},{"interface":"front","average":{"1min":6.4580000000000002,"5min":2.0539999999999998,"15min":1.3200000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":24.933,"5min":24.933,"15min":24.933},"last":0.72499999999999998}]},{"osd":5,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":5.4980000000000002,"5min":2.0209999999999999,"15min":1.4410000000000001},"min":{"1min":0.47699999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":20.056000000000001,"5min":20.056000000000001,"15min":20.056000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":5.3170000000000002,"5min":1.5649999999999999,"15min":0.93999999999999995},"min":{"1min":0.42399999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":16.013000000000002,"5min":16.013000000000002,"15min":16.013000000000002},"last":0.56100000000000005}]},{"osd":6,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":4.3959999999999999,"5min":1.6759999999999999,"15min":1.222},"min":{"1min":0.433,"5min":0.379,"15min":0.379},"max":{"1min":13.986000000000001,"5min":13.986000000000001,"15min":13.986000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":4.9909999999999997,"5min":1.923,"15min":1.4119999999999999},"min":{"1min":0.43099999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":20.088000000000001,"5min":20.088000000000001,"15min":20.088000000000001},"last":0.59799999999999998}]},{"osd":7,"last update":"Wed May 24 03:31:36 2023","interfaces":[{"interface":"back","average":{"1min":5.7279999999999998,"5min":1.6639999999999999,"15min":0.98699999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":21.571000000000002,"5min":21.571000000000002,"15min":21.571000000000002},"last":0.58899999999999997},{"interface":"front","average":{"1min":4.6029999999999998,"5min":1.724,"15min":1.244},"min":{"1min":0.44400000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":13.922000000000001,"5min":13.922000000000001,"15min":13.922000000000001},"last":0.747}]}]},{"osd":4,"up_from":13,"seq":55834574887,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61572,"kb_used_data":26428,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94310268,"statfs":{"total":96636764160,"available":96573714432,"internally_reserved":0,"allocated":27062272,"data_stored":26857212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:31:33 2023","interfaces":[{"interface":"back","average":{"1min":6.3440000000000003,"5min":1.663,"15min":0.88300000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":17.794,"5min":17.794,"15min":17.794},"last":0.53400000000000003},{"interface":"front","average":{"1min":5.2089999999999996,"5min":1.448,"15min":0.82099999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":16.597999999999999,"5min":16.597999999999999,"15min":16.597999999999999},"last":0.65000000000000002}]},{"osd":1,"last update":"Wed May 24 03:31:33 2023","interfaces":[{"interface":"back","average":{"1min":6.2549999999999999,"5min":1.6619999999999999,"15min":0.89600000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":22.933,"5min":22.933,"15min":22.933},"last":0.57999999999999996},{"interface":"front","average":{"1min":5.0650000000000004,"5min":1.4399999999999999,"15min":0.83599999999999997},"min":{"1min":0.35499999999999998,"5min":0.309,"15min":0.309},"max":{"1min":16.196000000000002,"5min":16.196000000000002,"15min":16.196000000000002},"last":0.60199999999999998}]},{"osd":2,"last update":"Wed May 24 03:31:33 2023","interfaces":[{"interface":"back","average":{"1min":5.0049999999999999,"5min":1.4119999999999999,"15min":0.81299999999999994},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":18.919,"5min":18.919,"15min":18.919},"last":0.51900000000000002},{"interface":"front","average":{"1min":5.391,"5min":1.4990000000000001,"15min":0.84999999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":16.277999999999999,"5min":16.277999999999999,"15min":16.277999999999999},"last":0.63200000000000001}]},{"osd":3,"last update":"Wed May 24 03:31:33 2023","interfaces":[{"interface":"back","average":{"1min":4.633,"5min":1.3169999999999999,"15min":0.76400000000000001},"min":{"1min":0.32000000000000001,"5min":0.312,"15min":0.312},"max":{"1min":18.956,"5min":18.956,"15min":18.956},"last":0.61599999999999999},{"interface":"front","average":{"1min":6.0899999999999999,"5min":1.651,"15min":0.91100000000000003},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":22.960000000000001,"5min":22.960000000000001,"15min":22.960000000000001},"last":0.54600000000000004}]},{"osd":5,"last update":"Wed May 24 03:31:33 2023","interfaces":[{"interface":"back","average":{"1min":4.0069999999999997,"5min":1.2230000000000001,"15min":0.75900000000000001},"min":{"1min":0.36199999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":16.231999999999999,"5min":16.231999999999999,"15min":16.231999999999999},"last":0.32400000000000001},{"interface":"front","average":{"1min":3.1560000000000001,"5min":1.0940000000000001,"15min":0.75},"min":{"1min":0.42399999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":11.904999999999999,"5min":11.904999999999999,"15min":11.904999999999999},"last":0.41499999999999998}]},{"osd":6,"last update":"Wed May 24 03:31:33 2023","interfaces":[{"interface":"back","average":{"1min":5.4790000000000001,"5min":1.492,"15min":0.82799999999999996},"min":{"1min":0.33400000000000002,"5min":0.315,"15min":0.315},"max":{"1min":22.983000000000001,"5min":22.983000000000001,"15min":22.983000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":3.2970000000000002,"5min":1.1100000000000001,"15min":0.746},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":12.367000000000001,"5min":12.367000000000001,"15min":12.367000000000001},"last":0.37}]},{"osd":7,"last update":"Wed May 24 03:31:33 2023","interfaces":[{"interface":"back","average":{"1min":3.2090000000000001,"5min":1.085,"15min":0.73099999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":16.576000000000001,"5min":16.576000000000001,"15min":16.576000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":5.5149999999999997,"5min":1.5820000000000001,"15min":0.92600000000000005},"min":{"1min":0.432,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":22.882000000000001,"5min":22.882000000000001,"15min":22.882000000000001},"last":0.40400000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574886,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46928,"kb_used_data":24904,"kb_used_omap":0,"kb_used_meta":22016,"kb_avail":94324912,"statfs":{"total":96636764160,"available":96588709888,"internally_reserved":0,"allocated":25501696,"data_stored":25305322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22544384},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:31:35 2023","interfaces":[{"interface":"back","average":{"1min":7.0830000000000002,"5min":1.831,"15min":0.95599999999999996},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":20.137,"5min":20.137,"15min":20.137},"last":0.48499999999999999},{"interface":"front","average":{"1min":6.6159999999999997,"5min":1.9019999999999999,"15min":1.1160000000000001},"min":{"1min":0.30499999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":25.988,"5min":25.988,"15min":25.988},"last":0.47399999999999998}]},{"osd":1,"last update":"Wed May 24 03:31:35 2023","interfaces":[{"interface":"back","average":{"1min":6.5759999999999996,"5min":1.748,"15min":0.94399999999999995},"min":{"1min":0.42799999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":22.765999999999998,"5min":22.765999999999998,"15min":22.765999999999998},"last":0.55500000000000005},{"interface":"front","average":{"1min":7.2190000000000003,"5min":2.044,"15min":1.1819999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":20.161999999999999,"5min":20.161999999999999,"15min":20.161999999999999},"last":0.57999999999999996}]},{"osd":2,"last update":"Wed May 24 03:31:35 2023","interfaces":[{"interface":"back","average":{"1min":7.4820000000000002,"5min":1.929,"15min":1.0029999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":25.946000000000002,"5min":25.946000000000002,"15min":25.946000000000002},"last":0.52600000000000002},{"interface":"front","average":{"1min":5.6459999999999999,"5min":1.7490000000000001,"15min":1.099},"min":{"1min":0.45900000000000002,"5min":0.437,"15min":0.437},"max":{"1min":22.800000000000001,"5min":22.800000000000001,"15min":22.800000000000001},"last":0.59499999999999997}]},{"osd":3,"last update":"Wed May 24 03:31:35 2023","interfaces":[{"interface":"back","average":{"1min":6.093,"5min":1.9059999999999999,"15min":1.208},"min":{"1min":0.38600000000000001,"5min":0.375,"15min":0.375},"max":{"1min":26.013999999999999,"5min":26.013999999999999,"15min":26.013999999999999},"last":0.504},{"interface":"front","average":{"1min":6.2140000000000004,"5min":1.8959999999999999,"15min":1.1759999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":22.687999999999999,"5min":22.687999999999999,"15min":22.687999999999999},"last":0.51100000000000001}]},{"osd":4,"last update":"Wed May 24 03:31:35 2023","interfaces":[{"interface":"back","average":{"1min":5.6379999999999999,"5min":1.5289999999999999,"15min":0.84399999999999997},"min":{"1min":0.33500000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":19.998000000000001,"5min":19.998000000000001,"15min":19.998000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":4.3520000000000003,"5min":1.2929999999999999,"15min":0.78300000000000003},"min":{"1min":0.38800000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":17.628,"5min":17.628,"15min":17.628},"last":0.36599999999999999}]},{"osd":6,"last update":"Wed May 24 03:31:35 2023","interfaces":[{"interface":"back","average":{"1min":4.516,"5min":1.3420000000000001,"15min":0.81299999999999994},"min":{"1min":0.39600000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":19.969000000000001,"5min":19.969000000000001,"15min":19.969000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":5.2229999999999999,"5min":1.4970000000000001,"15min":0.876},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":19.913,"5min":19.913,"15min":19.913},"last":0.53900000000000003}]},{"osd":7,"last update":"Wed May 24 03:31:35 2023","interfaces":[{"interface":"back","average":{"1min":3.9180000000000001,"5min":1.274,"15min":0.83399999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":17.731000000000002,"5min":17.731000000000002,"15min":17.731000000000002},"last":0.436},{"interface":"front","average":{"1min":4.2949999999999999,"5min":1.3620000000000001,"15min":0.873},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":20.099,"5min":20.099,"15min":20.099},"last":0.46100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":8334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1568768,"data_stored":1552542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1568768,"data_stored":1544950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23068672,"data_stored":23068672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23068672,"data_stored":23068672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":27262976,"data_stored":27262976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":31457280,"data_stored":31457280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-24T03:32:28.879 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.879 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.880 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.880 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.880 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.881 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.881 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.881 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.882 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.882 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.882 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.883 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.883 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.883 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.884 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.884 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-05-24T03:29:43.053877+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.884 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.885 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-05-24T03:29:43.053877+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.885 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.885 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.886 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.886 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.886 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.887 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-05-24T03:29:43.053877+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.887 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.887 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.888 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-05-24T03:29:43.053877+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.888 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.888 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.889 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-05-24T03:29:43.053877+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.889 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.889 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.890 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-05-24T03:29:43.053877+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.890 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.890 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.890 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.891 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-05-24T03:29:43.053877+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.891 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.891 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.892 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.892 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.892 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.893 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.893 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.893 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-05-24T03:29:43.053877+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.894 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.894 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.894 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.895 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-05-24T03:29:43.053877+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.895 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.895 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.896 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.896 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-05-24T03:29:43.053877+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.896 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.897 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.897 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.897 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.898 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.898 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.898 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-05-24T03:29:43.053877+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.899 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.899 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.899 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.900 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.900 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-05-24T03:29:43.053877+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.900 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.901 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.901 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.901 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.902 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.902 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.902 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.903 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.903 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-05-24T03:29:43.053877+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.903 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.904 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-05-24T03:29:43.053877+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.904 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.904 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.905 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.905 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-05-24T03:29:43.053877+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.906 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.906 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.906 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.907 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.907 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.907 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:28.908 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-05-24T03:32:44.491 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T03:32:44.494 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T03:32:48.908 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-24T03:32:49.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.039+0000 7f203515e700 1 Processor -- start 2023-05-24T03:32:49.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.039+0000 7f203515e700 1 -- start start 2023-05-24T03:32:49.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.040+0000 7f203515e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f203015cc20 0x7f20300d0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:49.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.040+0000 7f203515e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f203006bbe0 0x7f20300b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:49.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.040+0000 7f203515e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f203015cff0 0x7f20300b51f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:49.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.040+0000 7f203515e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20300cd920 con 0x7f203015cc20 2023-05-24T03:32:49.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.040+0000 7f203515e700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20300cdc00 con 0x7f203015cff0 2023-05-24T03:32:49.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.040+0000 7f203515e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20300cdee0 con 0x7f203006bbe0 2023-05-24T03:32:49.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.040+0000 7f202ed9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f203015cc20 0x7f20300d0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:49.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.040+0000 7f202ed9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f203015cc20 0x7f20300d0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40784/0 (socket says 172.21.15.146:40784) 2023-05-24T03:32:49.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.040+0000 7f202ed9d700 1 -- 172.21.15.146:0/995944372 learned_addr learned my addr 172.21.15.146:0/995944372 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:32:49.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.040+0000 7f202f59e700 1 --2- 172.21.15.146:0/995944372 >> v2:172.21.15.151:3300/0 conn(0x7f203015cff0 0x7f20300b51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:49.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.040+0000 7f202e59c700 1 --2- 172.21.15.146:0/995944372 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f203006bbe0 0x7f20300b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:49.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.040+0000 7f202ed9d700 1 -- 172.21.15.146:0/995944372 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f203006bbe0 msgr2=0x7f20300b4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:32:49.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.040+0000 7f202ed9d700 1 --2- 172.21.15.146:0/995944372 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f203006bbe0 0x7f20300b4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:49.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.041+0000 7f202ed9d700 1 -- 172.21.15.146:0/995944372 >> v2:172.21.15.151:3300/0 conn(0x7f203015cff0 msgr2=0x7f20300b51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:32:49.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.041+0000 7f202ed9d700 1 --2- 172.21.15.146:0/995944372 >> v2:172.21.15.151:3300/0 conn(0x7f203015cff0 0x7f20300b51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:49.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.041+0000 7f202ed9d700 1 -- 172.21.15.146:0/995944372 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20300d0e00 con 0x7f203015cc20 2023-05-24T03:32:49.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.041+0000 7f202f59e700 1 --2- 172.21.15.146:0/995944372 >> v2:172.21.15.151:3300/0 conn(0x7f203015cff0 0x7f20300b51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:32:49.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.041+0000 7f202e59c700 1 --2- 172.21.15.146:0/995944372 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f203006bbe0 0x7f20300b4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:32:49.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.041+0000 7f202ed9d700 1 --2- 172.21.15.146:0/995944372 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f203015cc20 0x7f20300d0000 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f20300b24d0 tx=0x7f2024009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbdad09d4603b3e9 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:49.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.041+0000 7f202dd9b700 1 -- 172.21.15.146:0/995944372 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f202400b870 con 0x7f203015cc20 2023-05-24T03:32:49.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.041+0000 7f202dd9b700 1 -- 172.21.15.146:0/995944372 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f202400b9d0 con 0x7f203015cc20 2023-05-24T03:32:49.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.041+0000 7f202dd9b700 1 -- 172.21.15.146:0/995944372 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f202400bd60 con 0x7f203015cc20 2023-05-24T03:32:49.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.041+0000 7f203515e700 1 -- 172.21.15.146:0/995944372 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f203015cc20 msgr2=0x7f20300d0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:49.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.041+0000 7f203515e700 1 --2- 172.21.15.146:0/995944372 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f203015cc20 0x7f20300d0000 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f20300b24d0 tx=0x7f2024009bd0 comp rx=0 tx=0).stop 2023-05-24T03:32:49.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.041+0000 7f203515e700 1 -- 172.21.15.146:0/995944372 shutdown_connections 2023-05-24T03:32:49.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.041+0000 7f203515e700 1 --2- 172.21.15.146:0/995944372 >> v2:172.21.15.151:3300/0 conn(0x7f203015cff0 0x7f20300b51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:49.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.041+0000 7f203515e700 1 --2- 172.21.15.146:0/995944372 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f203015cc20 0x7f20300d0000 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:49.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.041+0000 7f203515e700 1 --2- 172.21.15.146:0/995944372 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f203006bbe0 0x7f20300b4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:49.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.041+0000 7f203515e700 1 -- 172.21.15.146:0/995944372 >> 172.21.15.146:0/995944372 conn(0x7f2030074390 msgr2=0x7f203006af30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:32:49.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.041+0000 7f203515e700 1 -- 172.21.15.146:0/995944372 shutdown_connections 2023-05-24T03:32:49.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.041+0000 7f203515e700 1 -- 172.21.15.146:0/995944372 wait complete. 2023-05-24T03:32:49.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.043+0000 7f203515e700 1 Processor -- start 2023-05-24T03:32:49.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.043+0000 7f203515e700 1 -- start start 2023-05-24T03:32:49.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.044+0000 7f203515e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f203015cc20 0x7f20301e72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:49.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.044+0000 7f203515e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f203015cff0 0x7f2030157400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:49.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.044+0000 7f203515e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20300cc000 0x7f20300b4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:49.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.044+0000 7f203515e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20301e77e0 con 0x7f203015cc20 2023-05-24T03:32:49.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.044+0000 7f203515e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2030156680 con 0x7f203015cff0 2023-05-24T03:32:49.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.044+0000 7f203515e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20300cc9e0 con 0x7f20300cc000 2023-05-24T03:32:49.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.044+0000 7f202ed9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f203015cc20 0x7f20301e72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:49.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.045+0000 7f202ed9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f203015cc20 0x7f20301e72a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40790/0 (socket says 172.21.15.146:40790) 2023-05-24T03:32:49.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.045+0000 7f202ed9d700 1 -- 172.21.15.146:0/1250220711 learned_addr learned my addr 172.21.15.146:0/1250220711 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:32:49.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.045+0000 7f202e59c700 1 --2- 172.21.15.146:0/1250220711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f203015cff0 0x7f2030157400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:49.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.045+0000 7f202f59e700 1 --2- 172.21.15.146:0/1250220711 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20300cc000 0x7f20300b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:49.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.045+0000 7f202ed9d700 1 -- 172.21.15.146:0/1250220711 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20300cc000 msgr2=0x7f20300b4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:49.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.045+0000 7f202ed9d700 1 --2- 172.21.15.146:0/1250220711 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20300cc000 0x7f20300b4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:49.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.045+0000 7f202ed9d700 1 -- 172.21.15.146:0/1250220711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f203015cff0 msgr2=0x7f2030157400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:49.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.045+0000 7f202ed9d700 1 --2- 172.21.15.146:0/1250220711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f203015cff0 0x7f2030157400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:49.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.045+0000 7f202ed9d700 1 -- 172.21.15.146:0/1250220711 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2024009550 con 0x7f203015cc20 2023-05-24T03:32:49.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.045+0000 7f202ed9d700 1 --2- 172.21.15.146:0/1250220711 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f203015cc20 0x7f20301e72a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2030067060 tx=0x7f2024004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:49.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.045+0000 7f20177fe700 1 -- 172.21.15.146:0/1250220711 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2024004310 con 0x7f203015cc20 2023-05-24T03:32:49.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.045+0000 7f20177fe700 1 -- 172.21.15.146:0/1250220711 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f202401f070 con 0x7f203015cc20 2023-05-24T03:32:49.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.045+0000 7f203515e700 1 -- 172.21.15.146:0/1250220711 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20300d0540 con 0x7f203015cc20 2023-05-24T03:32:49.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.045+0000 7f20177fe700 1 -- 172.21.15.146:0/1250220711 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20240036a0 con 0x7f203015cc20 2023-05-24T03:32:49.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.045+0000 7f203515e700 1 -- 172.21.15.146:0/1250220711 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20300d10e0 con 0x7f203015cc20 2023-05-24T03:32:49.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.046+0000 7f203515e700 1 -- 172.21.15.146:0/1250220711 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20300d06d0 con 0x7f203015cc20 2023-05-24T03:32:49.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.047+0000 7f20177fe700 1 -- 172.21.15.146:0/1250220711 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2024021030 con 0x7f203015cc20 2023-05-24T03:32:49.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.047+0000 7f20177fe700 1 --2- 172.21.15.146:0/1250220711 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f201c06ace0 0x7f201c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:32:49.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.047+0000 7f20177fe700 1 -- 172.21.15.146:0/1250220711 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f202408ab50 con 0x7f203015cc20 2023-05-24T03:32:49.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.047+0000 7f202e59c700 1 --2- 172.21.15.146:0/1250220711 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f201c06ace0 0x7f201c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:32:49.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.048+0000 7f202e59c700 1 --2- 172.21.15.146:0/1250220711 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f201c06ace0 0x7f201c06d190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f20300b52e0 tx=0x7f2020008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:32:49.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.052+0000 7f20177fe700 1 -- 172.21.15.146:0/1250220711 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f20240558d0 con 0x7f203015cc20 2023-05-24T03:32:49.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.238+0000 7f203515e700 1 -- 172.21.15.146:0/1250220711 --> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2030072ae0 con 0x7f201c06ace0 2023-05-24T03:32:49.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.248+0000 7f20177fe700 1 -- 172.21.15.146:0/1250220711 <== mgr.4104 v2:172.21.15.146:6832/1985394169 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+392047 (secure 0 0 0) 0x7f2030072ae0 con 0x7f201c06ace0 2023-05-24T03:32:49.256 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:32:49.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.252+0000 7f203515e700 1 -- 172.21.15.146:0/1250220711 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f201c06ace0 msgr2=0x7f201c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:49.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.252+0000 7f203515e700 1 --2- 172.21.15.146:0/1250220711 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f201c06ace0 0x7f201c06d190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f20300b52e0 tx=0x7f2020008040 comp rx=0 tx=0).stop 2023-05-24T03:32:49.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.252+0000 7f203515e700 1 -- 172.21.15.146:0/1250220711 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f203015cc20 msgr2=0x7f20301e72a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:32:49.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.252+0000 7f203515e700 1 --2- 172.21.15.146:0/1250220711 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f203015cc20 0x7f20301e72a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2030067060 tx=0x7f2024004750 comp rx=0 tx=0).stop 2023-05-24T03:32:49.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.252+0000 7f203515e700 1 -- 172.21.15.146:0/1250220711 shutdown_connections 2023-05-24T03:32:49.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.252+0000 7f203515e700 1 --2- 172.21.15.146:0/1250220711 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f201c06ace0 0x7f201c06d190 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:49.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.252+0000 7f203515e700 1 --2- 172.21.15.146:0/1250220711 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20300cc000 0x7f20300b4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:49.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.252+0000 7f203515e700 1 --2- 172.21.15.146:0/1250220711 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f203015cc20 0x7f20301e72a0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:49.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.252+0000 7f203515e700 1 --2- 172.21.15.146:0/1250220711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f203015cff0 0x7f2030157400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:32:49.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.252+0000 7f203515e700 1 -- 172.21.15.146:0/1250220711 >> 172.21.15.146:0/1250220711 conn(0x7f203006bbe0 msgr2=0x7f203015ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:32:49.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.252+0000 7f203515e700 1 -- 172.21.15.146:0/1250220711 shutdown_connections 2023-05-24T03:32:49.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:32:49.252+0000 7f203515e700 1 -- 172.21.15.146:0/1250220711 wait complete. 2023-05-24T03:32:49.261 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-05-24T03:32:49.268 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":122,"stamp":"2023-05-24T03:32:48.804741+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":102806948,"num_objects":49,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":131,"num_read_kb":119,"num_write":1195,"num_write_kb":1158288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17630,"ondisk_log_size":17630,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":419800,"kb_used_data":203416,"kb_used_omap":0,"kb_used_meta":216320,"kb_avail":754554920,"statfs":{"total":773094113280,"available":772664238080,"internally_reserved":0,"allocated":208297984,"data_stored":206724664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":221511680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003656"},"pg_stats":[{"pgid":"4.3f","version":"30'28","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:13.677466+0000","last_change":"2023-05-24T03:32:13.677538+0000","last_active":"2023-05-24T03:32:13.677466+0000","last_peered":"2023-05-24T03:32:13.677466+0000","last_clean":"2023-05-24T03:32:13.677466+0000","last_became_active":"2023-05-24T03:29:44.489854+0000","last_became_peered":"2023-05-24T03:29:44.489854+0000","last_unstale":"2023-05-24T03:32:13.677466+0000","last_undegraded":"2023-05-24T03:32:13.677466+0000","last_fullsized":"2023-05-24T03:32:13.677466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'28","last_scrub_stamp":"2023-05-24T03:32:13.677364+0000","last_deep_scrub":"30'28","last_deep_scrub_stamp":"2023-05-24T03:32:13.677364+0000","last_clean_scrub_stamp":"2023-05-24T03:32:13.677364+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T03:41:35.361181+0000","scrub_duration":0.001818166,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"30'27","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.744662+0000","last_change":"2023-05-24T03:29:44.495973+0000","last_active":"2023-05-24T03:32:00.744662+0000","last_peered":"2023-05-24T03:32:00.744662+0000","last_clean":"2023-05-24T03:32:00.744662+0000","last_became_active":"2023-05-24T03:29:44.495700+0000","last_became_peered":"2023-05-24T03:29:44.495700+0000","last_unstale":"2023-05-24T03:32:00.744662+0000","last_undegraded":"2023-05-24T03:32:00.744662+0000","last_fullsized":"2023-05-24T03:32:00.744662+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"30'43","reported_seq":76,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:10.490334+0000","last_change":"2023-05-24T03:32:10.490388+0000","last_active":"2023-05-24T03:32:10.490334+0000","last_peered":"2023-05-24T03:32:10.490334+0000","last_clean":"2023-05-24T03:32:10.490334+0000","last_became_active":"2023-05-24T03:29:44.499663+0000","last_became_peered":"2023-05-24T03:29:44.499663+0000","last_unstale":"2023-05-24T03:32:10.490334+0000","last_undegraded":"2023-05-24T03:32:10.490334+0000","last_fullsized":"2023-05-24T03:32:10.490334+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'43","last_scrub_stamp":"2023-05-24T03:32:10.490217+0000","last_deep_scrub":"30'43","last_deep_scrub_stamp":"2023-05-24T03:32:10.490217+0000","last_clean_scrub_stamp":"2023-05-24T03:32:10.490217+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:07:18.348127+0000","scrub_duration":0.002187207,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"30'24","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:19.940238+0000","last_change":"2023-05-24T03:32:19.940327+0000","last_active":"2023-05-24T03:32:19.940238+0000","last_peered":"2023-05-24T03:32:19.940238+0000","last_clean":"2023-05-24T03:32:19.940238+0000","last_became_active":"2023-05-24T03:29:44.498528+0000","last_became_peered":"2023-05-24T03:29:44.498528+0000","last_unstale":"2023-05-24T03:32:19.940238+0000","last_undegraded":"2023-05-24T03:32:19.940238+0000","last_fullsized":"2023-05-24T03:32:19.940238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2023-05-24T03:32:19.940111+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2023-05-24T03:32:19.940111+0000","last_clean_scrub_stamp":"2023-05-24T03:32:19.940111+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:12:46.316536+0000","scrub_duration":0.002509664,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"30'34","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:04.613136+0000","last_change":"2023-05-24T03:29:44.504225+0000","last_active":"2023-05-24T03:32:04.613136+0000","last_peered":"2023-05-24T03:32:04.613136+0000","last_clean":"2023-05-24T03:32:04.613136+0000","last_became_active":"2023-05-24T03:29:44.503998+0000","last_became_peered":"2023-05-24T03:29:44.503998+0000","last_unstale":"2023-05-24T03:32:04.613136+0000","last_undegraded":"2023-05-24T03:32:04.613136+0000","last_fullsized":"2023-05-24T03:32:04.613136+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"30'39","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:06.604507+0000","last_change":"2023-05-24T03:29:44.500355+0000","last_active":"2023-05-24T03:32:06.604507+0000","last_peered":"2023-05-24T03:32:06.604507+0000","last_clean":"2023-05-24T03:32:06.604507+0000","last_became_active":"2023-05-24T03:29:44.500065+0000","last_became_peered":"2023-05-24T03:29:44.500065+0000","last_unstale":"2023-05-24T03:32:06.604507+0000","last_undegraded":"2023-05-24T03:32:06.604507+0000","last_fullsized":"2023-05-24T03:32:06.604507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"30'27","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:33.103467+0000","last_change":"2023-05-24T03:32:33.103534+0000","last_active":"2023-05-24T03:32:33.103467+0000","last_peered":"2023-05-24T03:32:33.103467+0000","last_clean":"2023-05-24T03:32:33.103467+0000","last_became_active":"2023-05-24T03:29:44.499324+0000","last_became_peered":"2023-05-24T03:29:44.499324+0000","last_unstale":"2023-05-24T03:32:33.103467+0000","last_undegraded":"2023-05-24T03:32:33.103467+0000","last_fullsized":"2023-05-24T03:32:33.103467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'27","last_scrub_stamp":"2023-05-24T03:32:33.103341+0000","last_deep_scrub":"30'27","last_deep_scrub_stamp":"2023-05-24T03:32:33.103341+0000","last_clean_scrub_stamp":"2023-05-24T03:32:33.103341+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:10:30.279133+0000","scrub_duration":0.0021747279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"30'31","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:07.551920+0000","last_change":"2023-05-24T03:32:07.551920+0000","last_active":"2023-05-24T03:32:07.551920+0000","last_peered":"2023-05-24T03:32:07.551920+0000","last_clean":"2023-05-24T03:32:07.551920+0000","last_became_active":"2023-05-24T03:29:44.500260+0000","last_became_peered":"2023-05-24T03:29:44.500260+0000","last_unstale":"2023-05-24T03:32:07.551920+0000","last_undegraded":"2023-05-24T03:32:07.551920+0000","last_fullsized":"2023-05-24T03:32:07.551920+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'31","last_scrub_stamp":"2023-05-24T03:32:07.551774+0000","last_deep_scrub":"30'31","last_deep_scrub_stamp":"2023-05-24T03:32:07.551774+0000","last_clean_scrub_stamp":"2023-05-24T03:32:07.551774+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:05:30.767531+0000","scrub_duration":0.001406902,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"30'38","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:04.613114+0000","last_change":"2023-05-24T03:29:44.502655+0000","last_active":"2023-05-24T03:32:04.613114+0000","last_peered":"2023-05-24T03:32:04.613114+0000","last_clean":"2023-05-24T03:32:04.613114+0000","last_became_active":"2023-05-24T03:29:44.502341+0000","last_became_peered":"2023-05-24T03:29:44.502341+0000","last_unstale":"2023-05-24T03:32:04.613114+0000","last_undegraded":"2023-05-24T03:32:04.613114+0000","last_fullsized":"2023-05-24T03:32:04.613114+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"30'44","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:07.101435+0000","last_change":"2023-05-24T03:29:44.500505+0000","last_active":"2023-05-24T03:32:07.101435+0000","last_peered":"2023-05-24T03:32:07.101435+0000","last_clean":"2023-05-24T03:32:07.101435+0000","last_became_active":"2023-05-24T03:29:44.500156+0000","last_became_peered":"2023-05-24T03:29:44.500156+0000","last_unstale":"2023-05-24T03:32:07.101435+0000","last_undegraded":"2023-05-24T03:32:07.101435+0000","last_fullsized":"2023-05-24T03:32:07.101435+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"30'25","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:27.381172+0000","last_change":"2023-05-24T03:32:27.381239+0000","last_active":"2023-05-24T03:32:27.381172+0000","last_peered":"2023-05-24T03:32:27.381172+0000","last_clean":"2023-05-24T03:32:27.381172+0000","last_became_active":"2023-05-24T03:29:44.492573+0000","last_became_peered":"2023-05-24T03:29:44.492573+0000","last_unstale":"2023-05-24T03:32:27.381172+0000","last_undegraded":"2023-05-24T03:32:27.381172+0000","last_fullsized":"2023-05-24T03:32:27.381172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'25","last_scrub_stamp":"2023-05-24T03:32:27.381053+0000","last_deep_scrub":"30'25","last_deep_scrub_stamp":"2023-05-24T03:32:27.381053+0000","last_clean_scrub_stamp":"2023-05-24T03:32:27.381053+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:57:47.032672+0000","scrub_duration":0.001811975,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"30'30","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:21.771720+0000","last_change":"2023-05-24T03:32:21.771773+0000","last_active":"2023-05-24T03:32:21.771720+0000","last_peered":"2023-05-24T03:32:21.771720+0000","last_clean":"2023-05-24T03:32:21.771720+0000","last_became_active":"2023-05-24T03:29:44.501371+0000","last_became_peered":"2023-05-24T03:29:44.501371+0000","last_unstale":"2023-05-24T03:32:21.771720+0000","last_undegraded":"2023-05-24T03:32:21.771720+0000","last_fullsized":"2023-05-24T03:32:21.771720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2023-05-24T03:32:21.771619+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2023-05-24T03:32:21.771619+0000","last_clean_scrub_stamp":"2023-05-24T03:32:21.771619+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:46:03.786320+0000","scrub_duration":0.0021789000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"30'30","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:10.688054+0000","last_change":"2023-05-24T03:32:10.688054+0000","last_active":"2023-05-24T03:32:10.688054+0000","last_peered":"2023-05-24T03:32:10.688054+0000","last_clean":"2023-05-24T03:32:10.688054+0000","last_became_active":"2023-05-24T03:29:44.490411+0000","last_became_peered":"2023-05-24T03:29:44.490411+0000","last_unstale":"2023-05-24T03:32:10.688054+0000","last_undegraded":"2023-05-24T03:32:10.688054+0000","last_fullsized":"2023-05-24T03:32:10.688054+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2023-05-24T03:32:10.687867+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2023-05-24T03:32:10.687867+0000","last_clean_scrub_stamp":"2023-05-24T03:32:10.687867+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:41:09.062399+0000","scrub_duration":0.0014586079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:08.559425+0000","last_change":"2023-05-24T03:32:08.559478+0000","last_active":"2023-05-24T03:32:08.559425+0000","last_peered":"2023-05-24T03:32:08.559425+0000","last_clean":"2023-05-24T03:32:08.559425+0000","last_became_active":"2023-05-24T03:29:44.494879+0000","last_became_peered":"2023-05-24T03:29:44.494879+0000","last_unstale":"2023-05-24T03:32:08.559425+0000","last_undegraded":"2023-05-24T03:32:08.559425+0000","last_fullsized":"2023-05-24T03:32:08.559425+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-05-24T03:32:08.559327+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-05-24T03:32:08.559327+0000","last_clean_scrub_stamp":"2023-05-24T03:32:08.559327+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:39:20.496878+0000","scrub_duration":0.0018937559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"30'31","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:43.164305+0000","last_change":"2023-05-24T03:32:43.164350+0000","last_active":"2023-05-24T03:32:43.164305+0000","last_peered":"2023-05-24T03:32:43.164305+0000","last_clean":"2023-05-24T03:32:43.164305+0000","last_became_active":"2023-05-24T03:29:44.499393+0000","last_became_peered":"2023-05-24T03:29:44.499393+0000","last_unstale":"2023-05-24T03:32:43.164305+0000","last_undegraded":"2023-05-24T03:32:43.164305+0000","last_fullsized":"2023-05-24T03:32:43.164305+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'31","last_scrub_stamp":"2023-05-24T03:32:43.164206+0000","last_deep_scrub":"30'31","last_deep_scrub_stamp":"2023-05-24T03:32:43.164206+0000","last_clean_scrub_stamp":"2023-05-24T03:32:43.164206+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:46:27.289607+0000","scrub_duration":0.0018417220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"30'39","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:06.604549+0000","last_change":"2023-05-24T03:29:44.501101+0000","last_active":"2023-05-24T03:32:06.604549+0000","last_peered":"2023-05-24T03:32:06.604549+0000","last_clean":"2023-05-24T03:32:06.604549+0000","last_became_active":"2023-05-24T03:29:44.500818+0000","last_became_peered":"2023-05-24T03:29:44.500818+0000","last_unstale":"2023-05-24T03:32:06.604549+0000","last_undegraded":"2023-05-24T03:32:06.604549+0000","last_fullsized":"2023-05-24T03:32:06.604549+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"30'34","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:05.266534+0000","last_change":"2023-05-24T03:32:05.266534+0000","last_active":"2023-05-24T03:32:05.266534+0000","last_peered":"2023-05-24T03:32:05.266534+0000","last_clean":"2023-05-24T03:32:05.266534+0000","last_became_active":"2023-05-24T03:29:44.499543+0000","last_became_peered":"2023-05-24T03:29:44.499543+0000","last_unstale":"2023-05-24T03:32:05.266534+0000","last_undegraded":"2023-05-24T03:32:05.266534+0000","last_fullsized":"2023-05-24T03:32:05.266534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'34","last_scrub_stamp":"2023-05-24T03:32:05.266373+0000","last_deep_scrub":"30'34","last_deep_scrub_stamp":"2023-05-24T03:32:05.266373+0000","last_clean_scrub_stamp":"2023-05-24T03:32:05.266373+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:30:44.837013+0000","scrub_duration":0.001465926,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"30'29","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:14.450147+0000","last_change":"2023-05-24T03:32:14.450198+0000","last_active":"2023-05-24T03:32:14.450147+0000","last_peered":"2023-05-24T03:32:14.450147+0000","last_clean":"2023-05-24T03:32:14.450147+0000","last_became_active":"2023-05-24T03:29:44.492109+0000","last_became_peered":"2023-05-24T03:29:44.492109+0000","last_unstale":"2023-05-24T03:32:14.450147+0000","last_undegraded":"2023-05-24T03:32:14.450147+0000","last_fullsized":"2023-05-24T03:32:14.450147+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'29","last_scrub_stamp":"2023-05-24T03:32:14.450045+0000","last_deep_scrub":"30'29","last_deep_scrub_stamp":"2023-05-24T03:32:14.450045+0000","last_clean_scrub_stamp":"2023-05-24T03:32:14.450045+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:29:13.731044+0000","scrub_duration":0.0018316579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"30'31","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:12.709356+0000","last_change":"2023-05-24T03:32:12.709408+0000","last_active":"2023-05-24T03:32:12.709356+0000","last_peered":"2023-05-24T03:32:12.709356+0000","last_clean":"2023-05-24T03:32:12.709356+0000","last_became_active":"2023-05-24T03:29:44.480597+0000","last_became_peered":"2023-05-24T03:29:44.480597+0000","last_unstale":"2023-05-24T03:32:12.709356+0000","last_undegraded":"2023-05-24T03:32:12.709356+0000","last_fullsized":"2023-05-24T03:32:12.709356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'31","last_scrub_stamp":"2023-05-24T03:32:12.709240+0000","last_deep_scrub":"30'31","last_deep_scrub_stamp":"2023-05-24T03:32:12.709240+0000","last_clean_scrub_stamp":"2023-05-24T03:32:12.709240+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:30:46.981383+0000","scrub_duration":0.001799042,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"30'34","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:21.334467+0000","last_change":"2023-05-24T03:32:21.334516+0000","last_active":"2023-05-24T03:32:21.334467+0000","last_peered":"2023-05-24T03:32:21.334467+0000","last_clean":"2023-05-24T03:32:21.334467+0000","last_became_active":"2023-05-24T03:29:44.499405+0000","last_became_peered":"2023-05-24T03:29:44.499405+0000","last_unstale":"2023-05-24T03:32:21.334467+0000","last_undegraded":"2023-05-24T03:32:21.334467+0000","last_fullsized":"2023-05-24T03:32:21.334467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'34","last_scrub_stamp":"2023-05-24T03:32:21.334367+0000","last_deep_scrub":"30'34","last_deep_scrub_stamp":"2023-05-24T03:32:21.334367+0000","last_clean_scrub_stamp":"2023-05-24T03:32:21.334367+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:18:40.971078+0000","scrub_duration":0.001550711,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"30'40","reported_seq":78,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:34.104760+0000","last_change":"2023-05-24T03:32:34.104814+0000","last_active":"2023-05-24T03:32:34.104760+0000","last_peered":"2023-05-24T03:32:34.104760+0000","last_clean":"2023-05-24T03:32:34.104760+0000","last_became_active":"2023-05-24T03:30:26.105858+0000","last_became_peered":"2023-05-24T03:30:26.105858+0000","last_unstale":"2023-05-24T03:32:34.104760+0000","last_undegraded":"2023-05-24T03:32:34.104760+0000","last_fullsized":"2023-05-24T03:32:34.104760+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'40","last_scrub_stamp":"2023-05-24T03:32:34.104644+0000","last_deep_scrub":"30'40","last_deep_scrub_stamp":"2023-05-24T03:32:34.104644+0000","last_clean_scrub_stamp":"2023-05-24T03:32:34.104644+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:12:02.487746+0000","scrub_duration":0.002118946,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:29.391149+0000","last_change":"2023-05-24T03:32:29.391187+0000","last_active":"2023-05-24T03:32:29.391149+0000","last_peered":"2023-05-24T03:32:29.391149+0000","last_clean":"2023-05-24T03:32:29.391149+0000","last_became_active":"2023-05-24T03:29:44.498463+0000","last_became_peered":"2023-05-24T03:29:44.498463+0000","last_unstale":"2023-05-24T03:32:29.391149+0000","last_undegraded":"2023-05-24T03:32:29.391149+0000","last_fullsized":"2023-05-24T03:32:29.391149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-05-24T03:32:29.391070+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-05-24T03:32:29.391070+0000","last_clean_scrub_stamp":"2023-05-24T03:32:29.391070+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:07:37.248980+0000","scrub_duration":0.0011854249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"30'36","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:18.872950+0000","last_change":"2023-05-24T03:32:18.872998+0000","last_active":"2023-05-24T03:32:18.872950+0000","last_peered":"2023-05-24T03:32:18.872950+0000","last_clean":"2023-05-24T03:32:18.872950+0000","last_became_active":"2023-05-24T03:29:44.499960+0000","last_became_peered":"2023-05-24T03:29:44.499960+0000","last_unstale":"2023-05-24T03:32:18.872950+0000","last_undegraded":"2023-05-24T03:32:18.872950+0000","last_fullsized":"2023-05-24T03:32:18.872950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'36","last_scrub_stamp":"2023-05-24T03:32:18.872839+0000","last_deep_scrub":"30'36","last_deep_scrub_stamp":"2023-05-24T03:32:18.872839+0000","last_clean_scrub_stamp":"2023-05-24T03:32:18.872839+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:53:45.834893+0000","scrub_duration":0.001506446,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"30'31","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:40.102248+0000","last_change":"2023-05-24T03:32:40.102298+0000","last_active":"2023-05-24T03:32:40.102248+0000","last_peered":"2023-05-24T03:32:40.102248+0000","last_clean":"2023-05-24T03:32:40.102248+0000","last_became_active":"2023-05-24T03:29:44.498437+0000","last_became_peered":"2023-05-24T03:29:44.498437+0000","last_unstale":"2023-05-24T03:32:40.102248+0000","last_undegraded":"2023-05-24T03:32:40.102248+0000","last_fullsized":"2023-05-24T03:32:40.102248+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'31","last_scrub_stamp":"2023-05-24T03:32:40.102145+0000","last_deep_scrub":"30'31","last_deep_scrub_stamp":"2023-05-24T03:32:40.102145+0000","last_clean_scrub_stamp":"2023-05-24T03:32:40.102145+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:18:59.738856+0000","scrub_duration":0.0016287210000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"30'25","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:33.878107+0000","last_change":"2023-05-24T03:32:33.878173+0000","last_active":"2023-05-24T03:32:33.878107+0000","last_peered":"2023-05-24T03:32:33.878107+0000","last_clean":"2023-05-24T03:32:33.878107+0000","last_became_active":"2023-05-24T03:29:44.481004+0000","last_became_peered":"2023-05-24T03:29:44.481004+0000","last_unstale":"2023-05-24T03:32:33.878107+0000","last_undegraded":"2023-05-24T03:32:33.878107+0000","last_fullsized":"2023-05-24T03:32:33.878107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'25","last_scrub_stamp":"2023-05-24T03:32:33.878004+0000","last_deep_scrub":"30'25","last_deep_scrub_stamp":"2023-05-24T03:32:33.878004+0000","last_clean_scrub_stamp":"2023-05-24T03:32:33.878004+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:10:31.053796+0000","scrub_duration":0.0019292770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"30'38","reported_seq":71,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:12.991958+0000","last_change":"2023-05-24T03:32:12.992009+0000","last_active":"2023-05-24T03:32:12.991958+0000","last_peered":"2023-05-24T03:32:12.991958+0000","last_clean":"2023-05-24T03:32:12.991958+0000","last_became_active":"2023-05-24T03:29:44.481686+0000","last_became_peered":"2023-05-24T03:29:44.481686+0000","last_unstale":"2023-05-24T03:32:12.991958+0000","last_undegraded":"2023-05-24T03:32:12.991958+0000","last_fullsized":"2023-05-24T03:32:12.991958+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'38","last_scrub_stamp":"2023-05-24T03:32:12.991844+0000","last_deep_scrub":"30'38","last_deep_scrub_stamp":"2023-05-24T03:32:12.991844+0000","last_clean_scrub_stamp":"2023-05-24T03:32:12.991844+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:11:02.613201+0000","scrub_duration":0.0013478520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"30'26","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:42.422520+0000","last_change":"2023-05-24T03:32:42.422571+0000","last_active":"2023-05-24T03:32:42.422520+0000","last_peered":"2023-05-24T03:32:42.422520+0000","last_clean":"2023-05-24T03:32:42.422520+0000","last_became_active":"2023-05-24T03:29:44.502669+0000","last_became_peered":"2023-05-24T03:29:44.502669+0000","last_unstale":"2023-05-24T03:32:42.422520+0000","last_undegraded":"2023-05-24T03:32:42.422520+0000","last_fullsized":"2023-05-24T03:32:42.422520+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'26","last_scrub_stamp":"2023-05-24T03:32:42.422420+0000","last_deep_scrub":"30'26","last_deep_scrub_stamp":"2023-05-24T03:32:42.422420+0000","last_clean_scrub_stamp":"2023-05-24T03:32:42.422420+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:58:02.074039+0000","scrub_duration":0.001487106,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"30'474","reported_seq":493,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:06.604588+0000","last_change":"2023-05-24T03:29:48.523138+0000","last_active":"2023-05-24T03:32:06.604588+0000","last_peered":"2023-05-24T03:32:06.604588+0000","last_clean":"2023-05-24T03:32:06.604588+0000","last_became_active":"2023-05-24T03:29:48.522749+0000","last_became_peered":"2023-05-24T03:29:48.522749+0000","last_unstale":"2023-05-24T03:32:06.604588+0000","last_undegraded":"2023-05-24T03:32:06.604588+0000","last_fullsized":"2023-05-24T03:32:06.604588+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:37.284844+0000","last_change":"2023-05-24T03:32:37.284943+0000","last_active":"2023-05-24T03:32:37.284844+0000","last_peered":"2023-05-24T03:32:37.284844+0000","last_clean":"2023-05-24T03:32:37.284844+0000","last_became_active":"2023-05-24T03:29:44.086143+0000","last_became_peered":"2023-05-24T03:29:44.086143+0000","last_unstale":"2023-05-24T03:32:37.284844+0000","last_undegraded":"2023-05-24T03:32:37.284844+0000","last_fullsized":"2023-05-24T03:32:37.284844+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-05-24T03:32:37.284689+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-05-24T03:32:37.284689+0000","last_clean_scrub_stamp":"2023-05-24T03:32:37.284689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T03:50:08.327208+0000","scrub_duration":0.0019021800000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'39","reported_seq":72,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:06.778805+0000","last_change":"2023-05-24T03:32:06.778805+0000","last_active":"2023-05-24T03:32:06.778805+0000","last_peered":"2023-05-24T03:32:06.778805+0000","last_clean":"2023-05-24T03:32:06.778805+0000","last_became_active":"2023-05-24T03:29:44.490772+0000","last_became_peered":"2023-05-24T03:29:44.490772+0000","last_unstale":"2023-05-24T03:32:06.778805+0000","last_undegraded":"2023-05-24T03:32:06.778805+0000","last_fullsized":"2023-05-24T03:32:06.778805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'39","last_scrub_stamp":"2023-05-24T03:32:06.778698+0000","last_deep_scrub":"30'39","last_deep_scrub_stamp":"2023-05-24T03:32:06.778698+0000","last_clean_scrub_stamp":"2023-05-24T03:32:06.778698+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:31:15.880804+0000","scrub_duration":0.0014151050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"30'444","reported_seq":471,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:34.799588+0000","last_change":"2023-05-24T03:32:34.799688+0000","last_active":"2023-05-24T03:32:34.799588+0000","last_peered":"2023-05-24T03:32:34.799588+0000","last_clean":"2023-05-24T03:32:34.799588+0000","last_became_active":"2023-05-24T03:29:48.523125+0000","last_became_peered":"2023-05-24T03:29:48.523125+0000","last_unstale":"2023-05-24T03:32:34.799588+0000","last_undegraded":"2023-05-24T03:32:34.799588+0000","last_fullsized":"2023-05-24T03:32:34.799588+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'444","last_scrub_stamp":"2023-05-24T03:32:34.799475+0000","last_deep_scrub":"30'444","last_deep_scrub_stamp":"2023-05-24T03:32:34.799475+0000","last_clean_scrub_stamp":"2023-05-24T03:32:34.799475+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:31:14.370115+0000","scrub_duration":0.0021951340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:27.924674+0000","last_change":"2023-05-24T03:32:27.924740+0000","last_active":"2023-05-24T03:32:27.924674+0000","last_peered":"2023-05-24T03:32:27.924674+0000","last_clean":"2023-05-24T03:32:27.924674+0000","last_became_active":"2023-05-24T03:29:44.084099+0000","last_became_peered":"2023-05-24T03:29:44.084099+0000","last_unstale":"2023-05-24T03:32:27.924674+0000","last_undegraded":"2023-05-24T03:32:27.924674+0000","last_fullsized":"2023-05-24T03:32:27.924674+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:27.924570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:27.924570+0000","last_clean_scrub_stamp":"2023-05-24T03:32:27.924570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:04:08.141178+0000","scrub_duration":0.001356494,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"30'31","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:43.340857+0000","last_change":"2023-05-24T03:32:43.340905+0000","last_active":"2023-05-24T03:32:43.340857+0000","last_peered":"2023-05-24T03:32:43.340857+0000","last_clean":"2023-05-24T03:32:43.340857+0000","last_became_active":"2023-05-24T03:29:44.503039+0000","last_became_peered":"2023-05-24T03:29:44.503039+0000","last_unstale":"2023-05-24T03:32:43.340857+0000","last_undegraded":"2023-05-24T03:32:43.340857+0000","last_fullsized":"2023-05-24T03:32:43.340857+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'31","last_scrub_stamp":"2023-05-24T03:32:43.340745+0000","last_deep_scrub":"30'31","last_deep_scrub_stamp":"2023-05-24T03:32:43.340745+0000","last_clean_scrub_stamp":"2023-05-24T03:32:43.340745+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:46:27.466145+0000","scrub_duration":0.001774086,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"30'454","reported_seq":473,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:01.666380+0000","last_change":"2023-05-24T03:29:48.529615+0000","last_active":"2023-05-24T03:32:01.666380+0000","last_peered":"2023-05-24T03:32:01.666380+0000","last_clean":"2023-05-24T03:32:01.666380+0000","last_became_active":"2023-05-24T03:29:48.529142+0000","last_became_peered":"2023-05-24T03:29:48.529142+0000","last_unstale":"2023-05-24T03:32:01.666380+0000","last_undegraded":"2023-05-24T03:32:01.666380+0000","last_fullsized":"2023-05-24T03:32:01.666380+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"30'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:21.861680+0000","last_change":"2023-05-24T03:32:21.861728+0000","last_active":"2023-05-24T03:32:21.861680+0000","last_peered":"2023-05-24T03:32:21.861680+0000","last_clean":"2023-05-24T03:32:21.861680+0000","last_became_active":"2023-05-24T03:29:44.084907+0000","last_became_peered":"2023-05-24T03:29:44.084907+0000","last_unstale":"2023-05-24T03:32:21.861680+0000","last_undegraded":"2023-05-24T03:32:21.861680+0000","last_fullsized":"2023-05-24T03:32:21.861680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-05-24T03:32:21.861585+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-05-24T03:32:21.861585+0000","last_clean_scrub_stamp":"2023-05-24T03:32:21.861585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:59:22.498081+0000","scrub_duration":0.0014618840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"30'30","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:27.920731+0000","last_change":"2023-05-24T03:32:27.920774+0000","last_active":"2023-05-24T03:32:27.920731+0000","last_peered":"2023-05-24T03:32:27.920731+0000","last_clean":"2023-05-24T03:32:27.920731+0000","last_became_active":"2023-05-24T03:29:44.496746+0000","last_became_peered":"2023-05-24T03:29:44.496746+0000","last_unstale":"2023-05-24T03:32:27.920731+0000","last_undegraded":"2023-05-24T03:32:27.920731+0000","last_fullsized":"2023-05-24T03:32:27.920731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2023-05-24T03:32:27.920648+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2023-05-24T03:32:27.920648+0000","last_clean_scrub_stamp":"2023-05-24T03:32:27.920648+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:59:00.870767+0000","scrub_duration":0.001516101,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"30'468","reported_seq":495,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:39.854622+0000","last_change":"2023-05-24T03:32:39.854702+0000","last_active":"2023-05-24T03:32:39.854622+0000","last_peered":"2023-05-24T03:32:39.854622+0000","last_clean":"2023-05-24T03:32:39.854622+0000","last_became_active":"2023-05-24T03:29:48.520319+0000","last_became_peered":"2023-05-24T03:29:48.520319+0000","last_unstale":"2023-05-24T03:32:39.854622+0000","last_undegraded":"2023-05-24T03:32:39.854622+0000","last_fullsized":"2023-05-24T03:32:39.854622+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'468","last_scrub_stamp":"2023-05-24T03:32:39.854508+0000","last_deep_scrub":"30'468","last_deep_scrub_stamp":"2023-05-24T03:32:39.854508+0000","last_clean_scrub_stamp":"2023-05-24T03:32:39.854508+0000","objects_scrubbed":1,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:06:16.342886+0000","scrub_duration":0.0070678420000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"30'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:16.397784+0000","last_change":"2023-05-24T03:32:16.397828+0000","last_active":"2023-05-24T03:32:16.397784+0000","last_peered":"2023-05-24T03:32:16.397784+0000","last_clean":"2023-05-24T03:32:16.397784+0000","last_became_active":"2023-05-24T03:29:44.088267+0000","last_became_peered":"2023-05-24T03:29:44.088267+0000","last_unstale":"2023-05-24T03:32:16.397784+0000","last_undegraded":"2023-05-24T03:32:16.397784+0000","last_fullsized":"2023-05-24T03:32:16.397784+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-05-24T03:32:16.397687+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-05-24T03:32:16.397687+0000","last_clean_scrub_stamp":"2023-05-24T03:32:16.397687+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:36:49.030839+0000","scrub_duration":0.0020232230000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"30'27","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:10.842423+0000","last_change":"2023-05-24T03:32:10.842496+0000","last_active":"2023-05-24T03:32:10.842423+0000","last_peered":"2023-05-24T03:32:10.842423+0000","last_clean":"2023-05-24T03:32:10.842423+0000","last_became_active":"2023-05-24T03:29:44.488666+0000","last_became_peered":"2023-05-24T03:29:44.488666+0000","last_unstale":"2023-05-24T03:32:10.842423+0000","last_undegraded":"2023-05-24T03:32:10.842423+0000","last_fullsized":"2023-05-24T03:32:10.842423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'27","last_scrub_stamp":"2023-05-24T03:32:10.842313+0000","last_deep_scrub":"30'27","last_deep_scrub_stamp":"2023-05-24T03:32:10.842313+0000","last_clean_scrub_stamp":"2023-05-24T03:32:10.842313+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:36:43.475465+0000","scrub_duration":0.001460512,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"30'453","reported_seq":472,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:08.096211+0000","last_change":"2023-05-24T03:29:48.518108+0000","last_active":"2023-05-24T03:32:08.096211+0000","last_peered":"2023-05-24T03:32:08.096211+0000","last_clean":"2023-05-24T03:32:08.096211+0000","last_became_active":"2023-05-24T03:29:48.517771+0000","last_became_peered":"2023-05-24T03:29:48.517771+0000","last_unstale":"2023-05-24T03:32:08.096211+0000","last_undegraded":"2023-05-24T03:32:08.096211+0000","last_fullsized":"2023-05-24T03:32:08.096211+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:29.379299+0000","last_change":"2023-05-24T03:32:29.379343+0000","last_active":"2023-05-24T03:32:29.379299+0000","last_peered":"2023-05-24T03:32:29.379299+0000","last_clean":"2023-05-24T03:32:29.379299+0000","last_became_active":"2023-05-24T03:29:44.087601+0000","last_became_peered":"2023-05-24T03:29:44.087601+0000","last_unstale":"2023-05-24T03:32:29.379299+0000","last_undegraded":"2023-05-24T03:32:29.379299+0000","last_fullsized":"2023-05-24T03:32:29.379299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:29.379207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:29.379207+0000","last_clean_scrub_stamp":"2023-05-24T03:32:29.379207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:11:57.762308+0000","scrub_duration":0.001464873,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"30'36","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:38.042737+0000","last_change":"2023-05-24T03:32:38.042785+0000","last_active":"2023-05-24T03:32:38.042737+0000","last_peered":"2023-05-24T03:32:38.042737+0000","last_clean":"2023-05-24T03:32:38.042737+0000","last_became_active":"2023-05-24T03:29:44.495752+0000","last_became_peered":"2023-05-24T03:29:44.495752+0000","last_unstale":"2023-05-24T03:32:38.042737+0000","last_undegraded":"2023-05-24T03:32:38.042737+0000","last_fullsized":"2023-05-24T03:32:38.042737+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'36","last_scrub_stamp":"2023-05-24T03:32:38.042641+0000","last_deep_scrub":"30'36","last_deep_scrub_stamp":"2023-05-24T03:32:38.042641+0000","last_clean_scrub_stamp":"2023-05-24T03:32:38.042641+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:46:22.168041+0000","scrub_duration":0.00190278,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"30'480","reported_seq":499,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:06.103520+0000","last_change":"2023-05-24T03:29:48.529893+0000","last_active":"2023-05-24T03:32:06.103520+0000","last_peered":"2023-05-24T03:32:06.103520+0000","last_clean":"2023-05-24T03:32:06.103520+0000","last_became_active":"2023-05-24T03:29:48.529514+0000","last_became_peered":"2023-05-24T03:29:48.529514+0000","last_unstale":"2023-05-24T03:32:06.103520+0000","last_undegraded":"2023-05-24T03:32:06.103520+0000","last_fullsized":"2023-05-24T03:32:06.103520+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"30'13","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:30.169052+0000","last_change":"2023-05-24T03:32:30.169101+0000","last_active":"2023-05-24T03:32:30.169052+0000","last_peered":"2023-05-24T03:32:30.169052+0000","last_clean":"2023-05-24T03:32:30.169052+0000","last_became_active":"2023-05-24T03:29:44.091390+0000","last_became_peered":"2023-05-24T03:29:44.091390+0000","last_unstale":"2023-05-24T03:32:30.169052+0000","last_undegraded":"2023-05-24T03:32:30.169052+0000","last_fullsized":"2023-05-24T03:32:30.169052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'13","last_scrub_stamp":"2023-05-24T03:32:30.168959+0000","last_deep_scrub":"30'13","last_deep_scrub_stamp":"2023-05-24T03:32:30.168959+0000","last_clean_scrub_stamp":"2023-05-24T03:32:30.168959+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:07:38.026869+0000","scrub_duration":0.003670534,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"30'42","reported_seq":75,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:28.880132+0000","last_change":"2023-05-24T03:32:28.880189+0000","last_active":"2023-05-24T03:32:28.880132+0000","last_peered":"2023-05-24T03:32:28.880132+0000","last_clean":"2023-05-24T03:32:28.880132+0000","last_became_active":"2023-05-24T03:29:44.481385+0000","last_became_peered":"2023-05-24T03:29:44.481385+0000","last_unstale":"2023-05-24T03:32:28.880132+0000","last_undegraded":"2023-05-24T03:32:28.880132+0000","last_fullsized":"2023-05-24T03:32:28.880132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'42","last_scrub_stamp":"2023-05-24T03:32:28.880056+0000","last_deep_scrub":"30'42","last_deep_scrub_stamp":"2023-05-24T03:32:28.880056+0000","last_clean_scrub_stamp":"2023-05-24T03:32:28.880056+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:50:10.559202+0000","scrub_duration":0.0020578609999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"30'471","reported_seq":498,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:43.963240+0000","last_change":"2023-05-24T03:32:43.963307+0000","last_active":"2023-05-24T03:32:43.963240+0000","last_peered":"2023-05-24T03:32:43.963240+0000","last_clean":"2023-05-24T03:32:43.963240+0000","last_became_active":"2023-05-24T03:29:48.524312+0000","last_became_peered":"2023-05-24T03:29:48.524312+0000","last_unstale":"2023-05-24T03:32:43.963240+0000","last_undegraded":"2023-05-24T03:32:43.963240+0000","last_fullsized":"2023-05-24T03:32:43.963240+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'471","last_scrub_stamp":"2023-05-24T03:32:43.963153+0000","last_deep_scrub":"30'471","last_deep_scrub_stamp":"2023-05-24T03:32:43.963153+0000","last_clean_scrub_stamp":"2023-05-24T03:32:43.963153+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:46:28.088553+0000","scrub_duration":0.0020290159999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"30'402","reported_seq":437,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:42.277172+0000","last_change":"2023-05-24T03:32:42.277223+0000","last_active":"2023-05-24T03:32:42.277172+0000","last_peered":"2023-05-24T03:32:42.277172+0000","last_clean":"2023-05-24T03:32:42.277172+0000","last_became_active":"2023-05-24T03:29:44.078785+0000","last_became_peered":"2023-05-24T03:29:44.078785+0000","last_unstale":"2023-05-24T03:32:42.277172+0000","last_undegraded":"2023-05-24T03:32:42.277172+0000","last_fullsized":"2023-05-24T03:32:42.277172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'402","last_scrub_stamp":"2023-05-24T03:32:42.277084+0000","last_deep_scrub":"30'402","last_deep_scrub_stamp":"2023-05-24T03:32:42.277084+0000","last_clean_scrub_stamp":"2023-05-24T03:32:42.277084+0000","objects_scrubbed":4,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:31:59.386881+0000","scrub_duration":0.0082326540000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1544734,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":399,"num_write_kb":1772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"30'41","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:06.604332+0000","last_change":"2023-05-24T03:29:44.497603+0000","last_active":"2023-05-24T03:32:06.604332+0000","last_peered":"2023-05-24T03:32:06.604332+0000","last_clean":"2023-05-24T03:32:06.604332+0000","last_became_active":"2023-05-24T03:29:44.497120+0000","last_became_peered":"2023-05-24T03:29:44.497120+0000","last_unstale":"2023-05-24T03:32:06.604332+0000","last_undegraded":"2023-05-24T03:32:06.604332+0000","last_fullsized":"2023-05-24T03:32:06.604332+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"30'438","reported_seq":457,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:07.101570+0000","last_change":"2023-05-24T03:29:48.531846+0000","last_active":"2023-05-24T03:32:07.101570+0000","last_peered":"2023-05-24T03:32:07.101570+0000","last_clean":"2023-05-24T03:32:07.101570+0000","last_became_active":"2023-05-24T03:29:48.531538+0000","last_became_peered":"2023-05-24T03:29:48.531538+0000","last_unstale":"2023-05-24T03:32:07.101570+0000","last_undegraded":"2023-05-24T03:32:07.101570+0000","last_fullsized":"2023-05-24T03:32:07.101570+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"30'5","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:28.074124+0000","last_change":"2023-05-24T03:32:28.074186+0000","last_active":"2023-05-24T03:32:28.074124+0000","last_peered":"2023-05-24T03:32:28.074124+0000","last_clean":"2023-05-24T03:32:28.074124+0000","last_became_active":"2023-05-24T03:29:44.086997+0000","last_became_peered":"2023-05-24T03:29:44.086997+0000","last_unstale":"2023-05-24T03:32:28.074124+0000","last_undegraded":"2023-05-24T03:32:28.074124+0000","last_fullsized":"2023-05-24T03:32:28.074124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'5","last_scrub_stamp":"2023-05-24T03:32:28.074042+0000","last_deep_scrub":"30'5","last_deep_scrub_stamp":"2023-05-24T03:32:28.074042+0000","last_clean_scrub_stamp":"2023-05-24T03:32:28.074042+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:50:09.753188+0000","scrub_duration":0.0031652949999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"30'29","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:41.963802+0000","last_change":"2023-05-24T03:32:41.963850+0000","last_active":"2023-05-24T03:32:41.963802+0000","last_peered":"2023-05-24T03:32:41.963802+0000","last_clean":"2023-05-24T03:32:41.963802+0000","last_became_active":"2023-05-24T03:29:44.487257+0000","last_became_peered":"2023-05-24T03:29:44.487257+0000","last_unstale":"2023-05-24T03:32:41.963802+0000","last_undegraded":"2023-05-24T03:32:41.963802+0000","last_fullsized":"2023-05-24T03:32:41.963802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'29","last_scrub_stamp":"2023-05-24T03:32:41.963713+0000","last_deep_scrub":"30'29","last_deep_scrub_stamp":"2023-05-24T03:32:41.963713+0000","last_clean_scrub_stamp":"2023-05-24T03:32:41.963713+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:58:01.615331+0000","scrub_duration":0.001302131,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"30'470","reported_seq":489,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:06.103472+0000","last_change":"2023-05-24T03:29:48.526115+0000","last_active":"2023-05-24T03:32:06.103472+0000","last_peered":"2023-05-24T03:32:06.103472+0000","last_clean":"2023-05-24T03:32:06.103472+0000","last_became_active":"2023-05-24T03:29:48.525726+0000","last_became_peered":"2023-05-24T03:29:48.525726+0000","last_unstale":"2023-05-24T03:32:06.103472+0000","last_undegraded":"2023-05-24T03:32:06.103472+0000","last_fullsized":"2023-05-24T03:32:06.103472+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:13.389468+0000","last_change":"2023-05-24T03:32:13.389511+0000","last_active":"2023-05-24T03:32:13.389468+0000","last_peered":"2023-05-24T03:32:13.389468+0000","last_clean":"2023-05-24T03:32:13.389468+0000","last_became_active":"2023-05-24T03:29:44.084278+0000","last_became_peered":"2023-05-24T03:29:44.084278+0000","last_unstale":"2023-05-24T03:32:13.389468+0000","last_undegraded":"2023-05-24T03:32:13.389468+0000","last_fullsized":"2023-05-24T03:32:13.389468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:13.389382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:13.389382+0000","last_clean_scrub_stamp":"2023-05-24T03:32:13.389382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:05:36.605139+0000","scrub_duration":0.0019599439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"30'33","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:10.564131+0000","last_change":"2023-05-24T03:32:10.564131+0000","last_active":"2023-05-24T03:32:10.564131+0000","last_peered":"2023-05-24T03:32:10.564131+0000","last_clean":"2023-05-24T03:32:10.564131+0000","last_became_active":"2023-05-24T03:29:44.498097+0000","last_became_peered":"2023-05-24T03:29:44.498097+0000","last_unstale":"2023-05-24T03:32:10.564131+0000","last_undegraded":"2023-05-24T03:32:10.564131+0000","last_fullsized":"2023-05-24T03:32:10.564131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'33","last_scrub_stamp":"2023-05-24T03:32:10.563952+0000","last_deep_scrub":"30'33","last_deep_scrub_stamp":"2023-05-24T03:32:10.563952+0000","last_clean_scrub_stamp":"2023-05-24T03:32:10.563952+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:36:43.197104+0000","scrub_duration":0.001462594,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"30'446","reported_seq":465,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:06.103453+0000","last_change":"2023-05-24T03:29:48.525018+0000","last_active":"2023-05-24T03:32:06.103453+0000","last_peered":"2023-05-24T03:32:06.103453+0000","last_clean":"2023-05-24T03:32:06.103453+0000","last_became_active":"2023-05-24T03:29:48.524602+0000","last_became_peered":"2023-05-24T03:29:48.524602+0000","last_unstale":"2023-05-24T03:32:06.103453+0000","last_undegraded":"2023-05-24T03:32:06.103453+0000","last_fullsized":"2023-05-24T03:32:06.103453+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"30'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:29.117566+0000","last_change":"2023-05-24T03:32:29.117619+0000","last_active":"2023-05-24T03:32:29.117566+0000","last_peered":"2023-05-24T03:32:29.117566+0000","last_clean":"2023-05-24T03:32:29.117566+0000","last_became_active":"2023-05-24T03:29:44.085001+0000","last_became_peered":"2023-05-24T03:29:44.085001+0000","last_unstale":"2023-05-24T03:32:29.117566+0000","last_undegraded":"2023-05-24T03:32:29.117566+0000","last_fullsized":"2023-05-24T03:32:29.117566+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-05-24T03:32:29.117451+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-05-24T03:32:29.117451+0000","last_clean_scrub_stamp":"2023-05-24T03:32:29.117451+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:00:25.037831+0000","scrub_duration":0.0015173610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"30'40","reported_seq":73,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:10.302878+0000","last_change":"2023-05-24T03:32:10.302878+0000","last_active":"2023-05-24T03:32:10.302878+0000","last_peered":"2023-05-24T03:32:10.302878+0000","last_clean":"2023-05-24T03:32:10.302878+0000","last_became_active":"2023-05-24T03:29:44.500631+0000","last_became_peered":"2023-05-24T03:29:44.500631+0000","last_unstale":"2023-05-24T03:32:10.302878+0000","last_undegraded":"2023-05-24T03:32:10.302878+0000","last_fullsized":"2023-05-24T03:32:10.302878+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'40","last_scrub_stamp":"2023-05-24T03:32:10.302703+0000","last_deep_scrub":"30'40","last_deep_scrub_stamp":"2023-05-24T03:32:10.302703+0000","last_clean_scrub_stamp":"2023-05-24T03:32:10.302703+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:05:46.791081+0000","scrub_duration":0.0016110149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"30'491","reported_seq":510,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:07.101564+0000","last_change":"2023-05-24T03:29:48.523523+0000","last_active":"2023-05-24T03:32:07.101564+0000","last_peered":"2023-05-24T03:32:07.101564+0000","last_clean":"2023-05-24T03:32:07.101564+0000","last_became_active":"2023-05-24T03:29:48.523138+0000","last_became_peered":"2023-05-24T03:29:48.523138+0000","last_unstale":"2023-05-24T03:32:07.101564+0000","last_undegraded":"2023-05-24T03:32:07.101564+0000","last_fullsized":"2023-05-24T03:32:07.101564+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"30'12","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:08.888415+0000","last_change":"2023-05-24T03:32:08.888472+0000","last_active":"2023-05-24T03:32:08.888415+0000","last_peered":"2023-05-24T03:32:08.888415+0000","last_clean":"2023-05-24T03:32:08.888415+0000","last_became_active":"2023-05-24T03:29:44.084914+0000","last_became_peered":"2023-05-24T03:29:44.084914+0000","last_unstale":"2023-05-24T03:32:08.888415+0000","last_undegraded":"2023-05-24T03:32:08.888415+0000","last_fullsized":"2023-05-24T03:32:08.888415+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'12","last_scrub_stamp":"2023-05-24T03:32:08.888326+0000","last_deep_scrub":"30'12","last_deep_scrub_stamp":"2023-05-24T03:32:08.888326+0000","last_clean_scrub_stamp":"2023-05-24T03:32:08.888326+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:48:53.009441+0000","scrub_duration":0.0042668330000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"30'32","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:06.103389+0000","last_change":"2023-05-24T03:29:44.496038+0000","last_active":"2023-05-24T03:32:06.103389+0000","last_peered":"2023-05-24T03:32:06.103389+0000","last_clean":"2023-05-24T03:32:06.103389+0000","last_became_active":"2023-05-24T03:29:44.495795+0000","last_became_peered":"2023-05-24T03:29:44.495795+0000","last_unstale":"2023-05-24T03:32:06.103389+0000","last_undegraded":"2023-05-24T03:32:06.103389+0000","last_fullsized":"2023-05-24T03:32:06.103389+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"30'445","reported_seq":464,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:01.944326+0000","last_change":"2023-05-24T03:29:48.518930+0000","last_active":"2023-05-24T03:32:01.944326+0000","last_peered":"2023-05-24T03:32:01.944326+0000","last_clean":"2023-05-24T03:32:01.944326+0000","last_became_active":"2023-05-24T03:29:48.518531+0000","last_became_peered":"2023-05-24T03:29:48.518531+0000","last_unstale":"2023-05-24T03:32:01.944326+0000","last_undegraded":"2023-05-24T03:32:01.944326+0000","last_fullsized":"2023-05-24T03:32:01.944326+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"30'2","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:09.895065+0000","last_change":"2023-05-24T03:32:09.895117+0000","last_active":"2023-05-24T03:32:09.895065+0000","last_peered":"2023-05-24T03:32:09.895065+0000","last_clean":"2023-05-24T03:32:09.895065+0000","last_became_active":"2023-05-24T03:29:44.089340+0000","last_became_peered":"2023-05-24T03:29:44.089340+0000","last_unstale":"2023-05-24T03:32:09.895065+0000","last_undegraded":"2023-05-24T03:32:09.895065+0000","last_fullsized":"2023-05-24T03:32:09.895065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2023-05-24T03:32:09.894975+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2023-05-24T03:32:09.894975+0000","last_clean_scrub_stamp":"2023-05-24T03:32:09.894975+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:10:59.516332+0000","scrub_duration":0.0029320729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"30'29","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:39.378526+0000","last_change":"2023-05-24T03:32:39.378610+0000","last_active":"2023-05-24T03:32:39.378526+0000","last_peered":"2023-05-24T03:32:39.378526+0000","last_clean":"2023-05-24T03:32:39.378526+0000","last_became_active":"2023-05-24T03:29:44.497795+0000","last_became_peered":"2023-05-24T03:29:44.497795+0000","last_unstale":"2023-05-24T03:32:39.378526+0000","last_undegraded":"2023-05-24T03:32:39.378526+0000","last_fullsized":"2023-05-24T03:32:39.378526+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'29","last_scrub_stamp":"2023-05-24T03:32:39.378407+0000","last_deep_scrub":"30'29","last_deep_scrub_stamp":"2023-05-24T03:32:39.378407+0000","last_clean_scrub_stamp":"2023-05-24T03:32:39.378407+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:46:23.503808+0000","scrub_duration":0.0016008050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"30'418","reported_seq":445,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:34.884323+0000","last_change":"2023-05-24T03:32:34.884417+0000","last_active":"2023-05-24T03:32:34.884323+0000","last_peered":"2023-05-24T03:32:34.884323+0000","last_clean":"2023-05-24T03:32:34.884323+0000","last_became_active":"2023-05-24T03:29:48.520899+0000","last_became_peered":"2023-05-24T03:29:48.520899+0000","last_unstale":"2023-05-24T03:32:34.884323+0000","last_undegraded":"2023-05-24T03:32:34.884323+0000","last_fullsized":"2023-05-24T03:32:34.884323+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'418","last_scrub_stamp":"2023-05-24T03:32:34.884196+0000","last_deep_scrub":"30'418","last_deep_scrub_stamp":"2023-05-24T03:32:34.884196+0000","last_clean_scrub_stamp":"2023-05-24T03:32:34.884196+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:27:57.934099+0000","scrub_duration":0.0021898960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"30'3","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:22.959017+0000","last_change":"2023-05-24T03:32:22.959064+0000","last_active":"2023-05-24T03:32:22.959017+0000","last_peered":"2023-05-24T03:32:22.959017+0000","last_clean":"2023-05-24T03:32:22.959017+0000","last_became_active":"2023-05-24T03:29:44.086054+0000","last_became_peered":"2023-05-24T03:29:44.086054+0000","last_unstale":"2023-05-24T03:32:22.959017+0000","last_undegraded":"2023-05-24T03:32:22.959017+0000","last_fullsized":"2023-05-24T03:32:22.959017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2023-05-24T03:32:22.958938+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2023-05-24T03:32:22.958938+0000","last_clean_scrub_stamp":"2023-05-24T03:32:22.958938+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:33:49.647593+0000","scrub_duration":0.0025152360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"30'32","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.739820+0000","last_change":"2023-05-24T03:30:25.949869+0000","last_active":"2023-05-24T03:32:00.739820+0000","last_peered":"2023-05-24T03:32:00.739820+0000","last_clean":"2023-05-24T03:32:00.739820+0000","last_became_active":"2023-05-24T03:30:25.949461+0000","last_became_peered":"2023-05-24T03:30:25.949461+0000","last_unstale":"2023-05-24T03:32:00.739820+0000","last_undegraded":"2023-05-24T03:32:00.739820+0000","last_fullsized":"2023-05-24T03:32:00.739820+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"30'464","reported_seq":491,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:31.887083+0000","last_change":"2023-05-24T03:32:31.887177+0000","last_active":"2023-05-24T03:32:31.887083+0000","last_peered":"2023-05-24T03:32:31.887083+0000","last_clean":"2023-05-24T03:32:31.887083+0000","last_became_active":"2023-05-24T03:29:48.521729+0000","last_became_peered":"2023-05-24T03:29:48.521729+0000","last_unstale":"2023-05-24T03:32:31.887083+0000","last_undegraded":"2023-05-24T03:32:31.887083+0000","last_fullsized":"2023-05-24T03:32:31.887083+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'464","last_scrub_stamp":"2023-05-24T03:32:31.886982+0000","last_deep_scrub":"30'464","last_deep_scrub_stamp":"2023-05-24T03:32:31.886982+0000","last_clean_scrub_stamp":"2023-05-24T03:32:31.886982+0000","objects_scrubbed":2,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:20:01.986028+0000","scrub_duration":0.010190022999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"30'2","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:31.138320+0000","last_change":"2023-05-24T03:32:31.138368+0000","last_active":"2023-05-24T03:32:31.138320+0000","last_peered":"2023-05-24T03:32:31.138320+0000","last_clean":"2023-05-24T03:32:31.138320+0000","last_became_active":"2023-05-24T03:29:44.088459+0000","last_became_peered":"2023-05-24T03:29:44.088459+0000","last_unstale":"2023-05-24T03:32:31.138320+0000","last_undegraded":"2023-05-24T03:32:31.138320+0000","last_fullsized":"2023-05-24T03:32:31.138320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2023-05-24T03:32:31.138230+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2023-05-24T03:32:31.138230+0000","last_clean_scrub_stamp":"2023-05-24T03:32:31.138230+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:30:44.414149+0000","scrub_duration":0.003068529,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:28.882341+0000","last_change":"2023-05-24T03:32:28.882412+0000","last_active":"2023-05-24T03:32:28.882341+0000","last_peered":"2023-05-24T03:32:28.882341+0000","last_clean":"2023-05-24T03:32:28.882341+0000","last_became_active":"2023-05-24T03:29:44.489975+0000","last_became_peered":"2023-05-24T03:29:44.489975+0000","last_unstale":"2023-05-24T03:32:28.882341+0000","last_undegraded":"2023-05-24T03:32:28.882341+0000","last_fullsized":"2023-05-24T03:32:28.882341+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-05-24T03:32:28.882230+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-05-24T03:32:28.882230+0000","last_clean_scrub_stamp":"2023-05-24T03:32:28.882230+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:19:58.981277+0000","scrub_duration":0.001376541,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"30'485","reported_seq":512,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:30.876266+0000","last_change":"2023-05-24T03:32:30.876384+0000","last_active":"2023-05-24T03:32:30.876266+0000","last_peered":"2023-05-24T03:32:30.876266+0000","last_clean":"2023-05-24T03:32:30.876266+0000","last_became_active":"2023-05-24T03:29:48.523545+0000","last_became_peered":"2023-05-24T03:29:48.523545+0000","last_unstale":"2023-05-24T03:32:30.876266+0000","last_undegraded":"2023-05-24T03:32:30.876266+0000","last_fullsized":"2023-05-24T03:32:30.876266+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'485","last_scrub_stamp":"2023-05-24T03:32:30.876160+0000","last_deep_scrub":"30'485","last_deep_scrub_stamp":"2023-05-24T03:32:30.876160+0000","last_clean_scrub_stamp":"2023-05-24T03:32:30.876160+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:59:03.826280+0000","scrub_duration":0.0023153539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"30'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:26.389741+0000","last_change":"2023-05-24T03:32:26.389791+0000","last_active":"2023-05-24T03:32:26.389741+0000","last_peered":"2023-05-24T03:32:26.389741+0000","last_clean":"2023-05-24T03:32:26.389741+0000","last_became_active":"2023-05-24T03:29:44.090887+0000","last_became_peered":"2023-05-24T03:29:44.090887+0000","last_unstale":"2023-05-24T03:32:26.389741+0000","last_undegraded":"2023-05-24T03:32:26.389741+0000","last_fullsized":"2023-05-24T03:32:26.389741+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-05-24T03:32:26.389638+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-05-24T03:32:26.389638+0000","last_clean_scrub_stamp":"2023-05-24T03:32:26.389638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:24:45.305781+0000","scrub_duration":0.0020604579999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:40.371260+0000","last_change":"2023-05-24T03:32:40.371344+0000","last_active":"2023-05-24T03:32:40.371260+0000","last_peered":"2023-05-24T03:32:40.371260+0000","last_clean":"2023-05-24T03:32:40.371260+0000","last_became_active":"2023-05-24T03:29:44.502286+0000","last_became_peered":"2023-05-24T03:29:44.502286+0000","last_unstale":"2023-05-24T03:32:40.371260+0000","last_undegraded":"2023-05-24T03:32:40.371260+0000","last_fullsized":"2023-05-24T03:32:40.371260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-05-24T03:32:40.371157+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-05-24T03:32:40.371157+0000","last_clean_scrub_stamp":"2023-05-24T03:32:40.371157+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:19:00.007869+0000","scrub_duration":0.0014833030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"30'465","reported_seq":492,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:22.800201+0000","last_change":"2023-05-24T03:32:22.800291+0000","last_active":"2023-05-24T03:32:22.800201+0000","last_peered":"2023-05-24T03:32:22.800201+0000","last_clean":"2023-05-24T03:32:22.800201+0000","last_became_active":"2023-05-24T03:29:48.520960+0000","last_became_peered":"2023-05-24T03:29:48.520960+0000","last_unstale":"2023-05-24T03:32:22.800201+0000","last_undegraded":"2023-05-24T03:32:22.800201+0000","last_fullsized":"2023-05-24T03:32:22.800201+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'465","last_scrub_stamp":"2023-05-24T03:32:22.800112+0000","last_deep_scrub":"30'465","last_deep_scrub_stamp":"2023-05-24T03:32:22.800112+0000","last_clean_scrub_stamp":"2023-05-24T03:32:22.800112+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:12:49.176537+0000","scrub_duration":0.002159808,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"30'5","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:27.928743+0000","last_change":"2023-05-24T03:32:27.928811+0000","last_active":"2023-05-24T03:32:27.928743+0000","last_peered":"2023-05-24T03:32:27.928743+0000","last_clean":"2023-05-24T03:32:27.928743+0000","last_became_active":"2023-05-24T03:29:44.087869+0000","last_became_peered":"2023-05-24T03:29:44.087869+0000","last_unstale":"2023-05-24T03:32:27.928743+0000","last_undegraded":"2023-05-24T03:32:27.928743+0000","last_fullsized":"2023-05-24T03:32:27.928743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'5","last_scrub_stamp":"2023-05-24T03:32:27.928612+0000","last_deep_scrub":"30'5","last_deep_scrub_stamp":"2023-05-24T03:32:27.928612+0000","last_clean_scrub_stamp":"2023-05-24T03:32:27.928612+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:29:27.209611+0000","scrub_duration":0.002678092,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"30'27","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:01.934141+0000","last_change":"2023-05-24T03:29:44.501176+0000","last_active":"2023-05-24T03:32:01.934141+0000","last_peered":"2023-05-24T03:32:01.934141+0000","last_clean":"2023-05-24T03:32:01.934141+0000","last_became_active":"2023-05-24T03:29:44.499700+0000","last_became_peered":"2023-05-24T03:29:44.499700+0000","last_unstale":"2023-05-24T03:32:01.934141+0000","last_undegraded":"2023-05-24T03:32:01.934141+0000","last_fullsized":"2023-05-24T03:32:01.934141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"30'454","reported_seq":473,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:05.111223+0000","last_change":"2023-05-24T03:29:48.522778+0000","last_active":"2023-05-24T03:32:05.111223+0000","last_peered":"2023-05-24T03:32:05.111223+0000","last_clean":"2023-05-24T03:32:05.111223+0000","last_became_active":"2023-05-24T03:29:48.522104+0000","last_became_peered":"2023-05-24T03:29:48.522104+0000","last_unstale":"2023-05-24T03:32:05.111223+0000","last_undegraded":"2023-05-24T03:32:05.111223+0000","last_fullsized":"2023-05-24T03:32:05.111223+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"30'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:18.901139+0000","last_change":"2023-05-24T03:32:18.901206+0000","last_active":"2023-05-24T03:32:18.901139+0000","last_peered":"2023-05-24T03:32:18.901139+0000","last_clean":"2023-05-24T03:32:18.901139+0000","last_became_active":"2023-05-24T03:29:44.084894+0000","last_became_peered":"2023-05-24T03:29:44.084894+0000","last_unstale":"2023-05-24T03:32:18.901139+0000","last_undegraded":"2023-05-24T03:32:18.901139+0000","last_fullsized":"2023-05-24T03:32:18.901139+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-05-24T03:32:18.900978+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-05-24T03:32:18.900978+0000","last_clean_scrub_stamp":"2023-05-24T03:32:18.900978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:46:00.915679+0000","scrub_duration":0.001606307,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"30'30","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:11.477819+0000","last_change":"2023-05-24T03:32:11.477870+0000","last_active":"2023-05-24T03:32:11.477819+0000","last_peered":"2023-05-24T03:32:11.477819+0000","last_clean":"2023-05-24T03:32:11.477819+0000","last_became_active":"2023-05-24T03:29:44.492462+0000","last_became_peered":"2023-05-24T03:29:44.492462+0000","last_unstale":"2023-05-24T03:32:11.477819+0000","last_undegraded":"2023-05-24T03:32:11.477819+0000","last_fullsized":"2023-05-24T03:32:11.477819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2023-05-24T03:32:11.477715+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2023-05-24T03:32:11.477715+0000","last_clean_scrub_stamp":"2023-05-24T03:32:11.477715+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:30:24.753635+0000","scrub_duration":0.0019852670000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'486","reported_seq":505,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:06.929077+0000","last_change":"2023-05-24T03:29:48.524960+0000","last_active":"2023-05-24T03:32:06.929077+0000","last_peered":"2023-05-24T03:32:06.929077+0000","last_clean":"2023-05-24T03:32:06.929077+0000","last_became_active":"2023-05-24T03:29:48.524023+0000","last_became_peered":"2023-05-24T03:29:48.524023+0000","last_unstale":"2023-05-24T03:32:06.929077+0000","last_undegraded":"2023-05-24T03:32:06.929077+0000","last_fullsized":"2023-05-24T03:32:06.929077+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:45.324390+0000","last_change":"2023-05-24T03:32:45.324439+0000","last_active":"2023-05-24T03:32:45.324390+0000","last_peered":"2023-05-24T03:32:45.324390+0000","last_clean":"2023-05-24T03:32:45.324390+0000","last_became_active":"2023-05-24T03:29:44.082382+0000","last_became_peered":"2023-05-24T03:29:44.082382+0000","last_unstale":"2023-05-24T03:32:45.324390+0000","last_undegraded":"2023-05-24T03:32:45.324390+0000","last_fullsized":"2023-05-24T03:32:45.324390+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:45.324292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:45.324292+0000","last_clean_scrub_stamp":"2023-05-24T03:32:45.324292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:24:28.461427+0000","scrub_duration":0.001657642,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"30'17","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:01.934217+0000","last_change":"2023-05-24T03:29:44.501409+0000","last_active":"2023-05-24T03:32:01.934217+0000","last_peered":"2023-05-24T03:32:01.934217+0000","last_clean":"2023-05-24T03:32:01.934217+0000","last_became_active":"2023-05-24T03:29:44.501080+0000","last_became_peered":"2023-05-24T03:29:44.501080+0000","last_unstale":"2023-05-24T03:32:01.934217+0000","last_undegraded":"2023-05-24T03:32:01.934217+0000","last_fullsized":"2023-05-24T03:32:01.934217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"30'494","reported_seq":513,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:06.604511+0000","last_change":"2023-05-24T03:29:48.519383+0000","last_active":"2023-05-24T03:32:06.604511+0000","last_peered":"2023-05-24T03:32:06.604511+0000","last_clean":"2023-05-24T03:32:06.604511+0000","last_became_active":"2023-05-24T03:29:48.519046+0000","last_became_peered":"2023-05-24T03:29:48.519046+0000","last_unstale":"2023-05-24T03:32:06.604511+0000","last_undegraded":"2023-05-24T03:32:06.604511+0000","last_fullsized":"2023-05-24T03:32:06.604511+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:23.923628+0000","last_change":"2023-05-24T03:32:23.923670+0000","last_active":"2023-05-24T03:32:23.923628+0000","last_peered":"2023-05-24T03:32:23.923628+0000","last_clean":"2023-05-24T03:32:23.923628+0000","last_became_active":"2023-05-24T03:29:44.085420+0000","last_became_peered":"2023-05-24T03:29:44.085420+0000","last_unstale":"2023-05-24T03:32:23.923628+0000","last_undegraded":"2023-05-24T03:32:23.923628+0000","last_fullsized":"2023-05-24T03:32:23.923628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:23.923533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:23.923533+0000","last_clean_scrub_stamp":"2023-05-24T03:32:23.923533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:07:31.781443+0000","scrub_duration":0.0013943619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"30'28","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:41.934540+0000","last_change":"2023-05-24T03:32:41.934595+0000","last_active":"2023-05-24T03:32:41.934540+0000","last_peered":"2023-05-24T03:32:41.934540+0000","last_clean":"2023-05-24T03:32:41.934540+0000","last_became_active":"2023-05-24T03:29:44.491089+0000","last_became_peered":"2023-05-24T03:29:44.491089+0000","last_unstale":"2023-05-24T03:32:41.934540+0000","last_undegraded":"2023-05-24T03:32:41.934540+0000","last_fullsized":"2023-05-24T03:32:41.934540+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'28","last_scrub_stamp":"2023-05-24T03:32:41.934431+0000","last_deep_scrub":"30'28","last_deep_scrub_stamp":"2023-05-24T03:32:41.934431+0000","last_clean_scrub_stamp":"2023-05-24T03:32:41.934431+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:30:38.542441+0000","scrub_duration":0.0018100130000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"30'503","reported_seq":522,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:01.666282+0000","last_change":"2023-05-24T03:29:48.530105+0000","last_active":"2023-05-24T03:32:01.666282+0000","last_peered":"2023-05-24T03:32:01.666282+0000","last_clean":"2023-05-24T03:32:01.666282+0000","last_became_active":"2023-05-24T03:29:48.529157+0000","last_became_peered":"2023-05-24T03:29:48.529157+0000","last_unstale":"2023-05-24T03:32:01.666282+0000","last_undegraded":"2023-05-24T03:32:01.666282+0000","last_fullsized":"2023-05-24T03:32:01.666282+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:16.946886+0000","last_change":"2023-05-24T03:32:16.946931+0000","last_active":"2023-05-24T03:32:16.946886+0000","last_peered":"2023-05-24T03:32:16.946886+0000","last_clean":"2023-05-24T03:32:16.946886+0000","last_became_active":"2023-05-24T03:29:39.142867+0000","last_became_peered":"2023-05-24T03:29:39.142867+0000","last_unstale":"2023-05-24T03:32:16.946886+0000","last_undegraded":"2023-05-24T03:32:16.946886+0000","last_fullsized":"2023-05-24T03:32:16.946886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:16.946787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:16.946787+0000","last_clean_scrub_stamp":"2023-05-24T03:32:16.946787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:05:40.162544+0000","scrub_duration":0.0014754880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"30'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:24.411219+0000","last_change":"2023-05-24T03:32:24.411266+0000","last_active":"2023-05-24T03:32:24.411219+0000","last_peered":"2023-05-24T03:32:24.411219+0000","last_clean":"2023-05-24T03:32:24.411219+0000","last_became_active":"2023-05-24T03:29:44.087475+0000","last_became_peered":"2023-05-24T03:29:44.087475+0000","last_unstale":"2023-05-24T03:32:24.411219+0000","last_undegraded":"2023-05-24T03:32:24.411219+0000","last_fullsized":"2023-05-24T03:32:24.411219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-05-24T03:32:24.411126+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-05-24T03:32:24.411126+0000","last_clean_scrub_stamp":"2023-05-24T03:32:24.411126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:07:32.269036+0000","scrub_duration":0.0017507200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"30'30","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:30.858330+0000","last_change":"2023-05-24T03:32:30.858385+0000","last_active":"2023-05-24T03:32:30.858330+0000","last_peered":"2023-05-24T03:32:30.858330+0000","last_clean":"2023-05-24T03:32:30.858330+0000","last_became_active":"2023-05-24T03:29:44.497015+0000","last_became_peered":"2023-05-24T03:29:44.497015+0000","last_unstale":"2023-05-24T03:32:30.858330+0000","last_undegraded":"2023-05-24T03:32:30.858330+0000","last_fullsized":"2023-05-24T03:32:30.858330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2023-05-24T03:32:30.858227+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2023-05-24T03:32:30.858227+0000","last_clean_scrub_stamp":"2023-05-24T03:32:30.858227+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:07:38.716137+0000","scrub_duration":0.0018578329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"30'446","reported_seq":465,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:01.641624+0000","last_change":"2023-05-24T03:29:48.527805+0000","last_active":"2023-05-24T03:32:01.641624+0000","last_peered":"2023-05-24T03:32:01.641624+0000","last_clean":"2023-05-24T03:32:01.641624+0000","last_became_active":"2023-05-24T03:29:48.527010+0000","last_became_peered":"2023-05-24T03:29:48.527010+0000","last_unstale":"2023-05-24T03:32:01.641624+0000","last_undegraded":"2023-05-24T03:32:01.641624+0000","last_fullsized":"2023-05-24T03:32:01.641624+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:16.419663+0000","last_change":"2023-05-24T03:32:16.419711+0000","last_active":"2023-05-24T03:32:16.419663+0000","last_peered":"2023-05-24T03:32:16.419663+0000","last_clean":"2023-05-24T03:32:16.419663+0000","last_became_active":"2023-05-24T03:29:39.048141+0000","last_became_peered":"2023-05-24T03:29:39.048141+0000","last_unstale":"2023-05-24T03:32:16.419663+0000","last_undegraded":"2023-05-24T03:32:16.419663+0000","last_fullsized":"2023-05-24T03:32:16.419663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:16.419576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:16.419576+0000","last_clean_scrub_stamp":"2023-05-24T03:32:16.419576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:04:44.737412+0000","scrub_duration":0.0017607219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:38.260499+0000","last_change":"2023-05-24T03:32:38.260565+0000","last_active":"2023-05-24T03:32:38.260499+0000","last_peered":"2023-05-24T03:32:38.260499+0000","last_clean":"2023-05-24T03:32:38.260499+0000","last_became_active":"2023-05-24T03:29:44.084944+0000","last_became_peered":"2023-05-24T03:29:44.084944+0000","last_unstale":"2023-05-24T03:32:38.260499+0000","last_undegraded":"2023-05-24T03:32:38.260499+0000","last_fullsized":"2023-05-24T03:32:38.260499+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:38.260355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:38.260355+0000","last_clean_scrub_stamp":"2023-05-24T03:32:38.260355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:15:54.254973+0000","scrub_duration":0.0018685679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"30'30","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:34.920933+0000","last_change":"2023-05-24T03:32:34.920980+0000","last_active":"2023-05-24T03:32:34.920933+0000","last_peered":"2023-05-24T03:32:34.920933+0000","last_clean":"2023-05-24T03:32:34.920933+0000","last_became_active":"2023-05-24T03:29:44.483134+0000","last_became_peered":"2023-05-24T03:29:44.483134+0000","last_unstale":"2023-05-24T03:32:34.920933+0000","last_undegraded":"2023-05-24T03:32:34.920933+0000","last_fullsized":"2023-05-24T03:32:34.920933+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2023-05-24T03:32:34.920849+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2023-05-24T03:32:34.920849+0000","last_clean_scrub_stamp":"2023-05-24T03:32:34.920849+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:12:03.303951+0000","scrub_duration":0.0012902980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'483","reported_seq":510,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:23.782504+0000","last_change":"2023-05-24T03:32:23.782578+0000","last_active":"2023-05-24T03:32:23.782504+0000","last_peered":"2023-05-24T03:32:23.782504+0000","last_clean":"2023-05-24T03:32:23.782504+0000","last_became_active":"2023-05-24T03:29:48.518546+0000","last_became_peered":"2023-05-24T03:29:48.518546+0000","last_unstale":"2023-05-24T03:32:23.782504+0000","last_undegraded":"2023-05-24T03:32:23.782504+0000","last_fullsized":"2023-05-24T03:32:23.782504+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'483","last_scrub_stamp":"2023-05-24T03:32:23.782396+0000","last_deep_scrub":"30'483","last_deep_scrub_stamp":"2023-05-24T03:32:23.782396+0000","last_clean_scrub_stamp":"2023-05-24T03:32:23.782396+0000","objects_scrubbed":2,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:25:09.865806+0000","scrub_duration":0.0096269460000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:07.643826+0000","last_change":"2023-05-24T03:32:07.643860+0000","last_active":"2023-05-24T03:32:07.643826+0000","last_peered":"2023-05-24T03:32:07.643826+0000","last_clean":"2023-05-24T03:32:07.643826+0000","last_became_active":"2023-05-24T03:29:39.310070+0000","last_became_peered":"2023-05-24T03:29:39.310070+0000","last_unstale":"2023-05-24T03:32:07.643826+0000","last_undegraded":"2023-05-24T03:32:07.643826+0000","last_fullsized":"2023-05-24T03:32:07.643826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:07.643745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:07.643745+0000","last_clean_scrub_stamp":"2023-05-24T03:32:07.643745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:58:52.005449+0000","scrub_duration":0.0012050990000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:19.948337+0000","last_change":"2023-05-24T03:32:19.948384+0000","last_active":"2023-05-24T03:32:19.948337+0000","last_peered":"2023-05-24T03:32:19.948337+0000","last_clean":"2023-05-24T03:32:19.948337+0000","last_became_active":"2023-05-24T03:29:44.074551+0000","last_became_peered":"2023-05-24T03:29:44.074551+0000","last_unstale":"2023-05-24T03:32:19.948337+0000","last_undegraded":"2023-05-24T03:32:19.948337+0000","last_fullsized":"2023-05-24T03:32:19.948337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:19.948200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:19.948200+0000","last_clean_scrub_stamp":"2023-05-24T03:32:19.948200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:36:52.581352+0000","scrub_duration":0.0016279319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"30'29","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:31.862975+0000","last_change":"2023-05-24T03:32:31.863048+0000","last_active":"2023-05-24T03:32:31.862975+0000","last_peered":"2023-05-24T03:32:31.862975+0000","last_clean":"2023-05-24T03:32:31.862975+0000","last_became_active":"2023-05-24T03:29:44.496030+0000","last_became_peered":"2023-05-24T03:29:44.496030+0000","last_unstale":"2023-05-24T03:32:31.862975+0000","last_undegraded":"2023-05-24T03:32:31.862975+0000","last_fullsized":"2023-05-24T03:32:31.862975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'29","last_scrub_stamp":"2023-05-24T03:32:31.862868+0000","last_deep_scrub":"30'29","last_deep_scrub_stamp":"2023-05-24T03:32:31.862868+0000","last_clean_scrub_stamp":"2023-05-24T03:32:31.862868+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:30:45.138787+0000","scrub_duration":0.0022191820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"30'473","reported_seq":492,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:01.660137+0000","last_change":"2023-05-24T03:29:48.523816+0000","last_active":"2023-05-24T03:32:01.660137+0000","last_peered":"2023-05-24T03:32:01.660137+0000","last_clean":"2023-05-24T03:32:01.660137+0000","last_became_active":"2023-05-24T03:29:48.523380+0000","last_became_peered":"2023-05-24T03:29:48.523380+0000","last_unstale":"2023-05-24T03:32:01.660137+0000","last_undegraded":"2023-05-24T03:32:01.660137+0000","last_fullsized":"2023-05-24T03:32:01.660137+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:22.404970+0000","last_change":"2023-05-24T03:32:22.405017+0000","last_active":"2023-05-24T03:32:22.404970+0000","last_peered":"2023-05-24T03:32:22.404970+0000","last_clean":"2023-05-24T03:32:22.404970+0000","last_became_active":"2023-05-24T03:29:39.050751+0000","last_became_peered":"2023-05-24T03:29:39.050751+0000","last_unstale":"2023-05-24T03:32:22.404970+0000","last_undegraded":"2023-05-24T03:32:22.404970+0000","last_fullsized":"2023-05-24T03:32:22.404970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:22.404884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:22.404884+0000","last_clean_scrub_stamp":"2023-05-24T03:32:22.404884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:59:23.041380+0000","scrub_duration":0.001963167,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"30'119","reported_seq":199,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:13.842759+0000","last_change":"2023-05-24T03:32:13.842821+0000","last_active":"2023-05-24T03:32:13.842759+0000","last_peered":"2023-05-24T03:32:13.842759+0000","last_clean":"2023-05-24T03:32:13.842759+0000","last_became_active":"2023-05-24T03:29:34.024728+0000","last_became_peered":"2023-05-24T03:29:34.024728+0000","last_unstale":"2023-05-24T03:32:13.842759+0000","last_undegraded":"2023-05-24T03:32:13.842759+0000","last_fullsized":"2023-05-24T03:32:13.842759+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'119","last_scrub_stamp":"2023-05-24T03:32:13.842676+0000","last_deep_scrub":"30'119","last_deep_scrub_stamp":"2023-05-24T03:32:13.842676+0000","last_clean_scrub_stamp":"2023-05-24T03:32:13.842676+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:42:28.083910+0000","scrub_duration":0.0058238170000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:22.880053+0000","last_change":"2023-05-24T03:32:22.880113+0000","last_active":"2023-05-24T03:32:22.880053+0000","last_peered":"2023-05-24T03:32:22.880053+0000","last_clean":"2023-05-24T03:32:22.880053+0000","last_became_active":"2023-05-24T03:29:44.086125+0000","last_became_peered":"2023-05-24T03:29:44.086125+0000","last_unstale":"2023-05-24T03:32:22.880053+0000","last_undegraded":"2023-05-24T03:32:22.880053+0000","last_fullsized":"2023-05-24T03:32:22.880053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:22.879929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:22.879929+0000","last_clean_scrub_stamp":"2023-05-24T03:32:22.879929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:00:18.800309+0000","scrub_duration":0.002203432,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:20.988892+0000","last_change":"2023-05-24T03:32:20.988943+0000","last_active":"2023-05-24T03:32:20.988892+0000","last_peered":"2023-05-24T03:32:20.988892+0000","last_clean":"2023-05-24T03:32:20.988892+0000","last_became_active":"2023-05-24T03:29:44.492375+0000","last_became_peered":"2023-05-24T03:29:44.492375+0000","last_unstale":"2023-05-24T03:32:20.988892+0000","last_undegraded":"2023-05-24T03:32:20.988892+0000","last_fullsized":"2023-05-24T03:32:20.988892+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-05-24T03:32:20.988784+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-05-24T03:32:20.988784+0000","last_clean_scrub_stamp":"2023-05-24T03:32:20.988784+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:25:07.072195+0000","scrub_duration":0.001550034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"30'444","reported_seq":463,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:01.928519+0000","last_change":"2023-05-24T03:29:48.525206+0000","last_active":"2023-05-24T03:32:01.928519+0000","last_peered":"2023-05-24T03:32:01.928519+0000","last_clean":"2023-05-24T03:32:01.928519+0000","last_became_active":"2023-05-24T03:29:48.524615+0000","last_became_peered":"2023-05-24T03:29:48.524615+0000","last_unstale":"2023-05-24T03:32:01.928519+0000","last_undegraded":"2023-05-24T03:32:01.928519+0000","last_fullsized":"2023-05-24T03:32:01.928519+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:14.823133+0000","last_change":"2023-05-24T03:32:14.823177+0000","last_active":"2023-05-24T03:32:14.823133+0000","last_peered":"2023-05-24T03:32:14.823133+0000","last_clean":"2023-05-24T03:32:14.823133+0000","last_became_active":"2023-05-24T03:29:39.053813+0000","last_became_peered":"2023-05-24T03:29:39.053813+0000","last_unstale":"2023-05-24T03:32:14.823133+0000","last_undegraded":"2023-05-24T03:32:14.823133+0000","last_fullsized":"2023-05-24T03:32:14.823133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:14.823047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:14.823047+0000","last_clean_scrub_stamp":"2023-05-24T03:32:14.823047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:39:26.760598+0000","scrub_duration":0.0020759749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"30'16","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:28.422974+0000","last_change":"2023-05-24T03:32:28.423022+0000","last_active":"2023-05-24T03:32:28.422974+0000","last_peered":"2023-05-24T03:32:28.422974+0000","last_clean":"2023-05-24T03:32:28.422974+0000","last_became_active":"2023-05-24T03:29:44.089943+0000","last_became_peered":"2023-05-24T03:29:44.089943+0000","last_unstale":"2023-05-24T03:32:28.422974+0000","last_undegraded":"2023-05-24T03:32:28.422974+0000","last_fullsized":"2023-05-24T03:32:28.422974+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'16","last_scrub_stamp":"2023-05-24T03:32:28.422880+0000","last_deep_scrub":"30'16","last_deep_scrub_stamp":"2023-05-24T03:32:28.422880+0000","last_clean_scrub_stamp":"2023-05-24T03:32:28.422880+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:00:24.343260+0000","scrub_duration":0.0023423319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7752,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":19,"num_write":15,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"30'28","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:31.390565+0000","last_change":"2023-05-24T03:32:31.390638+0000","last_active":"2023-05-24T03:32:31.390565+0000","last_peered":"2023-05-24T03:32:31.390565+0000","last_clean":"2023-05-24T03:32:31.390565+0000","last_became_active":"2023-05-24T03:29:44.498130+0000","last_became_peered":"2023-05-24T03:29:44.498130+0000","last_unstale":"2023-05-24T03:32:31.390565+0000","last_undegraded":"2023-05-24T03:32:31.390565+0000","last_fullsized":"2023-05-24T03:32:31.390565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'28","last_scrub_stamp":"2023-05-24T03:32:31.390463+0000","last_deep_scrub":"30'28","last_deep_scrub_stamp":"2023-05-24T03:32:31.390463+0000","last_clean_scrub_stamp":"2023-05-24T03:32:31.390463+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:24:50.306607+0000","scrub_duration":0.001403886,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"30'496","reported_seq":523,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:42.905980+0000","last_change":"2023-05-24T03:32:42.906088+0000","last_active":"2023-05-24T03:32:42.905980+0000","last_peered":"2023-05-24T03:32:42.905980+0000","last_clean":"2023-05-24T03:32:42.905980+0000","last_became_active":"2023-05-24T03:29:48.519673+0000","last_became_peered":"2023-05-24T03:29:48.519673+0000","last_unstale":"2023-05-24T03:32:42.905980+0000","last_undegraded":"2023-05-24T03:32:42.905980+0000","last_fullsized":"2023-05-24T03:32:42.905980+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'496","last_scrub_stamp":"2023-05-24T03:32:42.905857+0000","last_deep_scrub":"30'496","last_deep_scrub_stamp":"2023-05-24T03:32:42.905857+0000","last_clean_scrub_stamp":"2023-05-24T03:32:42.905857+0000","objects_scrubbed":2,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:06:06.121614+0000","scrub_duration":0.0097576420000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:16.859220+0000","last_change":"2023-05-24T03:32:16.859267+0000","last_active":"2023-05-24T03:32:16.859220+0000","last_peered":"2023-05-24T03:32:16.859220+0000","last_clean":"2023-05-24T03:32:16.859220+0000","last_became_active":"2023-05-24T03:29:39.142949+0000","last_became_peered":"2023-05-24T03:29:39.142949+0000","last_unstale":"2023-05-24T03:32:16.859220+0000","last_undegraded":"2023-05-24T03:32:16.859220+0000","last_fullsized":"2023-05-24T03:32:16.859220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:16.859110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:16.859110+0000","last_clean_scrub_stamp":"2023-05-24T03:32:16.859110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:36:49.492263+0000","scrub_duration":0.0019863950000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"30'2","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:25.922071+0000","last_change":"2023-05-24T03:32:25.922120+0000","last_active":"2023-05-24T03:32:25.922071+0000","last_peered":"2023-05-24T03:32:25.922071+0000","last_clean":"2023-05-24T03:32:25.922071+0000","last_became_active":"2023-05-24T03:29:44.074374+0000","last_became_peered":"2023-05-24T03:29:44.074374+0000","last_unstale":"2023-05-24T03:32:25.922071+0000","last_undegraded":"2023-05-24T03:32:25.922071+0000","last_fullsized":"2023-05-24T03:32:25.922071+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2023-05-24T03:32:25.921971+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2023-05-24T03:32:25.921971+0000","last_clean_scrub_stamp":"2023-05-24T03:32:25.921971+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:33:52.610626+0000","scrub_duration":0.001416947,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"30'34","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:33.381296+0000","last_change":"2023-05-24T03:32:33.381351+0000","last_active":"2023-05-24T03:32:33.381296+0000","last_peered":"2023-05-24T03:32:33.381296+0000","last_clean":"2023-05-24T03:32:33.381296+0000","last_became_active":"2023-05-24T03:29:44.499768+0000","last_became_peered":"2023-05-24T03:29:44.499768+0000","last_unstale":"2023-05-24T03:32:33.381296+0000","last_undegraded":"2023-05-24T03:32:33.381296+0000","last_fullsized":"2023-05-24T03:32:33.381296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'34","last_scrub_stamp":"2023-05-24T03:32:33.381196+0000","last_deep_scrub":"30'34","last_deep_scrub_stamp":"2023-05-24T03:32:33.381196+0000","last_clean_scrub_stamp":"2023-05-24T03:32:33.381196+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:29:32.662195+0000","scrub_duration":0.00213657,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"30'483","reported_seq":502,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:01.656979+0000","last_change":"2023-05-24T03:29:48.530781+0000","last_active":"2023-05-24T03:32:01.656979+0000","last_peered":"2023-05-24T03:32:01.656979+0000","last_clean":"2023-05-24T03:32:01.656979+0000","last_became_active":"2023-05-24T03:29:48.530401+0000","last_became_peered":"2023-05-24T03:29:48.530401+0000","last_unstale":"2023-05-24T03:32:01.656979+0000","last_undegraded":"2023-05-24T03:32:01.656979+0000","last_fullsized":"2023-05-24T03:32:01.656979+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"30'4","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:25.935295+0000","last_change":"2023-05-24T03:32:25.935385+0000","last_active":"2023-05-24T03:32:25.935295+0000","last_peered":"2023-05-24T03:32:25.935295+0000","last_clean":"2023-05-24T03:32:25.935295+0000","last_became_active":"2023-05-24T03:29:44.083929+0000","last_became_peered":"2023-05-24T03:29:44.083929+0000","last_unstale":"2023-05-24T03:32:25.935295+0000","last_undegraded":"2023-05-24T03:32:25.935295+0000","last_fullsized":"2023-05-24T03:32:25.935295+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2023-05-24T03:32:25.935195+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2023-05-24T03:32:25.935195+0000","last_clean_scrub_stamp":"2023-05-24T03:32:25.935195+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:24:44.851338+0000","scrub_duration":0.0036091059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:17.913709+0000","last_change":"2023-05-24T03:32:17.913792+0000","last_active":"2023-05-24T03:32:17.913709+0000","last_peered":"2023-05-24T03:32:17.913709+0000","last_clean":"2023-05-24T03:32:17.913709+0000","last_became_active":"2023-05-24T03:29:39.045543+0000","last_became_peered":"2023-05-24T03:29:39.045543+0000","last_unstale":"2023-05-24T03:32:17.913709+0000","last_undegraded":"2023-05-24T03:32:17.913709+0000","last_fullsized":"2023-05-24T03:32:17.913709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:17.913581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:17.913581+0000","last_clean_scrub_stamp":"2023-05-24T03:32:17.913581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:39:29.851131+0000","scrub_duration":0.0019810409999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"30'25","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.750661+0000","last_change":"2023-05-24T03:29:44.496106+0000","last_active":"2023-05-24T03:32:00.750661+0000","last_peered":"2023-05-24T03:32:00.750661+0000","last_clean":"2023-05-24T03:32:00.750661+0000","last_became_active":"2023-05-24T03:29:44.495816+0000","last_became_peered":"2023-05-24T03:29:44.495816+0000","last_unstale":"2023-05-24T03:32:00.750661+0000","last_undegraded":"2023-05-24T03:32:00.750661+0000","last_fullsized":"2023-05-24T03:32:00.750661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"30'447","reported_seq":466,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:01.659996+0000","last_change":"2023-05-24T03:29:48.527602+0000","last_active":"2023-05-24T03:32:01.659996+0000","last_peered":"2023-05-24T03:32:01.659996+0000","last_clean":"2023-05-24T03:32:01.659996+0000","last_became_active":"2023-05-24T03:29:48.527196+0000","last_became_peered":"2023-05-24T03:29:48.527196+0000","last_unstale":"2023-05-24T03:32:01.659996+0000","last_undegraded":"2023-05-24T03:32:01.659996+0000","last_fullsized":"2023-05-24T03:32:01.659996+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:07.895608+0000","last_change":"2023-05-24T03:32:07.895654+0000","last_active":"2023-05-24T03:32:07.895608+0000","last_peered":"2023-05-24T03:32:07.895608+0000","last_clean":"2023-05-24T03:32:07.895608+0000","last_became_active":"2023-05-24T03:29:39.046149+0000","last_became_peered":"2023-05-24T03:29:39.046149+0000","last_unstale":"2023-05-24T03:32:07.895608+0000","last_undegraded":"2023-05-24T03:32:07.895608+0000","last_fullsized":"2023-05-24T03:32:07.895608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:07.895507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:07.895507+0000","last_clean_scrub_stamp":"2023-05-24T03:32:07.895507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:19:25.177961+0000","scrub_duration":0.0013301140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"30'12","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:22.444476+0000","last_change":"2023-05-24T03:32:22.444544+0000","last_active":"2023-05-24T03:32:22.444476+0000","last_peered":"2023-05-24T03:32:22.444476+0000","last_clean":"2023-05-24T03:32:22.444476+0000","last_became_active":"2023-05-24T03:29:44.088495+0000","last_became_peered":"2023-05-24T03:29:44.088495+0000","last_unstale":"2023-05-24T03:32:22.444476+0000","last_undegraded":"2023-05-24T03:32:22.444476+0000","last_fullsized":"2023-05-24T03:32:22.444476+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'12","last_scrub_stamp":"2023-05-24T03:32:22.444366+0000","last_deep_scrub":"30'12","last_deep_scrub_stamp":"2023-05-24T03:32:22.444366+0000","last_clean_scrub_stamp":"2023-05-24T03:32:22.444366+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:33:49.133021+0000","scrub_duration":0.0019648030000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"30'21","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:33.402605+0000","last_change":"2023-05-24T03:32:33.402683+0000","last_active":"2023-05-24T03:32:33.402605+0000","last_peered":"2023-05-24T03:32:33.402605+0000","last_clean":"2023-05-24T03:32:33.402605+0000","last_became_active":"2023-05-24T03:29:44.496597+0000","last_became_peered":"2023-05-24T03:29:44.496597+0000","last_unstale":"2023-05-24T03:32:33.402605+0000","last_undegraded":"2023-05-24T03:32:33.402605+0000","last_fullsized":"2023-05-24T03:32:33.402605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'21","last_scrub_stamp":"2023-05-24T03:32:33.402506+0000","last_deep_scrub":"30'21","last_deep_scrub_stamp":"2023-05-24T03:32:33.402506+0000","last_clean_scrub_stamp":"2023-05-24T03:32:33.402506+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:41:50.146511+0000","scrub_duration":0.001534435,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"30'469","reported_seq":488,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:05.111203+0000","last_change":"2023-05-24T03:29:48.524541+0000","last_active":"2023-05-24T03:32:05.111203+0000","last_peered":"2023-05-24T03:32:05.111203+0000","last_clean":"2023-05-24T03:32:05.111203+0000","last_became_active":"2023-05-24T03:29:48.524170+0000","last_became_peered":"2023-05-24T03:29:48.524170+0000","last_unstale":"2023-05-24T03:32:05.111203+0000","last_undegraded":"2023-05-24T03:32:05.111203+0000","last_fullsized":"2023-05-24T03:32:05.111203+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:27.411055+0000","last_change":"2023-05-24T03:32:27.411131+0000","last_active":"2023-05-24T03:32:27.411055+0000","last_peered":"2023-05-24T03:32:27.411055+0000","last_clean":"2023-05-24T03:32:27.411055+0000","last_became_active":"2023-05-24T03:29:44.089993+0000","last_became_peered":"2023-05-24T03:29:44.089993+0000","last_unstale":"2023-05-24T03:32:27.411055+0000","last_undegraded":"2023-05-24T03:32:27.411055+0000","last_fullsized":"2023-05-24T03:32:27.411055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-05-24T03:32:27.410947+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-05-24T03:32:27.410947+0000","last_clean_scrub_stamp":"2023-05-24T03:32:27.410947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:59:28.047443+0000","scrub_duration":0.001931365,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:11.669985+0000","last_change":"2023-05-24T03:32:11.669985+0000","last_active":"2023-05-24T03:32:11.669985+0000","last_peered":"2023-05-24T03:32:11.669985+0000","last_clean":"2023-05-24T03:32:11.669985+0000","last_became_active":"2023-05-24T03:29:44.481655+0000","last_became_peered":"2023-05-24T03:29:44.481655+0000","last_unstale":"2023-05-24T03:32:11.669985+0000","last_undegraded":"2023-05-24T03:32:11.669985+0000","last_fullsized":"2023-05-24T03:32:11.669985+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-05-24T03:32:11.669801+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-05-24T03:32:11.669801+0000","last_clean_scrub_stamp":"2023-05-24T03:32:11.669801+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:19:28.952256+0000","scrub_duration":0.0015085610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"30'475","reported_seq":494,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:08.096199+0000","last_change":"2023-05-24T03:29:48.516800+0000","last_active":"2023-05-24T03:32:08.096199+0000","last_peered":"2023-05-24T03:32:08.096199+0000","last_clean":"2023-05-24T03:32:08.096199+0000","last_became_active":"2023-05-24T03:29:48.516366+0000","last_became_peered":"2023-05-24T03:29:48.516366+0000","last_unstale":"2023-05-24T03:32:08.096199+0000","last_undegraded":"2023-05-24T03:32:08.096199+0000","last_fullsized":"2023-05-24T03:32:08.096199+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"30'3","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:36.384834+0000","last_change":"2023-05-24T03:32:36.384884+0000","last_active":"2023-05-24T03:32:36.384834+0000","last_peered":"2023-05-24T03:32:36.384834+0000","last_clean":"2023-05-24T03:32:36.384834+0000","last_became_active":"2023-05-24T03:29:44.093909+0000","last_became_peered":"2023-05-24T03:29:44.093909+0000","last_unstale":"2023-05-24T03:32:36.384834+0000","last_undegraded":"2023-05-24T03:32:36.384834+0000","last_fullsized":"2023-05-24T03:32:36.384834+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2023-05-24T03:32:36.384751+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2023-05-24T03:32:36.384751+0000","last_clean_scrub_stamp":"2023-05-24T03:32:36.384751+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:18:56.021462+0000","scrub_duration":0.0025716570000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"30'24","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:07.504564+0000","last_change":"2023-05-24T03:32:07.504564+0000","last_active":"2023-05-24T03:32:07.504564+0000","last_peered":"2023-05-24T03:32:07.504564+0000","last_clean":"2023-05-24T03:32:07.504564+0000","last_became_active":"2023-05-24T03:29:44.496679+0000","last_became_peered":"2023-05-24T03:29:44.496679+0000","last_unstale":"2023-05-24T03:32:07.504564+0000","last_undegraded":"2023-05-24T03:32:07.504564+0000","last_fullsized":"2023-05-24T03:32:07.504564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2023-05-24T03:32:07.504421+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2023-05-24T03:32:07.504421+0000","last_clean_scrub_stamp":"2023-05-24T03:32:07.504421+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:39:43.529482+0000","scrub_duration":0.001971338,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"30'459","reported_seq":478,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:07.101578+0000","last_change":"2023-05-24T03:29:48.529231+0000","last_active":"2023-05-24T03:32:07.101578+0000","last_peered":"2023-05-24T03:32:07.101578+0000","last_clean":"2023-05-24T03:32:07.101578+0000","last_became_active":"2023-05-24T03:29:48.528862+0000","last_became_peered":"2023-05-24T03:29:48.528862+0000","last_unstale":"2023-05-24T03:32:07.101578+0000","last_undegraded":"2023-05-24T03:32:07.101578+0000","last_fullsized":"2023-05-24T03:32:07.101578+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"30'4","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:23.397701+0000","last_change":"2023-05-24T03:32:23.397749+0000","last_active":"2023-05-24T03:32:23.397701+0000","last_peered":"2023-05-24T03:32:23.397701+0000","last_clean":"2023-05-24T03:32:23.397701+0000","last_became_active":"2023-05-24T03:29:44.089949+0000","last_became_peered":"2023-05-24T03:29:44.089949+0000","last_unstale":"2023-05-24T03:32:23.397701+0000","last_undegraded":"2023-05-24T03:32:23.397701+0000","last_fullsized":"2023-05-24T03:32:23.397701+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2023-05-24T03:32:23.397608+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2023-05-24T03:32:23.397608+0000","last_clean_scrub_stamp":"2023-05-24T03:32:23.397608+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:00:19.317988+0000","scrub_duration":0.002711855,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'23","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:06.604416+0000","last_change":"2023-05-24T03:29:44.498632+0000","last_active":"2023-05-24T03:32:06.604416+0000","last_peered":"2023-05-24T03:32:06.604416+0000","last_clean":"2023-05-24T03:32:06.604416+0000","last_became_active":"2023-05-24T03:29:44.498350+0000","last_became_peered":"2023-05-24T03:29:44.498350+0000","last_unstale":"2023-05-24T03:32:06.604416+0000","last_undegraded":"2023-05-24T03:32:06.604416+0000","last_fullsized":"2023-05-24T03:32:06.604416+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"30'482","reported_seq":501,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:06.604582+0000","last_change":"2023-05-24T03:29:48.523434+0000","last_active":"2023-05-24T03:32:06.604582+0000","last_peered":"2023-05-24T03:32:06.604582+0000","last_clean":"2023-05-24T03:32:06.604582+0000","last_became_active":"2023-05-24T03:29:48.522228+0000","last_became_peered":"2023-05-24T03:29:48.522228+0000","last_unstale":"2023-05-24T03:32:06.604582+0000","last_undegraded":"2023-05-24T03:32:06.604582+0000","last_fullsized":"2023-05-24T03:32:06.604582+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:34.938357+0000","last_change":"2023-05-24T03:32:34.938407+0000","last_active":"2023-05-24T03:32:34.938357+0000","last_peered":"2023-05-24T03:32:34.938357+0000","last_clean":"2023-05-24T03:32:34.938357+0000","last_became_active":"2023-05-24T03:29:44.082903+0000","last_became_peered":"2023-05-24T03:29:44.082903+0000","last_unstale":"2023-05-24T03:32:34.938357+0000","last_undegraded":"2023-05-24T03:32:34.938357+0000","last_fullsized":"2023-05-24T03:32:34.938357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-05-24T03:32:34.938251+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-05-24T03:32:34.938251+0000","last_clean_scrub_stamp":"2023-05-24T03:32:34.938251+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:18:54.574963+0000","scrub_duration":0.0018086580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:16.902284+0000","last_change":"2023-05-24T03:32:16.902340+0000","last_active":"2023-05-24T03:32:16.902284+0000","last_peered":"2023-05-24T03:32:16.902284+0000","last_clean":"2023-05-24T03:32:16.902284+0000","last_became_active":"2023-05-24T03:29:44.487925+0000","last_became_peered":"2023-05-24T03:29:44.487925+0000","last_unstale":"2023-05-24T03:32:16.902284+0000","last_undegraded":"2023-05-24T03:32:16.902284+0000","last_fullsized":"2023-05-24T03:32:16.902284+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-05-24T03:32:16.902188+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-05-24T03:32:16.902188+0000","last_clean_scrub_stamp":"2023-05-24T03:32:16.902188+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:04:45.220024+0000","scrub_duration":0.0014004639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"30'490","reported_seq":509,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:05.111185+0000","last_change":"2023-05-24T03:29:48.519899+0000","last_active":"2023-05-24T03:32:05.111185+0000","last_peered":"2023-05-24T03:32:05.111185+0000","last_clean":"2023-05-24T03:32:05.111185+0000","last_became_active":"2023-05-24T03:29:48.519517+0000","last_became_peered":"2023-05-24T03:29:48.519517+0000","last_unstale":"2023-05-24T03:32:05.111185+0000","last_undegraded":"2023-05-24T03:32:05.111185+0000","last_fullsized":"2023-05-24T03:32:05.111185+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"30'7","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:14.413355+0000","last_change":"2023-05-24T03:32:14.413441+0000","last_active":"2023-05-24T03:32:14.413355+0000","last_peered":"2023-05-24T03:32:14.413355+0000","last_clean":"2023-05-24T03:32:14.413355+0000","last_became_active":"2023-05-24T03:29:44.087891+0000","last_became_peered":"2023-05-24T03:29:44.087891+0000","last_unstale":"2023-05-24T03:32:14.413355+0000","last_undegraded":"2023-05-24T03:32:14.413355+0000","last_fullsized":"2023-05-24T03:32:14.413355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'7","last_scrub_stamp":"2023-05-24T03:32:14.413253+0000","last_deep_scrub":"30'7","last_deep_scrub_stamp":"2023-05-24T03:32:14.413253+0000","last_clean_scrub_stamp":"2023-05-24T03:32:14.413253+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:39:26.350804+0000","scrub_duration":0.0039696540000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"30'42","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:06.604389+0000","last_change":"2023-05-24T03:29:44.493246+0000","last_active":"2023-05-24T03:32:06.604389+0000","last_peered":"2023-05-24T03:32:06.604389+0000","last_clean":"2023-05-24T03:32:06.604389+0000","last_became_active":"2023-05-24T03:29:44.492923+0000","last_became_peered":"2023-05-24T03:29:44.492923+0000","last_unstale":"2023-05-24T03:32:06.604389+0000","last_undegraded":"2023-05-24T03:32:06.604389+0000","last_fullsized":"2023-05-24T03:32:06.604389+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"30'50","reported_seq":83,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:33.769592+0000","last_change":"2023-05-24T03:32:33.769638+0000","last_active":"2023-05-24T03:32:33.769592+0000","last_peered":"2023-05-24T03:32:33.769592+0000","last_clean":"2023-05-24T03:32:33.769592+0000","last_became_active":"2023-05-24T03:29:44.483898+0000","last_became_peered":"2023-05-24T03:29:44.483898+0000","last_unstale":"2023-05-24T03:32:33.769592+0000","last_undegraded":"2023-05-24T03:32:33.769592+0000","last_fullsized":"2023-05-24T03:32:33.769592+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'50","last_scrub_stamp":"2023-05-24T03:32:33.769507+0000","last_deep_scrub":"30'50","last_deep_scrub_stamp":"2023-05-24T03:32:33.769507+0000","last_clean_scrub_stamp":"2023-05-24T03:32:33.769507+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:17:31.325426+0000","scrub_duration":0.0019421810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"30'46","reported_seq":71,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.750245+0000","last_change":"2023-05-24T03:29:44.494451+0000","last_active":"2023-05-24T03:32:00.750245+0000","last_peered":"2023-05-24T03:32:00.750245+0000","last_clean":"2023-05-24T03:32:00.750245+0000","last_became_active":"2023-05-24T03:29:44.494073+0000","last_became_peered":"2023-05-24T03:29:44.494073+0000","last_unstale":"2023-05-24T03:32:00.750245+0000","last_undegraded":"2023-05-24T03:32:00.750245+0000","last_fullsized":"2023-05-24T03:32:00.750245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"30'34","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:22.339321+0000","last_change":"2023-05-24T03:32:22.339366+0000","last_active":"2023-05-24T03:32:22.339321+0000","last_peered":"2023-05-24T03:32:22.339321+0000","last_clean":"2023-05-24T03:32:22.339321+0000","last_became_active":"2023-05-24T03:29:44.497832+0000","last_became_peered":"2023-05-24T03:29:44.497832+0000","last_unstale":"2023-05-24T03:32:22.339321+0000","last_undegraded":"2023-05-24T03:32:22.339321+0000","last_fullsized":"2023-05-24T03:32:22.339321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'34","last_scrub_stamp":"2023-05-24T03:32:22.339204+0000","last_deep_scrub":"30'34","last_deep_scrub_stamp":"2023-05-24T03:32:22.339204+0000","last_clean_scrub_stamp":"2023-05-24T03:32:22.339204+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:45:42.612392+0000","scrub_duration":0.0015569990000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"30'31","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.740967+0000","last_change":"2023-05-24T03:29:44.496468+0000","last_active":"2023-05-24T03:32:00.740967+0000","last_peered":"2023-05-24T03:32:00.740967+0000","last_clean":"2023-05-24T03:32:00.740967+0000","last_became_active":"2023-05-24T03:29:44.496197+0000","last_became_peered":"2023-05-24T03:29:44.496197+0000","last_unstale":"2023-05-24T03:32:00.740967+0000","last_undegraded":"2023-05-24T03:32:00.740967+0000","last_fullsized":"2023-05-24T03:32:00.740967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:29.880244+0000","last_change":"2023-05-24T03:32:29.880296+0000","last_active":"2023-05-24T03:32:29.880244+0000","last_peered":"2023-05-24T03:32:29.880244+0000","last_clean":"2023-05-24T03:32:29.880244+0000","last_became_active":"2023-05-24T03:29:44.494928+0000","last_became_peered":"2023-05-24T03:29:44.494928+0000","last_unstale":"2023-05-24T03:32:29.880244+0000","last_undegraded":"2023-05-24T03:32:29.880244+0000","last_fullsized":"2023-05-24T03:32:29.880244+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-05-24T03:32:29.880155+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-05-24T03:32:29.880155+0000","last_clean_scrub_stamp":"2023-05-24T03:32:29.880155+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:00:25.800535+0000","scrub_duration":0.001768146,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":552,"num_write_kb":1154048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":201326592,"data_stored":201326592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14950,"ondisk_log_size":14950,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2060,"ondisk_log_size":2060,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1553284,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":15,"num_read_kb":19,"num_write":484,"num_write_kb":1824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3162112,"data_stored":3106568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":501,"ondisk_log_size":501,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574891,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68296,"kb_used_data":33152,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94303544,"statfs":{"total":96636764160,"available":96566829056,"internally_reserved":0,"allocated":33947648,"data_stored":33731444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:32:40 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":1.3500000000000001,"15min":0.78000000000000003},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.66800000000000004,"5min":14.757999999999999,"15min":14.757999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.52000000000000002,"5min":1.6639999999999999,"15min":0.89700000000000002},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.69699999999999995,"5min":17.954000000000001,"15min":17.954000000000001},"last":0.67600000000000005}]},{"osd":1,"last update":"Wed May 24 03:32:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":1.379,"15min":0.79800000000000004},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73799999999999999,"5min":16.939,"15min":16.939},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.53500000000000003,"5min":1.766,"15min":0.94499999999999995},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.65200000000000002,"5min":17.981999999999999,"15min":17.981999999999999},"last":0.46800000000000003}]},{"osd":2,"last update":"Wed May 24 03:32:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":1.6519999999999999,"15min":0.89400000000000002},"min":{"1min":0.34300000000000003,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.292,"5min":14.720000000000001,"15min":14.720000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.53700000000000003,"5min":1.5489999999999999,"15min":0.87},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.76100000000000001,"5min":14.814,"15min":14.814},"last":0.66100000000000003}]},{"osd":3,"last update":"Wed May 24 03:32:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":1.7110000000000001,"15min":0.93899999999999995},"min":{"1min":0.39400000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.67700000000000005,"5min":22.977,"15min":22.977},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.56299999999999994,"5min":1.383,"15min":0.81899999999999995},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.79500000000000004,"5min":14.836,"15min":14.836},"last":0.51700000000000002}]},{"osd":4,"last update":"Wed May 24 03:32:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":1.343,"15min":0.76100000000000001},"min":{"1min":0.27400000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.69899999999999995,"5min":18.027000000000001,"15min":18.027000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.49099999999999999,"5min":1.073,"15min":0.69699999999999995},"min":{"1min":0.33700000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.68600000000000005,"5min":22.922000000000001,"15min":22.922000000000001},"last":0.622}]},{"osd":5,"last update":"Wed May 24 03:32:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":1.151,"15min":0.76300000000000001},"min":{"1min":0.32800000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.71699999999999997,"5min":17.925999999999998,"15min":17.925999999999998},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":1.2010000000000001,"15min":0.77400000000000002},"min":{"1min":0.40300000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.748,"5min":18.004999999999999,"15min":18.004999999999999},"last":0.64300000000000002}]},{"osd":6,"last update":"Wed May 24 03:32:40 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":1.5549999999999999,"15min":0.90100000000000002},"min":{"1min":0.42499999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.753,"5min":23.933,"15min":23.933},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":1.5249999999999999,"15min":0.90300000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.73199999999999998,"5min":22.954000000000001,"15min":22.954000000000001},"last":0.68700000000000006}]}]},{"osd":6,"up_from":13,"seq":55834574891,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48968,"kb_used_data":26944,"kb_used_omap":0,"kb_used_meta":22016,"kb_avail":94322872,"statfs":{"total":96636764160,"available":96586620928,"internally_reserved":0,"allocated":27590656,"data_stored":27401822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22544384},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:32:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":2.3769999999999998,"15min":1.427},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.68899999999999995,"5min":22.922999999999998,"15min":22.922999999999998},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.47399999999999998,"5min":1.9330000000000001,"15min":1.0229999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.71099999999999997,"5min":28.870000000000001,"15min":28.870000000000001},"last":0.57599999999999996}]},{"osd":1,"last update":"Wed May 24 03:32:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":2.2149999999999999,"15min":1.409},"min":{"1min":0.35899999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.71999999999999997,"5min":22.984999999999999,"15min":22.984999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.54100000000000004,"5min":2.0009999999999999,"15min":1.327},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.78800000000000003,"5min":21.984999999999999,"15min":21.984999999999999},"last":0.61599999999999999}]},{"osd":2,"last update":"Wed May 24 03:32:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":1.599,"15min":0.92500000000000004},"min":{"1min":0.36299999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.323,"5min":22.649999999999999,"15min":22.649999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":2.2269999999999999,"15min":1.4139999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.89500000000000002,"5min":23.035,"15min":23.035},"last":0.45700000000000002}]},{"osd":3,"last update":"Wed May 24 03:32:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":1.8169999999999999,"15min":1.0589999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.248,"5min":18.056000000000001,"15min":18.056000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":1.7609999999999999,"15min":1.0309999999999999},"min":{"1min":0.40799999999999997,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.2809999999999999,"5min":19.963999999999999,"15min":19.963999999999999},"last":0.55900000000000005}]},{"osd":4,"last update":"Wed May 24 03:32:38 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":1.55,"15min":0.86599999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":7.29,"5min":18.056000000000001,"15min":18.056000000000001},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.87,"5min":1.5369999999999999,"15min":0.88600000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":7.5090000000000003,"5min":21.943999999999999,"15min":21.943999999999999},"last":0.48999999999999999}]},{"osd":5,"last update":"Wed May 24 03:32:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":1.381,"15min":0.82099999999999995},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.347,"5min":11.976000000000001,"15min":11.976000000000001},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":1.8939999999999999,"15min":1.0529999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.749,"5min":23.010999999999999,"15min":23.010999999999999},"last":0.50900000000000001}]},{"osd":7,"last update":"Wed May 24 03:32:38 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":1.655,"15min":0.94799999999999995},"min":{"1min":0.432,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.393,"5min":11.989000000000001,"15min":11.989000000000001},"last":0.437},{"interface":"front","average":{"1min":0.63300000000000001,"5min":1.53,"15min":0.92400000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.381,"5min":21.042000000000002,"15min":21.042000000000002},"last":0.47299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574891,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53896,"kb_used_data":22848,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94317944,"statfs":{"total":96636764160,"available":96581574656,"internally_reserved":0,"allocated":23396352,"data_stored":23207518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":1.448,"15min":0.76900000000000002},"min":{"1min":0.23499999999999999,"5min":0.223,"15min":0.223},"max":{"1min":1.7130000000000001,"5min":18.954000000000001,"15min":18.954000000000001},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.35399999999999998,"5min":1.784,"15min":1.016},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.52400000000000002,"5min":21.981999999999999,"15min":21.981999999999999},"last":0.45000000000000001}]},{"osd":2,"last update":"Wed May 24 03:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":1.157,"15min":0.63500000000000001},"min":{"1min":0.246,"5min":0.221,"15min":0.221},"max":{"1min":1.198,"5min":15.004,"15min":15.004},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.44900000000000001,"5min":1.5669999999999999,"15min":0.82599999999999996},"min":{"1min":0.26800000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.75,"5min":21.885000000000002,"15min":21.885000000000002},"last":0.40600000000000003}]},{"osd":3,"last update":"Wed May 24 03:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":1.3089999999999999,"15min":0.77100000000000002},"min":{"1min":0.32700000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.147,"5min":18.167000000000002,"15min":18.167000000000002},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.42199999999999999,"5min":1.0900000000000001,"15min":0.64000000000000001},"min":{"1min":0.29399999999999998,"5min":0.254,"15min":0.254},"max":{"1min":0.83799999999999997,"5min":11.935,"15min":11.935},"last":0.49199999999999999}]},{"osd":4,"last update":"Wed May 24 03:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":1.9359999999999999,"15min":1.022},"min":{"1min":0.435,"5min":0.316,"15min":0.316},"max":{"1min":1.0740000000000001,"5min":28.891999999999999,"15min":28.891999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":2.0369999999999999,"15min":1.105},"min":{"1min":0.39900000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.177,"5min":21.954999999999998,"15min":21.954999999999998},"last":0.73799999999999999}]},{"osd":5,"last update":"Wed May 24 03:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":2.306,"15min":1.218},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.97799999999999998,"5min":21.928000000000001,"15min":21.928000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":2.069,"15min":1.135},"min":{"1min":0.42299999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.1020000000000001,"5min":19.757999999999999,"15min":19.757999999999999},"last":0.71899999999999997}]},{"osd":6,"last update":"Wed May 24 03:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":1.9059999999999999,"15min":1.0580000000000001},"min":{"1min":0.48999999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.93999999999999995,"5min":22.033999999999999,"15min":22.033999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.65900000000000003,"5min":2.0419999999999998,"15min":1.095},"min":{"1min":0.40699999999999997,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.1599999999999999,"5min":19.734999999999999,"15min":19.734999999999999},"last":0.66500000000000004}]},{"osd":7,"last update":"Wed May 24 03:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":2.2010000000000001,"15min":1.212},"min":{"1min":0.46100000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.2370000000000001,"5min":21.994,"15min":21.994},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.624,"5min":2.101,"15min":1.1419999999999999},"min":{"1min":0.47299999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.91100000000000003,"5min":21.957999999999998,"15min":21.957999999999998},"last":0.752}]}]},{"osd":0,"up_from":13,"seq":55834574891,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54488,"kb_used_data":23440,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94317352,"statfs":{"total":96636764160,"available":96580968448,"internally_reserved":0,"allocated":24002560,"data_stored":23806220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 24 03:32:40 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":1.538,"15min":0.77200000000000002},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":10.919,"5min":21.216000000000001,"15min":21.216000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.52700000000000002,"5min":1.7230000000000001,"15min":0.82699999999999996},"min":{"1min":0.22800000000000001,"5min":0.185,"15min":0.185},"max":{"1min":3.0640000000000001,"5min":29.925000000000001,"15min":29.925000000000001},"last":0.45100000000000001}]},{"osd":2,"last update":"Wed May 24 03:32:40 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":1.5109999999999999,"15min":0.76800000000000002},"min":{"1min":0.29299999999999998,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":10.958,"5min":19.018999999999998,"15min":19.018999999999998},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":1.8839999999999999,"15min":0.90600000000000003},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":3.032,"5min":21.945,"15min":21.945},"last":0.60899999999999999}]},{"osd":3,"last update":"Wed May 24 03:32:40 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.633,"15min":0.82799999999999996},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":18.431999999999999,"5min":25.381,"15min":25.381},"last":0.52600000000000002},{"interface":"front","average":{"1min":1.373,"5min":2.1949999999999998,"15min":1.042},"min":{"1min":0.32400000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":19.251999999999999,"5min":21.209,"15min":21.209},"last":0.57399999999999995}]},{"osd":4,"last update":"Wed May 24 03:32:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":2.238,"15min":1.1879999999999999},"min":{"1min":0.41299999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":8.2309999999999999,"5min":22.030000000000001,"15min":22.030000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.97399999999999998,"5min":2.1789999999999998,"15min":1.1559999999999999},"min":{"1min":0.42899999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":7.2549999999999999,"5min":25.279,"15min":25.279},"last":0.70899999999999996}]},{"osd":5,"last update":"Wed May 24 03:32:40 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":1.96,"15min":1.101},"min":{"1min":0.41399999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.94799999999999995,"5min":25.329999999999998,"15min":25.329999999999998},"last":0.745},{"interface":"front","average":{"1min":0.746,"5min":2.0310000000000001,"15min":1.109},"min":{"1min":0.45300000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":2.2309999999999999,"5min":28.928000000000001,"15min":28.928000000000001},"last":0.72299999999999998}]},{"osd":6,"last update":"Wed May 24 03:32:40 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":1.903,"15min":1.052},"min":{"1min":0.437,"5min":0.37,"15min":0.37},"max":{"1min":2.2709999999999999,"5min":21.132000000000001,"15min":21.132000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.75800000000000001,"5min":2.0840000000000001,"15min":1.103},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":3.0899999999999999,"5min":22.007000000000001,"15min":22.007000000000001},"last":0.73499999999999999}]},{"osd":7,"last update":"Wed May 24 03:32:40 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":2.3929999999999998,"15min":1.218},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":2.9710000000000001,"5min":21.983000000000001,"15min":21.983000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.626,"5min":1.931,"15min":1.079},"min":{"1min":0.44,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.93200000000000005,"5min":25.356000000000002,"15min":25.356000000000002},"last":0.65300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574891,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46920,"kb_used_data":24896,"kb_used_omap":0,"kb_used_meta":22016,"kb_avail":94324920,"statfs":{"total":96636764160,"available":96588718080,"internally_reserved":0,"allocated":25493504,"data_stored":25304670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22544384},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.84399999999999997,"15min":0.51200000000000001},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.96199999999999997,"5min":10.821999999999999,"15min":10.821999999999999},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.379,"5min":0.93400000000000005,"15min":0.65200000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.56599999999999995,"5min":11.743,"15min":11.743},"last":0.38600000000000001}]},{"osd":1,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.81999999999999995,"15min":0.53000000000000003},"min":{"1min":0.27800000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.524,"5min":12.079000000000001,"15min":12.079000000000001},"last":0.435},{"interface":"front","average":{"1min":0.377,"5min":1.2,"15min":0.76400000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.55200000000000005,"5min":19.954000000000001,"15min":19.954000000000001},"last":0.32800000000000001}]},{"osd":3,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":1.204,"15min":0.65400000000000003},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.44,"5min":21.611000000000001,"15min":21.611000000000001},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":1.04,"15min":0.63400000000000001},"min":{"1min":0.29099999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.90700000000000003,"5min":21.055,"15min":21.055},"last":0.40799999999999997}]},{"osd":4,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":1.4630000000000001,"15min":0.90200000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.4830000000000001,"5min":16.657,"15min":16.657},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":1.3979999999999999,"15min":0.96199999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85599999999999998,"5min":17.116,"15min":17.116},"last":0.51100000000000001}]},{"osd":5,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":1.5980000000000001,"15min":0.93799999999999994},"min":{"1min":0.34599999999999997,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.82799999999999996,"5min":21.655000000000001,"15min":21.655000000000001},"last":0.5},{"interface":"front","average":{"1min":0.59499999999999997,"5min":1.2889999999999999,"15min":0.86299999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.93799999999999994,"5min":14.045999999999999,"15min":14.045999999999999},"last":0.56599999999999995}]},{"osd":6,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":1.556,"15min":1.038},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.78500000000000003,"5min":20.966999999999999,"15min":20.966999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.55400000000000005,"5min":1.278,"15min":0.83999999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.83399999999999996,"5min":15.119,"15min":15.119},"last":0.52700000000000002}]},{"osd":7,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":1.649,"15min":1.079},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.089,"5min":17.035,"15min":17.035},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":1.5009999999999999,"15min":0.91200000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0680000000000001,"5min":18.611999999999998,"15min":18.611999999999998},"last":0.57799999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574890,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38732,"kb_used_data":20804,"kb_used_omap":0,"kb_used_meta":17920,"kb_avail":94333108,"statfs":{"total":96636764160,"available":96597102592,"internally_reserved":0,"allocated":21303296,"data_stored":21110456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18350080},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:32:39 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":1.6200000000000001,"15min":1.169},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":1.3080000000000001,"5min":22.969000000000001,"15min":22.969000000000001},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":1.3660000000000001,"15min":1.0469999999999999},"min":{"1min":0.24399999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.1579999999999999,"5min":15.933999999999999,"15min":15.933999999999999},"last":0.35299999999999998}]},{"osd":1,"last update":"Wed May 24 03:32:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":1.2090000000000001,"15min":0.90400000000000003},"min":{"1min":0.29499999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":2.266,"5min":19.882000000000001,"15min":19.882000000000001},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.41899999999999998,"5min":1.056,"15min":0.63400000000000001},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.71199999999999997,"5min":18.792000000000002,"15min":18.792000000000002},"last":0.42299999999999999}]},{"osd":2,"last update":"Wed May 24 03:32:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":1.732,"15min":1.093},"min":{"1min":0.318,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":3.161,"5min":22.922999999999998,"15min":22.922999999999998},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.45700000000000002,"5min":2.0739999999999998,"15min":2.0379999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.038,"5min":22.919,"15min":22.919},"last":0.376}]},{"osd":4,"last update":"Wed May 24 03:32:39 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":1.526,"15min":0.92800000000000005},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":3.2200000000000002,"5min":18.952000000000002,"15min":18.952000000000002},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.77100000000000002,"5min":2.0179999999999998,"15min":1.3080000000000001},"min":{"1min":0.38400000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":4.5220000000000002,"5min":24.933,"15min":24.933},"last":0.499}]},{"osd":5,"last update":"Wed May 24 03:32:39 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":1.9199999999999999,"15min":1.4079999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.2629999999999999,"5min":20.056000000000001,"15min":20.056000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":1.5600000000000001,"15min":0.93799999999999994},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.877,"5min":16.013000000000002,"15min":16.013000000000002},"last":0.60799999999999998}]},{"osd":6,"last update":"Wed May 24 03:32:39 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":1.605,"15min":1.1990000000000001},"min":{"1min":0.45600000000000002,"5min":0.379,"15min":0.379},"max":{"1min":1.016,"5min":13.986000000000001,"15min":13.986000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":1.8260000000000001,"15min":1.3799999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.3360000000000001,"5min":20.088000000000001,"15min":20.088000000000001},"last":0.54800000000000004}]},{"osd":7,"last update":"Wed May 24 03:32:39 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":1.681,"15min":0.99299999999999999},"min":{"1min":0.39900000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":3.181,"5min":21.571000000000002,"15min":21.571000000000002},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":1.661,"15min":1.2230000000000001},"min":{"1min":0.44400000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0860000000000001,"5min":13.922000000000001,"15min":13.922000000000001},"last":0.47399999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574891,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61572,"kb_used_data":26428,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94310268,"statfs":{"total":96636764160,"available":96573714432,"internally_reserved":0,"allocated":27062272,"data_stored":26857212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":1.667,"15min":0.88400000000000001},"min":{"1min":0.31900000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.78500000000000003,"5min":17.794,"15min":17.794},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":1.4570000000000001,"15min":0.82399999999999995},"min":{"1min":0.38200000000000001,"5min":0.375,"15min":0.375},"max":{"1min":1.214,"5min":16.597999999999999,"15min":16.597999999999999},"last":0.38}]},{"osd":1,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":1.6759999999999999,"15min":0.90100000000000002},"min":{"1min":0.42399999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.002,"5min":22.933,"15min":22.933},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.56299999999999994,"5min":1.446,"15min":0.83799999999999997},"min":{"1min":0.33600000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.73899999999999999,"5min":16.196000000000002,"15min":16.196000000000002},"last":0.56499999999999995}]},{"osd":2,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":1.4219999999999999,"15min":0.81599999999999995},"min":{"1min":0.40899999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.94799999999999995,"5min":18.919,"15min":18.919},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":1.4970000000000001,"15min":0.84899999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.77200000000000002,"5min":16.277999999999999,"15min":16.277999999999999},"last":0.46400000000000002}]},{"osd":3,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":1.351,"15min":0.77500000000000002},"min":{"1min":0.43099999999999999,"5min":0.312,"15min":0.312},"max":{"1min":2.383,"5min":18.956,"15min":18.956},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":1.659,"15min":0.91400000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0649999999999999,"5min":22.960000000000001,"15min":22.960000000000001},"last":0.498}]},{"osd":5,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":1.208,"15min":0.754},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.69199999999999995,"5min":16.231999999999999,"15min":16.231999999999999},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":1.0900000000000001,"15min":0.749},"min":{"1min":0.33100000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.91000000000000003,"5min":11.904999999999999,"15min":11.904999999999999},"last":0.55200000000000005}]},{"osd":6,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":1.4990000000000001,"15min":0.82999999999999996},"min":{"1min":0.34200000000000003,"5min":0.315,"15min":0.315},"max":{"1min":1.0329999999999999,"5min":22.983000000000001,"15min":22.983000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.497,"5min":1.097,"15min":0.74099999999999999},"min":{"1min":0.31,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.79300000000000004,"5min":12.367000000000001,"15min":12.367000000000001},"last":0.41099999999999998}]},{"osd":7,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":1.083,"15min":0.73099999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.97699999999999998,"5min":16.576000000000001,"15min":16.576000000000001},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":1.583,"15min":0.92700000000000005},"min":{"1min":0.38100000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.0900000000000001,"5min":22.882000000000001,"15min":22.882000000000001},"last":0.54000000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574890,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46928,"kb_used_data":24904,"kb_used_omap":0,"kb_used_meta":22016,"kb_avail":94324912,"statfs":{"total":96636764160,"available":96588709888,"internally_reserved":0,"allocated":25501696,"data_stored":25305322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22544384},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":1.8300000000000001,"15min":0.95599999999999996},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.93999999999999995,"5min":20.137,"15min":20.137},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.54100000000000004,"5min":1.865,"15min":1.1040000000000001},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.76400000000000001,"5min":25.988,"15min":25.988},"last":0.71299999999999997}]},{"osd":1,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":1.7390000000000001,"15min":0.94099999999999995},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.71699999999999997,"5min":22.765999999999998,"15min":22.765999999999998},"last":0.63},{"interface":"front","average":{"1min":0.53500000000000003,"5min":2.0009999999999999,"15min":1.167},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.72999999999999998,"5min":20.161999999999999,"15min":20.161999999999999},"last":0.73899999999999999}]},{"osd":2,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":1.923,"15min":1.0009999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.73799999999999999,"5min":25.946000000000002,"15min":25.946000000000002},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":1.7090000000000001,"15min":1.0860000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.0469999999999999,"5min":22.800000000000001,"15min":22.800000000000001},"last":0.72799999999999998}]},{"osd":3,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":1.8560000000000001,"15min":1.1919999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":2.0990000000000002,"5min":26.013999999999999,"15min":26.013999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.50600000000000001,"5min":1.8340000000000001,"15min":1.1559999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.749,"5min":22.687999999999999,"15min":22.687999999999999},"last":0.70099999999999996}]},{"osd":4,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":1.52,"15min":0.84099999999999997},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.77600000000000002,"5min":19.998000000000001,"15min":19.998000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.46600000000000003,"5min":1.2809999999999999,"15min":0.77900000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.629,"5min":17.628,"15min":17.628},"last":0.56599999999999995}]},{"osd":6,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":1.3280000000000001,"15min":0.80800000000000005},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.69999999999999996,"5min":19.969000000000001,"15min":19.969000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.54300000000000004,"5min":1.492,"15min":0.874},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.117,"5min":19.913,"15min":19.913},"last":0.60999999999999999}]},{"osd":7,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":1.2569999999999999,"15min":0.82799999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72899999999999998,"5min":17.731000000000002,"15min":17.731000000000002},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":1.3460000000000001,"15min":0.86799999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72499999999999998,"5min":20.099,"15min":20.099},"last":0.54600000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":8334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1568768,"data_stored":1552542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1568768,"data_stored":1544950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23068672,"data_stored":23068672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23068672,"data_stored":23068672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":27262976,"data_stored":27262976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":31457280,"data_stored":31457280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-24T03:32:49.277 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:49.278 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:49.278 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:49.279 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:49.279 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:49.279 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:49.280 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:49.280 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:49.280 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:49.281 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:49.281 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:49.281 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:49.282 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:49.282 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:49.282 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:49.283 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:49.283 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:49.283 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:49.284 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:49.284 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:49.284 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:49.285 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:49.285 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:49.285 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:49.285 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:49.286 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:49.286 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:49.287 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:49.287 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:49.287 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:49.287 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:49.288 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:49.288 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:49.288 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:49.289 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:49.289 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:49.289 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:49.290 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:49.290 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:32:49.290 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-05-24T03:33:09.291 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-24T03:33:09.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.421+0000 7fcb100a0700 1 Processor -- start 2023-05-24T03:33:09.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.421+0000 7fcb100a0700 1 -- start start 2023-05-24T03:33:09.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.422+0000 7fcb100a0700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb080cb8c0 0x7fcb08161030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:09.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.422+0000 7fcb100a0700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcb080cbc90 0x7fcb0806a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:09.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.422+0000 7fcb100a0700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb080b27e0 con 0x7fcb080cc1d0 2023-05-24T03:33:09.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.422+0000 7fcb100a0700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb080b2030 con 0x7fcb080cbc90 2023-05-24T03:33:09.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.422+0000 7fcb100a0700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb080b2220 con 0x7fcb080cb8c0 2023-05-24T03:33:09.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.422+0000 7fcb0d63b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fcb080cc1d0 0x7fcb080b1920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47250/0 (socket says 172.21.15.146:47250) 2023-05-24T03:33:09.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.422+0000 7fcb0d63b700 1 -- 172.21.15.146:0/421522584 learned_addr learned my addr 172.21.15.146:0/421522584 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:33:09.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.422+0000 7fcb0de3c700 1 --2- 172.21.15.146:0/421522584 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb080cb8c0 0x7fcb08161030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:09.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.422+0000 7fcb0e63d700 1 --2- 172.21.15.146:0/421522584 >> v2:172.21.15.151:3300/0 conn(0x7fcb080cbc90 0x7fcb0806a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:09.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.422+0000 7fcb0ce3a700 1 -- 172.21.15.146:0/421522584 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3092475227 0 0) 0x7fcb080b27e0 con 0x7fcb080cc1d0 2023-05-24T03:33:09.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.422+0000 7fcb0ce3a700 1 -- 172.21.15.146:0/421522584 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcaf40035b0 con 0x7fcb080cc1d0 2023-05-24T03:33:09.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.422+0000 7fcb0ce3a700 1 -- 172.21.15.146:0/421522584 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1981889752 0 0) 0x7fcaf40035b0 con 0x7fcb080cc1d0 2023-05-24T03:33:09.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.422+0000 7fcb0ce3a700 1 -- 172.21.15.146:0/421522584 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb080cb8c0 msgr2=0x7fcb08161030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:33:09.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.422+0000 7fcb0ce3a700 1 --2- 172.21.15.146:0/421522584 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb080cb8c0 0x7fcb08161030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:09.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.422+0000 7fcb0ce3a700 1 -- 172.21.15.146:0/421522584 >> v2:172.21.15.151:3300/0 conn(0x7fcb080cbc90 msgr2=0x7fcb0806a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:33:09.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.422+0000 7fcb0ce3a700 1 --2- 172.21.15.146:0/421522584 >> v2:172.21.15.151:3300/0 conn(0x7fcb080cbc90 0x7fcb0806a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:09.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.422+0000 7fcb0ce3a700 1 -- 172.21.15.146:0/421522584 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb080b2500 con 0x7fcb080cc1d0 2023-05-24T03:33:09.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.422+0000 7fcb0ce3a700 1 -- 172.21.15.146:0/421522584 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1301887351 0 0) 0x7fcb04001670 con 0x7fcb080cc1d0 2023-05-24T03:33:09.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.423+0000 7fcb0ce3a700 1 -- 172.21.15.146:0/421522584 >> v1:172.21.15.146:6789/0 conn(0x7fcb080cc1d0 legacy=0x7fcb080b1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:09.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.423+0000 7fcb0ce3a700 1 --2- 172.21.15.146:0/421522584 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb080cb8c0 0x7fcaf4003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:09.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.423+0000 7fcb0ce3a700 1 --2- 172.21.15.146:0/421522584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcaf4003f80 0x7fcaf4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:09.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.423+0000 7fcb0ce3a700 1 --2- 172.21.15.146:0/421522584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcaf4004d90 0x7fcaf4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:09.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.423+0000 7fcb0ce3a700 1 -- 172.21.15.146:0/421522584 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb080b2220 con 0x7fcaf4004d90 2023-05-24T03:33:09.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.423+0000 7fcb0ce3a700 1 -- 172.21.15.146:0/421522584 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf400ba10 con 0x7fcaf4003f80 2023-05-24T03:33:09.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.423+0000 7fcb0ce3a700 1 -- 172.21.15.146:0/421522584 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf400bb50 con 0x7fcb080cb8c0 2023-05-24T03:33:09.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.423+0000 7fcb0e63d700 1 --2- 172.21.15.146:0/421522584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcaf4004d90 0x7fcaf4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:09.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.423+0000 7fcb0de3c700 1 --2- 172.21.15.146:0/421522584 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb080cb8c0 0x7fcaf4003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:09.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.423+0000 7fcb0d63b700 1 --2- 172.21.15.146:0/421522584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcaf4003f80 0x7fcaf4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:09.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.423+0000 7fcb0de3c700 1 -- 172.21.15.146:0/421522584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcaf4003f80 msgr2=0x7fcaf4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:33:09.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.423+0000 7fcb0de3c700 1 --2- 172.21.15.146:0/421522584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcaf4003f80 0x7fcaf4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:09.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.423+0000 7fcb0de3c700 1 -- 172.21.15.146:0/421522584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcaf4004d90 msgr2=0x7fcaf4005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:33:09.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.423+0000 7fcb0de3c700 1 --2- 172.21.15.146:0/421522584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcaf4004d90 0x7fcaf4005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:09.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.423+0000 7fcb0de3c700 1 -- 172.21.15.146:0/421522584 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf40035b0 con 0x7fcb080cb8c0 2023-05-24T03:33:09.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.423+0000 7fcb0e63d700 1 --2- 172.21.15.146:0/421522584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcaf4004d90 0x7fcaf4005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T03:33:09.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.423+0000 7fcb0de3c700 1 --2- 172.21.15.146:0/421522584 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb080cb8c0 0x7fcaf4003a00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8009b60 tx=0x7fcaf4005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d5e516680ecc3f8 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:33:09.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.423+0000 7fcb0ce3a700 1 -- 172.21.15.146:0/421522584 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf800e6c0 con 0x7fcb080cb8c0 2023-05-24T03:33:09.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.423+0000 7fcb0ce3a700 1 -- 172.21.15.146:0/421522584 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf800e820 con 0x7fcb080cb8c0 2023-05-24T03:33:09.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.423+0000 7fcb0ce3a700 1 -- 172.21.15.146:0/421522584 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf800eb90 con 0x7fcb080cb8c0 2023-05-24T03:33:09.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.424+0000 7fcb100a0700 1 -- 172.21.15.146:0/421522584 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb080cb8c0 msgr2=0x7fcaf4003a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:09.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.424+0000 7fcb100a0700 1 --2- 172.21.15.146:0/421522584 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb080cb8c0 0x7fcaf4003a00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8009b60 tx=0x7fcaf4005880 comp rx=0 tx=0).stop 2023-05-24T03:33:09.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.424+0000 7fcb0e63d700 1 -- 172.21.15.146:0/421522584 reap_dead start 2023-05-24T03:33:09.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.424+0000 7fcb100a0700 1 -- 172.21.15.146:0/421522584 shutdown_connections 2023-05-24T03:33:09.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.424+0000 7fcb100a0700 1 -- 172.21.15.146:0/421522584 >> 172.21.15.146:0/421522584 conn(0x7fcb080cfea0 msgr2=0x7fcb080d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:33:09.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.424+0000 7fcb100a0700 1 -- 172.21.15.146:0/421522584 shutdown_connections 2023-05-24T03:33:09.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.424+0000 7fcb100a0700 1 -- 172.21.15.146:0/421522584 wait complete. 2023-05-24T03:33:09.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.425+0000 7fcb100a0700 1 Processor -- start 2023-05-24T03:33:09.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.425+0000 7fcb100a0700 1 -- start start 2023-05-24T03:33:09.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.426+0000 7fcb100a0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb080cb8c0 0x7fcb08159ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:09.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.426+0000 7fcb100a0700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb08159a40 0x7fcb080ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:09.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.426+0000 7fcb100a0700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb080c97e0 0x7fcb080ced30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:09.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.426+0000 7fcb100a0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0815a780 con 0x7fcb080cb8c0 2023-05-24T03:33:09.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.426+0000 7fcb100a0700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb080c9c60 con 0x7fcb080c97e0 2023-05-24T03:33:09.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.426+0000 7fcb100a0700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb080cb0d0 con 0x7fcb08159a40 2023-05-24T03:33:09.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.426+0000 7fcb0de3c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb080cb8c0 0x7fcb08159ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:09.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.426+0000 7fcb0de3c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb080cb8c0 0x7fcb08159ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40810/0 (socket says 172.21.15.146:40810) 2023-05-24T03:33:09.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.426+0000 7fcb0de3c700 1 -- 172.21.15.146:0/2828941306 learned_addr learned my addr 172.21.15.146:0/2828941306 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:33:09.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.426+0000 7fcb0e63d700 1 --2- 172.21.15.146:0/2828941306 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb080c97e0 0x7fcb080ced30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:09.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.426+0000 7fcb0d63b700 1 --2- 172.21.15.146:0/2828941306 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb08159a40 0x7fcb080ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:09.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.426+0000 7fcb0de3c700 1 -- 172.21.15.146:0/2828941306 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb08159a40 msgr2=0x7fcb080ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:09.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.426+0000 7fcb0de3c700 1 --2- 172.21.15.146:0/2828941306 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb08159a40 0x7fcb080ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:09.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.426+0000 7fcb0de3c700 1 -- 172.21.15.146:0/2828941306 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb080c97e0 msgr2=0x7fcb080ced30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:09.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.426+0000 7fcb0de3c700 1 --2- 172.21.15.146:0/2828941306 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb080c97e0 0x7fcb080ced30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:09.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.426+0000 7fcb0de3c700 1 -- 172.21.15.146:0/2828941306 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb08160b10 con 0x7fcb080cb8c0 2023-05-24T03:33:09.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.427+0000 7fcb0de3c700 1 --2- 172.21.15.146:0/2828941306 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb080cb8c0 0x7fcb08159ef0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fcaf80090b0 tx=0x7fcaf80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:33:09.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.427+0000 7fcafe7fc700 1 -- 172.21.15.146:0/2828941306 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf800e6c0 con 0x7fcb080cb8c0 2023-05-24T03:33:09.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.427+0000 7fcafe7fc700 1 -- 172.21.15.146:0/2828941306 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf8003ab0 con 0x7fcb080cb8c0 2023-05-24T03:33:09.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.427+0000 7fcb100a0700 1 -- 172.21.15.146:0/2828941306 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb08160830 con 0x7fcb080cb8c0 2023-05-24T03:33:09.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.427+0000 7fcafe7fc700 1 -- 172.21.15.146:0/2828941306 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf8003e40 con 0x7fcb080cb8c0 2023-05-24T03:33:09.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.427+0000 7fcb100a0700 1 -- 172.21.15.146:0/2828941306 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb0806a9a0 con 0x7fcb080cb8c0 2023-05-24T03:33:09.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.428+0000 7fcb100a0700 1 -- 172.21.15.146:0/2828941306 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb0804e810 con 0x7fcb080cb8c0 2023-05-24T03:33:09.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.428+0000 7fcafe7fc700 1 -- 172.21.15.146:0/2828941306 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcaf8013470 con 0x7fcb080cb8c0 2023-05-24T03:33:09.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.429+0000 7fcafe7fc700 1 --2- 172.21.15.146:0/2828941306 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fcaec06ace0 0x7fcaec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:09.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.429+0000 7fcafe7fc700 1 -- 172.21.15.146:0/2828941306 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fcaf808afa0 con 0x7fcb080cb8c0 2023-05-24T03:33:09.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.429+0000 7fcb0d63b700 1 --2- 172.21.15.146:0/2828941306 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fcaec06ace0 0x7fcaec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:09.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.429+0000 7fcb0d63b700 1 --2- 172.21.15.146:0/2828941306 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fcaec06ace0 0x7fcaec06d190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fcb080c7160 tx=0x7fcb04009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:33:09.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.433+0000 7fcafe7fc700 1 -- 172.21.15.146:0/2828941306 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fcaf80bd2d0 con 0x7fcb080cb8c0 2023-05-24T03:33:09.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.617+0000 7fcb100a0700 1 -- 172.21.15.146:0/2828941306 --> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcb0815a780 con 0x7fcaec06ace0 2023-05-24T03:33:09.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.628+0000 7fcafe7fc700 1 -- 172.21.15.146:0/2828941306 <== mgr.4104 v2:172.21.15.146:6832/1985394169 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+394176 (secure 0 0 0) 0x7fcb0815a780 con 0x7fcaec06ace0 2023-05-24T03:33:09.637 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:33:09.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.631+0000 7fcb100a0700 1 -- 172.21.15.146:0/2828941306 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fcaec06ace0 msgr2=0x7fcaec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:09.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.631+0000 7fcb100a0700 1 --2- 172.21.15.146:0/2828941306 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fcaec06ace0 0x7fcaec06d190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fcb080c7160 tx=0x7fcb04009040 comp rx=0 tx=0).stop 2023-05-24T03:33:09.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.631+0000 7fcb100a0700 1 -- 172.21.15.146:0/2828941306 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb080cb8c0 msgr2=0x7fcb08159ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:09.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.631+0000 7fcb100a0700 1 --2- 172.21.15.146:0/2828941306 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb080cb8c0 0x7fcb08159ef0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fcaf80090b0 tx=0x7fcaf80047c0 comp rx=0 tx=0).stop 2023-05-24T03:33:09.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.631+0000 7fcb100a0700 1 -- 172.21.15.146:0/2828941306 shutdown_connections 2023-05-24T03:33:09.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.631+0000 7fcb100a0700 1 --2- 172.21.15.146:0/2828941306 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fcaec06ace0 0x7fcaec06d190 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:09.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.631+0000 7fcb100a0700 1 --2- 172.21.15.146:0/2828941306 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb080c97e0 0x7fcb080ced30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:09.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.631+0000 7fcb100a0700 1 --2- 172.21.15.146:0/2828941306 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb080cb8c0 0x7fcb08159ef0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:09.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.631+0000 7fcb100a0700 1 --2- 172.21.15.146:0/2828941306 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb08159a40 0x7fcb080ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:09.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.631+0000 7fcb100a0700 1 -- 172.21.15.146:0/2828941306 >> 172.21.15.146:0/2828941306 conn(0x7fcb080cfea0 msgr2=0x7fcb0815e840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:33:09.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.632+0000 7fcb100a0700 1 -- 172.21.15.146:0/2828941306 shutdown_connections 2023-05-24T03:33:09.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:09.632+0000 7fcb100a0700 1 -- 172.21.15.146:0/2828941306 wait complete. 2023-05-24T03:33:09.642 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-05-24T03:33:09.648 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":132,"stamp":"2023-05-24T03:33:08.810363+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":102806948,"num_objects":49,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":131,"num_read_kb":119,"num_write":1195,"num_write_kb":1158288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17630,"ondisk_log_size":17630,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":423896,"kb_used_data":203416,"kb_used_omap":0,"kb_used_meta":220416,"kb_avail":754550824,"statfs":{"total":773094113280,"available":772660043776,"internally_reserved":0,"allocated":208297984,"data_stored":206724664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":225705984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003310"},"pg_stats":[{"pgid":"4.3f","version":"30'28","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:13.677466+0000","last_change":"2023-05-24T03:32:13.677538+0000","last_active":"2023-05-24T03:32:13.677466+0000","last_peered":"2023-05-24T03:32:13.677466+0000","last_clean":"2023-05-24T03:32:13.677466+0000","last_became_active":"2023-05-24T03:29:44.489854+0000","last_became_peered":"2023-05-24T03:29:44.489854+0000","last_unstale":"2023-05-24T03:32:13.677466+0000","last_undegraded":"2023-05-24T03:32:13.677466+0000","last_fullsized":"2023-05-24T03:32:13.677466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'28","last_scrub_stamp":"2023-05-24T03:32:13.677364+0000","last_deep_scrub":"30'28","last_deep_scrub_stamp":"2023-05-24T03:32:13.677364+0000","last_clean_scrub_stamp":"2023-05-24T03:32:13.677364+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T03:41:35.361181+0000","scrub_duration":0.001818166,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"30'27","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:51.474557+0000","last_change":"2023-05-24T03:32:51.474659+0000","last_active":"2023-05-24T03:32:51.474557+0000","last_peered":"2023-05-24T03:32:51.474557+0000","last_clean":"2023-05-24T03:32:51.474557+0000","last_became_active":"2023-05-24T03:29:44.495700+0000","last_became_peered":"2023-05-24T03:29:44.495700+0000","last_unstale":"2023-05-24T03:32:51.474557+0000","last_undegraded":"2023-05-24T03:32:51.474557+0000","last_fullsized":"2023-05-24T03:32:51.474557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'27","last_scrub_stamp":"2023-05-24T03:32:51.474428+0000","last_deep_scrub":"30'27","last_deep_scrub_stamp":"2023-05-24T03:32:51.474428+0000","last_clean_scrub_stamp":"2023-05-24T03:32:51.474428+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T03:50:22.516947+0000","scrub_duration":0.0020678659999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"30'43","reported_seq":76,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:10.490334+0000","last_change":"2023-05-24T03:32:10.490388+0000","last_active":"2023-05-24T03:32:10.490334+0000","last_peered":"2023-05-24T03:32:10.490334+0000","last_clean":"2023-05-24T03:32:10.490334+0000","last_became_active":"2023-05-24T03:29:44.499663+0000","last_became_peered":"2023-05-24T03:29:44.499663+0000","last_unstale":"2023-05-24T03:32:10.490334+0000","last_undegraded":"2023-05-24T03:32:10.490334+0000","last_fullsized":"2023-05-24T03:32:10.490334+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'43","last_scrub_stamp":"2023-05-24T03:32:10.490217+0000","last_deep_scrub":"30'43","last_deep_scrub_stamp":"2023-05-24T03:32:10.490217+0000","last_clean_scrub_stamp":"2023-05-24T03:32:10.490217+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:07:18.348127+0000","scrub_duration":0.002187207,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"30'24","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:19.940238+0000","last_change":"2023-05-24T03:32:19.940327+0000","last_active":"2023-05-24T03:32:19.940238+0000","last_peered":"2023-05-24T03:32:19.940238+0000","last_clean":"2023-05-24T03:32:19.940238+0000","last_became_active":"2023-05-24T03:29:44.498528+0000","last_became_peered":"2023-05-24T03:29:44.498528+0000","last_unstale":"2023-05-24T03:32:19.940238+0000","last_undegraded":"2023-05-24T03:32:19.940238+0000","last_fullsized":"2023-05-24T03:32:19.940238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2023-05-24T03:32:19.940111+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2023-05-24T03:32:19.940111+0000","last_clean_scrub_stamp":"2023-05-24T03:32:19.940111+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:12:46.316536+0000","scrub_duration":0.002509664,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"30'34","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:47.429884+0000","last_change":"2023-05-24T03:32:47.429941+0000","last_active":"2023-05-24T03:32:47.429884+0000","last_peered":"2023-05-24T03:32:47.429884+0000","last_clean":"2023-05-24T03:32:47.429884+0000","last_became_active":"2023-05-24T03:29:44.503998+0000","last_became_peered":"2023-05-24T03:29:44.503998+0000","last_unstale":"2023-05-24T03:32:47.429884+0000","last_undegraded":"2023-05-24T03:32:47.429884+0000","last_fullsized":"2023-05-24T03:32:47.429884+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'34","last_scrub_stamp":"2023-05-24T03:32:47.429774+0000","last_deep_scrub":"30'34","last_deep_scrub_stamp":"2023-05-24T03:32:47.429774+0000","last_clean_scrub_stamp":"2023-05-24T03:32:47.429774+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:58:07.081393+0000","scrub_duration":0.001382865,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"30'39","reported_seq":72,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:58.363772+0000","last_change":"2023-05-24T03:32:58.363841+0000","last_active":"2023-05-24T03:32:58.363772+0000","last_peered":"2023-05-24T03:32:58.363772+0000","last_clean":"2023-05-24T03:32:58.363772+0000","last_became_active":"2023-05-24T03:29:44.500065+0000","last_became_peered":"2023-05-24T03:29:44.500065+0000","last_unstale":"2023-05-24T03:32:58.363772+0000","last_undegraded":"2023-05-24T03:32:58.363772+0000","last_fullsized":"2023-05-24T03:32:58.363772+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'39","last_scrub_stamp":"2023-05-24T03:32:58.363628+0000","last_deep_scrub":"30'39","last_deep_scrub_stamp":"2023-05-24T03:32:58.363628+0000","last_clean_scrub_stamp":"2023-05-24T03:32:58.363628+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:28:10.844281+0000","scrub_duration":0.0019849030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"30'27","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:33.103467+0000","last_change":"2023-05-24T03:32:33.103534+0000","last_active":"2023-05-24T03:32:33.103467+0000","last_peered":"2023-05-24T03:32:33.103467+0000","last_clean":"2023-05-24T03:32:33.103467+0000","last_became_active":"2023-05-24T03:29:44.499324+0000","last_became_peered":"2023-05-24T03:29:44.499324+0000","last_unstale":"2023-05-24T03:32:33.103467+0000","last_undegraded":"2023-05-24T03:32:33.103467+0000","last_fullsized":"2023-05-24T03:32:33.103467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'27","last_scrub_stamp":"2023-05-24T03:32:33.103341+0000","last_deep_scrub":"30'27","last_deep_scrub_stamp":"2023-05-24T03:32:33.103341+0000","last_clean_scrub_stamp":"2023-05-24T03:32:33.103341+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:10:30.279133+0000","scrub_duration":0.0021747279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"30'31","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:07.551920+0000","last_change":"2023-05-24T03:32:07.551920+0000","last_active":"2023-05-24T03:32:07.551920+0000","last_peered":"2023-05-24T03:32:07.551920+0000","last_clean":"2023-05-24T03:32:07.551920+0000","last_became_active":"2023-05-24T03:29:44.500260+0000","last_became_peered":"2023-05-24T03:29:44.500260+0000","last_unstale":"2023-05-24T03:32:07.551920+0000","last_undegraded":"2023-05-24T03:32:07.551920+0000","last_fullsized":"2023-05-24T03:32:07.551920+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'31","last_scrub_stamp":"2023-05-24T03:32:07.551774+0000","last_deep_scrub":"30'31","last_deep_scrub_stamp":"2023-05-24T03:32:07.551774+0000","last_clean_scrub_stamp":"2023-05-24T03:32:07.551774+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:05:30.767531+0000","scrub_duration":0.001406902,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"30'38","reported_seq":71,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:53.522360+0000","last_change":"2023-05-24T03:32:53.522430+0000","last_active":"2023-05-24T03:32:53.522360+0000","last_peered":"2023-05-24T03:32:53.522360+0000","last_clean":"2023-05-24T03:32:53.522360+0000","last_became_active":"2023-05-24T03:29:44.502341+0000","last_became_peered":"2023-05-24T03:29:44.502341+0000","last_unstale":"2023-05-24T03:32:53.522360+0000","last_undegraded":"2023-05-24T03:32:53.522360+0000","last_fullsized":"2023-05-24T03:32:53.522360+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'38","last_scrub_stamp":"2023-05-24T03:32:53.522204+0000","last_deep_scrub":"30'38","last_deep_scrub_stamp":"2023-05-24T03:32:53.522204+0000","last_clean_scrub_stamp":"2023-05-24T03:32:53.522204+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:42:10.266209+0000","scrub_duration":0.0014911659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"30'44","reported_seq":77,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:48.502049+0000","last_change":"2023-05-24T03:32:48.502118+0000","last_active":"2023-05-24T03:32:48.502049+0000","last_peered":"2023-05-24T03:32:48.502049+0000","last_clean":"2023-05-24T03:32:48.502049+0000","last_became_active":"2023-05-24T03:29:44.500156+0000","last_became_peered":"2023-05-24T03:29:44.500156+0000","last_unstale":"2023-05-24T03:32:48.502049+0000","last_undegraded":"2023-05-24T03:32:48.502049+0000","last_fullsized":"2023-05-24T03:32:48.502049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'44","last_scrub_stamp":"2023-05-24T03:32:48.501926+0000","last_deep_scrub":"30'44","last_deep_scrub_stamp":"2023-05-24T03:32:48.501926+0000","last_clean_scrub_stamp":"2023-05-24T03:32:48.501926+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:42:05.245931+0000","scrub_duration":0.001515993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"30'25","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:27.381172+0000","last_change":"2023-05-24T03:32:27.381239+0000","last_active":"2023-05-24T03:32:27.381172+0000","last_peered":"2023-05-24T03:32:27.381172+0000","last_clean":"2023-05-24T03:32:27.381172+0000","last_became_active":"2023-05-24T03:29:44.492573+0000","last_became_peered":"2023-05-24T03:29:44.492573+0000","last_unstale":"2023-05-24T03:32:27.381172+0000","last_undegraded":"2023-05-24T03:32:27.381172+0000","last_fullsized":"2023-05-24T03:32:27.381172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'25","last_scrub_stamp":"2023-05-24T03:32:27.381053+0000","last_deep_scrub":"30'25","last_deep_scrub_stamp":"2023-05-24T03:32:27.381053+0000","last_clean_scrub_stamp":"2023-05-24T03:32:27.381053+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:57:47.032672+0000","scrub_duration":0.001811975,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"30'30","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:21.771720+0000","last_change":"2023-05-24T03:32:21.771773+0000","last_active":"2023-05-24T03:32:21.771720+0000","last_peered":"2023-05-24T03:32:21.771720+0000","last_clean":"2023-05-24T03:32:21.771720+0000","last_became_active":"2023-05-24T03:29:44.501371+0000","last_became_peered":"2023-05-24T03:29:44.501371+0000","last_unstale":"2023-05-24T03:32:21.771720+0000","last_undegraded":"2023-05-24T03:32:21.771720+0000","last_fullsized":"2023-05-24T03:32:21.771720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2023-05-24T03:32:21.771619+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2023-05-24T03:32:21.771619+0000","last_clean_scrub_stamp":"2023-05-24T03:32:21.771619+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:46:03.786320+0000","scrub_duration":0.0021789000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"30'30","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:10.688054+0000","last_change":"2023-05-24T03:32:10.688054+0000","last_active":"2023-05-24T03:32:10.688054+0000","last_peered":"2023-05-24T03:32:10.688054+0000","last_clean":"2023-05-24T03:32:10.688054+0000","last_became_active":"2023-05-24T03:29:44.490411+0000","last_became_peered":"2023-05-24T03:29:44.490411+0000","last_unstale":"2023-05-24T03:32:10.688054+0000","last_undegraded":"2023-05-24T03:32:10.688054+0000","last_fullsized":"2023-05-24T03:32:10.688054+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2023-05-24T03:32:10.687867+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2023-05-24T03:32:10.687867+0000","last_clean_scrub_stamp":"2023-05-24T03:32:10.687867+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:41:09.062399+0000","scrub_duration":0.0014586079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:08.559425+0000","last_change":"2023-05-24T03:32:08.559478+0000","last_active":"2023-05-24T03:32:08.559425+0000","last_peered":"2023-05-24T03:32:08.559425+0000","last_clean":"2023-05-24T03:32:08.559425+0000","last_became_active":"2023-05-24T03:29:44.494879+0000","last_became_peered":"2023-05-24T03:29:44.494879+0000","last_unstale":"2023-05-24T03:32:08.559425+0000","last_undegraded":"2023-05-24T03:32:08.559425+0000","last_fullsized":"2023-05-24T03:32:08.559425+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-05-24T03:32:08.559327+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-05-24T03:32:08.559327+0000","last_clean_scrub_stamp":"2023-05-24T03:32:08.559327+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:39:20.496878+0000","scrub_duration":0.0018937559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"30'31","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:43.164305+0000","last_change":"2023-05-24T03:32:43.164350+0000","last_active":"2023-05-24T03:32:43.164305+0000","last_peered":"2023-05-24T03:32:43.164305+0000","last_clean":"2023-05-24T03:32:43.164305+0000","last_became_active":"2023-05-24T03:29:44.499393+0000","last_became_peered":"2023-05-24T03:29:44.499393+0000","last_unstale":"2023-05-24T03:32:43.164305+0000","last_undegraded":"2023-05-24T03:32:43.164305+0000","last_fullsized":"2023-05-24T03:32:43.164305+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'31","last_scrub_stamp":"2023-05-24T03:32:43.164206+0000","last_deep_scrub":"30'31","last_deep_scrub_stamp":"2023-05-24T03:32:43.164206+0000","last_clean_scrub_stamp":"2023-05-24T03:32:43.164206+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:46:27.289607+0000","scrub_duration":0.0018417220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"30'39","reported_seq":72,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:48.292152+0000","last_change":"2023-05-24T03:32:48.292204+0000","last_active":"2023-05-24T03:32:48.292152+0000","last_peered":"2023-05-24T03:32:48.292152+0000","last_clean":"2023-05-24T03:32:48.292152+0000","last_became_active":"2023-05-24T03:29:44.500818+0000","last_became_peered":"2023-05-24T03:29:44.500818+0000","last_unstale":"2023-05-24T03:32:48.292152+0000","last_undegraded":"2023-05-24T03:32:48.292152+0000","last_fullsized":"2023-05-24T03:32:48.292152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'39","last_scrub_stamp":"2023-05-24T03:32:48.292044+0000","last_deep_scrub":"30'39","last_deep_scrub_stamp":"2023-05-24T03:32:48.292044+0000","last_clean_scrub_stamp":"2023-05-24T03:32:48.292044+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T03:55:31.386422+0000","scrub_duration":0.0020914950000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"30'34","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:05.266534+0000","last_change":"2023-05-24T03:32:05.266534+0000","last_active":"2023-05-24T03:32:05.266534+0000","last_peered":"2023-05-24T03:32:05.266534+0000","last_clean":"2023-05-24T03:32:05.266534+0000","last_became_active":"2023-05-24T03:29:44.499543+0000","last_became_peered":"2023-05-24T03:29:44.499543+0000","last_unstale":"2023-05-24T03:32:05.266534+0000","last_undegraded":"2023-05-24T03:32:05.266534+0000","last_fullsized":"2023-05-24T03:32:05.266534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'34","last_scrub_stamp":"2023-05-24T03:32:05.266373+0000","last_deep_scrub":"30'34","last_deep_scrub_stamp":"2023-05-24T03:32:05.266373+0000","last_clean_scrub_stamp":"2023-05-24T03:32:05.266373+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:30:44.837013+0000","scrub_duration":0.001465926,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"30'29","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:14.450147+0000","last_change":"2023-05-24T03:32:14.450198+0000","last_active":"2023-05-24T03:32:14.450147+0000","last_peered":"2023-05-24T03:32:14.450147+0000","last_clean":"2023-05-24T03:32:14.450147+0000","last_became_active":"2023-05-24T03:29:44.492109+0000","last_became_peered":"2023-05-24T03:29:44.492109+0000","last_unstale":"2023-05-24T03:32:14.450147+0000","last_undegraded":"2023-05-24T03:32:14.450147+0000","last_fullsized":"2023-05-24T03:32:14.450147+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'29","last_scrub_stamp":"2023-05-24T03:32:14.450045+0000","last_deep_scrub":"30'29","last_deep_scrub_stamp":"2023-05-24T03:32:14.450045+0000","last_clean_scrub_stamp":"2023-05-24T03:32:14.450045+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:29:13.731044+0000","scrub_duration":0.0018316579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"30'31","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:12.709356+0000","last_change":"2023-05-24T03:32:12.709408+0000","last_active":"2023-05-24T03:32:12.709356+0000","last_peered":"2023-05-24T03:32:12.709356+0000","last_clean":"2023-05-24T03:32:12.709356+0000","last_became_active":"2023-05-24T03:29:44.480597+0000","last_became_peered":"2023-05-24T03:29:44.480597+0000","last_unstale":"2023-05-24T03:32:12.709356+0000","last_undegraded":"2023-05-24T03:32:12.709356+0000","last_fullsized":"2023-05-24T03:32:12.709356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'31","last_scrub_stamp":"2023-05-24T03:32:12.709240+0000","last_deep_scrub":"30'31","last_deep_scrub_stamp":"2023-05-24T03:32:12.709240+0000","last_clean_scrub_stamp":"2023-05-24T03:32:12.709240+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:30:46.981383+0000","scrub_duration":0.001799042,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"30'34","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:21.334467+0000","last_change":"2023-05-24T03:32:21.334516+0000","last_active":"2023-05-24T03:32:21.334467+0000","last_peered":"2023-05-24T03:32:21.334467+0000","last_clean":"2023-05-24T03:32:21.334467+0000","last_became_active":"2023-05-24T03:29:44.499405+0000","last_became_peered":"2023-05-24T03:29:44.499405+0000","last_unstale":"2023-05-24T03:32:21.334467+0000","last_undegraded":"2023-05-24T03:32:21.334467+0000","last_fullsized":"2023-05-24T03:32:21.334467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'34","last_scrub_stamp":"2023-05-24T03:32:21.334367+0000","last_deep_scrub":"30'34","last_deep_scrub_stamp":"2023-05-24T03:32:21.334367+0000","last_clean_scrub_stamp":"2023-05-24T03:32:21.334367+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:18:40.971078+0000","scrub_duration":0.001550711,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"30'40","reported_seq":78,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:34.104760+0000","last_change":"2023-05-24T03:32:34.104814+0000","last_active":"2023-05-24T03:32:34.104760+0000","last_peered":"2023-05-24T03:32:34.104760+0000","last_clean":"2023-05-24T03:32:34.104760+0000","last_became_active":"2023-05-24T03:30:26.105858+0000","last_became_peered":"2023-05-24T03:30:26.105858+0000","last_unstale":"2023-05-24T03:32:34.104760+0000","last_undegraded":"2023-05-24T03:32:34.104760+0000","last_fullsized":"2023-05-24T03:32:34.104760+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'40","last_scrub_stamp":"2023-05-24T03:32:34.104644+0000","last_deep_scrub":"30'40","last_deep_scrub_stamp":"2023-05-24T03:32:34.104644+0000","last_clean_scrub_stamp":"2023-05-24T03:32:34.104644+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:12:02.487746+0000","scrub_duration":0.002118946,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:29.391149+0000","last_change":"2023-05-24T03:32:29.391187+0000","last_active":"2023-05-24T03:32:29.391149+0000","last_peered":"2023-05-24T03:32:29.391149+0000","last_clean":"2023-05-24T03:32:29.391149+0000","last_became_active":"2023-05-24T03:29:44.498463+0000","last_became_peered":"2023-05-24T03:29:44.498463+0000","last_unstale":"2023-05-24T03:32:29.391149+0000","last_undegraded":"2023-05-24T03:32:29.391149+0000","last_fullsized":"2023-05-24T03:32:29.391149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-05-24T03:32:29.391070+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-05-24T03:32:29.391070+0000","last_clean_scrub_stamp":"2023-05-24T03:32:29.391070+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:07:37.248980+0000","scrub_duration":0.0011854249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"30'36","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:18.872950+0000","last_change":"2023-05-24T03:32:18.872998+0000","last_active":"2023-05-24T03:32:18.872950+0000","last_peered":"2023-05-24T03:32:18.872950+0000","last_clean":"2023-05-24T03:32:18.872950+0000","last_became_active":"2023-05-24T03:29:44.499960+0000","last_became_peered":"2023-05-24T03:29:44.499960+0000","last_unstale":"2023-05-24T03:32:18.872950+0000","last_undegraded":"2023-05-24T03:32:18.872950+0000","last_fullsized":"2023-05-24T03:32:18.872950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'36","last_scrub_stamp":"2023-05-24T03:32:18.872839+0000","last_deep_scrub":"30'36","last_deep_scrub_stamp":"2023-05-24T03:32:18.872839+0000","last_clean_scrub_stamp":"2023-05-24T03:32:18.872839+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:53:45.834893+0000","scrub_duration":0.001506446,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"30'31","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:40.102248+0000","last_change":"2023-05-24T03:32:40.102298+0000","last_active":"2023-05-24T03:32:40.102248+0000","last_peered":"2023-05-24T03:32:40.102248+0000","last_clean":"2023-05-24T03:32:40.102248+0000","last_became_active":"2023-05-24T03:29:44.498437+0000","last_became_peered":"2023-05-24T03:29:44.498437+0000","last_unstale":"2023-05-24T03:32:40.102248+0000","last_undegraded":"2023-05-24T03:32:40.102248+0000","last_fullsized":"2023-05-24T03:32:40.102248+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'31","last_scrub_stamp":"2023-05-24T03:32:40.102145+0000","last_deep_scrub":"30'31","last_deep_scrub_stamp":"2023-05-24T03:32:40.102145+0000","last_clean_scrub_stamp":"2023-05-24T03:32:40.102145+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:18:59.738856+0000","scrub_duration":0.0016287210000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"30'25","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:33.878107+0000","last_change":"2023-05-24T03:32:33.878173+0000","last_active":"2023-05-24T03:32:33.878107+0000","last_peered":"2023-05-24T03:32:33.878107+0000","last_clean":"2023-05-24T03:32:33.878107+0000","last_became_active":"2023-05-24T03:29:44.481004+0000","last_became_peered":"2023-05-24T03:29:44.481004+0000","last_unstale":"2023-05-24T03:32:33.878107+0000","last_undegraded":"2023-05-24T03:32:33.878107+0000","last_fullsized":"2023-05-24T03:32:33.878107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'25","last_scrub_stamp":"2023-05-24T03:32:33.878004+0000","last_deep_scrub":"30'25","last_deep_scrub_stamp":"2023-05-24T03:32:33.878004+0000","last_clean_scrub_stamp":"2023-05-24T03:32:33.878004+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:10:31.053796+0000","scrub_duration":0.0019292770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"30'38","reported_seq":71,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:12.991958+0000","last_change":"2023-05-24T03:32:12.992009+0000","last_active":"2023-05-24T03:32:12.991958+0000","last_peered":"2023-05-24T03:32:12.991958+0000","last_clean":"2023-05-24T03:32:12.991958+0000","last_became_active":"2023-05-24T03:29:44.481686+0000","last_became_peered":"2023-05-24T03:29:44.481686+0000","last_unstale":"2023-05-24T03:32:12.991958+0000","last_undegraded":"2023-05-24T03:32:12.991958+0000","last_fullsized":"2023-05-24T03:32:12.991958+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'38","last_scrub_stamp":"2023-05-24T03:32:12.991844+0000","last_deep_scrub":"30'38","last_deep_scrub_stamp":"2023-05-24T03:32:12.991844+0000","last_clean_scrub_stamp":"2023-05-24T03:32:12.991844+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:11:02.613201+0000","scrub_duration":0.0013478520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"30'26","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:42.422520+0000","last_change":"2023-05-24T03:32:42.422571+0000","last_active":"2023-05-24T03:32:42.422520+0000","last_peered":"2023-05-24T03:32:42.422520+0000","last_clean":"2023-05-24T03:32:42.422520+0000","last_became_active":"2023-05-24T03:29:44.502669+0000","last_became_peered":"2023-05-24T03:29:44.502669+0000","last_unstale":"2023-05-24T03:32:42.422520+0000","last_undegraded":"2023-05-24T03:32:42.422520+0000","last_fullsized":"2023-05-24T03:32:42.422520+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'26","last_scrub_stamp":"2023-05-24T03:32:42.422420+0000","last_deep_scrub":"30'26","last_deep_scrub_stamp":"2023-05-24T03:32:42.422420+0000","last_clean_scrub_stamp":"2023-05-24T03:32:42.422420+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:58:02.074039+0000","scrub_duration":0.001487106,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"30'474","reported_seq":501,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:33:05.244110+0000","last_change":"2023-05-24T03:33:05.244184+0000","last_active":"2023-05-24T03:33:05.244110+0000","last_peered":"2023-05-24T03:33:05.244110+0000","last_clean":"2023-05-24T03:33:05.244110+0000","last_became_active":"2023-05-24T03:29:48.522749+0000","last_became_peered":"2023-05-24T03:29:48.522749+0000","last_unstale":"2023-05-24T03:33:05.244110+0000","last_undegraded":"2023-05-24T03:33:05.244110+0000","last_fullsized":"2023-05-24T03:33:05.244110+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'474","last_scrub_stamp":"2023-05-24T03:33:05.244005+0000","last_deep_scrub":"30'474","last_deep_scrub_stamp":"2023-05-24T03:33:05.244005+0000","last_clean_scrub_stamp":"2023-05-24T03:33:05.244005+0000","objects_scrubbed":1,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:01:27.665695+0000","scrub_duration":0.0063322040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:37.284844+0000","last_change":"2023-05-24T03:32:37.284943+0000","last_active":"2023-05-24T03:32:37.284844+0000","last_peered":"2023-05-24T03:32:37.284844+0000","last_clean":"2023-05-24T03:32:37.284844+0000","last_became_active":"2023-05-24T03:29:44.086143+0000","last_became_peered":"2023-05-24T03:29:44.086143+0000","last_unstale":"2023-05-24T03:32:37.284844+0000","last_undegraded":"2023-05-24T03:32:37.284844+0000","last_fullsized":"2023-05-24T03:32:37.284844+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-05-24T03:32:37.284689+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-05-24T03:32:37.284689+0000","last_clean_scrub_stamp":"2023-05-24T03:32:37.284689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T03:50:08.327208+0000","scrub_duration":0.0019021800000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'39","reported_seq":72,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:06.778805+0000","last_change":"2023-05-24T03:32:06.778805+0000","last_active":"2023-05-24T03:32:06.778805+0000","last_peered":"2023-05-24T03:32:06.778805+0000","last_clean":"2023-05-24T03:32:06.778805+0000","last_became_active":"2023-05-24T03:29:44.490772+0000","last_became_peered":"2023-05-24T03:29:44.490772+0000","last_unstale":"2023-05-24T03:32:06.778805+0000","last_undegraded":"2023-05-24T03:32:06.778805+0000","last_fullsized":"2023-05-24T03:32:06.778805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'39","last_scrub_stamp":"2023-05-24T03:32:06.778698+0000","last_deep_scrub":"30'39","last_deep_scrub_stamp":"2023-05-24T03:32:06.778698+0000","last_clean_scrub_stamp":"2023-05-24T03:32:06.778698+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:31:15.880804+0000","scrub_duration":0.0014151050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"30'444","reported_seq":471,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:34.799588+0000","last_change":"2023-05-24T03:32:34.799688+0000","last_active":"2023-05-24T03:32:34.799588+0000","last_peered":"2023-05-24T03:32:34.799588+0000","last_clean":"2023-05-24T03:32:34.799588+0000","last_became_active":"2023-05-24T03:29:48.523125+0000","last_became_peered":"2023-05-24T03:29:48.523125+0000","last_unstale":"2023-05-24T03:32:34.799588+0000","last_undegraded":"2023-05-24T03:32:34.799588+0000","last_fullsized":"2023-05-24T03:32:34.799588+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'444","last_scrub_stamp":"2023-05-24T03:32:34.799475+0000","last_deep_scrub":"30'444","last_deep_scrub_stamp":"2023-05-24T03:32:34.799475+0000","last_clean_scrub_stamp":"2023-05-24T03:32:34.799475+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:31:14.370115+0000","scrub_duration":0.0021951340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:27.924674+0000","last_change":"2023-05-24T03:32:27.924740+0000","last_active":"2023-05-24T03:32:27.924674+0000","last_peered":"2023-05-24T03:32:27.924674+0000","last_clean":"2023-05-24T03:32:27.924674+0000","last_became_active":"2023-05-24T03:29:44.084099+0000","last_became_peered":"2023-05-24T03:29:44.084099+0000","last_unstale":"2023-05-24T03:32:27.924674+0000","last_undegraded":"2023-05-24T03:32:27.924674+0000","last_fullsized":"2023-05-24T03:32:27.924674+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:27.924570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:27.924570+0000","last_clean_scrub_stamp":"2023-05-24T03:32:27.924570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:04:08.141178+0000","scrub_duration":0.001356494,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"30'31","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:43.340857+0000","last_change":"2023-05-24T03:32:43.340905+0000","last_active":"2023-05-24T03:32:43.340857+0000","last_peered":"2023-05-24T03:32:43.340857+0000","last_clean":"2023-05-24T03:32:43.340857+0000","last_became_active":"2023-05-24T03:29:44.503039+0000","last_became_peered":"2023-05-24T03:29:44.503039+0000","last_unstale":"2023-05-24T03:32:43.340857+0000","last_undegraded":"2023-05-24T03:32:43.340857+0000","last_fullsized":"2023-05-24T03:32:43.340857+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'31","last_scrub_stamp":"2023-05-24T03:32:43.340745+0000","last_deep_scrub":"30'31","last_deep_scrub_stamp":"2023-05-24T03:32:43.340745+0000","last_clean_scrub_stamp":"2023-05-24T03:32:43.340745+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:46:27.466145+0000","scrub_duration":0.001774086,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"30'454","reported_seq":481,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:57.529817+0000","last_change":"2023-05-24T03:32:57.529918+0000","last_active":"2023-05-24T03:32:57.529817+0000","last_peered":"2023-05-24T03:32:57.529817+0000","last_clean":"2023-05-24T03:32:57.529817+0000","last_became_active":"2023-05-24T03:29:48.529142+0000","last_became_peered":"2023-05-24T03:29:48.529142+0000","last_unstale":"2023-05-24T03:32:57.529817+0000","last_undegraded":"2023-05-24T03:32:57.529817+0000","last_fullsized":"2023-05-24T03:32:57.529817+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'454","last_scrub_stamp":"2023-05-24T03:32:57.529698+0000","last_deep_scrub":"30'454","last_deep_scrub_stamp":"2023-05-24T03:32:57.529698+0000","last_clean_scrub_stamp":"2023-05-24T03:32:57.529698+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:16:13.524316+0000","scrub_duration":0.002184737,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"30'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:21.861680+0000","last_change":"2023-05-24T03:32:21.861728+0000","last_active":"2023-05-24T03:32:21.861680+0000","last_peered":"2023-05-24T03:32:21.861680+0000","last_clean":"2023-05-24T03:32:21.861680+0000","last_became_active":"2023-05-24T03:29:44.084907+0000","last_became_peered":"2023-05-24T03:29:44.084907+0000","last_unstale":"2023-05-24T03:32:21.861680+0000","last_undegraded":"2023-05-24T03:32:21.861680+0000","last_fullsized":"2023-05-24T03:32:21.861680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-05-24T03:32:21.861585+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-05-24T03:32:21.861585+0000","last_clean_scrub_stamp":"2023-05-24T03:32:21.861585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:59:22.498081+0000","scrub_duration":0.0014618840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"30'30","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:27.920731+0000","last_change":"2023-05-24T03:32:27.920774+0000","last_active":"2023-05-24T03:32:27.920731+0000","last_peered":"2023-05-24T03:32:27.920731+0000","last_clean":"2023-05-24T03:32:27.920731+0000","last_became_active":"2023-05-24T03:29:44.496746+0000","last_became_peered":"2023-05-24T03:29:44.496746+0000","last_unstale":"2023-05-24T03:32:27.920731+0000","last_undegraded":"2023-05-24T03:32:27.920731+0000","last_fullsized":"2023-05-24T03:32:27.920731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2023-05-24T03:32:27.920648+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2023-05-24T03:32:27.920648+0000","last_clean_scrub_stamp":"2023-05-24T03:32:27.920648+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:59:00.870767+0000","scrub_duration":0.001516101,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"30'468","reported_seq":495,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:39.854622+0000","last_change":"2023-05-24T03:32:39.854702+0000","last_active":"2023-05-24T03:32:39.854622+0000","last_peered":"2023-05-24T03:32:39.854622+0000","last_clean":"2023-05-24T03:32:39.854622+0000","last_became_active":"2023-05-24T03:29:48.520319+0000","last_became_peered":"2023-05-24T03:29:48.520319+0000","last_unstale":"2023-05-24T03:32:39.854622+0000","last_undegraded":"2023-05-24T03:32:39.854622+0000","last_fullsized":"2023-05-24T03:32:39.854622+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'468","last_scrub_stamp":"2023-05-24T03:32:39.854508+0000","last_deep_scrub":"30'468","last_deep_scrub_stamp":"2023-05-24T03:32:39.854508+0000","last_clean_scrub_stamp":"2023-05-24T03:32:39.854508+0000","objects_scrubbed":1,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:06:16.342886+0000","scrub_duration":0.0070678420000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"30'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:16.397784+0000","last_change":"2023-05-24T03:32:16.397828+0000","last_active":"2023-05-24T03:32:16.397784+0000","last_peered":"2023-05-24T03:32:16.397784+0000","last_clean":"2023-05-24T03:32:16.397784+0000","last_became_active":"2023-05-24T03:29:44.088267+0000","last_became_peered":"2023-05-24T03:29:44.088267+0000","last_unstale":"2023-05-24T03:32:16.397784+0000","last_undegraded":"2023-05-24T03:32:16.397784+0000","last_fullsized":"2023-05-24T03:32:16.397784+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-05-24T03:32:16.397687+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-05-24T03:32:16.397687+0000","last_clean_scrub_stamp":"2023-05-24T03:32:16.397687+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:36:49.030839+0000","scrub_duration":0.0020232230000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"30'27","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:10.842423+0000","last_change":"2023-05-24T03:32:10.842496+0000","last_active":"2023-05-24T03:32:10.842423+0000","last_peered":"2023-05-24T03:32:10.842423+0000","last_clean":"2023-05-24T03:32:10.842423+0000","last_became_active":"2023-05-24T03:29:44.488666+0000","last_became_peered":"2023-05-24T03:29:44.488666+0000","last_unstale":"2023-05-24T03:32:10.842423+0000","last_undegraded":"2023-05-24T03:32:10.842423+0000","last_fullsized":"2023-05-24T03:32:10.842423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'27","last_scrub_stamp":"2023-05-24T03:32:10.842313+0000","last_deep_scrub":"30'27","last_deep_scrub_stamp":"2023-05-24T03:32:10.842313+0000","last_clean_scrub_stamp":"2023-05-24T03:32:10.842313+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:36:43.475465+0000","scrub_duration":0.001460512,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"30'453","reported_seq":480,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:47.129535+0000","last_change":"2023-05-24T03:32:47.129618+0000","last_active":"2023-05-24T03:32:47.129535+0000","last_peered":"2023-05-24T03:32:47.129535+0000","last_clean":"2023-05-24T03:32:47.129535+0000","last_became_active":"2023-05-24T03:29:48.517771+0000","last_became_peered":"2023-05-24T03:29:48.517771+0000","last_unstale":"2023-05-24T03:32:47.129535+0000","last_undegraded":"2023-05-24T03:32:47.129535+0000","last_fullsized":"2023-05-24T03:32:47.129535+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'453","last_scrub_stamp":"2023-05-24T03:32:47.129412+0000","last_deep_scrub":"30'453","last_deep_scrub_stamp":"2023-05-24T03:32:47.129412+0000","last_clean_scrub_stamp":"2023-05-24T03:32:47.129412+0000","objects_scrubbed":2,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:58:06.781030+0000","scrub_duration":0.010316357,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:29.379299+0000","last_change":"2023-05-24T03:32:29.379343+0000","last_active":"2023-05-24T03:32:29.379299+0000","last_peered":"2023-05-24T03:32:29.379299+0000","last_clean":"2023-05-24T03:32:29.379299+0000","last_became_active":"2023-05-24T03:29:44.087601+0000","last_became_peered":"2023-05-24T03:29:44.087601+0000","last_unstale":"2023-05-24T03:32:29.379299+0000","last_undegraded":"2023-05-24T03:32:29.379299+0000","last_fullsized":"2023-05-24T03:32:29.379299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:29.379207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:29.379207+0000","last_clean_scrub_stamp":"2023-05-24T03:32:29.379207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:11:57.762308+0000","scrub_duration":0.001464873,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"30'36","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:38.042737+0000","last_change":"2023-05-24T03:32:38.042785+0000","last_active":"2023-05-24T03:32:38.042737+0000","last_peered":"2023-05-24T03:32:38.042737+0000","last_clean":"2023-05-24T03:32:38.042737+0000","last_became_active":"2023-05-24T03:29:44.495752+0000","last_became_peered":"2023-05-24T03:29:44.495752+0000","last_unstale":"2023-05-24T03:32:38.042737+0000","last_undegraded":"2023-05-24T03:32:38.042737+0000","last_fullsized":"2023-05-24T03:32:38.042737+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'36","last_scrub_stamp":"2023-05-24T03:32:38.042641+0000","last_deep_scrub":"30'36","last_deep_scrub_stamp":"2023-05-24T03:32:38.042641+0000","last_clean_scrub_stamp":"2023-05-24T03:32:38.042641+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:46:22.168041+0000","scrub_duration":0.00190278,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"30'480","reported_seq":507,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:33:01.929131+0000","last_change":"2023-05-24T03:33:01.929200+0000","last_active":"2023-05-24T03:33:01.929131+0000","last_peered":"2023-05-24T03:33:01.929131+0000","last_clean":"2023-05-24T03:33:01.929131+0000","last_became_active":"2023-05-24T03:29:48.529514+0000","last_became_peered":"2023-05-24T03:29:48.529514+0000","last_unstale":"2023-05-24T03:33:01.929131+0000","last_undegraded":"2023-05-24T03:33:01.929131+0000","last_fullsized":"2023-05-24T03:33:01.929131+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'480","last_scrub_stamp":"2023-05-24T03:33:01.929044+0000","last_deep_scrub":"30'480","last_deep_scrub_stamp":"2023-05-24T03:33:01.929044+0000","last_clean_scrub_stamp":"2023-05-24T03:33:01.929044+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T03:55:45.023422+0000","scrub_duration":0.0020237010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"30'13","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:30.169052+0000","last_change":"2023-05-24T03:32:30.169101+0000","last_active":"2023-05-24T03:32:30.169052+0000","last_peered":"2023-05-24T03:32:30.169052+0000","last_clean":"2023-05-24T03:32:30.169052+0000","last_became_active":"2023-05-24T03:29:44.091390+0000","last_became_peered":"2023-05-24T03:29:44.091390+0000","last_unstale":"2023-05-24T03:32:30.169052+0000","last_undegraded":"2023-05-24T03:32:30.169052+0000","last_fullsized":"2023-05-24T03:32:30.169052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'13","last_scrub_stamp":"2023-05-24T03:32:30.168959+0000","last_deep_scrub":"30'13","last_deep_scrub_stamp":"2023-05-24T03:32:30.168959+0000","last_clean_scrub_stamp":"2023-05-24T03:32:30.168959+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:07:38.026869+0000","scrub_duration":0.003670534,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"30'42","reported_seq":75,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:28.880132+0000","last_change":"2023-05-24T03:32:28.880189+0000","last_active":"2023-05-24T03:32:28.880132+0000","last_peered":"2023-05-24T03:32:28.880132+0000","last_clean":"2023-05-24T03:32:28.880132+0000","last_became_active":"2023-05-24T03:29:44.481385+0000","last_became_peered":"2023-05-24T03:29:44.481385+0000","last_unstale":"2023-05-24T03:32:28.880132+0000","last_undegraded":"2023-05-24T03:32:28.880132+0000","last_fullsized":"2023-05-24T03:32:28.880132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'42","last_scrub_stamp":"2023-05-24T03:32:28.880056+0000","last_deep_scrub":"30'42","last_deep_scrub_stamp":"2023-05-24T03:32:28.880056+0000","last_clean_scrub_stamp":"2023-05-24T03:32:28.880056+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:50:10.559202+0000","scrub_duration":0.0020578609999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"30'471","reported_seq":498,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:43.963240+0000","last_change":"2023-05-24T03:32:43.963307+0000","last_active":"2023-05-24T03:32:43.963240+0000","last_peered":"2023-05-24T03:32:43.963240+0000","last_clean":"2023-05-24T03:32:43.963240+0000","last_became_active":"2023-05-24T03:29:48.524312+0000","last_became_peered":"2023-05-24T03:29:48.524312+0000","last_unstale":"2023-05-24T03:32:43.963240+0000","last_undegraded":"2023-05-24T03:32:43.963240+0000","last_fullsized":"2023-05-24T03:32:43.963240+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'471","last_scrub_stamp":"2023-05-24T03:32:43.963153+0000","last_deep_scrub":"30'471","last_deep_scrub_stamp":"2023-05-24T03:32:43.963153+0000","last_clean_scrub_stamp":"2023-05-24T03:32:43.963153+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:46:28.088553+0000","scrub_duration":0.0020290159999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"30'402","reported_seq":437,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:42.277172+0000","last_change":"2023-05-24T03:32:42.277223+0000","last_active":"2023-05-24T03:32:42.277172+0000","last_peered":"2023-05-24T03:32:42.277172+0000","last_clean":"2023-05-24T03:32:42.277172+0000","last_became_active":"2023-05-24T03:29:44.078785+0000","last_became_peered":"2023-05-24T03:29:44.078785+0000","last_unstale":"2023-05-24T03:32:42.277172+0000","last_undegraded":"2023-05-24T03:32:42.277172+0000","last_fullsized":"2023-05-24T03:32:42.277172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'402","last_scrub_stamp":"2023-05-24T03:32:42.277084+0000","last_deep_scrub":"30'402","last_deep_scrub_stamp":"2023-05-24T03:32:42.277084+0000","last_clean_scrub_stamp":"2023-05-24T03:32:42.277084+0000","objects_scrubbed":4,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:31:59.386881+0000","scrub_duration":0.0082326540000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1544734,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":399,"num_write_kb":1772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"30'41","reported_seq":74,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:52.362485+0000","last_change":"2023-05-24T03:32:52.362535+0000","last_active":"2023-05-24T03:32:52.362485+0000","last_peered":"2023-05-24T03:32:52.362485+0000","last_clean":"2023-05-24T03:32:52.362485+0000","last_became_active":"2023-05-24T03:29:44.497120+0000","last_became_peered":"2023-05-24T03:29:44.497120+0000","last_unstale":"2023-05-24T03:32:52.362485+0000","last_undegraded":"2023-05-24T03:32:52.362485+0000","last_fullsized":"2023-05-24T03:32:52.362485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'41","last_scrub_stamp":"2023-05-24T03:32:52.362394+0000","last_deep_scrub":"30'41","last_deep_scrub_stamp":"2023-05-24T03:32:52.362394+0000","last_clean_scrub_stamp":"2023-05-24T03:32:52.362394+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:58:23.800829+0000","scrub_duration":0.00159844,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"30'438","reported_seq":465,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:33:03.535026+0000","last_change":"2023-05-24T03:33:03.535133+0000","last_active":"2023-05-24T03:33:03.535026+0000","last_peered":"2023-05-24T03:33:03.535026+0000","last_clean":"2023-05-24T03:33:03.535026+0000","last_became_active":"2023-05-24T03:29:48.531538+0000","last_became_peered":"2023-05-24T03:29:48.531538+0000","last_unstale":"2023-05-24T03:33:03.535026+0000","last_undegraded":"2023-05-24T03:33:03.535026+0000","last_fullsized":"2023-05-24T03:33:03.535026+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'438","last_scrub_stamp":"2023-05-24T03:33:03.534883+0000","last_deep_scrub":"30'438","last_deep_scrub_stamp":"2023-05-24T03:33:03.534883+0000","last_clean_scrub_stamp":"2023-05-24T03:33:03.534883+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:05:03.373286+0000","scrub_duration":0.002328554,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"30'5","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:28.074124+0000","last_change":"2023-05-24T03:32:28.074186+0000","last_active":"2023-05-24T03:32:28.074124+0000","last_peered":"2023-05-24T03:32:28.074124+0000","last_clean":"2023-05-24T03:32:28.074124+0000","last_became_active":"2023-05-24T03:29:44.086997+0000","last_became_peered":"2023-05-24T03:29:44.086997+0000","last_unstale":"2023-05-24T03:32:28.074124+0000","last_undegraded":"2023-05-24T03:32:28.074124+0000","last_fullsized":"2023-05-24T03:32:28.074124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'5","last_scrub_stamp":"2023-05-24T03:32:28.074042+0000","last_deep_scrub":"30'5","last_deep_scrub_stamp":"2023-05-24T03:32:28.074042+0000","last_clean_scrub_stamp":"2023-05-24T03:32:28.074042+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:50:09.753188+0000","scrub_duration":0.0031652949999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"30'29","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:41.963802+0000","last_change":"2023-05-24T03:32:41.963850+0000","last_active":"2023-05-24T03:32:41.963802+0000","last_peered":"2023-05-24T03:32:41.963802+0000","last_clean":"2023-05-24T03:32:41.963802+0000","last_became_active":"2023-05-24T03:29:44.487257+0000","last_became_peered":"2023-05-24T03:29:44.487257+0000","last_unstale":"2023-05-24T03:32:41.963802+0000","last_undegraded":"2023-05-24T03:32:41.963802+0000","last_fullsized":"2023-05-24T03:32:41.963802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'29","last_scrub_stamp":"2023-05-24T03:32:41.963713+0000","last_deep_scrub":"30'29","last_deep_scrub_stamp":"2023-05-24T03:32:41.963713+0000","last_clean_scrub_stamp":"2023-05-24T03:32:41.963713+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:58:01.615331+0000","scrub_duration":0.001302131,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"30'470","reported_seq":497,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:33:05.891643+0000","last_change":"2023-05-24T03:33:05.891710+0000","last_active":"2023-05-24T03:33:05.891643+0000","last_peered":"2023-05-24T03:33:05.891643+0000","last_clean":"2023-05-24T03:33:05.891643+0000","last_became_active":"2023-05-24T03:29:48.525726+0000","last_became_peered":"2023-05-24T03:29:48.525726+0000","last_unstale":"2023-05-24T03:33:05.891643+0000","last_undegraded":"2023-05-24T03:33:05.891643+0000","last_fullsized":"2023-05-24T03:33:05.891643+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'470","last_scrub_stamp":"2023-05-24T03:33:05.891531+0000","last_deep_scrub":"30'470","last_deep_scrub_stamp":"2023-05-24T03:33:05.891531+0000","last_clean_scrub_stamp":"2023-05-24T03:33:05.891531+0000","objects_scrubbed":1,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:58:37.329967+0000","scrub_duration":0.0068845900000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:13.389468+0000","last_change":"2023-05-24T03:32:13.389511+0000","last_active":"2023-05-24T03:32:13.389468+0000","last_peered":"2023-05-24T03:32:13.389468+0000","last_clean":"2023-05-24T03:32:13.389468+0000","last_became_active":"2023-05-24T03:29:44.084278+0000","last_became_peered":"2023-05-24T03:29:44.084278+0000","last_unstale":"2023-05-24T03:32:13.389468+0000","last_undegraded":"2023-05-24T03:32:13.389468+0000","last_fullsized":"2023-05-24T03:32:13.389468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:13.389382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:13.389382+0000","last_clean_scrub_stamp":"2023-05-24T03:32:13.389382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:05:36.605139+0000","scrub_duration":0.0019599439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"30'33","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:10.564131+0000","last_change":"2023-05-24T03:32:10.564131+0000","last_active":"2023-05-24T03:32:10.564131+0000","last_peered":"2023-05-24T03:32:10.564131+0000","last_clean":"2023-05-24T03:32:10.564131+0000","last_became_active":"2023-05-24T03:29:44.498097+0000","last_became_peered":"2023-05-24T03:29:44.498097+0000","last_unstale":"2023-05-24T03:32:10.564131+0000","last_undegraded":"2023-05-24T03:32:10.564131+0000","last_fullsized":"2023-05-24T03:32:10.564131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'33","last_scrub_stamp":"2023-05-24T03:32:10.563952+0000","last_deep_scrub":"30'33","last_deep_scrub_stamp":"2023-05-24T03:32:10.563952+0000","last_clean_scrub_stamp":"2023-05-24T03:32:10.563952+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:36:43.197104+0000","scrub_duration":0.001462594,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"30'446","reported_seq":473,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:33:02.924211+0000","last_change":"2023-05-24T03:33:02.924334+0000","last_active":"2023-05-24T03:33:02.924211+0000","last_peered":"2023-05-24T03:33:02.924211+0000","last_clean":"2023-05-24T03:33:02.924211+0000","last_became_active":"2023-05-24T03:29:48.524602+0000","last_became_peered":"2023-05-24T03:29:48.524602+0000","last_unstale":"2023-05-24T03:33:02.924211+0000","last_undegraded":"2023-05-24T03:33:02.924211+0000","last_fullsized":"2023-05-24T03:33:02.924211+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'446","last_scrub_stamp":"2023-05-24T03:33:02.924092+0000","last_deep_scrub":"30'446","last_deep_scrub_stamp":"2023-05-24T03:33:02.924092+0000","last_clean_scrub_stamp":"2023-05-24T03:33:02.924092+0000","objects_scrubbed":1,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:05:02.762495+0000","scrub_duration":0.0076459340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"30'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:29.117566+0000","last_change":"2023-05-24T03:32:29.117619+0000","last_active":"2023-05-24T03:32:29.117566+0000","last_peered":"2023-05-24T03:32:29.117566+0000","last_clean":"2023-05-24T03:32:29.117566+0000","last_became_active":"2023-05-24T03:29:44.085001+0000","last_became_peered":"2023-05-24T03:29:44.085001+0000","last_unstale":"2023-05-24T03:32:29.117566+0000","last_undegraded":"2023-05-24T03:32:29.117566+0000","last_fullsized":"2023-05-24T03:32:29.117566+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-05-24T03:32:29.117451+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-05-24T03:32:29.117451+0000","last_clean_scrub_stamp":"2023-05-24T03:32:29.117451+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:00:25.037831+0000","scrub_duration":0.0015173610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"30'40","reported_seq":73,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:10.302878+0000","last_change":"2023-05-24T03:32:10.302878+0000","last_active":"2023-05-24T03:32:10.302878+0000","last_peered":"2023-05-24T03:32:10.302878+0000","last_clean":"2023-05-24T03:32:10.302878+0000","last_became_active":"2023-05-24T03:29:44.500631+0000","last_became_peered":"2023-05-24T03:29:44.500631+0000","last_unstale":"2023-05-24T03:32:10.302878+0000","last_undegraded":"2023-05-24T03:32:10.302878+0000","last_fullsized":"2023-05-24T03:32:10.302878+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'40","last_scrub_stamp":"2023-05-24T03:32:10.302703+0000","last_deep_scrub":"30'40","last_deep_scrub_stamp":"2023-05-24T03:32:10.302703+0000","last_clean_scrub_stamp":"2023-05-24T03:32:10.302703+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:05:46.791081+0000","scrub_duration":0.0016110149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"30'491","reported_seq":518,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:33:02.554838+0000","last_change":"2023-05-24T03:33:02.554953+0000","last_active":"2023-05-24T03:33:02.554838+0000","last_peered":"2023-05-24T03:33:02.554838+0000","last_clean":"2023-05-24T03:33:02.554838+0000","last_became_active":"2023-05-24T03:29:48.523138+0000","last_became_peered":"2023-05-24T03:29:48.523138+0000","last_unstale":"2023-05-24T03:33:02.554838+0000","last_undegraded":"2023-05-24T03:33:02.554838+0000","last_fullsized":"2023-05-24T03:33:02.554838+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'491","last_scrub_stamp":"2023-05-24T03:33:02.554700+0000","last_deep_scrub":"30'491","last_deep_scrub_stamp":"2023-05-24T03:33:02.554700+0000","last_clean_scrub_stamp":"2023-05-24T03:33:02.554700+0000","objects_scrubbed":1,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T03:55:45.649077+0000","scrub_duration":0.0067877040000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"30'12","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:08.888415+0000","last_change":"2023-05-24T03:32:08.888472+0000","last_active":"2023-05-24T03:32:08.888415+0000","last_peered":"2023-05-24T03:32:08.888415+0000","last_clean":"2023-05-24T03:32:08.888415+0000","last_became_active":"2023-05-24T03:29:44.084914+0000","last_became_peered":"2023-05-24T03:29:44.084914+0000","last_unstale":"2023-05-24T03:32:08.888415+0000","last_undegraded":"2023-05-24T03:32:08.888415+0000","last_fullsized":"2023-05-24T03:32:08.888415+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'12","last_scrub_stamp":"2023-05-24T03:32:08.888326+0000","last_deep_scrub":"30'12","last_deep_scrub_stamp":"2023-05-24T03:32:08.888326+0000","last_clean_scrub_stamp":"2023-05-24T03:32:08.888326+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:48:53.009441+0000","scrub_duration":0.0042668330000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:55.898712+0000","last_change":"2023-05-24T03:32:55.898790+0000","last_active":"2023-05-24T03:32:55.898712+0000","last_peered":"2023-05-24T03:32:55.898712+0000","last_clean":"2023-05-24T03:32:55.898712+0000","last_became_active":"2023-05-24T03:29:44.495795+0000","last_became_peered":"2023-05-24T03:29:44.495795+0000","last_unstale":"2023-05-24T03:32:55.898712+0000","last_undegraded":"2023-05-24T03:32:55.898712+0000","last_fullsized":"2023-05-24T03:32:55.898712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-05-24T03:32:55.898602+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-05-24T03:32:55.898602+0000","last_clean_scrub_stamp":"2023-05-24T03:32:55.898602+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:32:13.008398+0000","scrub_duration":0.0019232170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"30'445","reported_seq":472,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:57.290262+0000","last_change":"2023-05-24T03:32:57.290346+0000","last_active":"2023-05-24T03:32:57.290262+0000","last_peered":"2023-05-24T03:32:57.290262+0000","last_clean":"2023-05-24T03:32:57.290262+0000","last_became_active":"2023-05-24T03:29:48.518531+0000","last_became_peered":"2023-05-24T03:29:48.518531+0000","last_unstale":"2023-05-24T03:32:57.290262+0000","last_undegraded":"2023-05-24T03:32:57.290262+0000","last_fullsized":"2023-05-24T03:32:57.290262+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'445","last_scrub_stamp":"2023-05-24T03:32:57.290146+0000","last_deep_scrub":"30'445","last_deep_scrub_stamp":"2023-05-24T03:32:57.290146+0000","last_clean_scrub_stamp":"2023-05-24T03:32:57.290146+0000","objects_scrubbed":3,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:16:13.284763+0000","scrub_duration":0.015334965000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"30'2","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:09.895065+0000","last_change":"2023-05-24T03:32:09.895117+0000","last_active":"2023-05-24T03:32:09.895065+0000","last_peered":"2023-05-24T03:32:09.895065+0000","last_clean":"2023-05-24T03:32:09.895065+0000","last_became_active":"2023-05-24T03:29:44.089340+0000","last_became_peered":"2023-05-24T03:29:44.089340+0000","last_unstale":"2023-05-24T03:32:09.895065+0000","last_undegraded":"2023-05-24T03:32:09.895065+0000","last_fullsized":"2023-05-24T03:32:09.895065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2023-05-24T03:32:09.894975+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2023-05-24T03:32:09.894975+0000","last_clean_scrub_stamp":"2023-05-24T03:32:09.894975+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:10:59.516332+0000","scrub_duration":0.0029320729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"30'29","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:39.378526+0000","last_change":"2023-05-24T03:32:39.378610+0000","last_active":"2023-05-24T03:32:39.378526+0000","last_peered":"2023-05-24T03:32:39.378526+0000","last_clean":"2023-05-24T03:32:39.378526+0000","last_became_active":"2023-05-24T03:29:44.497795+0000","last_became_peered":"2023-05-24T03:29:44.497795+0000","last_unstale":"2023-05-24T03:32:39.378526+0000","last_undegraded":"2023-05-24T03:32:39.378526+0000","last_fullsized":"2023-05-24T03:32:39.378526+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'29","last_scrub_stamp":"2023-05-24T03:32:39.378407+0000","last_deep_scrub":"30'29","last_deep_scrub_stamp":"2023-05-24T03:32:39.378407+0000","last_clean_scrub_stamp":"2023-05-24T03:32:39.378407+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:46:23.503808+0000","scrub_duration":0.0016008050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"30'418","reported_seq":445,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:34.884323+0000","last_change":"2023-05-24T03:32:34.884417+0000","last_active":"2023-05-24T03:32:34.884323+0000","last_peered":"2023-05-24T03:32:34.884323+0000","last_clean":"2023-05-24T03:32:34.884323+0000","last_became_active":"2023-05-24T03:29:48.520899+0000","last_became_peered":"2023-05-24T03:29:48.520899+0000","last_unstale":"2023-05-24T03:32:34.884323+0000","last_undegraded":"2023-05-24T03:32:34.884323+0000","last_fullsized":"2023-05-24T03:32:34.884323+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'418","last_scrub_stamp":"2023-05-24T03:32:34.884196+0000","last_deep_scrub":"30'418","last_deep_scrub_stamp":"2023-05-24T03:32:34.884196+0000","last_clean_scrub_stamp":"2023-05-24T03:32:34.884196+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:27:57.934099+0000","scrub_duration":0.0021898960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"30'3","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:22.959017+0000","last_change":"2023-05-24T03:32:22.959064+0000","last_active":"2023-05-24T03:32:22.959017+0000","last_peered":"2023-05-24T03:32:22.959017+0000","last_clean":"2023-05-24T03:32:22.959017+0000","last_became_active":"2023-05-24T03:29:44.086054+0000","last_became_peered":"2023-05-24T03:29:44.086054+0000","last_unstale":"2023-05-24T03:32:22.959017+0000","last_undegraded":"2023-05-24T03:32:22.959017+0000","last_fullsized":"2023-05-24T03:32:22.959017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2023-05-24T03:32:22.958938+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2023-05-24T03:32:22.958938+0000","last_clean_scrub_stamp":"2023-05-24T03:32:22.958938+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:33:49.647593+0000","scrub_duration":0.0025152360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"30'32","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:00.739820+0000","last_change":"2023-05-24T03:30:25.949869+0000","last_active":"2023-05-24T03:32:00.739820+0000","last_peered":"2023-05-24T03:32:00.739820+0000","last_clean":"2023-05-24T03:32:00.739820+0000","last_became_active":"2023-05-24T03:30:25.949461+0000","last_became_peered":"2023-05-24T03:30:25.949461+0000","last_unstale":"2023-05-24T03:32:00.739820+0000","last_undegraded":"2023-05-24T03:32:00.739820+0000","last_fullsized":"2023-05-24T03:32:00.739820+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:44.060323+0000","last_clean_scrub_stamp":"2023-05-24T03:29:44.060323+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"30'464","reported_seq":491,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:31.887083+0000","last_change":"2023-05-24T03:32:31.887177+0000","last_active":"2023-05-24T03:32:31.887083+0000","last_peered":"2023-05-24T03:32:31.887083+0000","last_clean":"2023-05-24T03:32:31.887083+0000","last_became_active":"2023-05-24T03:29:48.521729+0000","last_became_peered":"2023-05-24T03:29:48.521729+0000","last_unstale":"2023-05-24T03:32:31.887083+0000","last_undegraded":"2023-05-24T03:32:31.887083+0000","last_fullsized":"2023-05-24T03:32:31.887083+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'464","last_scrub_stamp":"2023-05-24T03:32:31.886982+0000","last_deep_scrub":"30'464","last_deep_scrub_stamp":"2023-05-24T03:32:31.886982+0000","last_clean_scrub_stamp":"2023-05-24T03:32:31.886982+0000","objects_scrubbed":2,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:20:01.986028+0000","scrub_duration":0.010190022999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"30'2","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:31.138320+0000","last_change":"2023-05-24T03:32:31.138368+0000","last_active":"2023-05-24T03:32:31.138320+0000","last_peered":"2023-05-24T03:32:31.138320+0000","last_clean":"2023-05-24T03:32:31.138320+0000","last_became_active":"2023-05-24T03:29:44.088459+0000","last_became_peered":"2023-05-24T03:29:44.088459+0000","last_unstale":"2023-05-24T03:32:31.138320+0000","last_undegraded":"2023-05-24T03:32:31.138320+0000","last_fullsized":"2023-05-24T03:32:31.138320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2023-05-24T03:32:31.138230+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2023-05-24T03:32:31.138230+0000","last_clean_scrub_stamp":"2023-05-24T03:32:31.138230+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:30:44.414149+0000","scrub_duration":0.003068529,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:28.882341+0000","last_change":"2023-05-24T03:32:28.882412+0000","last_active":"2023-05-24T03:32:28.882341+0000","last_peered":"2023-05-24T03:32:28.882341+0000","last_clean":"2023-05-24T03:32:28.882341+0000","last_became_active":"2023-05-24T03:29:44.489975+0000","last_became_peered":"2023-05-24T03:29:44.489975+0000","last_unstale":"2023-05-24T03:32:28.882341+0000","last_undegraded":"2023-05-24T03:32:28.882341+0000","last_fullsized":"2023-05-24T03:32:28.882341+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-05-24T03:32:28.882230+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-05-24T03:32:28.882230+0000","last_clean_scrub_stamp":"2023-05-24T03:32:28.882230+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:19:58.981277+0000","scrub_duration":0.001376541,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"30'485","reported_seq":512,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:30.876266+0000","last_change":"2023-05-24T03:32:30.876384+0000","last_active":"2023-05-24T03:32:30.876266+0000","last_peered":"2023-05-24T03:32:30.876266+0000","last_clean":"2023-05-24T03:32:30.876266+0000","last_became_active":"2023-05-24T03:29:48.523545+0000","last_became_peered":"2023-05-24T03:29:48.523545+0000","last_unstale":"2023-05-24T03:32:30.876266+0000","last_undegraded":"2023-05-24T03:32:30.876266+0000","last_fullsized":"2023-05-24T03:32:30.876266+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'485","last_scrub_stamp":"2023-05-24T03:32:30.876160+0000","last_deep_scrub":"30'485","last_deep_scrub_stamp":"2023-05-24T03:32:30.876160+0000","last_clean_scrub_stamp":"2023-05-24T03:32:30.876160+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:59:03.826280+0000","scrub_duration":0.0023153539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"30'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:26.389741+0000","last_change":"2023-05-24T03:32:26.389791+0000","last_active":"2023-05-24T03:32:26.389741+0000","last_peered":"2023-05-24T03:32:26.389741+0000","last_clean":"2023-05-24T03:32:26.389741+0000","last_became_active":"2023-05-24T03:29:44.090887+0000","last_became_peered":"2023-05-24T03:29:44.090887+0000","last_unstale":"2023-05-24T03:32:26.389741+0000","last_undegraded":"2023-05-24T03:32:26.389741+0000","last_fullsized":"2023-05-24T03:32:26.389741+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-05-24T03:32:26.389638+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-05-24T03:32:26.389638+0000","last_clean_scrub_stamp":"2023-05-24T03:32:26.389638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:24:45.305781+0000","scrub_duration":0.0020604579999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:40.371260+0000","last_change":"2023-05-24T03:32:40.371344+0000","last_active":"2023-05-24T03:32:40.371260+0000","last_peered":"2023-05-24T03:32:40.371260+0000","last_clean":"2023-05-24T03:32:40.371260+0000","last_became_active":"2023-05-24T03:29:44.502286+0000","last_became_peered":"2023-05-24T03:29:44.502286+0000","last_unstale":"2023-05-24T03:32:40.371260+0000","last_undegraded":"2023-05-24T03:32:40.371260+0000","last_fullsized":"2023-05-24T03:32:40.371260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-05-24T03:32:40.371157+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-05-24T03:32:40.371157+0000","last_clean_scrub_stamp":"2023-05-24T03:32:40.371157+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:19:00.007869+0000","scrub_duration":0.0014833030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"30'465","reported_seq":492,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:22.800201+0000","last_change":"2023-05-24T03:32:22.800291+0000","last_active":"2023-05-24T03:32:22.800201+0000","last_peered":"2023-05-24T03:32:22.800201+0000","last_clean":"2023-05-24T03:32:22.800201+0000","last_became_active":"2023-05-24T03:29:48.520960+0000","last_became_peered":"2023-05-24T03:29:48.520960+0000","last_unstale":"2023-05-24T03:32:22.800201+0000","last_undegraded":"2023-05-24T03:32:22.800201+0000","last_fullsized":"2023-05-24T03:32:22.800201+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'465","last_scrub_stamp":"2023-05-24T03:32:22.800112+0000","last_deep_scrub":"30'465","last_deep_scrub_stamp":"2023-05-24T03:32:22.800112+0000","last_clean_scrub_stamp":"2023-05-24T03:32:22.800112+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:12:49.176537+0000","scrub_duration":0.002159808,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"30'5","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:27.928743+0000","last_change":"2023-05-24T03:32:27.928811+0000","last_active":"2023-05-24T03:32:27.928743+0000","last_peered":"2023-05-24T03:32:27.928743+0000","last_clean":"2023-05-24T03:32:27.928743+0000","last_became_active":"2023-05-24T03:29:44.087869+0000","last_became_peered":"2023-05-24T03:29:44.087869+0000","last_unstale":"2023-05-24T03:32:27.928743+0000","last_undegraded":"2023-05-24T03:32:27.928743+0000","last_fullsized":"2023-05-24T03:32:27.928743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'5","last_scrub_stamp":"2023-05-24T03:32:27.928612+0000","last_deep_scrub":"30'5","last_deep_scrub_stamp":"2023-05-24T03:32:27.928612+0000","last_clean_scrub_stamp":"2023-05-24T03:32:27.928612+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:29:27.209611+0000","scrub_duration":0.002678092,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"30'27","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:59.343047+0000","last_change":"2023-05-24T03:32:59.343135+0000","last_active":"2023-05-24T03:32:59.343047+0000","last_peered":"2023-05-24T03:32:59.343047+0000","last_clean":"2023-05-24T03:32:59.343047+0000","last_became_active":"2023-05-24T03:29:44.499700+0000","last_became_peered":"2023-05-24T03:29:44.499700+0000","last_unstale":"2023-05-24T03:32:59.343047+0000","last_undegraded":"2023-05-24T03:32:59.343047+0000","last_fullsized":"2023-05-24T03:32:59.343047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'27","last_scrub_stamp":"2023-05-24T03:32:59.342932+0000","last_deep_scrub":"30'27","last_deep_scrub_stamp":"2023-05-24T03:32:59.342932+0000","last_clean_scrub_stamp":"2023-05-24T03:32:59.342932+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:19:54.960700+0000","scrub_duration":0.0020994780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"30'454","reported_seq":481,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:57.068907+0000","last_change":"2023-05-24T03:32:57.068977+0000","last_active":"2023-05-24T03:32:57.068907+0000","last_peered":"2023-05-24T03:32:57.068907+0000","last_clean":"2023-05-24T03:32:57.068907+0000","last_became_active":"2023-05-24T03:29:48.522104+0000","last_became_peered":"2023-05-24T03:29:48.522104+0000","last_unstale":"2023-05-24T03:32:57.068907+0000","last_undegraded":"2023-05-24T03:32:57.068907+0000","last_fullsized":"2023-05-24T03:32:57.068907+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'454","last_scrub_stamp":"2023-05-24T03:32:57.068802+0000","last_deep_scrub":"30'454","last_deep_scrub_stamp":"2023-05-24T03:32:57.068802+0000","last_clean_scrub_stamp":"2023-05-24T03:32:57.068802+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T03:50:28.111321+0000","scrub_duration":0.0022441129999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"30'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:18.901139+0000","last_change":"2023-05-24T03:32:18.901206+0000","last_active":"2023-05-24T03:32:18.901139+0000","last_peered":"2023-05-24T03:32:18.901139+0000","last_clean":"2023-05-24T03:32:18.901139+0000","last_became_active":"2023-05-24T03:29:44.084894+0000","last_became_peered":"2023-05-24T03:29:44.084894+0000","last_unstale":"2023-05-24T03:32:18.901139+0000","last_undegraded":"2023-05-24T03:32:18.901139+0000","last_fullsized":"2023-05-24T03:32:18.901139+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-05-24T03:32:18.900978+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-05-24T03:32:18.900978+0000","last_clean_scrub_stamp":"2023-05-24T03:32:18.900978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:46:00.915679+0000","scrub_duration":0.001606307,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"30'30","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:11.477819+0000","last_change":"2023-05-24T03:32:11.477870+0000","last_active":"2023-05-24T03:32:11.477819+0000","last_peered":"2023-05-24T03:32:11.477819+0000","last_clean":"2023-05-24T03:32:11.477819+0000","last_became_active":"2023-05-24T03:29:44.492462+0000","last_became_peered":"2023-05-24T03:29:44.492462+0000","last_unstale":"2023-05-24T03:32:11.477819+0000","last_undegraded":"2023-05-24T03:32:11.477819+0000","last_fullsized":"2023-05-24T03:32:11.477819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2023-05-24T03:32:11.477715+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2023-05-24T03:32:11.477715+0000","last_clean_scrub_stamp":"2023-05-24T03:32:11.477715+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:30:24.753635+0000","scrub_duration":0.0019852670000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'486","reported_seq":513,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:56.607482+0000","last_change":"2023-05-24T03:32:56.607555+0000","last_active":"2023-05-24T03:32:56.607482+0000","last_peered":"2023-05-24T03:32:56.607482+0000","last_clean":"2023-05-24T03:32:56.607482+0000","last_became_active":"2023-05-24T03:29:48.524023+0000","last_became_peered":"2023-05-24T03:29:48.524023+0000","last_unstale":"2023-05-24T03:32:56.607482+0000","last_undegraded":"2023-05-24T03:32:56.607482+0000","last_fullsized":"2023-05-24T03:32:56.607482+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'486","last_scrub_stamp":"2023-05-24T03:32:56.607382+0000","last_deep_scrub":"30'486","last_deep_scrub_stamp":"2023-05-24T03:32:56.607382+0000","last_clean_scrub_stamp":"2023-05-24T03:32:56.607382+0000","objects_scrubbed":1,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:32:13.717179+0000","scrub_duration":0.0065709569999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:45.324390+0000","last_change":"2023-05-24T03:32:45.324439+0000","last_active":"2023-05-24T03:32:45.324390+0000","last_peered":"2023-05-24T03:32:45.324390+0000","last_clean":"2023-05-24T03:32:45.324390+0000","last_became_active":"2023-05-24T03:29:44.082382+0000","last_became_peered":"2023-05-24T03:29:44.082382+0000","last_unstale":"2023-05-24T03:32:45.324390+0000","last_undegraded":"2023-05-24T03:32:45.324390+0000","last_fullsized":"2023-05-24T03:32:45.324390+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:45.324292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:45.324292+0000","last_clean_scrub_stamp":"2023-05-24T03:32:45.324292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:24:28.461427+0000","scrub_duration":0.001657642,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"30'17","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:57.379468+0000","last_change":"2023-05-24T03:32:57.379518+0000","last_active":"2023-05-24T03:32:57.379468+0000","last_peered":"2023-05-24T03:32:57.379468+0000","last_clean":"2023-05-24T03:32:57.379468+0000","last_became_active":"2023-05-24T03:29:44.501080+0000","last_became_peered":"2023-05-24T03:29:44.501080+0000","last_unstale":"2023-05-24T03:32:57.379468+0000","last_undegraded":"2023-05-24T03:32:57.379468+0000","last_fullsized":"2023-05-24T03:32:57.379468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'17","last_scrub_stamp":"2023-05-24T03:32:57.379374+0000","last_deep_scrub":"30'17","last_deep_scrub_stamp":"2023-05-24T03:32:57.379374+0000","last_clean_scrub_stamp":"2023-05-24T03:32:57.379374+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:01:46.374511+0000","scrub_duration":0.0013134970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"30'494","reported_seq":513,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:06.604511+0000","last_change":"2023-05-24T03:29:48.519383+0000","last_active":"2023-05-24T03:32:06.604511+0000","last_peered":"2023-05-24T03:32:06.604511+0000","last_clean":"2023-05-24T03:32:06.604511+0000","last_became_active":"2023-05-24T03:29:48.519046+0000","last_became_peered":"2023-05-24T03:29:48.519046+0000","last_unstale":"2023-05-24T03:32:06.604511+0000","last_undegraded":"2023-05-24T03:32:06.604511+0000","last_fullsized":"2023-05-24T03:32:06.604511+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:23.923628+0000","last_change":"2023-05-24T03:32:23.923670+0000","last_active":"2023-05-24T03:32:23.923628+0000","last_peered":"2023-05-24T03:32:23.923628+0000","last_clean":"2023-05-24T03:32:23.923628+0000","last_became_active":"2023-05-24T03:29:44.085420+0000","last_became_peered":"2023-05-24T03:29:44.085420+0000","last_unstale":"2023-05-24T03:32:23.923628+0000","last_undegraded":"2023-05-24T03:32:23.923628+0000","last_fullsized":"2023-05-24T03:32:23.923628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:23.923533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:23.923533+0000","last_clean_scrub_stamp":"2023-05-24T03:32:23.923533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:07:31.781443+0000","scrub_duration":0.0013943619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"30'28","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:41.934540+0000","last_change":"2023-05-24T03:32:41.934595+0000","last_active":"2023-05-24T03:32:41.934540+0000","last_peered":"2023-05-24T03:32:41.934540+0000","last_clean":"2023-05-24T03:32:41.934540+0000","last_became_active":"2023-05-24T03:29:44.491089+0000","last_became_peered":"2023-05-24T03:29:44.491089+0000","last_unstale":"2023-05-24T03:32:41.934540+0000","last_undegraded":"2023-05-24T03:32:41.934540+0000","last_fullsized":"2023-05-24T03:32:41.934540+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'28","last_scrub_stamp":"2023-05-24T03:32:41.934431+0000","last_deep_scrub":"30'28","last_deep_scrub_stamp":"2023-05-24T03:32:41.934431+0000","last_clean_scrub_stamp":"2023-05-24T03:32:41.934431+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:30:38.542441+0000","scrub_duration":0.0018100130000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"30'503","reported_seq":530,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:56.571681+0000","last_change":"2023-05-24T03:32:56.571744+0000","last_active":"2023-05-24T03:32:56.571681+0000","last_peered":"2023-05-24T03:32:56.571681+0000","last_clean":"2023-05-24T03:32:56.571681+0000","last_became_active":"2023-05-24T03:29:48.529157+0000","last_became_peered":"2023-05-24T03:29:48.529157+0000","last_unstale":"2023-05-24T03:32:56.571681+0000","last_undegraded":"2023-05-24T03:32:56.571681+0000","last_fullsized":"2023-05-24T03:32:56.571681+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'503","last_scrub_stamp":"2023-05-24T03:32:56.571583+0000","last_deep_scrub":"30'503","last_deep_scrub_stamp":"2023-05-24T03:32:56.571583+0000","last_clean_scrub_stamp":"2023-05-24T03:32:56.571583+0000","objects_scrubbed":0,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T03:50:27.614103+0000","scrub_duration":0.0021946100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:16.946886+0000","last_change":"2023-05-24T03:32:16.946931+0000","last_active":"2023-05-24T03:32:16.946886+0000","last_peered":"2023-05-24T03:32:16.946886+0000","last_clean":"2023-05-24T03:32:16.946886+0000","last_became_active":"2023-05-24T03:29:39.142867+0000","last_became_peered":"2023-05-24T03:29:39.142867+0000","last_unstale":"2023-05-24T03:32:16.946886+0000","last_undegraded":"2023-05-24T03:32:16.946886+0000","last_fullsized":"2023-05-24T03:32:16.946886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:16.946787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:16.946787+0000","last_clean_scrub_stamp":"2023-05-24T03:32:16.946787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:05:40.162544+0000","scrub_duration":0.0014754880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"30'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:24.411219+0000","last_change":"2023-05-24T03:32:24.411266+0000","last_active":"2023-05-24T03:32:24.411219+0000","last_peered":"2023-05-24T03:32:24.411219+0000","last_clean":"2023-05-24T03:32:24.411219+0000","last_became_active":"2023-05-24T03:29:44.087475+0000","last_became_peered":"2023-05-24T03:29:44.087475+0000","last_unstale":"2023-05-24T03:32:24.411219+0000","last_undegraded":"2023-05-24T03:32:24.411219+0000","last_fullsized":"2023-05-24T03:32:24.411219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-05-24T03:32:24.411126+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-05-24T03:32:24.411126+0000","last_clean_scrub_stamp":"2023-05-24T03:32:24.411126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:07:32.269036+0000","scrub_duration":0.0017507200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"30'30","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:30.858330+0000","last_change":"2023-05-24T03:32:30.858385+0000","last_active":"2023-05-24T03:32:30.858330+0000","last_peered":"2023-05-24T03:32:30.858330+0000","last_clean":"2023-05-24T03:32:30.858330+0000","last_became_active":"2023-05-24T03:29:44.497015+0000","last_became_peered":"2023-05-24T03:29:44.497015+0000","last_unstale":"2023-05-24T03:32:30.858330+0000","last_undegraded":"2023-05-24T03:32:30.858330+0000","last_fullsized":"2023-05-24T03:32:30.858330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2023-05-24T03:32:30.858227+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2023-05-24T03:32:30.858227+0000","last_clean_scrub_stamp":"2023-05-24T03:32:30.858227+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:07:38.716137+0000","scrub_duration":0.0018578329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"30'446","reported_seq":473,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:33:01.537248+0000","last_change":"2023-05-24T03:33:01.537349+0000","last_active":"2023-05-24T03:33:01.537248+0000","last_peered":"2023-05-24T03:33:01.537248+0000","last_clean":"2023-05-24T03:33:01.537248+0000","last_became_active":"2023-05-24T03:29:48.527010+0000","last_became_peered":"2023-05-24T03:29:48.527010+0000","last_unstale":"2023-05-24T03:33:01.537248+0000","last_undegraded":"2023-05-24T03:33:01.537248+0000","last_fullsized":"2023-05-24T03:33:01.537248+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'446","last_scrub_stamp":"2023-05-24T03:33:01.537087+0000","last_deep_scrub":"30'446","last_deep_scrub_stamp":"2023-05-24T03:33:01.537087+0000","last_clean_scrub_stamp":"2023-05-24T03:33:01.537087+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:32:18.646883+0000","scrub_duration":0.002541892,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:16.419663+0000","last_change":"2023-05-24T03:32:16.419711+0000","last_active":"2023-05-24T03:32:16.419663+0000","last_peered":"2023-05-24T03:32:16.419663+0000","last_clean":"2023-05-24T03:32:16.419663+0000","last_became_active":"2023-05-24T03:29:39.048141+0000","last_became_peered":"2023-05-24T03:29:39.048141+0000","last_unstale":"2023-05-24T03:32:16.419663+0000","last_undegraded":"2023-05-24T03:32:16.419663+0000","last_fullsized":"2023-05-24T03:32:16.419663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:16.419576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:16.419576+0000","last_clean_scrub_stamp":"2023-05-24T03:32:16.419576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:04:44.737412+0000","scrub_duration":0.0017607219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:38.260499+0000","last_change":"2023-05-24T03:32:38.260565+0000","last_active":"2023-05-24T03:32:38.260499+0000","last_peered":"2023-05-24T03:32:38.260499+0000","last_clean":"2023-05-24T03:32:38.260499+0000","last_became_active":"2023-05-24T03:29:44.084944+0000","last_became_peered":"2023-05-24T03:29:44.084944+0000","last_unstale":"2023-05-24T03:32:38.260499+0000","last_undegraded":"2023-05-24T03:32:38.260499+0000","last_fullsized":"2023-05-24T03:32:38.260499+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:38.260355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:38.260355+0000","last_clean_scrub_stamp":"2023-05-24T03:32:38.260355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:15:54.254973+0000","scrub_duration":0.0018685679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"30'30","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:34.920933+0000","last_change":"2023-05-24T03:32:34.920980+0000","last_active":"2023-05-24T03:32:34.920933+0000","last_peered":"2023-05-24T03:32:34.920933+0000","last_clean":"2023-05-24T03:32:34.920933+0000","last_became_active":"2023-05-24T03:29:44.483134+0000","last_became_peered":"2023-05-24T03:29:44.483134+0000","last_unstale":"2023-05-24T03:32:34.920933+0000","last_undegraded":"2023-05-24T03:32:34.920933+0000","last_fullsized":"2023-05-24T03:32:34.920933+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2023-05-24T03:32:34.920849+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2023-05-24T03:32:34.920849+0000","last_clean_scrub_stamp":"2023-05-24T03:32:34.920849+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:12:03.303951+0000","scrub_duration":0.0012902980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'483","reported_seq":510,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:23.782504+0000","last_change":"2023-05-24T03:32:23.782578+0000","last_active":"2023-05-24T03:32:23.782504+0000","last_peered":"2023-05-24T03:32:23.782504+0000","last_clean":"2023-05-24T03:32:23.782504+0000","last_became_active":"2023-05-24T03:29:48.518546+0000","last_became_peered":"2023-05-24T03:29:48.518546+0000","last_unstale":"2023-05-24T03:32:23.782504+0000","last_undegraded":"2023-05-24T03:32:23.782504+0000","last_fullsized":"2023-05-24T03:32:23.782504+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'483","last_scrub_stamp":"2023-05-24T03:32:23.782396+0000","last_deep_scrub":"30'483","last_deep_scrub_stamp":"2023-05-24T03:32:23.782396+0000","last_clean_scrub_stamp":"2023-05-24T03:32:23.782396+0000","objects_scrubbed":2,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:25:09.865806+0000","scrub_duration":0.0096269460000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:07.643826+0000","last_change":"2023-05-24T03:32:07.643860+0000","last_active":"2023-05-24T03:32:07.643826+0000","last_peered":"2023-05-24T03:32:07.643826+0000","last_clean":"2023-05-24T03:32:07.643826+0000","last_became_active":"2023-05-24T03:29:39.310070+0000","last_became_peered":"2023-05-24T03:29:39.310070+0000","last_unstale":"2023-05-24T03:32:07.643826+0000","last_undegraded":"2023-05-24T03:32:07.643826+0000","last_fullsized":"2023-05-24T03:32:07.643826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:07.643745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:07.643745+0000","last_clean_scrub_stamp":"2023-05-24T03:32:07.643745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:58:52.005449+0000","scrub_duration":0.0012050990000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:19.948337+0000","last_change":"2023-05-24T03:32:19.948384+0000","last_active":"2023-05-24T03:32:19.948337+0000","last_peered":"2023-05-24T03:32:19.948337+0000","last_clean":"2023-05-24T03:32:19.948337+0000","last_became_active":"2023-05-24T03:29:44.074551+0000","last_became_peered":"2023-05-24T03:29:44.074551+0000","last_unstale":"2023-05-24T03:32:19.948337+0000","last_undegraded":"2023-05-24T03:32:19.948337+0000","last_fullsized":"2023-05-24T03:32:19.948337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:19.948200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:19.948200+0000","last_clean_scrub_stamp":"2023-05-24T03:32:19.948200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:36:52.581352+0000","scrub_duration":0.0016279319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"30'29","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:31.862975+0000","last_change":"2023-05-24T03:32:31.863048+0000","last_active":"2023-05-24T03:32:31.862975+0000","last_peered":"2023-05-24T03:32:31.862975+0000","last_clean":"2023-05-24T03:32:31.862975+0000","last_became_active":"2023-05-24T03:29:44.496030+0000","last_became_peered":"2023-05-24T03:29:44.496030+0000","last_unstale":"2023-05-24T03:32:31.862975+0000","last_undegraded":"2023-05-24T03:32:31.862975+0000","last_fullsized":"2023-05-24T03:32:31.862975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'29","last_scrub_stamp":"2023-05-24T03:32:31.862868+0000","last_deep_scrub":"30'29","last_deep_scrub_stamp":"2023-05-24T03:32:31.862868+0000","last_clean_scrub_stamp":"2023-05-24T03:32:31.862868+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:30:45.138787+0000","scrub_duration":0.0022191820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"30'473","reported_seq":500,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:53.298330+0000","last_change":"2023-05-24T03:32:53.298410+0000","last_active":"2023-05-24T03:32:53.298330+0000","last_peered":"2023-05-24T03:32:53.298330+0000","last_clean":"2023-05-24T03:32:53.298330+0000","last_became_active":"2023-05-24T03:29:48.523380+0000","last_became_peered":"2023-05-24T03:29:48.523380+0000","last_unstale":"2023-05-24T03:32:53.298330+0000","last_undegraded":"2023-05-24T03:32:53.298330+0000","last_fullsized":"2023-05-24T03:32:53.298330+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'473","last_scrub_stamp":"2023-05-24T03:32:53.298210+0000","last_deep_scrub":"30'473","last_deep_scrub_stamp":"2023-05-24T03:32:53.298210+0000","last_clean_scrub_stamp":"2023-05-24T03:32:53.298210+0000","objects_scrubbed":1,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:42:10.042215+0000","scrub_duration":0.0061571220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:22.404970+0000","last_change":"2023-05-24T03:32:22.405017+0000","last_active":"2023-05-24T03:32:22.404970+0000","last_peered":"2023-05-24T03:32:22.404970+0000","last_clean":"2023-05-24T03:32:22.404970+0000","last_became_active":"2023-05-24T03:29:39.050751+0000","last_became_peered":"2023-05-24T03:29:39.050751+0000","last_unstale":"2023-05-24T03:32:22.404970+0000","last_undegraded":"2023-05-24T03:32:22.404970+0000","last_fullsized":"2023-05-24T03:32:22.404970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:22.404884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:22.404884+0000","last_clean_scrub_stamp":"2023-05-24T03:32:22.404884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:59:23.041380+0000","scrub_duration":0.001963167,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"30'119","reported_seq":199,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:13.842759+0000","last_change":"2023-05-24T03:32:13.842821+0000","last_active":"2023-05-24T03:32:13.842759+0000","last_peered":"2023-05-24T03:32:13.842759+0000","last_clean":"2023-05-24T03:32:13.842759+0000","last_became_active":"2023-05-24T03:29:34.024728+0000","last_became_peered":"2023-05-24T03:29:34.024728+0000","last_unstale":"2023-05-24T03:32:13.842759+0000","last_undegraded":"2023-05-24T03:32:13.842759+0000","last_fullsized":"2023-05-24T03:32:13.842759+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'119","last_scrub_stamp":"2023-05-24T03:32:13.842676+0000","last_deep_scrub":"30'119","last_deep_scrub_stamp":"2023-05-24T03:32:13.842676+0000","last_clean_scrub_stamp":"2023-05-24T03:32:13.842676+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:42:28.083910+0000","scrub_duration":0.0058238170000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:22.880053+0000","last_change":"2023-05-24T03:32:22.880113+0000","last_active":"2023-05-24T03:32:22.880053+0000","last_peered":"2023-05-24T03:32:22.880053+0000","last_clean":"2023-05-24T03:32:22.880053+0000","last_became_active":"2023-05-24T03:29:44.086125+0000","last_became_peered":"2023-05-24T03:29:44.086125+0000","last_unstale":"2023-05-24T03:32:22.880053+0000","last_undegraded":"2023-05-24T03:32:22.880053+0000","last_fullsized":"2023-05-24T03:32:22.880053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:22.879929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:22.879929+0000","last_clean_scrub_stamp":"2023-05-24T03:32:22.879929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:00:18.800309+0000","scrub_duration":0.002203432,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:20.988892+0000","last_change":"2023-05-24T03:32:20.988943+0000","last_active":"2023-05-24T03:32:20.988892+0000","last_peered":"2023-05-24T03:32:20.988892+0000","last_clean":"2023-05-24T03:32:20.988892+0000","last_became_active":"2023-05-24T03:29:44.492375+0000","last_became_peered":"2023-05-24T03:29:44.492375+0000","last_unstale":"2023-05-24T03:32:20.988892+0000","last_undegraded":"2023-05-24T03:32:20.988892+0000","last_fullsized":"2023-05-24T03:32:20.988892+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-05-24T03:32:20.988784+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-05-24T03:32:20.988784+0000","last_clean_scrub_stamp":"2023-05-24T03:32:20.988784+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:25:07.072195+0000","scrub_duration":0.001550034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"30'444","reported_seq":471,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:59.649307+0000","last_change":"2023-05-24T03:32:59.649372+0000","last_active":"2023-05-24T03:32:59.649307+0000","last_peered":"2023-05-24T03:32:59.649307+0000","last_clean":"2023-05-24T03:32:59.649307+0000","last_became_active":"2023-05-24T03:29:48.524615+0000","last_became_peered":"2023-05-24T03:29:48.524615+0000","last_unstale":"2023-05-24T03:32:59.649307+0000","last_undegraded":"2023-05-24T03:32:59.649307+0000","last_fullsized":"2023-05-24T03:32:59.649307+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'444","last_scrub_stamp":"2023-05-24T03:32:59.649200+0000","last_deep_scrub":"30'444","last_deep_scrub_stamp":"2023-05-24T03:32:59.649200+0000","last_clean_scrub_stamp":"2023-05-24T03:32:59.649200+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:24:42.786335+0000","scrub_duration":0.002191438,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:14.823133+0000","last_change":"2023-05-24T03:32:14.823177+0000","last_active":"2023-05-24T03:32:14.823133+0000","last_peered":"2023-05-24T03:32:14.823133+0000","last_clean":"2023-05-24T03:32:14.823133+0000","last_became_active":"2023-05-24T03:29:39.053813+0000","last_became_peered":"2023-05-24T03:29:39.053813+0000","last_unstale":"2023-05-24T03:32:14.823133+0000","last_undegraded":"2023-05-24T03:32:14.823133+0000","last_fullsized":"2023-05-24T03:32:14.823133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:14.823047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:14.823047+0000","last_clean_scrub_stamp":"2023-05-24T03:32:14.823047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:39:26.760598+0000","scrub_duration":0.0020759749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"30'16","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:28.422974+0000","last_change":"2023-05-24T03:32:28.423022+0000","last_active":"2023-05-24T03:32:28.422974+0000","last_peered":"2023-05-24T03:32:28.422974+0000","last_clean":"2023-05-24T03:32:28.422974+0000","last_became_active":"2023-05-24T03:29:44.089943+0000","last_became_peered":"2023-05-24T03:29:44.089943+0000","last_unstale":"2023-05-24T03:32:28.422974+0000","last_undegraded":"2023-05-24T03:32:28.422974+0000","last_fullsized":"2023-05-24T03:32:28.422974+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'16","last_scrub_stamp":"2023-05-24T03:32:28.422880+0000","last_deep_scrub":"30'16","last_deep_scrub_stamp":"2023-05-24T03:32:28.422880+0000","last_clean_scrub_stamp":"2023-05-24T03:32:28.422880+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:00:24.343260+0000","scrub_duration":0.0023423319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7752,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":19,"num_write":15,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"30'28","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:31.390565+0000","last_change":"2023-05-24T03:32:31.390638+0000","last_active":"2023-05-24T03:32:31.390565+0000","last_peered":"2023-05-24T03:32:31.390565+0000","last_clean":"2023-05-24T03:32:31.390565+0000","last_became_active":"2023-05-24T03:29:44.498130+0000","last_became_peered":"2023-05-24T03:29:44.498130+0000","last_unstale":"2023-05-24T03:32:31.390565+0000","last_undegraded":"2023-05-24T03:32:31.390565+0000","last_fullsized":"2023-05-24T03:32:31.390565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'28","last_scrub_stamp":"2023-05-24T03:32:31.390463+0000","last_deep_scrub":"30'28","last_deep_scrub_stamp":"2023-05-24T03:32:31.390463+0000","last_clean_scrub_stamp":"2023-05-24T03:32:31.390463+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:24:50.306607+0000","scrub_duration":0.001403886,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"30'496","reported_seq":523,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:42.905980+0000","last_change":"2023-05-24T03:32:42.906088+0000","last_active":"2023-05-24T03:32:42.905980+0000","last_peered":"2023-05-24T03:32:42.905980+0000","last_clean":"2023-05-24T03:32:42.905980+0000","last_became_active":"2023-05-24T03:29:48.519673+0000","last_became_peered":"2023-05-24T03:29:48.519673+0000","last_unstale":"2023-05-24T03:32:42.905980+0000","last_undegraded":"2023-05-24T03:32:42.905980+0000","last_fullsized":"2023-05-24T03:32:42.905980+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'496","last_scrub_stamp":"2023-05-24T03:32:42.905857+0000","last_deep_scrub":"30'496","last_deep_scrub_stamp":"2023-05-24T03:32:42.905857+0000","last_clean_scrub_stamp":"2023-05-24T03:32:42.905857+0000","objects_scrubbed":2,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:06:06.121614+0000","scrub_duration":0.0097576420000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:16.859220+0000","last_change":"2023-05-24T03:32:16.859267+0000","last_active":"2023-05-24T03:32:16.859220+0000","last_peered":"2023-05-24T03:32:16.859220+0000","last_clean":"2023-05-24T03:32:16.859220+0000","last_became_active":"2023-05-24T03:29:39.142949+0000","last_became_peered":"2023-05-24T03:29:39.142949+0000","last_unstale":"2023-05-24T03:32:16.859220+0000","last_undegraded":"2023-05-24T03:32:16.859220+0000","last_fullsized":"2023-05-24T03:32:16.859220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:16.859110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:16.859110+0000","last_clean_scrub_stamp":"2023-05-24T03:32:16.859110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:36:49.492263+0000","scrub_duration":0.0019863950000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"30'2","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:25.922071+0000","last_change":"2023-05-24T03:32:25.922120+0000","last_active":"2023-05-24T03:32:25.922071+0000","last_peered":"2023-05-24T03:32:25.922071+0000","last_clean":"2023-05-24T03:32:25.922071+0000","last_became_active":"2023-05-24T03:29:44.074374+0000","last_became_peered":"2023-05-24T03:29:44.074374+0000","last_unstale":"2023-05-24T03:32:25.922071+0000","last_undegraded":"2023-05-24T03:32:25.922071+0000","last_fullsized":"2023-05-24T03:32:25.922071+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2023-05-24T03:32:25.921971+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2023-05-24T03:32:25.921971+0000","last_clean_scrub_stamp":"2023-05-24T03:32:25.921971+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:33:52.610626+0000","scrub_duration":0.001416947,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"30'34","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:33.381296+0000","last_change":"2023-05-24T03:32:33.381351+0000","last_active":"2023-05-24T03:32:33.381296+0000","last_peered":"2023-05-24T03:32:33.381296+0000","last_clean":"2023-05-24T03:32:33.381296+0000","last_became_active":"2023-05-24T03:29:44.499768+0000","last_became_peered":"2023-05-24T03:29:44.499768+0000","last_unstale":"2023-05-24T03:32:33.381296+0000","last_undegraded":"2023-05-24T03:32:33.381296+0000","last_fullsized":"2023-05-24T03:32:33.381296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'34","last_scrub_stamp":"2023-05-24T03:32:33.381196+0000","last_deep_scrub":"30'34","last_deep_scrub_stamp":"2023-05-24T03:32:33.381196+0000","last_clean_scrub_stamp":"2023-05-24T03:32:33.381196+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:29:32.662195+0000","scrub_duration":0.00213657,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"30'483","reported_seq":510,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:33:06.244057+0000","last_change":"2023-05-24T03:33:06.244122+0000","last_active":"2023-05-24T03:33:06.244057+0000","last_peered":"2023-05-24T03:33:06.244057+0000","last_clean":"2023-05-24T03:33:06.244057+0000","last_became_active":"2023-05-24T03:29:48.530401+0000","last_became_peered":"2023-05-24T03:29:48.530401+0000","last_unstale":"2023-05-24T03:33:06.244057+0000","last_undegraded":"2023-05-24T03:33:06.244057+0000","last_fullsized":"2023-05-24T03:33:06.244057+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'483","last_scrub_stamp":"2023-05-24T03:33:06.243957+0000","last_deep_scrub":"30'483","last_deep_scrub_stamp":"2023-05-24T03:33:06.243957+0000","last_clean_scrub_stamp":"2023-05-24T03:33:06.243957+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:27:00.104082+0000","scrub_duration":0.0026812899999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"30'4","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:25.935295+0000","last_change":"2023-05-24T03:32:25.935385+0000","last_active":"2023-05-24T03:32:25.935295+0000","last_peered":"2023-05-24T03:32:25.935295+0000","last_clean":"2023-05-24T03:32:25.935295+0000","last_became_active":"2023-05-24T03:29:44.083929+0000","last_became_peered":"2023-05-24T03:29:44.083929+0000","last_unstale":"2023-05-24T03:32:25.935295+0000","last_undegraded":"2023-05-24T03:32:25.935295+0000","last_fullsized":"2023-05-24T03:32:25.935295+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2023-05-24T03:32:25.935195+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2023-05-24T03:32:25.935195+0000","last_clean_scrub_stamp":"2023-05-24T03:32:25.935195+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:24:44.851338+0000","scrub_duration":0.0036091059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:17.913709+0000","last_change":"2023-05-24T03:32:17.913792+0000","last_active":"2023-05-24T03:32:17.913709+0000","last_peered":"2023-05-24T03:32:17.913709+0000","last_clean":"2023-05-24T03:32:17.913709+0000","last_became_active":"2023-05-24T03:29:39.045543+0000","last_became_peered":"2023-05-24T03:29:39.045543+0000","last_unstale":"2023-05-24T03:32:17.913709+0000","last_undegraded":"2023-05-24T03:32:17.913709+0000","last_fullsized":"2023-05-24T03:32:17.913709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:17.913581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:17.913581+0000","last_clean_scrub_stamp":"2023-05-24T03:32:17.913581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:39:29.851131+0000","scrub_duration":0.0019810409999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"30'25","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:47.882602+0000","last_change":"2023-05-24T03:32:47.882652+0000","last_active":"2023-05-24T03:32:47.882602+0000","last_peered":"2023-05-24T03:32:47.882602+0000","last_clean":"2023-05-24T03:32:47.882602+0000","last_became_active":"2023-05-24T03:29:44.495816+0000","last_became_peered":"2023-05-24T03:29:44.495816+0000","last_unstale":"2023-05-24T03:32:47.882602+0000","last_undegraded":"2023-05-24T03:32:47.882602+0000","last_fullsized":"2023-05-24T03:32:47.882602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'25","last_scrub_stamp":"2023-05-24T03:32:47.882509+0000","last_deep_scrub":"30'25","last_deep_scrub_stamp":"2023-05-24T03:32:47.882509+0000","last_clean_scrub_stamp":"2023-05-24T03:32:47.882509+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:42:04.626514+0000","scrub_duration":0.002051588,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"30'447","reported_seq":474,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:58.922521+0000","last_change":"2023-05-24T03:32:58.922602+0000","last_active":"2023-05-24T03:32:58.922521+0000","last_peered":"2023-05-24T03:32:58.922521+0000","last_clean":"2023-05-24T03:32:58.922521+0000","last_became_active":"2023-05-24T03:29:48.527196+0000","last_became_peered":"2023-05-24T03:29:48.527196+0000","last_unstale":"2023-05-24T03:32:58.922521+0000","last_undegraded":"2023-05-24T03:32:58.922521+0000","last_fullsized":"2023-05-24T03:32:58.922521+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'447","last_scrub_stamp":"2023-05-24T03:32:58.922404+0000","last_deep_scrub":"30'447","last_deep_scrub_stamp":"2023-05-24T03:32:58.922404+0000","last_clean_scrub_stamp":"2023-05-24T03:32:58.922404+0000","objects_scrubbed":2,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:24:42.059539+0000","scrub_duration":0.010453692000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:07.895608+0000","last_change":"2023-05-24T03:32:07.895654+0000","last_active":"2023-05-24T03:32:07.895608+0000","last_peered":"2023-05-24T03:32:07.895608+0000","last_clean":"2023-05-24T03:32:07.895608+0000","last_became_active":"2023-05-24T03:29:39.046149+0000","last_became_peered":"2023-05-24T03:29:39.046149+0000","last_unstale":"2023-05-24T03:32:07.895608+0000","last_undegraded":"2023-05-24T03:32:07.895608+0000","last_fullsized":"2023-05-24T03:32:07.895608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:07.895507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:07.895507+0000","last_clean_scrub_stamp":"2023-05-24T03:32:07.895507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:19:25.177961+0000","scrub_duration":0.0013301140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"30'12","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:22.444476+0000","last_change":"2023-05-24T03:32:22.444544+0000","last_active":"2023-05-24T03:32:22.444476+0000","last_peered":"2023-05-24T03:32:22.444476+0000","last_clean":"2023-05-24T03:32:22.444476+0000","last_became_active":"2023-05-24T03:29:44.088495+0000","last_became_peered":"2023-05-24T03:29:44.088495+0000","last_unstale":"2023-05-24T03:32:22.444476+0000","last_undegraded":"2023-05-24T03:32:22.444476+0000","last_fullsized":"2023-05-24T03:32:22.444476+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'12","last_scrub_stamp":"2023-05-24T03:32:22.444366+0000","last_deep_scrub":"30'12","last_deep_scrub_stamp":"2023-05-24T03:32:22.444366+0000","last_clean_scrub_stamp":"2023-05-24T03:32:22.444366+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:33:49.133021+0000","scrub_duration":0.0019648030000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"30'21","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:33.402605+0000","last_change":"2023-05-24T03:32:33.402683+0000","last_active":"2023-05-24T03:32:33.402605+0000","last_peered":"2023-05-24T03:32:33.402605+0000","last_clean":"2023-05-24T03:32:33.402605+0000","last_became_active":"2023-05-24T03:29:44.496597+0000","last_became_peered":"2023-05-24T03:29:44.496597+0000","last_unstale":"2023-05-24T03:32:33.402605+0000","last_undegraded":"2023-05-24T03:32:33.402605+0000","last_fullsized":"2023-05-24T03:32:33.402605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'21","last_scrub_stamp":"2023-05-24T03:32:33.402506+0000","last_deep_scrub":"30'21","last_deep_scrub_stamp":"2023-05-24T03:32:33.402506+0000","last_clean_scrub_stamp":"2023-05-24T03:32:33.402506+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:41:50.146511+0000","scrub_duration":0.001534435,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"30'469","reported_seq":496,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:58.068864+0000","last_change":"2023-05-24T03:32:58.068954+0000","last_active":"2023-05-24T03:32:58.068864+0000","last_peered":"2023-05-24T03:32:58.068864+0000","last_clean":"2023-05-24T03:32:58.068864+0000","last_became_active":"2023-05-24T03:29:48.524170+0000","last_became_peered":"2023-05-24T03:29:48.524170+0000","last_unstale":"2023-05-24T03:32:58.068864+0000","last_undegraded":"2023-05-24T03:32:58.068864+0000","last_fullsized":"2023-05-24T03:32:58.068864+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'469","last_scrub_stamp":"2023-05-24T03:32:58.068759+0000","last_deep_scrub":"30'469","last_deep_scrub_stamp":"2023-05-24T03:32:58.068759+0000","last_clean_scrub_stamp":"2023-05-24T03:32:58.068759+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:36:48.747989+0000","scrub_duration":0.0019696819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:27.411055+0000","last_change":"2023-05-24T03:32:27.411131+0000","last_active":"2023-05-24T03:32:27.411055+0000","last_peered":"2023-05-24T03:32:27.411055+0000","last_clean":"2023-05-24T03:32:27.411055+0000","last_became_active":"2023-05-24T03:29:44.089993+0000","last_became_peered":"2023-05-24T03:29:44.089993+0000","last_unstale":"2023-05-24T03:32:27.411055+0000","last_undegraded":"2023-05-24T03:32:27.411055+0000","last_fullsized":"2023-05-24T03:32:27.411055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-05-24T03:32:27.410947+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-05-24T03:32:27.410947+0000","last_clean_scrub_stamp":"2023-05-24T03:32:27.410947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:59:28.047443+0000","scrub_duration":0.001931365,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:11.669985+0000","last_change":"2023-05-24T03:32:11.669985+0000","last_active":"2023-05-24T03:32:11.669985+0000","last_peered":"2023-05-24T03:32:11.669985+0000","last_clean":"2023-05-24T03:32:11.669985+0000","last_became_active":"2023-05-24T03:29:44.481655+0000","last_became_peered":"2023-05-24T03:29:44.481655+0000","last_unstale":"2023-05-24T03:32:11.669985+0000","last_undegraded":"2023-05-24T03:32:11.669985+0000","last_fullsized":"2023-05-24T03:32:11.669985+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-05-24T03:32:11.669801+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-05-24T03:32:11.669801+0000","last_clean_scrub_stamp":"2023-05-24T03:32:11.669801+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:19:28.952256+0000","scrub_duration":0.0015085610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"30'475","reported_seq":502,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:56.271520+0000","last_change":"2023-05-24T03:32:56.271624+0000","last_active":"2023-05-24T03:32:56.271520+0000","last_peered":"2023-05-24T03:32:56.271520+0000","last_clean":"2023-05-24T03:32:56.271520+0000","last_became_active":"2023-05-24T03:29:48.516366+0000","last_became_peered":"2023-05-24T03:29:48.516366+0000","last_unstale":"2023-05-24T03:32:56.271520+0000","last_undegraded":"2023-05-24T03:32:56.271520+0000","last_fullsized":"2023-05-24T03:32:56.271520+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'475","last_scrub_stamp":"2023-05-24T03:32:56.271385+0000","last_deep_scrub":"30'475","last_deep_scrub_stamp":"2023-05-24T03:32:56.271385+0000","last_clean_scrub_stamp":"2023-05-24T03:32:56.271385+0000","objects_scrubbed":1,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T03:50:27.313904+0000","scrub_duration":0.0075476670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"30'3","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:36.384834+0000","last_change":"2023-05-24T03:32:36.384884+0000","last_active":"2023-05-24T03:32:36.384834+0000","last_peered":"2023-05-24T03:32:36.384834+0000","last_clean":"2023-05-24T03:32:36.384834+0000","last_became_active":"2023-05-24T03:29:44.093909+0000","last_became_peered":"2023-05-24T03:29:44.093909+0000","last_unstale":"2023-05-24T03:32:36.384834+0000","last_undegraded":"2023-05-24T03:32:36.384834+0000","last_fullsized":"2023-05-24T03:32:36.384834+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2023-05-24T03:32:36.384751+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2023-05-24T03:32:36.384751+0000","last_clean_scrub_stamp":"2023-05-24T03:32:36.384751+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:18:56.021462+0000","scrub_duration":0.0025716570000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"30'24","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:07.504564+0000","last_change":"2023-05-24T03:32:07.504564+0000","last_active":"2023-05-24T03:32:07.504564+0000","last_peered":"2023-05-24T03:32:07.504564+0000","last_clean":"2023-05-24T03:32:07.504564+0000","last_became_active":"2023-05-24T03:29:44.496679+0000","last_became_peered":"2023-05-24T03:29:44.496679+0000","last_unstale":"2023-05-24T03:32:07.504564+0000","last_undegraded":"2023-05-24T03:32:07.504564+0000","last_fullsized":"2023-05-24T03:32:07.504564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2023-05-24T03:32:07.504421+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2023-05-24T03:32:07.504421+0000","last_clean_scrub_stamp":"2023-05-24T03:32:07.504421+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:39:43.529482+0000","scrub_duration":0.001971338,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"30'459","reported_seq":486,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:52.481655+0000","last_change":"2023-05-24T03:32:52.481725+0000","last_active":"2023-05-24T03:32:52.481655+0000","last_peered":"2023-05-24T03:32:52.481655+0000","last_clean":"2023-05-24T03:32:52.481655+0000","last_became_active":"2023-05-24T03:29:48.528862+0000","last_became_peered":"2023-05-24T03:29:48.528862+0000","last_unstale":"2023-05-24T03:32:52.481655+0000","last_undegraded":"2023-05-24T03:32:52.481655+0000","last_fullsized":"2023-05-24T03:32:52.481655+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'459","last_scrub_stamp":"2023-05-24T03:32:52.481549+0000","last_deep_scrub":"30'459","last_deep_scrub_stamp":"2023-05-24T03:32:52.481549+0000","last_clean_scrub_stamp":"2023-05-24T03:32:52.481549+0000","objects_scrubbed":1,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:16:08.476167+0000","scrub_duration":0.0069357050000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"30'4","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:23.397701+0000","last_change":"2023-05-24T03:32:23.397749+0000","last_active":"2023-05-24T03:32:23.397701+0000","last_peered":"2023-05-24T03:32:23.397701+0000","last_clean":"2023-05-24T03:32:23.397701+0000","last_became_active":"2023-05-24T03:29:44.089949+0000","last_became_peered":"2023-05-24T03:29:44.089949+0000","last_unstale":"2023-05-24T03:32:23.397701+0000","last_undegraded":"2023-05-24T03:32:23.397701+0000","last_fullsized":"2023-05-24T03:32:23.397701+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2023-05-24T03:32:23.397608+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2023-05-24T03:32:23.397608+0000","last_clean_scrub_stamp":"2023-05-24T03:32:23.397608+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:00:19.317988+0000","scrub_duration":0.002711855,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'23","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:33:04.259375+0000","last_change":"2023-05-24T03:33:04.259429+0000","last_active":"2023-05-24T03:33:04.259375+0000","last_peered":"2023-05-24T03:33:04.259375+0000","last_clean":"2023-05-24T03:33:04.259375+0000","last_became_active":"2023-05-24T03:29:44.498350+0000","last_became_peered":"2023-05-24T03:29:44.498350+0000","last_unstale":"2023-05-24T03:33:04.259375+0000","last_undegraded":"2023-05-24T03:33:04.259375+0000","last_fullsized":"2023-05-24T03:33:04.259375+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'23","last_scrub_stamp":"2023-05-24T03:33:04.259273+0000","last_deep_scrub":"30'23","last_deep_scrub_stamp":"2023-05-24T03:33:04.259273+0000","last_clean_scrub_stamp":"2023-05-24T03:33:04.259273+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:53:26.285046+0000","scrub_duration":0.002170314,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"30'482","reported_seq":501,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:06.604582+0000","last_change":"2023-05-24T03:29:48.523434+0000","last_active":"2023-05-24T03:32:06.604582+0000","last_peered":"2023-05-24T03:32:06.604582+0000","last_clean":"2023-05-24T03:32:06.604582+0000","last_became_active":"2023-05-24T03:29:48.522228+0000","last_became_peered":"2023-05-24T03:29:48.522228+0000","last_unstale":"2023-05-24T03:32:06.604582+0000","last_undegraded":"2023-05-24T03:32:06.604582+0000","last_fullsized":"2023-05-24T03:32:06.604582+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:29:47.482603+0000","last_clean_scrub_stamp":"2023-05-24T03:29:47.482603+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:34.938357+0000","last_change":"2023-05-24T03:32:34.938407+0000","last_active":"2023-05-24T03:32:34.938357+0000","last_peered":"2023-05-24T03:32:34.938357+0000","last_clean":"2023-05-24T03:32:34.938357+0000","last_became_active":"2023-05-24T03:29:44.082903+0000","last_became_peered":"2023-05-24T03:29:44.082903+0000","last_unstale":"2023-05-24T03:32:34.938357+0000","last_undegraded":"2023-05-24T03:32:34.938357+0000","last_fullsized":"2023-05-24T03:32:34.938357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-05-24T03:32:34.938251+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-05-24T03:32:34.938251+0000","last_clean_scrub_stamp":"2023-05-24T03:32:34.938251+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:18:54.574963+0000","scrub_duration":0.0018086580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:16.902284+0000","last_change":"2023-05-24T03:32:16.902340+0000","last_active":"2023-05-24T03:32:16.902284+0000","last_peered":"2023-05-24T03:32:16.902284+0000","last_clean":"2023-05-24T03:32:16.902284+0000","last_became_active":"2023-05-24T03:29:44.487925+0000","last_became_peered":"2023-05-24T03:29:44.487925+0000","last_unstale":"2023-05-24T03:32:16.902284+0000","last_undegraded":"2023-05-24T03:32:16.902284+0000","last_fullsized":"2023-05-24T03:32:16.902284+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-05-24T03:32:16.902188+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-05-24T03:32:16.902188+0000","last_clean_scrub_stamp":"2023-05-24T03:32:16.902188+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:04:45.220024+0000","scrub_duration":0.0014004639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"30'490","reported_seq":517,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:48.035103+0000","last_change":"2023-05-24T03:32:48.035172+0000","last_active":"2023-05-24T03:32:48.035103+0000","last_peered":"2023-05-24T03:32:48.035103+0000","last_clean":"2023-05-24T03:32:48.035103+0000","last_became_active":"2023-05-24T03:29:48.519517+0000","last_became_peered":"2023-05-24T03:29:48.519517+0000","last_unstale":"2023-05-24T03:32:48.035103+0000","last_undegraded":"2023-05-24T03:32:48.035103+0000","last_fullsized":"2023-05-24T03:32:48.035103+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'490","last_scrub_stamp":"2023-05-24T03:32:48.034993+0000","last_deep_scrub":"30'490","last_deep_scrub_stamp":"2023-05-24T03:32:48.034993+0000","last_clean_scrub_stamp":"2023-05-24T03:32:48.034993+0000","objects_scrubbed":2,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:58:07.686612+0000","scrub_duration":0.0095380369999999992,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"30'7","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:14.413355+0000","last_change":"2023-05-24T03:32:14.413441+0000","last_active":"2023-05-24T03:32:14.413355+0000","last_peered":"2023-05-24T03:32:14.413355+0000","last_clean":"2023-05-24T03:32:14.413355+0000","last_became_active":"2023-05-24T03:29:44.087891+0000","last_became_peered":"2023-05-24T03:29:44.087891+0000","last_unstale":"2023-05-24T03:32:14.413355+0000","last_undegraded":"2023-05-24T03:32:14.413355+0000","last_fullsized":"2023-05-24T03:32:14.413355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'7","last_scrub_stamp":"2023-05-24T03:32:14.413253+0000","last_deep_scrub":"30'7","last_deep_scrub_stamp":"2023-05-24T03:32:14.413253+0000","last_clean_scrub_stamp":"2023-05-24T03:32:14.413253+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:39:26.350804+0000","scrub_duration":0.0039696540000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"30'42","reported_seq":75,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:49.303943+0000","last_change":"2023-05-24T03:32:49.304023+0000","last_active":"2023-05-24T03:32:49.303943+0000","last_peered":"2023-05-24T03:32:49.303943+0000","last_clean":"2023-05-24T03:32:49.303943+0000","last_became_active":"2023-05-24T03:29:44.492923+0000","last_became_peered":"2023-05-24T03:29:44.492923+0000","last_unstale":"2023-05-24T03:32:49.303943+0000","last_undegraded":"2023-05-24T03:32:49.303943+0000","last_fullsized":"2023-05-24T03:32:49.303943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'42","last_scrub_stamp":"2023-05-24T03:32:49.303828+0000","last_deep_scrub":"30'42","last_deep_scrub_stamp":"2023-05-24T03:32:49.303828+0000","last_clean_scrub_stamp":"2023-05-24T03:32:49.303828+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:04:49.142230+0000","scrub_duration":0.0017584,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"30'50","reported_seq":83,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:33.769592+0000","last_change":"2023-05-24T03:32:33.769638+0000","last_active":"2023-05-24T03:32:33.769592+0000","last_peered":"2023-05-24T03:32:33.769592+0000","last_clean":"2023-05-24T03:32:33.769592+0000","last_became_active":"2023-05-24T03:29:44.483898+0000","last_became_peered":"2023-05-24T03:29:44.483898+0000","last_unstale":"2023-05-24T03:32:33.769592+0000","last_undegraded":"2023-05-24T03:32:33.769592+0000","last_fullsized":"2023-05-24T03:32:33.769592+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'50","last_scrub_stamp":"2023-05-24T03:32:33.769507+0000","last_deep_scrub":"30'50","last_deep_scrub_stamp":"2023-05-24T03:32:33.769507+0000","last_clean_scrub_stamp":"2023-05-24T03:32:33.769507+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:17:31.325426+0000","scrub_duration":0.0019421810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"30'46","reported_seq":79,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:51.879016+0000","last_change":"2023-05-24T03:32:51.879082+0000","last_active":"2023-05-24T03:32:51.879016+0000","last_peered":"2023-05-24T03:32:51.879016+0000","last_clean":"2023-05-24T03:32:51.879016+0000","last_became_active":"2023-05-24T03:29:44.494073+0000","last_became_peered":"2023-05-24T03:29:44.494073+0000","last_unstale":"2023-05-24T03:32:51.879016+0000","last_undegraded":"2023-05-24T03:32:51.879016+0000","last_fullsized":"2023-05-24T03:32:51.879016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'46","last_scrub_stamp":"2023-05-24T03:32:51.878878+0000","last_deep_scrub":"30'46","last_deep_scrub_stamp":"2023-05-24T03:32:51.878878+0000","last_clean_scrub_stamp":"2023-05-24T03:32:51.878878+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:16:07.873495+0000","scrub_duration":0.00149986,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"30'34","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:22.339321+0000","last_change":"2023-05-24T03:32:22.339366+0000","last_active":"2023-05-24T03:32:22.339321+0000","last_peered":"2023-05-24T03:32:22.339321+0000","last_clean":"2023-05-24T03:32:22.339321+0000","last_became_active":"2023-05-24T03:29:44.497832+0000","last_became_peered":"2023-05-24T03:29:44.497832+0000","last_unstale":"2023-05-24T03:32:22.339321+0000","last_undegraded":"2023-05-24T03:32:22.339321+0000","last_fullsized":"2023-05-24T03:32:22.339321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'34","last_scrub_stamp":"2023-05-24T03:32:22.339204+0000","last_deep_scrub":"30'34","last_deep_scrub_stamp":"2023-05-24T03:32:22.339204+0000","last_clean_scrub_stamp":"2023-05-24T03:32:22.339204+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:45:42.612392+0000","scrub_duration":0.0015569990000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"30'31","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:50.926941+0000","last_change":"2023-05-24T03:32:50.926988+0000","last_active":"2023-05-24T03:32:50.926941+0000","last_peered":"2023-05-24T03:32:50.926941+0000","last_clean":"2023-05-24T03:32:50.926941+0000","last_became_active":"2023-05-24T03:29:44.496197+0000","last_became_peered":"2023-05-24T03:29:44.496197+0000","last_unstale":"2023-05-24T03:32:50.926941+0000","last_undegraded":"2023-05-24T03:32:50.926941+0000","last_fullsized":"2023-05-24T03:32:50.926941+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'31","last_scrub_stamp":"2023-05-24T03:32:50.926840+0000","last_deep_scrub":"30'31","last_deep_scrub_stamp":"2023-05-24T03:32:50.926840+0000","last_clean_scrub_stamp":"2023-05-24T03:32:50.926840+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T03:50:21.969359+0000","scrub_duration":0.0021052290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:29.880244+0000","last_change":"2023-05-24T03:32:29.880296+0000","last_active":"2023-05-24T03:32:29.880244+0000","last_peered":"2023-05-24T03:32:29.880244+0000","last_clean":"2023-05-24T03:32:29.880244+0000","last_became_active":"2023-05-24T03:29:44.494928+0000","last_became_peered":"2023-05-24T03:29:44.494928+0000","last_unstale":"2023-05-24T03:32:29.880244+0000","last_undegraded":"2023-05-24T03:32:29.880244+0000","last_fullsized":"2023-05-24T03:32:29.880244+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-05-24T03:32:29.880155+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-05-24T03:32:29.880155+0000","last_clean_scrub_stamp":"2023-05-24T03:32:29.880155+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:00:25.800535+0000","scrub_duration":0.001768146,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":552,"num_write_kb":1154048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":201326592,"data_stored":201326592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14950,"ondisk_log_size":14950,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2060,"ondisk_log_size":2060,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1553284,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":15,"num_read_kb":19,"num_write":484,"num_write_kb":1824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3162112,"data_stored":3106568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":501,"ondisk_log_size":501,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574895,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68296,"kb_used_data":33152,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94303544,"statfs":{"total":96636764160,"available":96566829056,"internally_reserved":0,"allocated":33947648,"data_stored":33731444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:32:40 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":1.3500000000000001,"15min":0.78000000000000003},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.66800000000000004,"5min":14.757999999999999,"15min":14.757999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":1.6639999999999999,"15min":0.89700000000000002},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.69699999999999995,"5min":17.954000000000001,"15min":17.954000000000001},"last":0.64200000000000002}]},{"osd":1,"last update":"Wed May 24 03:32:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":1.379,"15min":0.79800000000000004},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73799999999999999,"5min":16.939,"15min":16.939},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":1.766,"15min":0.94499999999999995},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.65200000000000002,"5min":17.981999999999999,"15min":17.981999999999999},"last":0.53000000000000003}]},{"osd":2,"last update":"Wed May 24 03:32:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":1.6519999999999999,"15min":0.89400000000000002},"min":{"1min":0.34300000000000003,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.292,"5min":14.720000000000001,"15min":14.720000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.53700000000000003,"5min":1.5489999999999999,"15min":0.87},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.76100000000000001,"5min":14.814,"15min":14.814},"last":0.72099999999999997}]},{"osd":3,"last update":"Wed May 24 03:32:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":1.7110000000000001,"15min":0.93899999999999995},"min":{"1min":0.39400000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.67700000000000005,"5min":22.977,"15min":22.977},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.56299999999999994,"5min":1.383,"15min":0.81899999999999995},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.79500000000000004,"5min":14.836,"15min":14.836},"last":0.68999999999999995}]},{"osd":4,"last update":"Wed May 24 03:32:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":1.343,"15min":0.76100000000000001},"min":{"1min":0.27400000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.69899999999999995,"5min":18.027000000000001,"15min":18.027000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.49099999999999999,"5min":1.073,"15min":0.69699999999999995},"min":{"1min":0.33700000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.68600000000000005,"5min":22.922000000000001,"15min":22.922000000000001},"last":0.44700000000000001}]},{"osd":5,"last update":"Wed May 24 03:32:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":1.151,"15min":0.76300000000000001},"min":{"1min":0.32800000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.71699999999999997,"5min":17.925999999999998,"15min":17.925999999999998},"last":0.378},{"interface":"front","average":{"1min":0.53500000000000003,"5min":1.2010000000000001,"15min":0.77400000000000002},"min":{"1min":0.40300000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.748,"5min":18.004999999999999,"15min":18.004999999999999},"last":0.47199999999999998}]},{"osd":6,"last update":"Wed May 24 03:32:40 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":1.5549999999999999,"15min":0.90100000000000002},"min":{"1min":0.42499999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.753,"5min":23.933,"15min":23.933},"last":0.432},{"interface":"front","average":{"1min":0.55000000000000004,"5min":1.5249999999999999,"15min":0.90300000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.73199999999999998,"5min":22.954000000000001,"15min":22.954000000000001},"last":0.50600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48968,"kb_used_data":26944,"kb_used_omap":0,"kb_used_meta":22016,"kb_avail":94322872,"statfs":{"total":96636764160,"available":96586620928,"internally_reserved":0,"allocated":27590656,"data_stored":27401822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22544384},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:32:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":2.3769999999999998,"15min":1.427},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.68899999999999995,"5min":22.922999999999998,"15min":22.922999999999998},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":1.9330000000000001,"15min":1.0229999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.71099999999999997,"5min":28.870000000000001,"15min":28.870000000000001},"last":0.75}]},{"osd":1,"last update":"Wed May 24 03:32:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":2.2149999999999999,"15min":1.409},"min":{"1min":0.35899999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.71999999999999997,"5min":22.984999999999999,"15min":22.984999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.54100000000000004,"5min":2.0009999999999999,"15min":1.327},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.78800000000000003,"5min":21.984999999999999,"15min":21.984999999999999},"last":0.85699999999999998}]},{"osd":2,"last update":"Wed May 24 03:32:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":1.599,"15min":0.92500000000000004},"min":{"1min":0.36299999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.323,"5min":22.649999999999999,"15min":22.649999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":2.2269999999999999,"15min":1.4139999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.89500000000000002,"5min":23.035,"15min":23.035},"last":0.58799999999999997}]},{"osd":3,"last update":"Wed May 24 03:32:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":1.8169999999999999,"15min":1.0589999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.248,"5min":18.056000000000001,"15min":18.056000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.59999999999999998,"5min":1.7609999999999999,"15min":1.0309999999999999},"min":{"1min":0.40799999999999997,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.2809999999999999,"5min":19.963999999999999,"15min":19.963999999999999},"last":0.80200000000000005}]},{"osd":4,"last update":"Wed May 24 03:32:38 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":1.55,"15min":0.86599999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":7.29,"5min":18.056000000000001,"15min":18.056000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.87,"5min":1.5369999999999999,"15min":0.88600000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":7.5090000000000003,"5min":21.943999999999999,"15min":21.943999999999999},"last":0.78800000000000003}]},{"osd":5,"last update":"Wed May 24 03:32:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":1.381,"15min":0.82099999999999995},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.347,"5min":11.976000000000001,"15min":11.976000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.54300000000000004,"5min":1.8939999999999999,"15min":1.0529999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.749,"5min":23.010999999999999,"15min":23.010999999999999},"last":0.63600000000000001}]},{"osd":7,"last update":"Wed May 24 03:32:38 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":1.655,"15min":0.94799999999999995},"min":{"1min":0.432,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.393,"5min":11.989000000000001,"15min":11.989000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.63300000000000001,"5min":1.53,"15min":0.92400000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.381,"5min":21.042000000000002,"15min":21.042000000000002},"last":0.76900000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574895,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53896,"kb_used_data":22848,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94317944,"statfs":{"total":96636764160,"available":96581574656,"internally_reserved":0,"allocated":23396352,"data_stored":23207518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":1.448,"15min":0.76900000000000002},"min":{"1min":0.23499999999999999,"5min":0.223,"15min":0.223},"max":{"1min":1.7130000000000001,"5min":18.954000000000001,"15min":18.954000000000001},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.35399999999999998,"5min":1.784,"15min":1.016},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.52400000000000002,"5min":21.981999999999999,"15min":21.981999999999999},"last":0.38700000000000001}]},{"osd":2,"last update":"Wed May 24 03:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":1.157,"15min":0.63500000000000001},"min":{"1min":0.246,"5min":0.221,"15min":0.221},"max":{"1min":1.198,"5min":15.004,"15min":15.004},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.44900000000000001,"5min":1.5669999999999999,"15min":0.82599999999999996},"min":{"1min":0.26800000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.75,"5min":21.885000000000002,"15min":21.885000000000002},"last":0.41299999999999998}]},{"osd":3,"last update":"Wed May 24 03:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":1.3089999999999999,"15min":0.77100000000000002},"min":{"1min":0.32700000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.147,"5min":18.167000000000002,"15min":18.167000000000002},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.42199999999999999,"5min":1.0900000000000001,"15min":0.64000000000000001},"min":{"1min":0.29399999999999998,"5min":0.254,"15min":0.254},"max":{"1min":0.83799999999999997,"5min":11.935,"15min":11.935},"last":0.44500000000000001}]},{"osd":4,"last update":"Wed May 24 03:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":1.9359999999999999,"15min":1.022},"min":{"1min":0.435,"5min":0.316,"15min":0.316},"max":{"1min":1.0740000000000001,"5min":28.891999999999999,"15min":28.891999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.60199999999999998,"5min":2.0369999999999999,"15min":1.105},"min":{"1min":0.39900000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.177,"5min":21.954999999999998,"15min":21.954999999999998},"last":0.624}]},{"osd":5,"last update":"Wed May 24 03:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":2.306,"15min":1.218},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.97799999999999998,"5min":21.928000000000001,"15min":21.928000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.65100000000000002,"5min":2.069,"15min":1.135},"min":{"1min":0.42299999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.1020000000000001,"5min":19.757999999999999,"15min":19.757999999999999},"last":0.63700000000000001}]},{"osd":6,"last update":"Wed May 24 03:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":1.9059999999999999,"15min":1.0580000000000001},"min":{"1min":0.48999999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.93999999999999995,"5min":22.033999999999999,"15min":22.033999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":2.0419999999999998,"15min":1.095},"min":{"1min":0.40699999999999997,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.1599999999999999,"5min":19.734999999999999,"15min":19.734999999999999},"last":0.54100000000000004}]},{"osd":7,"last update":"Wed May 24 03:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":2.2010000000000001,"15min":1.212},"min":{"1min":0.46100000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.2370000000000001,"5min":21.994,"15min":21.994},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.624,"5min":2.101,"15min":1.1419999999999999},"min":{"1min":0.47299999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.91100000000000003,"5min":21.957999999999998,"15min":21.957999999999998},"last":0.68600000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574895,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54488,"kb_used_data":23440,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94317352,"statfs":{"total":96636764160,"available":96580968448,"internally_reserved":0,"allocated":24002560,"data_stored":23806220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 24 03:32:40 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":1.538,"15min":0.77200000000000002},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":10.919,"5min":21.216000000000001,"15min":21.216000000000001},"last":0.432},{"interface":"front","average":{"1min":0.52700000000000002,"5min":1.7230000000000001,"15min":0.82699999999999996},"min":{"1min":0.22800000000000001,"5min":0.185,"15min":0.185},"max":{"1min":3.0640000000000001,"5min":29.925000000000001,"15min":29.925000000000001},"last":0.34699999999999998}]},{"osd":2,"last update":"Wed May 24 03:32:40 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":1.5109999999999999,"15min":0.76800000000000002},"min":{"1min":0.29299999999999998,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":10.958,"5min":19.018999999999998,"15min":19.018999999999998},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":1.8839999999999999,"15min":0.90600000000000003},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":3.032,"5min":21.945,"15min":21.945},"last":0.504}]},{"osd":3,"last update":"Wed May 24 03:32:40 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.633,"15min":0.82799999999999996},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":18.431999999999999,"5min":25.381,"15min":25.381},"last":0.45000000000000001},{"interface":"front","average":{"1min":1.373,"5min":2.1949999999999998,"15min":1.042},"min":{"1min":0.32400000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":19.251999999999999,"5min":21.209,"15min":21.209},"last":0.48299999999999998}]},{"osd":4,"last update":"Wed May 24 03:32:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":2.238,"15min":1.1879999999999999},"min":{"1min":0.41299999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":8.2309999999999999,"5min":22.030000000000001,"15min":22.030000000000001},"last":0.749},{"interface":"front","average":{"1min":0.97399999999999998,"5min":2.1789999999999998,"15min":1.1559999999999999},"min":{"1min":0.42899999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":7.2549999999999999,"5min":25.279,"15min":25.279},"last":0.82999999999999996}]},{"osd":5,"last update":"Wed May 24 03:32:40 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":1.96,"15min":1.101},"min":{"1min":0.41399999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.94799999999999995,"5min":25.329999999999998,"15min":25.329999999999998},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.746,"5min":2.0310000000000001,"15min":1.109},"min":{"1min":0.45300000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":2.2309999999999999,"5min":28.928000000000001,"15min":28.928000000000001},"last":0.74099999999999999}]},{"osd":6,"last update":"Wed May 24 03:32:40 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":1.903,"15min":1.052},"min":{"1min":0.437,"5min":0.37,"15min":0.37},"max":{"1min":2.2709999999999999,"5min":21.132000000000001,"15min":21.132000000000001},"last":0.627},{"interface":"front","average":{"1min":0.75800000000000001,"5min":2.0840000000000001,"15min":1.103},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":3.0899999999999999,"5min":22.007000000000001,"15min":22.007000000000001},"last":0.69199999999999995}]},{"osd":7,"last update":"Wed May 24 03:32:40 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":2.3929999999999998,"15min":1.218},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":2.9710000000000001,"5min":21.983000000000001,"15min":21.983000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.626,"5min":1.931,"15min":1.079},"min":{"1min":0.44,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.93200000000000005,"5min":25.356000000000002,"15min":25.356000000000002},"last":0.76600000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574895,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46920,"kb_used_data":24896,"kb_used_omap":0,"kb_used_meta":22016,"kb_avail":94324920,"statfs":{"total":96636764160,"available":96588718080,"internally_reserved":0,"allocated":25493504,"data_stored":25304670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22544384},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.84399999999999997,"15min":0.51200000000000001},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.96199999999999997,"5min":10.821999999999999,"15min":10.821999999999999},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.379,"5min":0.93400000000000005,"15min":0.65200000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.56599999999999995,"5min":11.743,"15min":11.743},"last":0.40999999999999998}]},{"osd":1,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.81999999999999995,"15min":0.53000000000000003},"min":{"1min":0.27800000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.524,"5min":12.079000000000001,"15min":12.079000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.377,"5min":1.2,"15min":0.76400000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.55200000000000005,"5min":19.954000000000001,"15min":19.954000000000001},"last":0.32200000000000001}]},{"osd":3,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":1.204,"15min":0.65400000000000003},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.44,"5min":21.611000000000001,"15min":21.611000000000001},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.46400000000000002,"5min":1.04,"15min":0.63400000000000001},"min":{"1min":0.29099999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.90700000000000003,"5min":21.055,"15min":21.055},"last":0.48099999999999998}]},{"osd":4,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":1.4630000000000001,"15min":0.90200000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.4830000000000001,"5min":16.657,"15min":16.657},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":1.3979999999999999,"15min":0.96199999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85599999999999998,"5min":17.116,"15min":17.116},"last":0.625}]},{"osd":5,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":1.5980000000000001,"15min":0.93799999999999994},"min":{"1min":0.34599999999999997,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.82799999999999996,"5min":21.655000000000001,"15min":21.655000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":1.2889999999999999,"15min":0.86299999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.93799999999999994,"5min":14.045999999999999,"15min":14.045999999999999},"last":0.60599999999999998}]},{"osd":6,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":1.556,"15min":1.038},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.78500000000000003,"5min":20.966999999999999,"15min":20.966999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":1.278,"15min":0.83999999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.83399999999999996,"5min":15.119,"15min":15.119},"last":0.56799999999999995}]},{"osd":7,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":1.649,"15min":1.079},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.089,"5min":17.035,"15min":17.035},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.61599999999999999,"5min":1.5009999999999999,"15min":0.91200000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0680000000000001,"5min":18.611999999999998,"15min":18.611999999999998},"last":0.61499999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42828,"kb_used_data":20804,"kb_used_omap":0,"kb_used_meta":22016,"kb_avail":94329012,"statfs":{"total":96636764160,"available":96592908288,"internally_reserved":0,"allocated":21303296,"data_stored":21110456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22544384},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:32:39 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":1.6200000000000001,"15min":1.169},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":1.3080000000000001,"5min":22.969000000000001,"15min":22.969000000000001},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.46500000000000002,"5min":1.3660000000000001,"15min":1.0469999999999999},"min":{"1min":0.24399999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.1579999999999999,"5min":15.933999999999999,"15min":15.933999999999999},"last":0.43099999999999999}]},{"osd":1,"last update":"Wed May 24 03:32:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":1.2090000000000001,"15min":0.90400000000000003},"min":{"1min":0.29499999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":2.266,"5min":19.882000000000001,"15min":19.882000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.41899999999999998,"5min":1.056,"15min":0.63400000000000001},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.71199999999999997,"5min":18.792000000000002,"15min":18.792000000000002},"last":0.52600000000000002}]},{"osd":2,"last update":"Wed May 24 03:32:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":1.732,"15min":1.093},"min":{"1min":0.318,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":3.161,"5min":22.922999999999998,"15min":22.922999999999998},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":2.0739999999999998,"15min":2.0379999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.038,"5min":22.919,"15min":22.919},"last":0.47999999999999998}]},{"osd":4,"last update":"Wed May 24 03:32:39 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":1.526,"15min":0.92800000000000005},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":3.2200000000000002,"5min":18.952000000000002,"15min":18.952000000000002},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.77100000000000002,"5min":2.0179999999999998,"15min":1.3080000000000001},"min":{"1min":0.38400000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":4.5220000000000002,"5min":24.933,"15min":24.933},"last":0.64800000000000002}]},{"osd":5,"last update":"Wed May 24 03:32:39 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":1.9199999999999999,"15min":1.4079999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.2629999999999999,"5min":20.056000000000001,"15min":20.056000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.60199999999999998,"5min":1.5600000000000001,"15min":0.93799999999999994},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.877,"5min":16.013000000000002,"15min":16.013000000000002},"last":0.60399999999999998}]},{"osd":6,"last update":"Wed May 24 03:32:39 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":1.605,"15min":1.1990000000000001},"min":{"1min":0.45600000000000002,"5min":0.379,"15min":0.379},"max":{"1min":1.016,"5min":13.986000000000001,"15min":13.986000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.67000000000000004,"5min":1.8260000000000001,"15min":1.3799999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.3360000000000001,"5min":20.088000000000001,"15min":20.088000000000001},"last":0.68600000000000005}]},{"osd":7,"last update":"Wed May 24 03:32:39 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":1.681,"15min":0.99299999999999999},"min":{"1min":0.39900000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":3.181,"5min":21.571000000000002,"15min":21.571000000000002},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.68899999999999995,"5min":1.661,"15min":1.2230000000000001},"min":{"1min":0.44400000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0860000000000001,"5min":13.922000000000001,"15min":13.922000000000001},"last":0.66900000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574895,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61572,"kb_used_data":26428,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94310268,"statfs":{"total":96636764160,"available":96573714432,"internally_reserved":0,"allocated":27062272,"data_stored":26857212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":1.667,"15min":0.88400000000000001},"min":{"1min":0.31900000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.78500000000000003,"5min":17.794,"15min":17.794},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":1.4570000000000001,"15min":0.82399999999999995},"min":{"1min":0.38200000000000001,"5min":0.375,"15min":0.375},"max":{"1min":1.214,"5min":16.597999999999999,"15min":16.597999999999999},"last":0.64900000000000002}]},{"osd":1,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":1.6759999999999999,"15min":0.90100000000000002},"min":{"1min":0.42399999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.002,"5min":22.933,"15min":22.933},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":1.446,"15min":0.83799999999999997},"min":{"1min":0.33600000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.73899999999999999,"5min":16.196000000000002,"15min":16.196000000000002},"last":0.80600000000000005}]},{"osd":2,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":1.4219999999999999,"15min":0.81599999999999995},"min":{"1min":0.40899999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.94799999999999995,"5min":18.919,"15min":18.919},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.51900000000000002,"5min":1.4970000000000001,"15min":0.84899999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.77200000000000002,"5min":16.277999999999999,"15min":16.277999999999999},"last":0.83199999999999996}]},{"osd":3,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":1.351,"15min":0.77500000000000002},"min":{"1min":0.43099999999999999,"5min":0.312,"15min":0.312},"max":{"1min":2.383,"5min":18.956,"15min":18.956},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":1.659,"15min":0.91400000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0649999999999999,"5min":22.960000000000001,"15min":22.960000000000001},"last":0.78300000000000003}]},{"osd":5,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":1.208,"15min":0.754},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.69199999999999995,"5min":16.231999999999999,"15min":16.231999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":1.0900000000000001,"15min":0.749},"min":{"1min":0.33100000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.91000000000000003,"5min":11.904999999999999,"15min":11.904999999999999},"last":0.70499999999999996}]},{"osd":6,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":1.4990000000000001,"15min":0.82999999999999996},"min":{"1min":0.34200000000000003,"5min":0.315,"15min":0.315},"max":{"1min":1.0329999999999999,"5min":22.983000000000001,"15min":22.983000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.497,"5min":1.097,"15min":0.74099999999999999},"min":{"1min":0.31,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.79300000000000004,"5min":12.367000000000001,"15min":12.367000000000001},"last":0.58099999999999996}]},{"osd":7,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":1.083,"15min":0.73099999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.97699999999999998,"5min":16.576000000000001,"15min":16.576000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.60499999999999998,"5min":1.583,"15min":0.92700000000000005},"min":{"1min":0.38100000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.0900000000000001,"5min":22.882000000000001,"15min":22.882000000000001},"last":0.63600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574894,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46928,"kb_used_data":24904,"kb_used_omap":0,"kb_used_meta":22016,"kb_avail":94324912,"statfs":{"total":96636764160,"available":96588709888,"internally_reserved":0,"allocated":25501696,"data_stored":25305322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22544384},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":1.8300000000000001,"15min":0.95599999999999996},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.93999999999999995,"5min":20.137,"15min":20.137},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":1.865,"15min":1.1040000000000001},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.76400000000000001,"5min":25.988,"15min":25.988},"last":0.47499999999999998}]},{"osd":1,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":1.7390000000000001,"15min":0.94099999999999995},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.71699999999999997,"5min":22.765999999999998,"15min":22.765999999999998},"last":0.504},{"interface":"front","average":{"1min":0.53500000000000003,"5min":2.0009999999999999,"15min":1.167},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.72999999999999998,"5min":20.161999999999999,"15min":20.161999999999999},"last":0.61599999999999999}]},{"osd":2,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":1.923,"15min":1.0009999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.73799999999999999,"5min":25.946000000000002,"15min":25.946000000000002},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.57499999999999996,"5min":1.7090000000000001,"15min":1.0860000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.0469999999999999,"5min":22.800000000000001,"15min":22.800000000000001},"last":0.64200000000000002}]},{"osd":3,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":1.8560000000000001,"15min":1.1919999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":2.0990000000000002,"5min":26.013999999999999,"15min":26.013999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":1.8340000000000001,"15min":1.1559999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.749,"5min":22.687999999999999,"15min":22.687999999999999},"last":0.56100000000000005}]},{"osd":4,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":1.52,"15min":0.84099999999999997},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.77600000000000002,"5min":19.998000000000001,"15min":19.998000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.46600000000000003,"5min":1.2809999999999999,"15min":0.77900000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.629,"5min":17.628,"15min":17.628},"last":0.67100000000000004}]},{"osd":6,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":1.3280000000000001,"15min":0.80800000000000005},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.69999999999999996,"5min":19.969000000000001,"15min":19.969000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":1.492,"15min":0.874},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.117,"5min":19.913,"15min":19.913},"last":0.65900000000000003}]},{"osd":7,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":1.2569999999999999,"15min":0.82799999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72899999999999998,"5min":17.731000000000002,"15min":17.731000000000002},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.54900000000000004,"5min":1.3460000000000001,"15min":0.86799999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72499999999999998,"5min":20.099,"15min":20.099},"last":0.68400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":8334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1568768,"data_stored":1552542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1568768,"data_stored":1544950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23068672,"data_stored":23068672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23068672,"data_stored":23068672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":27262976,"data_stored":27262976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":31457280,"data_stored":31457280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-24T03:33:09.658 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-05-24T03:29:44.060323+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=44, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:33:09.659 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:33:09.660 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-05-24T03:29:47.482603+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=144, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=24, tm_hour=3, tm_min=32, tm_sec=3, tm_wday=2, tm_yday=144, tm_isdst=0) 2023-05-24T03:33:09.660 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-05-24T03:33:14.886 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T03:33:14.889 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T03:33:29.661 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-24T03:33:29.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.792+0000 7f120ab5a700 1 Processor -- start 2023-05-24T03:33:29.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.792+0000 7f120ab5a700 1 -- start start 2023-05-24T03:33:29.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.793+0000 7f120ab5a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12040ce100 0x7f12040d0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:29.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.793+0000 7f120ab5a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12040cd940 con 0x7f12040cec50 2023-05-24T03:33:29.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.793+0000 7f120ab5a700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12040b33d0 con 0x7f120415acd0 2023-05-24T03:33:29.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.793+0000 7f120ab5a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12040b3690 con 0x7f12040ce100 2023-05-24T03:33:29.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.793+0000 7f12090f7700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f12040cec50 0x7f12040cf0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47274/0 (socket says 172.21.15.146:47274) 2023-05-24T03:33:29.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.793+0000 7f12090f7700 1 -- 172.21.15.146:0/2584985994 learned_addr learned my addr 172.21.15.146:0/2584985994 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:33:29.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.793+0000 7f12037fe700 1 -- 172.21.15.146:0/2584985994 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2508793254 0 0) 0x7f12040cd940 con 0x7f12040cec50 2023-05-24T03:33:29.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.793+0000 7f1203fff700 1 --2- 172.21.15.146:0/2584985994 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12040ce100 0x7f12040d0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:29.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.793+0000 7f12037fe700 1 -- 172.21.15.146:0/2584985994 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11f40035b0 con 0x7f12040cec50 2023-05-24T03:33:29.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.794+0000 7f12037fe700 1 -- 172.21.15.146:0/2584985994 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3170864204 0 0) 0x7f11f40035b0 con 0x7f12040cec50 2023-05-24T03:33:29.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.794+0000 7f12037fe700 1 -- 172.21.15.146:0/2584985994 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12040ce100 msgr2=0x7f12040d0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:33:29.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.794+0000 7f12037fe700 1 --2- 172.21.15.146:0/2584985994 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12040ce100 0x7f12040d0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:29.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.794+0000 7f12037fe700 1 -- 172.21.15.146:0/2584985994 >> v1:172.21.15.151:6789/0 conn(0x7f120415acd0 legacy=0x7f12040d06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:29.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.794+0000 7f12037fe700 1 -- 172.21.15.146:0/2584985994 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12040cdbe0 con 0x7f12040cec50 2023-05-24T03:33:29.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.794+0000 7f12037fe700 1 -- 172.21.15.146:0/2584985994 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1301887351 0 0) 0x7f11fc0019f0 con 0x7f12040cec50 2023-05-24T03:33:29.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.794+0000 7f12037fe700 1 -- 172.21.15.146:0/2584985994 >> v1:172.21.15.146:6789/0 conn(0x7f12040cec50 legacy=0x7f12040cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:29.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.794+0000 7f12037fe700 1 --2- 172.21.15.146:0/2584985994 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11f4003a30 0x7f11f4003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:29.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.794+0000 7f12037fe700 1 --2- 172.21.15.146:0/2584985994 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12040ce100 0x7f11f4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:29.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.794+0000 7f12037fe700 1 --2- 172.21.15.146:0/2584985994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11f4004d90 0x7f11f4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:29.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.794+0000 7f12037fe700 1 -- 172.21.15.146:0/2584985994 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12040b3690 con 0x7f11f4004d90 2023-05-24T03:33:29.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.794+0000 7f12037fe700 1 -- 172.21.15.146:0/2584985994 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f400bac0 con 0x7f11f4003a30 2023-05-24T03:33:29.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.794+0000 7f12037fe700 1 -- 172.21.15.146:0/2584985994 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11f400bc50 con 0x7f12040ce100 2023-05-24T03:33:29.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.794+0000 7f12090f7700 1 --2- 172.21.15.146:0/2584985994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11f4004d90 0x7f11f4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:29.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.794+0000 7f1203fff700 1 --2- 172.21.15.146:0/2584985994 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12040ce100 0x7f11f4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:29.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.794+0000 7f12088f6700 1 --2- 172.21.15.146:0/2584985994 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11f4003a30 0x7f11f4003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:29.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.794+0000 7f12090f7700 1 -- 172.21.15.146:0/2584985994 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12040ce100 msgr2=0x7f11f4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:33:29.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.794+0000 7f12090f7700 1 --2- 172.21.15.146:0/2584985994 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12040ce100 0x7f11f4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:29.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.794+0000 7f12090f7700 1 -- 172.21.15.146:0/2584985994 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11f4003a30 msgr2=0x7f11f4003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:33:29.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.794+0000 7f12090f7700 1 --2- 172.21.15.146:0/2584985994 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11f4003a30 0x7f11f4003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:29.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.794+0000 7f12090f7700 1 -- 172.21.15.146:0/2584985994 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f40035b0 con 0x7f11f4004d90 2023-05-24T03:33:29.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.794+0000 7f12090f7700 1 --2- 172.21.15.146:0/2584985994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11f4004d90 0x7f11f4005200 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f11fc00a830 tx=0x7f11f4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c907fa39315de4d server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:33:29.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.794+0000 7f12037fe700 1 -- 172.21.15.146:0/2584985994 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11fc00a2f0 con 0x7f11f4004d90 2023-05-24T03:33:29.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.794+0000 7f12037fe700 1 -- 172.21.15.146:0/2584985994 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11fc012620 con 0x7f11f4004d90 2023-05-24T03:33:29.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.794+0000 7f12037fe700 1 -- 172.21.15.146:0/2584985994 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11fc0129d0 con 0x7f11f4004d90 2023-05-24T03:33:29.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.795+0000 7f120ab5a700 1 -- 172.21.15.146:0/2584985994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11f4004d90 msgr2=0x7f11f4005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:29.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.795+0000 7f120ab5a700 1 --2- 172.21.15.146:0/2584985994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11f4004d90 0x7f11f4005200 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f11fc00a830 tx=0x7f11f4005880 comp rx=0 tx=0).stop 2023-05-24T03:33:29.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.795+0000 7f12090f7700 1 -- 172.21.15.146:0/2584985994 reap_dead start 2023-05-24T03:33:29.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.795+0000 7f120ab5a700 1 -- 172.21.15.146:0/2584985994 shutdown_connections 2023-05-24T03:33:29.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.795+0000 7f120ab5a700 1 -- 172.21.15.146:0/2584985994 >> 172.21.15.146:0/2584985994 conn(0x7f120406e2a0 msgr2=0x7f120406e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:33:29.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.795+0000 7f120ab5a700 1 -- 172.21.15.146:0/2584985994 shutdown_connections 2023-05-24T03:33:29.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.795+0000 7f120ab5a700 1 -- 172.21.15.146:0/2584985994 wait complete. 2023-05-24T03:33:29.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.796+0000 7f120ab5a700 1 Processor -- start 2023-05-24T03:33:29.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.796+0000 7f120ab5a700 1 -- start start 2023-05-24T03:33:29.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.797+0000 7f120ab5a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11f4004d90 0x7f120415bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:29.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.797+0000 7f120ab5a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f120414f920 0x7f120406ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:29.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.797+0000 7f120ab5a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f120406d340 0x7f12040d0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:29.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.797+0000 7f120ab5a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12041f6910 con 0x7f11f4004d90 2023-05-24T03:33:29.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.797+0000 7f120ab5a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12041f5d90 con 0x7f120406d340 2023-05-24T03:33:29.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.797+0000 7f120ab5a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12041f6070 con 0x7f120414f920 2023-05-24T03:33:29.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.797+0000 7f12088f6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11f4004d90 0x7f120415bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:29.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.797+0000 7f12088f6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11f4004d90 0x7f120415bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40830/0 (socket says 172.21.15.146:40830) 2023-05-24T03:33:29.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.797+0000 7f12088f6700 1 -- 172.21.15.146:0/617495438 learned_addr learned my addr 172.21.15.146:0/617495438 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:33:29.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.797+0000 7f1203fff700 1 --2- 172.21.15.146:0/617495438 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f120414f920 0x7f120406ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:29.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.797+0000 7f12090f7700 1 --2- 172.21.15.146:0/617495438 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f120406d340 0x7f12040d0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:29.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.798+0000 7f12088f6700 1 -- 172.21.15.146:0/617495438 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f120414f920 msgr2=0x7f120406ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:29.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.798+0000 7f12088f6700 1 --2- 172.21.15.146:0/617495438 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f120414f920 0x7f120406ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:29.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.798+0000 7f12088f6700 1 -- 172.21.15.146:0/617495438 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f120406d340 msgr2=0x7f12040d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:29.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.798+0000 7f12088f6700 1 --2- 172.21.15.146:0/617495438 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f120406d340 0x7f12040d0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:29.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.798+0000 7f12088f6700 1 -- 172.21.15.146:0/617495438 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12040d03b0 con 0x7f11f4004d90 2023-05-24T03:33:29.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.798+0000 7f1203fff700 1 --2- 172.21.15.146:0/617495438 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f120414f920 0x7f120406ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:33:29.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.798+0000 7f12088f6700 1 --2- 172.21.15.146:0/617495438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11f4004d90 0x7f120415bf20 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f11f800f7f0 tx=0x7f11f800fb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:33:29.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.798+0000 7f12017fa700 1 -- 172.21.15.146:0/617495438 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f80052e0 con 0x7f11f4004d90 2023-05-24T03:33:29.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.798+0000 7f12017fa700 1 -- 172.21.15.146:0/617495438 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f8005440 con 0x7f11f4004d90 2023-05-24T03:33:29.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.798+0000 7f120ab5a700 1 -- 172.21.15.146:0/617495438 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12040b3970 con 0x7f11f4004d90 2023-05-24T03:33:29.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.798+0000 7f12017fa700 1 -- 172.21.15.146:0/617495438 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f80038c0 con 0x7f11f4004d90 2023-05-24T03:33:29.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.798+0000 7f120ab5a700 1 -- 172.21.15.146:0/617495438 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f120415b0a0 con 0x7f11f4004d90 2023-05-24T03:33:29.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.799+0000 7f120ab5a700 1 -- 172.21.15.146:0/617495438 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f120404e810 con 0x7f11f4004d90 2023-05-24T03:33:29.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.799+0000 7f12017fa700 1 -- 172.21.15.146:0/617495438 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f11f8003a20 con 0x7f11f4004d90 2023-05-24T03:33:29.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.800+0000 7f12017fa700 1 --2- 172.21.15.146:0/617495438 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f11e806ace0 0x7f11e806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:29.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.800+0000 7f12017fa700 1 -- 172.21.15.146:0/617495438 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f11f8089540 con 0x7f11f4004d90 2023-05-24T03:33:29.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.800+0000 7f1203fff700 1 --2- 172.21.15.146:0/617495438 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f11e806ace0 0x7f11e806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:29.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.800+0000 7f1203fff700 1 --2- 172.21.15.146:0/617495438 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f11e806ace0 0x7f11e806d190 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f120406cab0 tx=0x7f11f0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:33:29.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.804+0000 7f12017fa700 1 -- 172.21.15.146:0/617495438 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f11f80542c0 con 0x7f11f4004d90 2023-05-24T03:33:29.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.988+0000 7f120ab5a700 1 -- 172.21.15.146:0/617495438 --> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f12040c5dc0 con 0x7f11e806ace0 2023-05-24T03:33:30.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:29.998+0000 7f12017fa700 1 -- 172.21.15.146:0/617495438 <== mgr.4104 v2:172.21.15.146:6832/1985394169 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+394293 (secure 0 0 0) 0x7f12040c5dc0 con 0x7f11e806ace0 2023-05-24T03:33:30.006 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:33:30.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.002+0000 7f120ab5a700 1 -- 172.21.15.146:0/617495438 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f11e806ace0 msgr2=0x7f11e806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:30.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.002+0000 7f120ab5a700 1 --2- 172.21.15.146:0/617495438 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f11e806ace0 0x7f11e806d190 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f120406cab0 tx=0x7f11f0008040 comp rx=0 tx=0).stop 2023-05-24T03:33:30.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.002+0000 7f120ab5a700 1 -- 172.21.15.146:0/617495438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11f4004d90 msgr2=0x7f120415bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:30.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.002+0000 7f120ab5a700 1 --2- 172.21.15.146:0/617495438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11f4004d90 0x7f120415bf20 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f11f800f7f0 tx=0x7f11f800fb00 comp rx=0 tx=0).stop 2023-05-24T03:33:30.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.002+0000 7f120ab5a700 1 -- 172.21.15.146:0/617495438 shutdown_connections 2023-05-24T03:33:30.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.002+0000 7f120ab5a700 1 --2- 172.21.15.146:0/617495438 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f11e806ace0 0x7f11e806d190 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:30.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.002+0000 7f120ab5a700 1 --2- 172.21.15.146:0/617495438 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f120406d340 0x7f12040d0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:30.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.002+0000 7f120ab5a700 1 --2- 172.21.15.146:0/617495438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11f4004d90 0x7f120415bf20 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:30.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.002+0000 7f120ab5a700 1 --2- 172.21.15.146:0/617495438 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f120414f920 0x7f120406ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:30.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.002+0000 7f120ab5a700 1 -- 172.21.15.146:0/617495438 >> 172.21.15.146:0/617495438 conn(0x7f120406e2a0 msgr2=0x7f12041596c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:33:30.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.002+0000 7f120ab5a700 1 -- 172.21.15.146:0/617495438 shutdown_connections 2023-05-24T03:33:30.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.002+0000 7f120ab5a700 1 -- 172.21.15.146:0/617495438 wait complete. 2023-05-24T03:33:30.011 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-05-24T03:33:30.018 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":142,"stamp":"2023-05-24T03:33:28.816148+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":102806948,"num_objects":49,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":131,"num_read_kb":119,"num_write":1195,"num_write_kb":1158288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17630,"ondisk_log_size":17630,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":423896,"kb_used_data":203416,"kb_used_omap":0,"kb_used_meta":220416,"kb_avail":754550824,"statfs":{"total":773094113280,"available":772660043776,"internally_reserved":0,"allocated":208297984,"data_stored":206724664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":225705984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003260"},"pg_stats":[{"pgid":"4.3f","version":"30'28","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:13.677466+0000","last_change":"2023-05-24T03:32:13.677538+0000","last_active":"2023-05-24T03:32:13.677466+0000","last_peered":"2023-05-24T03:32:13.677466+0000","last_clean":"2023-05-24T03:32:13.677466+0000","last_became_active":"2023-05-24T03:29:44.489854+0000","last_became_peered":"2023-05-24T03:29:44.489854+0000","last_unstale":"2023-05-24T03:32:13.677466+0000","last_undegraded":"2023-05-24T03:32:13.677466+0000","last_fullsized":"2023-05-24T03:32:13.677466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'28","last_scrub_stamp":"2023-05-24T03:32:13.677364+0000","last_deep_scrub":"30'28","last_deep_scrub_stamp":"2023-05-24T03:32:13.677364+0000","last_clean_scrub_stamp":"2023-05-24T03:32:13.677364+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T03:41:35.361181+0000","scrub_duration":0.001818166,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"30'27","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:51.474557+0000","last_change":"2023-05-24T03:32:51.474659+0000","last_active":"2023-05-24T03:32:51.474557+0000","last_peered":"2023-05-24T03:32:51.474557+0000","last_clean":"2023-05-24T03:32:51.474557+0000","last_became_active":"2023-05-24T03:29:44.495700+0000","last_became_peered":"2023-05-24T03:29:44.495700+0000","last_unstale":"2023-05-24T03:32:51.474557+0000","last_undegraded":"2023-05-24T03:32:51.474557+0000","last_fullsized":"2023-05-24T03:32:51.474557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'27","last_scrub_stamp":"2023-05-24T03:32:51.474428+0000","last_deep_scrub":"30'27","last_deep_scrub_stamp":"2023-05-24T03:32:51.474428+0000","last_clean_scrub_stamp":"2023-05-24T03:32:51.474428+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T03:50:22.516947+0000","scrub_duration":0.0020678659999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"30'43","reported_seq":76,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:10.490334+0000","last_change":"2023-05-24T03:32:10.490388+0000","last_active":"2023-05-24T03:32:10.490334+0000","last_peered":"2023-05-24T03:32:10.490334+0000","last_clean":"2023-05-24T03:32:10.490334+0000","last_became_active":"2023-05-24T03:29:44.499663+0000","last_became_peered":"2023-05-24T03:29:44.499663+0000","last_unstale":"2023-05-24T03:32:10.490334+0000","last_undegraded":"2023-05-24T03:32:10.490334+0000","last_fullsized":"2023-05-24T03:32:10.490334+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'43","last_scrub_stamp":"2023-05-24T03:32:10.490217+0000","last_deep_scrub":"30'43","last_deep_scrub_stamp":"2023-05-24T03:32:10.490217+0000","last_clean_scrub_stamp":"2023-05-24T03:32:10.490217+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:07:18.348127+0000","scrub_duration":0.002187207,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"30'24","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:19.940238+0000","last_change":"2023-05-24T03:32:19.940327+0000","last_active":"2023-05-24T03:32:19.940238+0000","last_peered":"2023-05-24T03:32:19.940238+0000","last_clean":"2023-05-24T03:32:19.940238+0000","last_became_active":"2023-05-24T03:29:44.498528+0000","last_became_peered":"2023-05-24T03:29:44.498528+0000","last_unstale":"2023-05-24T03:32:19.940238+0000","last_undegraded":"2023-05-24T03:32:19.940238+0000","last_fullsized":"2023-05-24T03:32:19.940238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2023-05-24T03:32:19.940111+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2023-05-24T03:32:19.940111+0000","last_clean_scrub_stamp":"2023-05-24T03:32:19.940111+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:12:46.316536+0000","scrub_duration":0.002509664,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"30'34","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:47.429884+0000","last_change":"2023-05-24T03:32:47.429941+0000","last_active":"2023-05-24T03:32:47.429884+0000","last_peered":"2023-05-24T03:32:47.429884+0000","last_clean":"2023-05-24T03:32:47.429884+0000","last_became_active":"2023-05-24T03:29:44.503998+0000","last_became_peered":"2023-05-24T03:29:44.503998+0000","last_unstale":"2023-05-24T03:32:47.429884+0000","last_undegraded":"2023-05-24T03:32:47.429884+0000","last_fullsized":"2023-05-24T03:32:47.429884+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'34","last_scrub_stamp":"2023-05-24T03:32:47.429774+0000","last_deep_scrub":"30'34","last_deep_scrub_stamp":"2023-05-24T03:32:47.429774+0000","last_clean_scrub_stamp":"2023-05-24T03:32:47.429774+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:58:07.081393+0000","scrub_duration":0.001382865,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"30'39","reported_seq":72,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:58.363772+0000","last_change":"2023-05-24T03:32:58.363841+0000","last_active":"2023-05-24T03:32:58.363772+0000","last_peered":"2023-05-24T03:32:58.363772+0000","last_clean":"2023-05-24T03:32:58.363772+0000","last_became_active":"2023-05-24T03:29:44.500065+0000","last_became_peered":"2023-05-24T03:29:44.500065+0000","last_unstale":"2023-05-24T03:32:58.363772+0000","last_undegraded":"2023-05-24T03:32:58.363772+0000","last_fullsized":"2023-05-24T03:32:58.363772+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'39","last_scrub_stamp":"2023-05-24T03:32:58.363628+0000","last_deep_scrub":"30'39","last_deep_scrub_stamp":"2023-05-24T03:32:58.363628+0000","last_clean_scrub_stamp":"2023-05-24T03:32:58.363628+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:28:10.844281+0000","scrub_duration":0.0019849030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"30'27","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:33.103467+0000","last_change":"2023-05-24T03:32:33.103534+0000","last_active":"2023-05-24T03:32:33.103467+0000","last_peered":"2023-05-24T03:32:33.103467+0000","last_clean":"2023-05-24T03:32:33.103467+0000","last_became_active":"2023-05-24T03:29:44.499324+0000","last_became_peered":"2023-05-24T03:29:44.499324+0000","last_unstale":"2023-05-24T03:32:33.103467+0000","last_undegraded":"2023-05-24T03:32:33.103467+0000","last_fullsized":"2023-05-24T03:32:33.103467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'27","last_scrub_stamp":"2023-05-24T03:32:33.103341+0000","last_deep_scrub":"30'27","last_deep_scrub_stamp":"2023-05-24T03:32:33.103341+0000","last_clean_scrub_stamp":"2023-05-24T03:32:33.103341+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:10:30.279133+0000","scrub_duration":0.0021747279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"30'31","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:07.551920+0000","last_change":"2023-05-24T03:32:07.551920+0000","last_active":"2023-05-24T03:32:07.551920+0000","last_peered":"2023-05-24T03:32:07.551920+0000","last_clean":"2023-05-24T03:32:07.551920+0000","last_became_active":"2023-05-24T03:29:44.500260+0000","last_became_peered":"2023-05-24T03:29:44.500260+0000","last_unstale":"2023-05-24T03:32:07.551920+0000","last_undegraded":"2023-05-24T03:32:07.551920+0000","last_fullsized":"2023-05-24T03:32:07.551920+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'31","last_scrub_stamp":"2023-05-24T03:32:07.551774+0000","last_deep_scrub":"30'31","last_deep_scrub_stamp":"2023-05-24T03:32:07.551774+0000","last_clean_scrub_stamp":"2023-05-24T03:32:07.551774+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:05:30.767531+0000","scrub_duration":0.001406902,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"30'38","reported_seq":71,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:53.522360+0000","last_change":"2023-05-24T03:32:53.522430+0000","last_active":"2023-05-24T03:32:53.522360+0000","last_peered":"2023-05-24T03:32:53.522360+0000","last_clean":"2023-05-24T03:32:53.522360+0000","last_became_active":"2023-05-24T03:29:44.502341+0000","last_became_peered":"2023-05-24T03:29:44.502341+0000","last_unstale":"2023-05-24T03:32:53.522360+0000","last_undegraded":"2023-05-24T03:32:53.522360+0000","last_fullsized":"2023-05-24T03:32:53.522360+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'38","last_scrub_stamp":"2023-05-24T03:32:53.522204+0000","last_deep_scrub":"30'38","last_deep_scrub_stamp":"2023-05-24T03:32:53.522204+0000","last_clean_scrub_stamp":"2023-05-24T03:32:53.522204+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:42:10.266209+0000","scrub_duration":0.0014911659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"30'44","reported_seq":77,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:48.502049+0000","last_change":"2023-05-24T03:32:48.502118+0000","last_active":"2023-05-24T03:32:48.502049+0000","last_peered":"2023-05-24T03:32:48.502049+0000","last_clean":"2023-05-24T03:32:48.502049+0000","last_became_active":"2023-05-24T03:29:44.500156+0000","last_became_peered":"2023-05-24T03:29:44.500156+0000","last_unstale":"2023-05-24T03:32:48.502049+0000","last_undegraded":"2023-05-24T03:32:48.502049+0000","last_fullsized":"2023-05-24T03:32:48.502049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'44","last_scrub_stamp":"2023-05-24T03:32:48.501926+0000","last_deep_scrub":"30'44","last_deep_scrub_stamp":"2023-05-24T03:32:48.501926+0000","last_clean_scrub_stamp":"2023-05-24T03:32:48.501926+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:42:05.245931+0000","scrub_duration":0.001515993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"30'25","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:27.381172+0000","last_change":"2023-05-24T03:32:27.381239+0000","last_active":"2023-05-24T03:32:27.381172+0000","last_peered":"2023-05-24T03:32:27.381172+0000","last_clean":"2023-05-24T03:32:27.381172+0000","last_became_active":"2023-05-24T03:29:44.492573+0000","last_became_peered":"2023-05-24T03:29:44.492573+0000","last_unstale":"2023-05-24T03:32:27.381172+0000","last_undegraded":"2023-05-24T03:32:27.381172+0000","last_fullsized":"2023-05-24T03:32:27.381172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'25","last_scrub_stamp":"2023-05-24T03:32:27.381053+0000","last_deep_scrub":"30'25","last_deep_scrub_stamp":"2023-05-24T03:32:27.381053+0000","last_clean_scrub_stamp":"2023-05-24T03:32:27.381053+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:57:47.032672+0000","scrub_duration":0.001811975,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"30'30","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:21.771720+0000","last_change":"2023-05-24T03:32:21.771773+0000","last_active":"2023-05-24T03:32:21.771720+0000","last_peered":"2023-05-24T03:32:21.771720+0000","last_clean":"2023-05-24T03:32:21.771720+0000","last_became_active":"2023-05-24T03:29:44.501371+0000","last_became_peered":"2023-05-24T03:29:44.501371+0000","last_unstale":"2023-05-24T03:32:21.771720+0000","last_undegraded":"2023-05-24T03:32:21.771720+0000","last_fullsized":"2023-05-24T03:32:21.771720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2023-05-24T03:32:21.771619+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2023-05-24T03:32:21.771619+0000","last_clean_scrub_stamp":"2023-05-24T03:32:21.771619+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:46:03.786320+0000","scrub_duration":0.0021789000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"30'30","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:10.688054+0000","last_change":"2023-05-24T03:32:10.688054+0000","last_active":"2023-05-24T03:32:10.688054+0000","last_peered":"2023-05-24T03:32:10.688054+0000","last_clean":"2023-05-24T03:32:10.688054+0000","last_became_active":"2023-05-24T03:29:44.490411+0000","last_became_peered":"2023-05-24T03:29:44.490411+0000","last_unstale":"2023-05-24T03:32:10.688054+0000","last_undegraded":"2023-05-24T03:32:10.688054+0000","last_fullsized":"2023-05-24T03:32:10.688054+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2023-05-24T03:32:10.687867+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2023-05-24T03:32:10.687867+0000","last_clean_scrub_stamp":"2023-05-24T03:32:10.687867+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:41:09.062399+0000","scrub_duration":0.0014586079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:08.559425+0000","last_change":"2023-05-24T03:32:08.559478+0000","last_active":"2023-05-24T03:32:08.559425+0000","last_peered":"2023-05-24T03:32:08.559425+0000","last_clean":"2023-05-24T03:32:08.559425+0000","last_became_active":"2023-05-24T03:29:44.494879+0000","last_became_peered":"2023-05-24T03:29:44.494879+0000","last_unstale":"2023-05-24T03:32:08.559425+0000","last_undegraded":"2023-05-24T03:32:08.559425+0000","last_fullsized":"2023-05-24T03:32:08.559425+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-05-24T03:32:08.559327+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-05-24T03:32:08.559327+0000","last_clean_scrub_stamp":"2023-05-24T03:32:08.559327+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:39:20.496878+0000","scrub_duration":0.0018937559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"30'31","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:43.164305+0000","last_change":"2023-05-24T03:32:43.164350+0000","last_active":"2023-05-24T03:32:43.164305+0000","last_peered":"2023-05-24T03:32:43.164305+0000","last_clean":"2023-05-24T03:32:43.164305+0000","last_became_active":"2023-05-24T03:29:44.499393+0000","last_became_peered":"2023-05-24T03:29:44.499393+0000","last_unstale":"2023-05-24T03:32:43.164305+0000","last_undegraded":"2023-05-24T03:32:43.164305+0000","last_fullsized":"2023-05-24T03:32:43.164305+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'31","last_scrub_stamp":"2023-05-24T03:32:43.164206+0000","last_deep_scrub":"30'31","last_deep_scrub_stamp":"2023-05-24T03:32:43.164206+0000","last_clean_scrub_stamp":"2023-05-24T03:32:43.164206+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:46:27.289607+0000","scrub_duration":0.0018417220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"30'39","reported_seq":72,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:48.292152+0000","last_change":"2023-05-24T03:32:48.292204+0000","last_active":"2023-05-24T03:32:48.292152+0000","last_peered":"2023-05-24T03:32:48.292152+0000","last_clean":"2023-05-24T03:32:48.292152+0000","last_became_active":"2023-05-24T03:29:44.500818+0000","last_became_peered":"2023-05-24T03:29:44.500818+0000","last_unstale":"2023-05-24T03:32:48.292152+0000","last_undegraded":"2023-05-24T03:32:48.292152+0000","last_fullsized":"2023-05-24T03:32:48.292152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'39","last_scrub_stamp":"2023-05-24T03:32:48.292044+0000","last_deep_scrub":"30'39","last_deep_scrub_stamp":"2023-05-24T03:32:48.292044+0000","last_clean_scrub_stamp":"2023-05-24T03:32:48.292044+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T03:55:31.386422+0000","scrub_duration":0.0020914950000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"30'34","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:05.266534+0000","last_change":"2023-05-24T03:32:05.266534+0000","last_active":"2023-05-24T03:32:05.266534+0000","last_peered":"2023-05-24T03:32:05.266534+0000","last_clean":"2023-05-24T03:32:05.266534+0000","last_became_active":"2023-05-24T03:29:44.499543+0000","last_became_peered":"2023-05-24T03:29:44.499543+0000","last_unstale":"2023-05-24T03:32:05.266534+0000","last_undegraded":"2023-05-24T03:32:05.266534+0000","last_fullsized":"2023-05-24T03:32:05.266534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'34","last_scrub_stamp":"2023-05-24T03:32:05.266373+0000","last_deep_scrub":"30'34","last_deep_scrub_stamp":"2023-05-24T03:32:05.266373+0000","last_clean_scrub_stamp":"2023-05-24T03:32:05.266373+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:30:44.837013+0000","scrub_duration":0.001465926,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"30'29","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:14.450147+0000","last_change":"2023-05-24T03:32:14.450198+0000","last_active":"2023-05-24T03:32:14.450147+0000","last_peered":"2023-05-24T03:32:14.450147+0000","last_clean":"2023-05-24T03:32:14.450147+0000","last_became_active":"2023-05-24T03:29:44.492109+0000","last_became_peered":"2023-05-24T03:29:44.492109+0000","last_unstale":"2023-05-24T03:32:14.450147+0000","last_undegraded":"2023-05-24T03:32:14.450147+0000","last_fullsized":"2023-05-24T03:32:14.450147+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'29","last_scrub_stamp":"2023-05-24T03:32:14.450045+0000","last_deep_scrub":"30'29","last_deep_scrub_stamp":"2023-05-24T03:32:14.450045+0000","last_clean_scrub_stamp":"2023-05-24T03:32:14.450045+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:29:13.731044+0000","scrub_duration":0.0018316579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"30'31","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:12.709356+0000","last_change":"2023-05-24T03:32:12.709408+0000","last_active":"2023-05-24T03:32:12.709356+0000","last_peered":"2023-05-24T03:32:12.709356+0000","last_clean":"2023-05-24T03:32:12.709356+0000","last_became_active":"2023-05-24T03:29:44.480597+0000","last_became_peered":"2023-05-24T03:29:44.480597+0000","last_unstale":"2023-05-24T03:32:12.709356+0000","last_undegraded":"2023-05-24T03:32:12.709356+0000","last_fullsized":"2023-05-24T03:32:12.709356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'31","last_scrub_stamp":"2023-05-24T03:32:12.709240+0000","last_deep_scrub":"30'31","last_deep_scrub_stamp":"2023-05-24T03:32:12.709240+0000","last_clean_scrub_stamp":"2023-05-24T03:32:12.709240+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:30:46.981383+0000","scrub_duration":0.001799042,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"30'34","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:21.334467+0000","last_change":"2023-05-24T03:32:21.334516+0000","last_active":"2023-05-24T03:32:21.334467+0000","last_peered":"2023-05-24T03:32:21.334467+0000","last_clean":"2023-05-24T03:32:21.334467+0000","last_became_active":"2023-05-24T03:29:44.499405+0000","last_became_peered":"2023-05-24T03:29:44.499405+0000","last_unstale":"2023-05-24T03:32:21.334467+0000","last_undegraded":"2023-05-24T03:32:21.334467+0000","last_fullsized":"2023-05-24T03:32:21.334467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'34","last_scrub_stamp":"2023-05-24T03:32:21.334367+0000","last_deep_scrub":"30'34","last_deep_scrub_stamp":"2023-05-24T03:32:21.334367+0000","last_clean_scrub_stamp":"2023-05-24T03:32:21.334367+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:18:40.971078+0000","scrub_duration":0.001550711,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"30'40","reported_seq":78,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:34.104760+0000","last_change":"2023-05-24T03:32:34.104814+0000","last_active":"2023-05-24T03:32:34.104760+0000","last_peered":"2023-05-24T03:32:34.104760+0000","last_clean":"2023-05-24T03:32:34.104760+0000","last_became_active":"2023-05-24T03:30:26.105858+0000","last_became_peered":"2023-05-24T03:30:26.105858+0000","last_unstale":"2023-05-24T03:32:34.104760+0000","last_undegraded":"2023-05-24T03:32:34.104760+0000","last_fullsized":"2023-05-24T03:32:34.104760+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'40","last_scrub_stamp":"2023-05-24T03:32:34.104644+0000","last_deep_scrub":"30'40","last_deep_scrub_stamp":"2023-05-24T03:32:34.104644+0000","last_clean_scrub_stamp":"2023-05-24T03:32:34.104644+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:12:02.487746+0000","scrub_duration":0.002118946,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:29.391149+0000","last_change":"2023-05-24T03:32:29.391187+0000","last_active":"2023-05-24T03:32:29.391149+0000","last_peered":"2023-05-24T03:32:29.391149+0000","last_clean":"2023-05-24T03:32:29.391149+0000","last_became_active":"2023-05-24T03:29:44.498463+0000","last_became_peered":"2023-05-24T03:29:44.498463+0000","last_unstale":"2023-05-24T03:32:29.391149+0000","last_undegraded":"2023-05-24T03:32:29.391149+0000","last_fullsized":"2023-05-24T03:32:29.391149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-05-24T03:32:29.391070+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-05-24T03:32:29.391070+0000","last_clean_scrub_stamp":"2023-05-24T03:32:29.391070+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:07:37.248980+0000","scrub_duration":0.0011854249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"30'36","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:18.872950+0000","last_change":"2023-05-24T03:32:18.872998+0000","last_active":"2023-05-24T03:32:18.872950+0000","last_peered":"2023-05-24T03:32:18.872950+0000","last_clean":"2023-05-24T03:32:18.872950+0000","last_became_active":"2023-05-24T03:29:44.499960+0000","last_became_peered":"2023-05-24T03:29:44.499960+0000","last_unstale":"2023-05-24T03:32:18.872950+0000","last_undegraded":"2023-05-24T03:32:18.872950+0000","last_fullsized":"2023-05-24T03:32:18.872950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'36","last_scrub_stamp":"2023-05-24T03:32:18.872839+0000","last_deep_scrub":"30'36","last_deep_scrub_stamp":"2023-05-24T03:32:18.872839+0000","last_clean_scrub_stamp":"2023-05-24T03:32:18.872839+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:53:45.834893+0000","scrub_duration":0.001506446,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"30'31","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:40.102248+0000","last_change":"2023-05-24T03:32:40.102298+0000","last_active":"2023-05-24T03:32:40.102248+0000","last_peered":"2023-05-24T03:32:40.102248+0000","last_clean":"2023-05-24T03:32:40.102248+0000","last_became_active":"2023-05-24T03:29:44.498437+0000","last_became_peered":"2023-05-24T03:29:44.498437+0000","last_unstale":"2023-05-24T03:32:40.102248+0000","last_undegraded":"2023-05-24T03:32:40.102248+0000","last_fullsized":"2023-05-24T03:32:40.102248+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'31","last_scrub_stamp":"2023-05-24T03:32:40.102145+0000","last_deep_scrub":"30'31","last_deep_scrub_stamp":"2023-05-24T03:32:40.102145+0000","last_clean_scrub_stamp":"2023-05-24T03:32:40.102145+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:18:59.738856+0000","scrub_duration":0.0016287210000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"30'25","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:33.878107+0000","last_change":"2023-05-24T03:32:33.878173+0000","last_active":"2023-05-24T03:32:33.878107+0000","last_peered":"2023-05-24T03:32:33.878107+0000","last_clean":"2023-05-24T03:32:33.878107+0000","last_became_active":"2023-05-24T03:29:44.481004+0000","last_became_peered":"2023-05-24T03:29:44.481004+0000","last_unstale":"2023-05-24T03:32:33.878107+0000","last_undegraded":"2023-05-24T03:32:33.878107+0000","last_fullsized":"2023-05-24T03:32:33.878107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'25","last_scrub_stamp":"2023-05-24T03:32:33.878004+0000","last_deep_scrub":"30'25","last_deep_scrub_stamp":"2023-05-24T03:32:33.878004+0000","last_clean_scrub_stamp":"2023-05-24T03:32:33.878004+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:10:31.053796+0000","scrub_duration":0.0019292770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"30'38","reported_seq":71,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:12.991958+0000","last_change":"2023-05-24T03:32:12.992009+0000","last_active":"2023-05-24T03:32:12.991958+0000","last_peered":"2023-05-24T03:32:12.991958+0000","last_clean":"2023-05-24T03:32:12.991958+0000","last_became_active":"2023-05-24T03:29:44.481686+0000","last_became_peered":"2023-05-24T03:29:44.481686+0000","last_unstale":"2023-05-24T03:32:12.991958+0000","last_undegraded":"2023-05-24T03:32:12.991958+0000","last_fullsized":"2023-05-24T03:32:12.991958+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'38","last_scrub_stamp":"2023-05-24T03:32:12.991844+0000","last_deep_scrub":"30'38","last_deep_scrub_stamp":"2023-05-24T03:32:12.991844+0000","last_clean_scrub_stamp":"2023-05-24T03:32:12.991844+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:11:02.613201+0000","scrub_duration":0.0013478520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"30'26","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:42.422520+0000","last_change":"2023-05-24T03:32:42.422571+0000","last_active":"2023-05-24T03:32:42.422520+0000","last_peered":"2023-05-24T03:32:42.422520+0000","last_clean":"2023-05-24T03:32:42.422520+0000","last_became_active":"2023-05-24T03:29:44.502669+0000","last_became_peered":"2023-05-24T03:29:44.502669+0000","last_unstale":"2023-05-24T03:32:42.422520+0000","last_undegraded":"2023-05-24T03:32:42.422520+0000","last_fullsized":"2023-05-24T03:32:42.422520+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'26","last_scrub_stamp":"2023-05-24T03:32:42.422420+0000","last_deep_scrub":"30'26","last_deep_scrub_stamp":"2023-05-24T03:32:42.422420+0000","last_clean_scrub_stamp":"2023-05-24T03:32:42.422420+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:58:02.074039+0000","scrub_duration":0.001487106,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"30'474","reported_seq":501,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:33:05.244110+0000","last_change":"2023-05-24T03:33:05.244184+0000","last_active":"2023-05-24T03:33:05.244110+0000","last_peered":"2023-05-24T03:33:05.244110+0000","last_clean":"2023-05-24T03:33:05.244110+0000","last_became_active":"2023-05-24T03:29:48.522749+0000","last_became_peered":"2023-05-24T03:29:48.522749+0000","last_unstale":"2023-05-24T03:33:05.244110+0000","last_undegraded":"2023-05-24T03:33:05.244110+0000","last_fullsized":"2023-05-24T03:33:05.244110+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'474","last_scrub_stamp":"2023-05-24T03:33:05.244005+0000","last_deep_scrub":"30'474","last_deep_scrub_stamp":"2023-05-24T03:33:05.244005+0000","last_clean_scrub_stamp":"2023-05-24T03:33:05.244005+0000","objects_scrubbed":1,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:01:27.665695+0000","scrub_duration":0.0063322040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:37.284844+0000","last_change":"2023-05-24T03:32:37.284943+0000","last_active":"2023-05-24T03:32:37.284844+0000","last_peered":"2023-05-24T03:32:37.284844+0000","last_clean":"2023-05-24T03:32:37.284844+0000","last_became_active":"2023-05-24T03:29:44.086143+0000","last_became_peered":"2023-05-24T03:29:44.086143+0000","last_unstale":"2023-05-24T03:32:37.284844+0000","last_undegraded":"2023-05-24T03:32:37.284844+0000","last_fullsized":"2023-05-24T03:32:37.284844+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-05-24T03:32:37.284689+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-05-24T03:32:37.284689+0000","last_clean_scrub_stamp":"2023-05-24T03:32:37.284689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T03:50:08.327208+0000","scrub_duration":0.0019021800000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'39","reported_seq":72,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:06.778805+0000","last_change":"2023-05-24T03:32:06.778805+0000","last_active":"2023-05-24T03:32:06.778805+0000","last_peered":"2023-05-24T03:32:06.778805+0000","last_clean":"2023-05-24T03:32:06.778805+0000","last_became_active":"2023-05-24T03:29:44.490772+0000","last_became_peered":"2023-05-24T03:29:44.490772+0000","last_unstale":"2023-05-24T03:32:06.778805+0000","last_undegraded":"2023-05-24T03:32:06.778805+0000","last_fullsized":"2023-05-24T03:32:06.778805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'39","last_scrub_stamp":"2023-05-24T03:32:06.778698+0000","last_deep_scrub":"30'39","last_deep_scrub_stamp":"2023-05-24T03:32:06.778698+0000","last_clean_scrub_stamp":"2023-05-24T03:32:06.778698+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:31:15.880804+0000","scrub_duration":0.0014151050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"30'444","reported_seq":471,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:34.799588+0000","last_change":"2023-05-24T03:32:34.799688+0000","last_active":"2023-05-24T03:32:34.799588+0000","last_peered":"2023-05-24T03:32:34.799588+0000","last_clean":"2023-05-24T03:32:34.799588+0000","last_became_active":"2023-05-24T03:29:48.523125+0000","last_became_peered":"2023-05-24T03:29:48.523125+0000","last_unstale":"2023-05-24T03:32:34.799588+0000","last_undegraded":"2023-05-24T03:32:34.799588+0000","last_fullsized":"2023-05-24T03:32:34.799588+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'444","last_scrub_stamp":"2023-05-24T03:32:34.799475+0000","last_deep_scrub":"30'444","last_deep_scrub_stamp":"2023-05-24T03:32:34.799475+0000","last_clean_scrub_stamp":"2023-05-24T03:32:34.799475+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:31:14.370115+0000","scrub_duration":0.0021951340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:27.924674+0000","last_change":"2023-05-24T03:32:27.924740+0000","last_active":"2023-05-24T03:32:27.924674+0000","last_peered":"2023-05-24T03:32:27.924674+0000","last_clean":"2023-05-24T03:32:27.924674+0000","last_became_active":"2023-05-24T03:29:44.084099+0000","last_became_peered":"2023-05-24T03:29:44.084099+0000","last_unstale":"2023-05-24T03:32:27.924674+0000","last_undegraded":"2023-05-24T03:32:27.924674+0000","last_fullsized":"2023-05-24T03:32:27.924674+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:27.924570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:27.924570+0000","last_clean_scrub_stamp":"2023-05-24T03:32:27.924570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:04:08.141178+0000","scrub_duration":0.001356494,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"30'31","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:43.340857+0000","last_change":"2023-05-24T03:32:43.340905+0000","last_active":"2023-05-24T03:32:43.340857+0000","last_peered":"2023-05-24T03:32:43.340857+0000","last_clean":"2023-05-24T03:32:43.340857+0000","last_became_active":"2023-05-24T03:29:44.503039+0000","last_became_peered":"2023-05-24T03:29:44.503039+0000","last_unstale":"2023-05-24T03:32:43.340857+0000","last_undegraded":"2023-05-24T03:32:43.340857+0000","last_fullsized":"2023-05-24T03:32:43.340857+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'31","last_scrub_stamp":"2023-05-24T03:32:43.340745+0000","last_deep_scrub":"30'31","last_deep_scrub_stamp":"2023-05-24T03:32:43.340745+0000","last_clean_scrub_stamp":"2023-05-24T03:32:43.340745+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:46:27.466145+0000","scrub_duration":0.001774086,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"30'454","reported_seq":481,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:57.529817+0000","last_change":"2023-05-24T03:32:57.529918+0000","last_active":"2023-05-24T03:32:57.529817+0000","last_peered":"2023-05-24T03:32:57.529817+0000","last_clean":"2023-05-24T03:32:57.529817+0000","last_became_active":"2023-05-24T03:29:48.529142+0000","last_became_peered":"2023-05-24T03:29:48.529142+0000","last_unstale":"2023-05-24T03:32:57.529817+0000","last_undegraded":"2023-05-24T03:32:57.529817+0000","last_fullsized":"2023-05-24T03:32:57.529817+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'454","last_scrub_stamp":"2023-05-24T03:32:57.529698+0000","last_deep_scrub":"30'454","last_deep_scrub_stamp":"2023-05-24T03:32:57.529698+0000","last_clean_scrub_stamp":"2023-05-24T03:32:57.529698+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:16:13.524316+0000","scrub_duration":0.002184737,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"30'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:21.861680+0000","last_change":"2023-05-24T03:32:21.861728+0000","last_active":"2023-05-24T03:32:21.861680+0000","last_peered":"2023-05-24T03:32:21.861680+0000","last_clean":"2023-05-24T03:32:21.861680+0000","last_became_active":"2023-05-24T03:29:44.084907+0000","last_became_peered":"2023-05-24T03:29:44.084907+0000","last_unstale":"2023-05-24T03:32:21.861680+0000","last_undegraded":"2023-05-24T03:32:21.861680+0000","last_fullsized":"2023-05-24T03:32:21.861680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-05-24T03:32:21.861585+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-05-24T03:32:21.861585+0000","last_clean_scrub_stamp":"2023-05-24T03:32:21.861585+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:59:22.498081+0000","scrub_duration":0.0014618840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"30'30","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:27.920731+0000","last_change":"2023-05-24T03:32:27.920774+0000","last_active":"2023-05-24T03:32:27.920731+0000","last_peered":"2023-05-24T03:32:27.920731+0000","last_clean":"2023-05-24T03:32:27.920731+0000","last_became_active":"2023-05-24T03:29:44.496746+0000","last_became_peered":"2023-05-24T03:29:44.496746+0000","last_unstale":"2023-05-24T03:32:27.920731+0000","last_undegraded":"2023-05-24T03:32:27.920731+0000","last_fullsized":"2023-05-24T03:32:27.920731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2023-05-24T03:32:27.920648+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2023-05-24T03:32:27.920648+0000","last_clean_scrub_stamp":"2023-05-24T03:32:27.920648+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:59:00.870767+0000","scrub_duration":0.001516101,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"30'468","reported_seq":495,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:39.854622+0000","last_change":"2023-05-24T03:32:39.854702+0000","last_active":"2023-05-24T03:32:39.854622+0000","last_peered":"2023-05-24T03:32:39.854622+0000","last_clean":"2023-05-24T03:32:39.854622+0000","last_became_active":"2023-05-24T03:29:48.520319+0000","last_became_peered":"2023-05-24T03:29:48.520319+0000","last_unstale":"2023-05-24T03:32:39.854622+0000","last_undegraded":"2023-05-24T03:32:39.854622+0000","last_fullsized":"2023-05-24T03:32:39.854622+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'468","last_scrub_stamp":"2023-05-24T03:32:39.854508+0000","last_deep_scrub":"30'468","last_deep_scrub_stamp":"2023-05-24T03:32:39.854508+0000","last_clean_scrub_stamp":"2023-05-24T03:32:39.854508+0000","objects_scrubbed":1,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:06:16.342886+0000","scrub_duration":0.0070678420000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"30'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:16.397784+0000","last_change":"2023-05-24T03:32:16.397828+0000","last_active":"2023-05-24T03:32:16.397784+0000","last_peered":"2023-05-24T03:32:16.397784+0000","last_clean":"2023-05-24T03:32:16.397784+0000","last_became_active":"2023-05-24T03:29:44.088267+0000","last_became_peered":"2023-05-24T03:29:44.088267+0000","last_unstale":"2023-05-24T03:32:16.397784+0000","last_undegraded":"2023-05-24T03:32:16.397784+0000","last_fullsized":"2023-05-24T03:32:16.397784+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-05-24T03:32:16.397687+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-05-24T03:32:16.397687+0000","last_clean_scrub_stamp":"2023-05-24T03:32:16.397687+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:36:49.030839+0000","scrub_duration":0.0020232230000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"30'27","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:10.842423+0000","last_change":"2023-05-24T03:32:10.842496+0000","last_active":"2023-05-24T03:32:10.842423+0000","last_peered":"2023-05-24T03:32:10.842423+0000","last_clean":"2023-05-24T03:32:10.842423+0000","last_became_active":"2023-05-24T03:29:44.488666+0000","last_became_peered":"2023-05-24T03:29:44.488666+0000","last_unstale":"2023-05-24T03:32:10.842423+0000","last_undegraded":"2023-05-24T03:32:10.842423+0000","last_fullsized":"2023-05-24T03:32:10.842423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'27","last_scrub_stamp":"2023-05-24T03:32:10.842313+0000","last_deep_scrub":"30'27","last_deep_scrub_stamp":"2023-05-24T03:32:10.842313+0000","last_clean_scrub_stamp":"2023-05-24T03:32:10.842313+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:36:43.475465+0000","scrub_duration":0.001460512,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"30'453","reported_seq":480,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:47.129535+0000","last_change":"2023-05-24T03:32:47.129618+0000","last_active":"2023-05-24T03:32:47.129535+0000","last_peered":"2023-05-24T03:32:47.129535+0000","last_clean":"2023-05-24T03:32:47.129535+0000","last_became_active":"2023-05-24T03:29:48.517771+0000","last_became_peered":"2023-05-24T03:29:48.517771+0000","last_unstale":"2023-05-24T03:32:47.129535+0000","last_undegraded":"2023-05-24T03:32:47.129535+0000","last_fullsized":"2023-05-24T03:32:47.129535+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'453","last_scrub_stamp":"2023-05-24T03:32:47.129412+0000","last_deep_scrub":"30'453","last_deep_scrub_stamp":"2023-05-24T03:32:47.129412+0000","last_clean_scrub_stamp":"2023-05-24T03:32:47.129412+0000","objects_scrubbed":2,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:58:06.781030+0000","scrub_duration":0.010316357,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:29.379299+0000","last_change":"2023-05-24T03:32:29.379343+0000","last_active":"2023-05-24T03:32:29.379299+0000","last_peered":"2023-05-24T03:32:29.379299+0000","last_clean":"2023-05-24T03:32:29.379299+0000","last_became_active":"2023-05-24T03:29:44.087601+0000","last_became_peered":"2023-05-24T03:29:44.087601+0000","last_unstale":"2023-05-24T03:32:29.379299+0000","last_undegraded":"2023-05-24T03:32:29.379299+0000","last_fullsized":"2023-05-24T03:32:29.379299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:29.379207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:29.379207+0000","last_clean_scrub_stamp":"2023-05-24T03:32:29.379207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:11:57.762308+0000","scrub_duration":0.001464873,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"30'36","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:38.042737+0000","last_change":"2023-05-24T03:32:38.042785+0000","last_active":"2023-05-24T03:32:38.042737+0000","last_peered":"2023-05-24T03:32:38.042737+0000","last_clean":"2023-05-24T03:32:38.042737+0000","last_became_active":"2023-05-24T03:29:44.495752+0000","last_became_peered":"2023-05-24T03:29:44.495752+0000","last_unstale":"2023-05-24T03:32:38.042737+0000","last_undegraded":"2023-05-24T03:32:38.042737+0000","last_fullsized":"2023-05-24T03:32:38.042737+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'36","last_scrub_stamp":"2023-05-24T03:32:38.042641+0000","last_deep_scrub":"30'36","last_deep_scrub_stamp":"2023-05-24T03:32:38.042641+0000","last_clean_scrub_stamp":"2023-05-24T03:32:38.042641+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:46:22.168041+0000","scrub_duration":0.00190278,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"30'480","reported_seq":507,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:33:01.929131+0000","last_change":"2023-05-24T03:33:01.929200+0000","last_active":"2023-05-24T03:33:01.929131+0000","last_peered":"2023-05-24T03:33:01.929131+0000","last_clean":"2023-05-24T03:33:01.929131+0000","last_became_active":"2023-05-24T03:29:48.529514+0000","last_became_peered":"2023-05-24T03:29:48.529514+0000","last_unstale":"2023-05-24T03:33:01.929131+0000","last_undegraded":"2023-05-24T03:33:01.929131+0000","last_fullsized":"2023-05-24T03:33:01.929131+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'480","last_scrub_stamp":"2023-05-24T03:33:01.929044+0000","last_deep_scrub":"30'480","last_deep_scrub_stamp":"2023-05-24T03:33:01.929044+0000","last_clean_scrub_stamp":"2023-05-24T03:33:01.929044+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T03:55:45.023422+0000","scrub_duration":0.0020237010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"30'13","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:30.169052+0000","last_change":"2023-05-24T03:32:30.169101+0000","last_active":"2023-05-24T03:32:30.169052+0000","last_peered":"2023-05-24T03:32:30.169052+0000","last_clean":"2023-05-24T03:32:30.169052+0000","last_became_active":"2023-05-24T03:29:44.091390+0000","last_became_peered":"2023-05-24T03:29:44.091390+0000","last_unstale":"2023-05-24T03:32:30.169052+0000","last_undegraded":"2023-05-24T03:32:30.169052+0000","last_fullsized":"2023-05-24T03:32:30.169052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'13","last_scrub_stamp":"2023-05-24T03:32:30.168959+0000","last_deep_scrub":"30'13","last_deep_scrub_stamp":"2023-05-24T03:32:30.168959+0000","last_clean_scrub_stamp":"2023-05-24T03:32:30.168959+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:07:38.026869+0000","scrub_duration":0.003670534,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"30'42","reported_seq":75,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:28.880132+0000","last_change":"2023-05-24T03:32:28.880189+0000","last_active":"2023-05-24T03:32:28.880132+0000","last_peered":"2023-05-24T03:32:28.880132+0000","last_clean":"2023-05-24T03:32:28.880132+0000","last_became_active":"2023-05-24T03:29:44.481385+0000","last_became_peered":"2023-05-24T03:29:44.481385+0000","last_unstale":"2023-05-24T03:32:28.880132+0000","last_undegraded":"2023-05-24T03:32:28.880132+0000","last_fullsized":"2023-05-24T03:32:28.880132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'42","last_scrub_stamp":"2023-05-24T03:32:28.880056+0000","last_deep_scrub":"30'42","last_deep_scrub_stamp":"2023-05-24T03:32:28.880056+0000","last_clean_scrub_stamp":"2023-05-24T03:32:28.880056+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:50:10.559202+0000","scrub_duration":0.0020578609999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"30'471","reported_seq":498,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:43.963240+0000","last_change":"2023-05-24T03:32:43.963307+0000","last_active":"2023-05-24T03:32:43.963240+0000","last_peered":"2023-05-24T03:32:43.963240+0000","last_clean":"2023-05-24T03:32:43.963240+0000","last_became_active":"2023-05-24T03:29:48.524312+0000","last_became_peered":"2023-05-24T03:29:48.524312+0000","last_unstale":"2023-05-24T03:32:43.963240+0000","last_undegraded":"2023-05-24T03:32:43.963240+0000","last_fullsized":"2023-05-24T03:32:43.963240+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'471","last_scrub_stamp":"2023-05-24T03:32:43.963153+0000","last_deep_scrub":"30'471","last_deep_scrub_stamp":"2023-05-24T03:32:43.963153+0000","last_clean_scrub_stamp":"2023-05-24T03:32:43.963153+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:46:28.088553+0000","scrub_duration":0.0020290159999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"30'402","reported_seq":437,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:42.277172+0000","last_change":"2023-05-24T03:32:42.277223+0000","last_active":"2023-05-24T03:32:42.277172+0000","last_peered":"2023-05-24T03:32:42.277172+0000","last_clean":"2023-05-24T03:32:42.277172+0000","last_became_active":"2023-05-24T03:29:44.078785+0000","last_became_peered":"2023-05-24T03:29:44.078785+0000","last_unstale":"2023-05-24T03:32:42.277172+0000","last_undegraded":"2023-05-24T03:32:42.277172+0000","last_fullsized":"2023-05-24T03:32:42.277172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'402","last_scrub_stamp":"2023-05-24T03:32:42.277084+0000","last_deep_scrub":"30'402","last_deep_scrub_stamp":"2023-05-24T03:32:42.277084+0000","last_clean_scrub_stamp":"2023-05-24T03:32:42.277084+0000","objects_scrubbed":4,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:31:59.386881+0000","scrub_duration":0.0082326540000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1544734,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":399,"num_write_kb":1772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"30'41","reported_seq":74,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:52.362485+0000","last_change":"2023-05-24T03:32:52.362535+0000","last_active":"2023-05-24T03:32:52.362485+0000","last_peered":"2023-05-24T03:32:52.362485+0000","last_clean":"2023-05-24T03:32:52.362485+0000","last_became_active":"2023-05-24T03:29:44.497120+0000","last_became_peered":"2023-05-24T03:29:44.497120+0000","last_unstale":"2023-05-24T03:32:52.362485+0000","last_undegraded":"2023-05-24T03:32:52.362485+0000","last_fullsized":"2023-05-24T03:32:52.362485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'41","last_scrub_stamp":"2023-05-24T03:32:52.362394+0000","last_deep_scrub":"30'41","last_deep_scrub_stamp":"2023-05-24T03:32:52.362394+0000","last_clean_scrub_stamp":"2023-05-24T03:32:52.362394+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:58:23.800829+0000","scrub_duration":0.00159844,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"30'438","reported_seq":465,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:33:03.535026+0000","last_change":"2023-05-24T03:33:03.535133+0000","last_active":"2023-05-24T03:33:03.535026+0000","last_peered":"2023-05-24T03:33:03.535026+0000","last_clean":"2023-05-24T03:33:03.535026+0000","last_became_active":"2023-05-24T03:29:48.531538+0000","last_became_peered":"2023-05-24T03:29:48.531538+0000","last_unstale":"2023-05-24T03:33:03.535026+0000","last_undegraded":"2023-05-24T03:33:03.535026+0000","last_fullsized":"2023-05-24T03:33:03.535026+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'438","last_scrub_stamp":"2023-05-24T03:33:03.534883+0000","last_deep_scrub":"30'438","last_deep_scrub_stamp":"2023-05-24T03:33:03.534883+0000","last_clean_scrub_stamp":"2023-05-24T03:33:03.534883+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:05:03.373286+0000","scrub_duration":0.002328554,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"30'5","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:28.074124+0000","last_change":"2023-05-24T03:32:28.074186+0000","last_active":"2023-05-24T03:32:28.074124+0000","last_peered":"2023-05-24T03:32:28.074124+0000","last_clean":"2023-05-24T03:32:28.074124+0000","last_became_active":"2023-05-24T03:29:44.086997+0000","last_became_peered":"2023-05-24T03:29:44.086997+0000","last_unstale":"2023-05-24T03:32:28.074124+0000","last_undegraded":"2023-05-24T03:32:28.074124+0000","last_fullsized":"2023-05-24T03:32:28.074124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'5","last_scrub_stamp":"2023-05-24T03:32:28.074042+0000","last_deep_scrub":"30'5","last_deep_scrub_stamp":"2023-05-24T03:32:28.074042+0000","last_clean_scrub_stamp":"2023-05-24T03:32:28.074042+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:50:09.753188+0000","scrub_duration":0.0031652949999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"30'29","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:41.963802+0000","last_change":"2023-05-24T03:32:41.963850+0000","last_active":"2023-05-24T03:32:41.963802+0000","last_peered":"2023-05-24T03:32:41.963802+0000","last_clean":"2023-05-24T03:32:41.963802+0000","last_became_active":"2023-05-24T03:29:44.487257+0000","last_became_peered":"2023-05-24T03:29:44.487257+0000","last_unstale":"2023-05-24T03:32:41.963802+0000","last_undegraded":"2023-05-24T03:32:41.963802+0000","last_fullsized":"2023-05-24T03:32:41.963802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'29","last_scrub_stamp":"2023-05-24T03:32:41.963713+0000","last_deep_scrub":"30'29","last_deep_scrub_stamp":"2023-05-24T03:32:41.963713+0000","last_clean_scrub_stamp":"2023-05-24T03:32:41.963713+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:58:01.615331+0000","scrub_duration":0.001302131,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"30'470","reported_seq":497,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:33:05.891643+0000","last_change":"2023-05-24T03:33:05.891710+0000","last_active":"2023-05-24T03:33:05.891643+0000","last_peered":"2023-05-24T03:33:05.891643+0000","last_clean":"2023-05-24T03:33:05.891643+0000","last_became_active":"2023-05-24T03:29:48.525726+0000","last_became_peered":"2023-05-24T03:29:48.525726+0000","last_unstale":"2023-05-24T03:33:05.891643+0000","last_undegraded":"2023-05-24T03:33:05.891643+0000","last_fullsized":"2023-05-24T03:33:05.891643+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'470","last_scrub_stamp":"2023-05-24T03:33:05.891531+0000","last_deep_scrub":"30'470","last_deep_scrub_stamp":"2023-05-24T03:33:05.891531+0000","last_clean_scrub_stamp":"2023-05-24T03:33:05.891531+0000","objects_scrubbed":1,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:58:37.329967+0000","scrub_duration":0.0068845900000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:13.389468+0000","last_change":"2023-05-24T03:32:13.389511+0000","last_active":"2023-05-24T03:32:13.389468+0000","last_peered":"2023-05-24T03:32:13.389468+0000","last_clean":"2023-05-24T03:32:13.389468+0000","last_became_active":"2023-05-24T03:29:44.084278+0000","last_became_peered":"2023-05-24T03:29:44.084278+0000","last_unstale":"2023-05-24T03:32:13.389468+0000","last_undegraded":"2023-05-24T03:32:13.389468+0000","last_fullsized":"2023-05-24T03:32:13.389468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:13.389382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:13.389382+0000","last_clean_scrub_stamp":"2023-05-24T03:32:13.389382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:05:36.605139+0000","scrub_duration":0.0019599439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"30'33","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:10.564131+0000","last_change":"2023-05-24T03:32:10.564131+0000","last_active":"2023-05-24T03:32:10.564131+0000","last_peered":"2023-05-24T03:32:10.564131+0000","last_clean":"2023-05-24T03:32:10.564131+0000","last_became_active":"2023-05-24T03:29:44.498097+0000","last_became_peered":"2023-05-24T03:29:44.498097+0000","last_unstale":"2023-05-24T03:32:10.564131+0000","last_undegraded":"2023-05-24T03:32:10.564131+0000","last_fullsized":"2023-05-24T03:32:10.564131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'33","last_scrub_stamp":"2023-05-24T03:32:10.563952+0000","last_deep_scrub":"30'33","last_deep_scrub_stamp":"2023-05-24T03:32:10.563952+0000","last_clean_scrub_stamp":"2023-05-24T03:32:10.563952+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:36:43.197104+0000","scrub_duration":0.001462594,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"30'446","reported_seq":473,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:33:02.924211+0000","last_change":"2023-05-24T03:33:02.924334+0000","last_active":"2023-05-24T03:33:02.924211+0000","last_peered":"2023-05-24T03:33:02.924211+0000","last_clean":"2023-05-24T03:33:02.924211+0000","last_became_active":"2023-05-24T03:29:48.524602+0000","last_became_peered":"2023-05-24T03:29:48.524602+0000","last_unstale":"2023-05-24T03:33:02.924211+0000","last_undegraded":"2023-05-24T03:33:02.924211+0000","last_fullsized":"2023-05-24T03:33:02.924211+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'446","last_scrub_stamp":"2023-05-24T03:33:02.924092+0000","last_deep_scrub":"30'446","last_deep_scrub_stamp":"2023-05-24T03:33:02.924092+0000","last_clean_scrub_stamp":"2023-05-24T03:33:02.924092+0000","objects_scrubbed":1,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:05:02.762495+0000","scrub_duration":0.0076459340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"30'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:29.117566+0000","last_change":"2023-05-24T03:32:29.117619+0000","last_active":"2023-05-24T03:32:29.117566+0000","last_peered":"2023-05-24T03:32:29.117566+0000","last_clean":"2023-05-24T03:32:29.117566+0000","last_became_active":"2023-05-24T03:29:44.085001+0000","last_became_peered":"2023-05-24T03:29:44.085001+0000","last_unstale":"2023-05-24T03:32:29.117566+0000","last_undegraded":"2023-05-24T03:32:29.117566+0000","last_fullsized":"2023-05-24T03:32:29.117566+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-05-24T03:32:29.117451+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-05-24T03:32:29.117451+0000","last_clean_scrub_stamp":"2023-05-24T03:32:29.117451+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:00:25.037831+0000","scrub_duration":0.0015173610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"30'40","reported_seq":73,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:10.302878+0000","last_change":"2023-05-24T03:32:10.302878+0000","last_active":"2023-05-24T03:32:10.302878+0000","last_peered":"2023-05-24T03:32:10.302878+0000","last_clean":"2023-05-24T03:32:10.302878+0000","last_became_active":"2023-05-24T03:29:44.500631+0000","last_became_peered":"2023-05-24T03:29:44.500631+0000","last_unstale":"2023-05-24T03:32:10.302878+0000","last_undegraded":"2023-05-24T03:32:10.302878+0000","last_fullsized":"2023-05-24T03:32:10.302878+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'40","last_scrub_stamp":"2023-05-24T03:32:10.302703+0000","last_deep_scrub":"30'40","last_deep_scrub_stamp":"2023-05-24T03:32:10.302703+0000","last_clean_scrub_stamp":"2023-05-24T03:32:10.302703+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:05:46.791081+0000","scrub_duration":0.0016110149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"30'491","reported_seq":518,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:33:02.554838+0000","last_change":"2023-05-24T03:33:02.554953+0000","last_active":"2023-05-24T03:33:02.554838+0000","last_peered":"2023-05-24T03:33:02.554838+0000","last_clean":"2023-05-24T03:33:02.554838+0000","last_became_active":"2023-05-24T03:29:48.523138+0000","last_became_peered":"2023-05-24T03:29:48.523138+0000","last_unstale":"2023-05-24T03:33:02.554838+0000","last_undegraded":"2023-05-24T03:33:02.554838+0000","last_fullsized":"2023-05-24T03:33:02.554838+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'491","last_scrub_stamp":"2023-05-24T03:33:02.554700+0000","last_deep_scrub":"30'491","last_deep_scrub_stamp":"2023-05-24T03:33:02.554700+0000","last_clean_scrub_stamp":"2023-05-24T03:33:02.554700+0000","objects_scrubbed":1,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T03:55:45.649077+0000","scrub_duration":0.0067877040000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"30'12","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:08.888415+0000","last_change":"2023-05-24T03:32:08.888472+0000","last_active":"2023-05-24T03:32:08.888415+0000","last_peered":"2023-05-24T03:32:08.888415+0000","last_clean":"2023-05-24T03:32:08.888415+0000","last_became_active":"2023-05-24T03:29:44.084914+0000","last_became_peered":"2023-05-24T03:29:44.084914+0000","last_unstale":"2023-05-24T03:32:08.888415+0000","last_undegraded":"2023-05-24T03:32:08.888415+0000","last_fullsized":"2023-05-24T03:32:08.888415+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'12","last_scrub_stamp":"2023-05-24T03:32:08.888326+0000","last_deep_scrub":"30'12","last_deep_scrub_stamp":"2023-05-24T03:32:08.888326+0000","last_clean_scrub_stamp":"2023-05-24T03:32:08.888326+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:48:53.009441+0000","scrub_duration":0.0042668330000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:55.898712+0000","last_change":"2023-05-24T03:32:55.898790+0000","last_active":"2023-05-24T03:32:55.898712+0000","last_peered":"2023-05-24T03:32:55.898712+0000","last_clean":"2023-05-24T03:32:55.898712+0000","last_became_active":"2023-05-24T03:29:44.495795+0000","last_became_peered":"2023-05-24T03:29:44.495795+0000","last_unstale":"2023-05-24T03:32:55.898712+0000","last_undegraded":"2023-05-24T03:32:55.898712+0000","last_fullsized":"2023-05-24T03:32:55.898712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-05-24T03:32:55.898602+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-05-24T03:32:55.898602+0000","last_clean_scrub_stamp":"2023-05-24T03:32:55.898602+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:32:13.008398+0000","scrub_duration":0.0019232170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"30'445","reported_seq":472,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:57.290262+0000","last_change":"2023-05-24T03:32:57.290346+0000","last_active":"2023-05-24T03:32:57.290262+0000","last_peered":"2023-05-24T03:32:57.290262+0000","last_clean":"2023-05-24T03:32:57.290262+0000","last_became_active":"2023-05-24T03:29:48.518531+0000","last_became_peered":"2023-05-24T03:29:48.518531+0000","last_unstale":"2023-05-24T03:32:57.290262+0000","last_undegraded":"2023-05-24T03:32:57.290262+0000","last_fullsized":"2023-05-24T03:32:57.290262+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'445","last_scrub_stamp":"2023-05-24T03:32:57.290146+0000","last_deep_scrub":"30'445","last_deep_scrub_stamp":"2023-05-24T03:32:57.290146+0000","last_clean_scrub_stamp":"2023-05-24T03:32:57.290146+0000","objects_scrubbed":3,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:16:13.284763+0000","scrub_duration":0.015334965000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"30'2","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:09.895065+0000","last_change":"2023-05-24T03:32:09.895117+0000","last_active":"2023-05-24T03:32:09.895065+0000","last_peered":"2023-05-24T03:32:09.895065+0000","last_clean":"2023-05-24T03:32:09.895065+0000","last_became_active":"2023-05-24T03:29:44.089340+0000","last_became_peered":"2023-05-24T03:29:44.089340+0000","last_unstale":"2023-05-24T03:32:09.895065+0000","last_undegraded":"2023-05-24T03:32:09.895065+0000","last_fullsized":"2023-05-24T03:32:09.895065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2023-05-24T03:32:09.894975+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2023-05-24T03:32:09.894975+0000","last_clean_scrub_stamp":"2023-05-24T03:32:09.894975+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:10:59.516332+0000","scrub_duration":0.0029320729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"30'29","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:39.378526+0000","last_change":"2023-05-24T03:32:39.378610+0000","last_active":"2023-05-24T03:32:39.378526+0000","last_peered":"2023-05-24T03:32:39.378526+0000","last_clean":"2023-05-24T03:32:39.378526+0000","last_became_active":"2023-05-24T03:29:44.497795+0000","last_became_peered":"2023-05-24T03:29:44.497795+0000","last_unstale":"2023-05-24T03:32:39.378526+0000","last_undegraded":"2023-05-24T03:32:39.378526+0000","last_fullsized":"2023-05-24T03:32:39.378526+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'29","last_scrub_stamp":"2023-05-24T03:32:39.378407+0000","last_deep_scrub":"30'29","last_deep_scrub_stamp":"2023-05-24T03:32:39.378407+0000","last_clean_scrub_stamp":"2023-05-24T03:32:39.378407+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:46:23.503808+0000","scrub_duration":0.0016008050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"30'418","reported_seq":445,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:34.884323+0000","last_change":"2023-05-24T03:32:34.884417+0000","last_active":"2023-05-24T03:32:34.884323+0000","last_peered":"2023-05-24T03:32:34.884323+0000","last_clean":"2023-05-24T03:32:34.884323+0000","last_became_active":"2023-05-24T03:29:48.520899+0000","last_became_peered":"2023-05-24T03:29:48.520899+0000","last_unstale":"2023-05-24T03:32:34.884323+0000","last_undegraded":"2023-05-24T03:32:34.884323+0000","last_fullsized":"2023-05-24T03:32:34.884323+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'418","last_scrub_stamp":"2023-05-24T03:32:34.884196+0000","last_deep_scrub":"30'418","last_deep_scrub_stamp":"2023-05-24T03:32:34.884196+0000","last_clean_scrub_stamp":"2023-05-24T03:32:34.884196+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:27:57.934099+0000","scrub_duration":0.0021898960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"30'3","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:22.959017+0000","last_change":"2023-05-24T03:32:22.959064+0000","last_active":"2023-05-24T03:32:22.959017+0000","last_peered":"2023-05-24T03:32:22.959017+0000","last_clean":"2023-05-24T03:32:22.959017+0000","last_became_active":"2023-05-24T03:29:44.086054+0000","last_became_peered":"2023-05-24T03:29:44.086054+0000","last_unstale":"2023-05-24T03:32:22.959017+0000","last_undegraded":"2023-05-24T03:32:22.959017+0000","last_fullsized":"2023-05-24T03:32:22.959017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2023-05-24T03:32:22.958938+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2023-05-24T03:32:22.958938+0000","last_clean_scrub_stamp":"2023-05-24T03:32:22.958938+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:33:49.647593+0000","scrub_duration":0.0025152360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"30'32","reported_seq":70,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:33:13.378311+0000","last_change":"2023-05-24T03:33:13.378384+0000","last_active":"2023-05-24T03:33:13.378311+0000","last_peered":"2023-05-24T03:33:13.378311+0000","last_clean":"2023-05-24T03:33:13.378311+0000","last_became_active":"2023-05-24T03:30:25.949461+0000","last_became_peered":"2023-05-24T03:30:25.949461+0000","last_unstale":"2023-05-24T03:33:13.378311+0000","last_undegraded":"2023-05-24T03:33:13.378311+0000","last_fullsized":"2023-05-24T03:33:13.378311+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-05-24T03:33:13.378176+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-05-24T03:33:13.378176+0000","last_clean_scrub_stamp":"2023-05-24T03:33:13.378176+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T06:52:14.959819+0000","scrub_duration":0.0014169320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"30'464","reported_seq":491,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:31.887083+0000","last_change":"2023-05-24T03:32:31.887177+0000","last_active":"2023-05-24T03:32:31.887083+0000","last_peered":"2023-05-24T03:32:31.887083+0000","last_clean":"2023-05-24T03:32:31.887083+0000","last_became_active":"2023-05-24T03:29:48.521729+0000","last_became_peered":"2023-05-24T03:29:48.521729+0000","last_unstale":"2023-05-24T03:32:31.887083+0000","last_undegraded":"2023-05-24T03:32:31.887083+0000","last_fullsized":"2023-05-24T03:32:31.887083+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'464","last_scrub_stamp":"2023-05-24T03:32:31.886982+0000","last_deep_scrub":"30'464","last_deep_scrub_stamp":"2023-05-24T03:32:31.886982+0000","last_clean_scrub_stamp":"2023-05-24T03:32:31.886982+0000","objects_scrubbed":2,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:20:01.986028+0000","scrub_duration":0.010190022999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"30'2","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:31.138320+0000","last_change":"2023-05-24T03:32:31.138368+0000","last_active":"2023-05-24T03:32:31.138320+0000","last_peered":"2023-05-24T03:32:31.138320+0000","last_clean":"2023-05-24T03:32:31.138320+0000","last_became_active":"2023-05-24T03:29:44.088459+0000","last_became_peered":"2023-05-24T03:29:44.088459+0000","last_unstale":"2023-05-24T03:32:31.138320+0000","last_undegraded":"2023-05-24T03:32:31.138320+0000","last_fullsized":"2023-05-24T03:32:31.138320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2023-05-24T03:32:31.138230+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2023-05-24T03:32:31.138230+0000","last_clean_scrub_stamp":"2023-05-24T03:32:31.138230+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:30:44.414149+0000","scrub_duration":0.003068529,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:28.882341+0000","last_change":"2023-05-24T03:32:28.882412+0000","last_active":"2023-05-24T03:32:28.882341+0000","last_peered":"2023-05-24T03:32:28.882341+0000","last_clean":"2023-05-24T03:32:28.882341+0000","last_became_active":"2023-05-24T03:29:44.489975+0000","last_became_peered":"2023-05-24T03:29:44.489975+0000","last_unstale":"2023-05-24T03:32:28.882341+0000","last_undegraded":"2023-05-24T03:32:28.882341+0000","last_fullsized":"2023-05-24T03:32:28.882341+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-05-24T03:32:28.882230+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-05-24T03:32:28.882230+0000","last_clean_scrub_stamp":"2023-05-24T03:32:28.882230+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:19:58.981277+0000","scrub_duration":0.001376541,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"30'485","reported_seq":512,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:30.876266+0000","last_change":"2023-05-24T03:32:30.876384+0000","last_active":"2023-05-24T03:32:30.876266+0000","last_peered":"2023-05-24T03:32:30.876266+0000","last_clean":"2023-05-24T03:32:30.876266+0000","last_became_active":"2023-05-24T03:29:48.523545+0000","last_became_peered":"2023-05-24T03:29:48.523545+0000","last_unstale":"2023-05-24T03:32:30.876266+0000","last_undegraded":"2023-05-24T03:32:30.876266+0000","last_fullsized":"2023-05-24T03:32:30.876266+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'485","last_scrub_stamp":"2023-05-24T03:32:30.876160+0000","last_deep_scrub":"30'485","last_deep_scrub_stamp":"2023-05-24T03:32:30.876160+0000","last_clean_scrub_stamp":"2023-05-24T03:32:30.876160+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:59:03.826280+0000","scrub_duration":0.0023153539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"30'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:26.389741+0000","last_change":"2023-05-24T03:32:26.389791+0000","last_active":"2023-05-24T03:32:26.389741+0000","last_peered":"2023-05-24T03:32:26.389741+0000","last_clean":"2023-05-24T03:32:26.389741+0000","last_became_active":"2023-05-24T03:29:44.090887+0000","last_became_peered":"2023-05-24T03:29:44.090887+0000","last_unstale":"2023-05-24T03:32:26.389741+0000","last_undegraded":"2023-05-24T03:32:26.389741+0000","last_fullsized":"2023-05-24T03:32:26.389741+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-05-24T03:32:26.389638+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-05-24T03:32:26.389638+0000","last_clean_scrub_stamp":"2023-05-24T03:32:26.389638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:24:45.305781+0000","scrub_duration":0.0020604579999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:40.371260+0000","last_change":"2023-05-24T03:32:40.371344+0000","last_active":"2023-05-24T03:32:40.371260+0000","last_peered":"2023-05-24T03:32:40.371260+0000","last_clean":"2023-05-24T03:32:40.371260+0000","last_became_active":"2023-05-24T03:29:44.502286+0000","last_became_peered":"2023-05-24T03:29:44.502286+0000","last_unstale":"2023-05-24T03:32:40.371260+0000","last_undegraded":"2023-05-24T03:32:40.371260+0000","last_fullsized":"2023-05-24T03:32:40.371260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-05-24T03:32:40.371157+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-05-24T03:32:40.371157+0000","last_clean_scrub_stamp":"2023-05-24T03:32:40.371157+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:19:00.007869+0000","scrub_duration":0.0014833030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"30'465","reported_seq":492,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:22.800201+0000","last_change":"2023-05-24T03:32:22.800291+0000","last_active":"2023-05-24T03:32:22.800201+0000","last_peered":"2023-05-24T03:32:22.800201+0000","last_clean":"2023-05-24T03:32:22.800201+0000","last_became_active":"2023-05-24T03:29:48.520960+0000","last_became_peered":"2023-05-24T03:29:48.520960+0000","last_unstale":"2023-05-24T03:32:22.800201+0000","last_undegraded":"2023-05-24T03:32:22.800201+0000","last_fullsized":"2023-05-24T03:32:22.800201+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'465","last_scrub_stamp":"2023-05-24T03:32:22.800112+0000","last_deep_scrub":"30'465","last_deep_scrub_stamp":"2023-05-24T03:32:22.800112+0000","last_clean_scrub_stamp":"2023-05-24T03:32:22.800112+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:12:49.176537+0000","scrub_duration":0.002159808,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"30'5","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:27.928743+0000","last_change":"2023-05-24T03:32:27.928811+0000","last_active":"2023-05-24T03:32:27.928743+0000","last_peered":"2023-05-24T03:32:27.928743+0000","last_clean":"2023-05-24T03:32:27.928743+0000","last_became_active":"2023-05-24T03:29:44.087869+0000","last_became_peered":"2023-05-24T03:29:44.087869+0000","last_unstale":"2023-05-24T03:32:27.928743+0000","last_undegraded":"2023-05-24T03:32:27.928743+0000","last_fullsized":"2023-05-24T03:32:27.928743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'5","last_scrub_stamp":"2023-05-24T03:32:27.928612+0000","last_deep_scrub":"30'5","last_deep_scrub_stamp":"2023-05-24T03:32:27.928612+0000","last_clean_scrub_stamp":"2023-05-24T03:32:27.928612+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:29:27.209611+0000","scrub_duration":0.002678092,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"30'27","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:59.343047+0000","last_change":"2023-05-24T03:32:59.343135+0000","last_active":"2023-05-24T03:32:59.343047+0000","last_peered":"2023-05-24T03:32:59.343047+0000","last_clean":"2023-05-24T03:32:59.343047+0000","last_became_active":"2023-05-24T03:29:44.499700+0000","last_became_peered":"2023-05-24T03:29:44.499700+0000","last_unstale":"2023-05-24T03:32:59.343047+0000","last_undegraded":"2023-05-24T03:32:59.343047+0000","last_fullsized":"2023-05-24T03:32:59.343047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'27","last_scrub_stamp":"2023-05-24T03:32:59.342932+0000","last_deep_scrub":"30'27","last_deep_scrub_stamp":"2023-05-24T03:32:59.342932+0000","last_clean_scrub_stamp":"2023-05-24T03:32:59.342932+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:19:54.960700+0000","scrub_duration":0.0020994780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"30'454","reported_seq":481,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:57.068907+0000","last_change":"2023-05-24T03:32:57.068977+0000","last_active":"2023-05-24T03:32:57.068907+0000","last_peered":"2023-05-24T03:32:57.068907+0000","last_clean":"2023-05-24T03:32:57.068907+0000","last_became_active":"2023-05-24T03:29:48.522104+0000","last_became_peered":"2023-05-24T03:29:48.522104+0000","last_unstale":"2023-05-24T03:32:57.068907+0000","last_undegraded":"2023-05-24T03:32:57.068907+0000","last_fullsized":"2023-05-24T03:32:57.068907+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'454","last_scrub_stamp":"2023-05-24T03:32:57.068802+0000","last_deep_scrub":"30'454","last_deep_scrub_stamp":"2023-05-24T03:32:57.068802+0000","last_clean_scrub_stamp":"2023-05-24T03:32:57.068802+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T03:50:28.111321+0000","scrub_duration":0.0022441129999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"30'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:18.901139+0000","last_change":"2023-05-24T03:32:18.901206+0000","last_active":"2023-05-24T03:32:18.901139+0000","last_peered":"2023-05-24T03:32:18.901139+0000","last_clean":"2023-05-24T03:32:18.901139+0000","last_became_active":"2023-05-24T03:29:44.084894+0000","last_became_peered":"2023-05-24T03:29:44.084894+0000","last_unstale":"2023-05-24T03:32:18.901139+0000","last_undegraded":"2023-05-24T03:32:18.901139+0000","last_fullsized":"2023-05-24T03:32:18.901139+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-05-24T03:32:18.900978+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-05-24T03:32:18.900978+0000","last_clean_scrub_stamp":"2023-05-24T03:32:18.900978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:46:00.915679+0000","scrub_duration":0.001606307,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"30'30","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:11.477819+0000","last_change":"2023-05-24T03:32:11.477870+0000","last_active":"2023-05-24T03:32:11.477819+0000","last_peered":"2023-05-24T03:32:11.477819+0000","last_clean":"2023-05-24T03:32:11.477819+0000","last_became_active":"2023-05-24T03:29:44.492462+0000","last_became_peered":"2023-05-24T03:29:44.492462+0000","last_unstale":"2023-05-24T03:32:11.477819+0000","last_undegraded":"2023-05-24T03:32:11.477819+0000","last_fullsized":"2023-05-24T03:32:11.477819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2023-05-24T03:32:11.477715+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2023-05-24T03:32:11.477715+0000","last_clean_scrub_stamp":"2023-05-24T03:32:11.477715+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:30:24.753635+0000","scrub_duration":0.0019852670000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'486","reported_seq":513,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:56.607482+0000","last_change":"2023-05-24T03:32:56.607555+0000","last_active":"2023-05-24T03:32:56.607482+0000","last_peered":"2023-05-24T03:32:56.607482+0000","last_clean":"2023-05-24T03:32:56.607482+0000","last_became_active":"2023-05-24T03:29:48.524023+0000","last_became_peered":"2023-05-24T03:29:48.524023+0000","last_unstale":"2023-05-24T03:32:56.607482+0000","last_undegraded":"2023-05-24T03:32:56.607482+0000","last_fullsized":"2023-05-24T03:32:56.607482+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'486","last_scrub_stamp":"2023-05-24T03:32:56.607382+0000","last_deep_scrub":"30'486","last_deep_scrub_stamp":"2023-05-24T03:32:56.607382+0000","last_clean_scrub_stamp":"2023-05-24T03:32:56.607382+0000","objects_scrubbed":1,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:32:13.717179+0000","scrub_duration":0.0065709569999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:45.324390+0000","last_change":"2023-05-24T03:32:45.324439+0000","last_active":"2023-05-24T03:32:45.324390+0000","last_peered":"2023-05-24T03:32:45.324390+0000","last_clean":"2023-05-24T03:32:45.324390+0000","last_became_active":"2023-05-24T03:29:44.082382+0000","last_became_peered":"2023-05-24T03:29:44.082382+0000","last_unstale":"2023-05-24T03:32:45.324390+0000","last_undegraded":"2023-05-24T03:32:45.324390+0000","last_fullsized":"2023-05-24T03:32:45.324390+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:45.324292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:45.324292+0000","last_clean_scrub_stamp":"2023-05-24T03:32:45.324292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:24:28.461427+0000","scrub_duration":0.001657642,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"30'17","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:57.379468+0000","last_change":"2023-05-24T03:32:57.379518+0000","last_active":"2023-05-24T03:32:57.379468+0000","last_peered":"2023-05-24T03:32:57.379468+0000","last_clean":"2023-05-24T03:32:57.379468+0000","last_became_active":"2023-05-24T03:29:44.501080+0000","last_became_peered":"2023-05-24T03:29:44.501080+0000","last_unstale":"2023-05-24T03:32:57.379468+0000","last_undegraded":"2023-05-24T03:32:57.379468+0000","last_fullsized":"2023-05-24T03:32:57.379468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'17","last_scrub_stamp":"2023-05-24T03:32:57.379374+0000","last_deep_scrub":"30'17","last_deep_scrub_stamp":"2023-05-24T03:32:57.379374+0000","last_clean_scrub_stamp":"2023-05-24T03:32:57.379374+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:01:46.374511+0000","scrub_duration":0.0013134970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"30'494","reported_seq":521,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:33:09.285368+0000","last_change":"2023-05-24T03:33:09.285479+0000","last_active":"2023-05-24T03:33:09.285368+0000","last_peered":"2023-05-24T03:33:09.285368+0000","last_clean":"2023-05-24T03:33:09.285368+0000","last_became_active":"2023-05-24T03:29:48.519046+0000","last_became_peered":"2023-05-24T03:29:48.519046+0000","last_unstale":"2023-05-24T03:33:09.285368+0000","last_undegraded":"2023-05-24T03:33:09.285368+0000","last_fullsized":"2023-05-24T03:33:09.285368+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'494","last_scrub_stamp":"2023-05-24T03:33:09.285246+0000","last_deep_scrub":"30'494","last_deep_scrub_stamp":"2023-05-24T03:33:09.285246+0000","last_clean_scrub_stamp":"2023-05-24T03:33:09.285246+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:00:26.480943+0000","scrub_duration":0.0022600110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:23.923628+0000","last_change":"2023-05-24T03:32:23.923670+0000","last_active":"2023-05-24T03:32:23.923628+0000","last_peered":"2023-05-24T03:32:23.923628+0000","last_clean":"2023-05-24T03:32:23.923628+0000","last_became_active":"2023-05-24T03:29:44.085420+0000","last_became_peered":"2023-05-24T03:29:44.085420+0000","last_unstale":"2023-05-24T03:32:23.923628+0000","last_undegraded":"2023-05-24T03:32:23.923628+0000","last_fullsized":"2023-05-24T03:32:23.923628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:23.923533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:23.923533+0000","last_clean_scrub_stamp":"2023-05-24T03:32:23.923533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:07:31.781443+0000","scrub_duration":0.0013943619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"30'28","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:41.934540+0000","last_change":"2023-05-24T03:32:41.934595+0000","last_active":"2023-05-24T03:32:41.934540+0000","last_peered":"2023-05-24T03:32:41.934540+0000","last_clean":"2023-05-24T03:32:41.934540+0000","last_became_active":"2023-05-24T03:29:44.491089+0000","last_became_peered":"2023-05-24T03:29:44.491089+0000","last_unstale":"2023-05-24T03:32:41.934540+0000","last_undegraded":"2023-05-24T03:32:41.934540+0000","last_fullsized":"2023-05-24T03:32:41.934540+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'28","last_scrub_stamp":"2023-05-24T03:32:41.934431+0000","last_deep_scrub":"30'28","last_deep_scrub_stamp":"2023-05-24T03:32:41.934431+0000","last_clean_scrub_stamp":"2023-05-24T03:32:41.934431+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:30:38.542441+0000","scrub_duration":0.0018100130000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"30'503","reported_seq":530,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:56.571681+0000","last_change":"2023-05-24T03:32:56.571744+0000","last_active":"2023-05-24T03:32:56.571681+0000","last_peered":"2023-05-24T03:32:56.571681+0000","last_clean":"2023-05-24T03:32:56.571681+0000","last_became_active":"2023-05-24T03:29:48.529157+0000","last_became_peered":"2023-05-24T03:29:48.529157+0000","last_unstale":"2023-05-24T03:32:56.571681+0000","last_undegraded":"2023-05-24T03:32:56.571681+0000","last_fullsized":"2023-05-24T03:32:56.571681+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'503","last_scrub_stamp":"2023-05-24T03:32:56.571583+0000","last_deep_scrub":"30'503","last_deep_scrub_stamp":"2023-05-24T03:32:56.571583+0000","last_clean_scrub_stamp":"2023-05-24T03:32:56.571583+0000","objects_scrubbed":0,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T03:50:27.614103+0000","scrub_duration":0.0021946100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:16.946886+0000","last_change":"2023-05-24T03:32:16.946931+0000","last_active":"2023-05-24T03:32:16.946886+0000","last_peered":"2023-05-24T03:32:16.946886+0000","last_clean":"2023-05-24T03:32:16.946886+0000","last_became_active":"2023-05-24T03:29:39.142867+0000","last_became_peered":"2023-05-24T03:29:39.142867+0000","last_unstale":"2023-05-24T03:32:16.946886+0000","last_undegraded":"2023-05-24T03:32:16.946886+0000","last_fullsized":"2023-05-24T03:32:16.946886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:16.946787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:16.946787+0000","last_clean_scrub_stamp":"2023-05-24T03:32:16.946787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:05:40.162544+0000","scrub_duration":0.0014754880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"30'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:24.411219+0000","last_change":"2023-05-24T03:32:24.411266+0000","last_active":"2023-05-24T03:32:24.411219+0000","last_peered":"2023-05-24T03:32:24.411219+0000","last_clean":"2023-05-24T03:32:24.411219+0000","last_became_active":"2023-05-24T03:29:44.087475+0000","last_became_peered":"2023-05-24T03:29:44.087475+0000","last_unstale":"2023-05-24T03:32:24.411219+0000","last_undegraded":"2023-05-24T03:32:24.411219+0000","last_fullsized":"2023-05-24T03:32:24.411219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-05-24T03:32:24.411126+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-05-24T03:32:24.411126+0000","last_clean_scrub_stamp":"2023-05-24T03:32:24.411126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:07:32.269036+0000","scrub_duration":0.0017507200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"30'30","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:30.858330+0000","last_change":"2023-05-24T03:32:30.858385+0000","last_active":"2023-05-24T03:32:30.858330+0000","last_peered":"2023-05-24T03:32:30.858330+0000","last_clean":"2023-05-24T03:32:30.858330+0000","last_became_active":"2023-05-24T03:29:44.497015+0000","last_became_peered":"2023-05-24T03:29:44.497015+0000","last_unstale":"2023-05-24T03:32:30.858330+0000","last_undegraded":"2023-05-24T03:32:30.858330+0000","last_fullsized":"2023-05-24T03:32:30.858330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2023-05-24T03:32:30.858227+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2023-05-24T03:32:30.858227+0000","last_clean_scrub_stamp":"2023-05-24T03:32:30.858227+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:07:38.716137+0000","scrub_duration":0.0018578329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"30'446","reported_seq":473,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:33:01.537248+0000","last_change":"2023-05-24T03:33:01.537349+0000","last_active":"2023-05-24T03:33:01.537248+0000","last_peered":"2023-05-24T03:33:01.537248+0000","last_clean":"2023-05-24T03:33:01.537248+0000","last_became_active":"2023-05-24T03:29:48.527010+0000","last_became_peered":"2023-05-24T03:29:48.527010+0000","last_unstale":"2023-05-24T03:33:01.537248+0000","last_undegraded":"2023-05-24T03:33:01.537248+0000","last_fullsized":"2023-05-24T03:33:01.537248+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'446","last_scrub_stamp":"2023-05-24T03:33:01.537087+0000","last_deep_scrub":"30'446","last_deep_scrub_stamp":"2023-05-24T03:33:01.537087+0000","last_clean_scrub_stamp":"2023-05-24T03:33:01.537087+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:32:18.646883+0000","scrub_duration":0.002541892,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:16.419663+0000","last_change":"2023-05-24T03:32:16.419711+0000","last_active":"2023-05-24T03:32:16.419663+0000","last_peered":"2023-05-24T03:32:16.419663+0000","last_clean":"2023-05-24T03:32:16.419663+0000","last_became_active":"2023-05-24T03:29:39.048141+0000","last_became_peered":"2023-05-24T03:29:39.048141+0000","last_unstale":"2023-05-24T03:32:16.419663+0000","last_undegraded":"2023-05-24T03:32:16.419663+0000","last_fullsized":"2023-05-24T03:32:16.419663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:16.419576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:16.419576+0000","last_clean_scrub_stamp":"2023-05-24T03:32:16.419576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:04:44.737412+0000","scrub_duration":0.0017607219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:38.260499+0000","last_change":"2023-05-24T03:32:38.260565+0000","last_active":"2023-05-24T03:32:38.260499+0000","last_peered":"2023-05-24T03:32:38.260499+0000","last_clean":"2023-05-24T03:32:38.260499+0000","last_became_active":"2023-05-24T03:29:44.084944+0000","last_became_peered":"2023-05-24T03:29:44.084944+0000","last_unstale":"2023-05-24T03:32:38.260499+0000","last_undegraded":"2023-05-24T03:32:38.260499+0000","last_fullsized":"2023-05-24T03:32:38.260499+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:38.260355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:38.260355+0000","last_clean_scrub_stamp":"2023-05-24T03:32:38.260355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:15:54.254973+0000","scrub_duration":0.0018685679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"30'30","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:34.920933+0000","last_change":"2023-05-24T03:32:34.920980+0000","last_active":"2023-05-24T03:32:34.920933+0000","last_peered":"2023-05-24T03:32:34.920933+0000","last_clean":"2023-05-24T03:32:34.920933+0000","last_became_active":"2023-05-24T03:29:44.483134+0000","last_became_peered":"2023-05-24T03:29:44.483134+0000","last_unstale":"2023-05-24T03:32:34.920933+0000","last_undegraded":"2023-05-24T03:32:34.920933+0000","last_fullsized":"2023-05-24T03:32:34.920933+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2023-05-24T03:32:34.920849+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2023-05-24T03:32:34.920849+0000","last_clean_scrub_stamp":"2023-05-24T03:32:34.920849+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:12:03.303951+0000","scrub_duration":0.0012902980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'483","reported_seq":510,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:23.782504+0000","last_change":"2023-05-24T03:32:23.782578+0000","last_active":"2023-05-24T03:32:23.782504+0000","last_peered":"2023-05-24T03:32:23.782504+0000","last_clean":"2023-05-24T03:32:23.782504+0000","last_became_active":"2023-05-24T03:29:48.518546+0000","last_became_peered":"2023-05-24T03:29:48.518546+0000","last_unstale":"2023-05-24T03:32:23.782504+0000","last_undegraded":"2023-05-24T03:32:23.782504+0000","last_fullsized":"2023-05-24T03:32:23.782504+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'483","last_scrub_stamp":"2023-05-24T03:32:23.782396+0000","last_deep_scrub":"30'483","last_deep_scrub_stamp":"2023-05-24T03:32:23.782396+0000","last_clean_scrub_stamp":"2023-05-24T03:32:23.782396+0000","objects_scrubbed":2,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:25:09.865806+0000","scrub_duration":0.0096269460000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:07.643826+0000","last_change":"2023-05-24T03:32:07.643860+0000","last_active":"2023-05-24T03:32:07.643826+0000","last_peered":"2023-05-24T03:32:07.643826+0000","last_clean":"2023-05-24T03:32:07.643826+0000","last_became_active":"2023-05-24T03:29:39.310070+0000","last_became_peered":"2023-05-24T03:29:39.310070+0000","last_unstale":"2023-05-24T03:32:07.643826+0000","last_undegraded":"2023-05-24T03:32:07.643826+0000","last_fullsized":"2023-05-24T03:32:07.643826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:07.643745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:07.643745+0000","last_clean_scrub_stamp":"2023-05-24T03:32:07.643745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T05:58:52.005449+0000","scrub_duration":0.0012050990000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:19.948337+0000","last_change":"2023-05-24T03:32:19.948384+0000","last_active":"2023-05-24T03:32:19.948337+0000","last_peered":"2023-05-24T03:32:19.948337+0000","last_clean":"2023-05-24T03:32:19.948337+0000","last_became_active":"2023-05-24T03:29:44.074551+0000","last_became_peered":"2023-05-24T03:29:44.074551+0000","last_unstale":"2023-05-24T03:32:19.948337+0000","last_undegraded":"2023-05-24T03:32:19.948337+0000","last_fullsized":"2023-05-24T03:32:19.948337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:19.948200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:19.948200+0000","last_clean_scrub_stamp":"2023-05-24T03:32:19.948200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:36:52.581352+0000","scrub_duration":0.0016279319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"30'29","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:31.862975+0000","last_change":"2023-05-24T03:32:31.863048+0000","last_active":"2023-05-24T03:32:31.862975+0000","last_peered":"2023-05-24T03:32:31.862975+0000","last_clean":"2023-05-24T03:32:31.862975+0000","last_became_active":"2023-05-24T03:29:44.496030+0000","last_became_peered":"2023-05-24T03:29:44.496030+0000","last_unstale":"2023-05-24T03:32:31.862975+0000","last_undegraded":"2023-05-24T03:32:31.862975+0000","last_fullsized":"2023-05-24T03:32:31.862975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'29","last_scrub_stamp":"2023-05-24T03:32:31.862868+0000","last_deep_scrub":"30'29","last_deep_scrub_stamp":"2023-05-24T03:32:31.862868+0000","last_clean_scrub_stamp":"2023-05-24T03:32:31.862868+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:30:45.138787+0000","scrub_duration":0.0022191820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"30'473","reported_seq":500,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:53.298330+0000","last_change":"2023-05-24T03:32:53.298410+0000","last_active":"2023-05-24T03:32:53.298330+0000","last_peered":"2023-05-24T03:32:53.298330+0000","last_clean":"2023-05-24T03:32:53.298330+0000","last_became_active":"2023-05-24T03:29:48.523380+0000","last_became_peered":"2023-05-24T03:29:48.523380+0000","last_unstale":"2023-05-24T03:32:53.298330+0000","last_undegraded":"2023-05-24T03:32:53.298330+0000","last_fullsized":"2023-05-24T03:32:53.298330+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'473","last_scrub_stamp":"2023-05-24T03:32:53.298210+0000","last_deep_scrub":"30'473","last_deep_scrub_stamp":"2023-05-24T03:32:53.298210+0000","last_clean_scrub_stamp":"2023-05-24T03:32:53.298210+0000","objects_scrubbed":1,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:42:10.042215+0000","scrub_duration":0.0061571220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:22.404970+0000","last_change":"2023-05-24T03:32:22.405017+0000","last_active":"2023-05-24T03:32:22.404970+0000","last_peered":"2023-05-24T03:32:22.404970+0000","last_clean":"2023-05-24T03:32:22.404970+0000","last_became_active":"2023-05-24T03:29:39.050751+0000","last_became_peered":"2023-05-24T03:29:39.050751+0000","last_unstale":"2023-05-24T03:32:22.404970+0000","last_undegraded":"2023-05-24T03:32:22.404970+0000","last_fullsized":"2023-05-24T03:32:22.404970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:22.404884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:22.404884+0000","last_clean_scrub_stamp":"2023-05-24T03:32:22.404884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:59:23.041380+0000","scrub_duration":0.001963167,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"30'119","reported_seq":199,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:13.842759+0000","last_change":"2023-05-24T03:32:13.842821+0000","last_active":"2023-05-24T03:32:13.842759+0000","last_peered":"2023-05-24T03:32:13.842759+0000","last_clean":"2023-05-24T03:32:13.842759+0000","last_became_active":"2023-05-24T03:29:34.024728+0000","last_became_peered":"2023-05-24T03:29:34.024728+0000","last_unstale":"2023-05-24T03:32:13.842759+0000","last_undegraded":"2023-05-24T03:32:13.842759+0000","last_fullsized":"2023-05-24T03:32:13.842759+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'119","last_scrub_stamp":"2023-05-24T03:32:13.842676+0000","last_deep_scrub":"30'119","last_deep_scrub_stamp":"2023-05-24T03:32:13.842676+0000","last_clean_scrub_stamp":"2023-05-24T03:32:13.842676+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:42:28.083910+0000","scrub_duration":0.0058238170000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:22.880053+0000","last_change":"2023-05-24T03:32:22.880113+0000","last_active":"2023-05-24T03:32:22.880053+0000","last_peered":"2023-05-24T03:32:22.880053+0000","last_clean":"2023-05-24T03:32:22.880053+0000","last_became_active":"2023-05-24T03:29:44.086125+0000","last_became_peered":"2023-05-24T03:29:44.086125+0000","last_unstale":"2023-05-24T03:32:22.880053+0000","last_undegraded":"2023-05-24T03:32:22.880053+0000","last_fullsized":"2023-05-24T03:32:22.880053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:22.879929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:22.879929+0000","last_clean_scrub_stamp":"2023-05-24T03:32:22.879929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:00:18.800309+0000","scrub_duration":0.002203432,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:20.988892+0000","last_change":"2023-05-24T03:32:20.988943+0000","last_active":"2023-05-24T03:32:20.988892+0000","last_peered":"2023-05-24T03:32:20.988892+0000","last_clean":"2023-05-24T03:32:20.988892+0000","last_became_active":"2023-05-24T03:29:44.492375+0000","last_became_peered":"2023-05-24T03:29:44.492375+0000","last_unstale":"2023-05-24T03:32:20.988892+0000","last_undegraded":"2023-05-24T03:32:20.988892+0000","last_fullsized":"2023-05-24T03:32:20.988892+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-05-24T03:32:20.988784+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-05-24T03:32:20.988784+0000","last_clean_scrub_stamp":"2023-05-24T03:32:20.988784+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:25:07.072195+0000","scrub_duration":0.001550034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"30'444","reported_seq":471,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:59.649307+0000","last_change":"2023-05-24T03:32:59.649372+0000","last_active":"2023-05-24T03:32:59.649307+0000","last_peered":"2023-05-24T03:32:59.649307+0000","last_clean":"2023-05-24T03:32:59.649307+0000","last_became_active":"2023-05-24T03:29:48.524615+0000","last_became_peered":"2023-05-24T03:29:48.524615+0000","last_unstale":"2023-05-24T03:32:59.649307+0000","last_undegraded":"2023-05-24T03:32:59.649307+0000","last_fullsized":"2023-05-24T03:32:59.649307+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'444","last_scrub_stamp":"2023-05-24T03:32:59.649200+0000","last_deep_scrub":"30'444","last_deep_scrub_stamp":"2023-05-24T03:32:59.649200+0000","last_clean_scrub_stamp":"2023-05-24T03:32:59.649200+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:24:42.786335+0000","scrub_duration":0.002191438,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:14.823133+0000","last_change":"2023-05-24T03:32:14.823177+0000","last_active":"2023-05-24T03:32:14.823133+0000","last_peered":"2023-05-24T03:32:14.823133+0000","last_clean":"2023-05-24T03:32:14.823133+0000","last_became_active":"2023-05-24T03:29:39.053813+0000","last_became_peered":"2023-05-24T03:29:39.053813+0000","last_unstale":"2023-05-24T03:32:14.823133+0000","last_undegraded":"2023-05-24T03:32:14.823133+0000","last_fullsized":"2023-05-24T03:32:14.823133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:14.823047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:14.823047+0000","last_clean_scrub_stamp":"2023-05-24T03:32:14.823047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:39:26.760598+0000","scrub_duration":0.0020759749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"30'16","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:28.422974+0000","last_change":"2023-05-24T03:32:28.423022+0000","last_active":"2023-05-24T03:32:28.422974+0000","last_peered":"2023-05-24T03:32:28.422974+0000","last_clean":"2023-05-24T03:32:28.422974+0000","last_became_active":"2023-05-24T03:29:44.089943+0000","last_became_peered":"2023-05-24T03:29:44.089943+0000","last_unstale":"2023-05-24T03:32:28.422974+0000","last_undegraded":"2023-05-24T03:32:28.422974+0000","last_fullsized":"2023-05-24T03:32:28.422974+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'16","last_scrub_stamp":"2023-05-24T03:32:28.422880+0000","last_deep_scrub":"30'16","last_deep_scrub_stamp":"2023-05-24T03:32:28.422880+0000","last_clean_scrub_stamp":"2023-05-24T03:32:28.422880+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:00:24.343260+0000","scrub_duration":0.0023423319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7752,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":19,"num_write":15,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"30'28","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:31.390565+0000","last_change":"2023-05-24T03:32:31.390638+0000","last_active":"2023-05-24T03:32:31.390565+0000","last_peered":"2023-05-24T03:32:31.390565+0000","last_clean":"2023-05-24T03:32:31.390565+0000","last_became_active":"2023-05-24T03:29:44.498130+0000","last_became_peered":"2023-05-24T03:29:44.498130+0000","last_unstale":"2023-05-24T03:32:31.390565+0000","last_undegraded":"2023-05-24T03:32:31.390565+0000","last_fullsized":"2023-05-24T03:32:31.390565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'28","last_scrub_stamp":"2023-05-24T03:32:31.390463+0000","last_deep_scrub":"30'28","last_deep_scrub_stamp":"2023-05-24T03:32:31.390463+0000","last_clean_scrub_stamp":"2023-05-24T03:32:31.390463+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:24:50.306607+0000","scrub_duration":0.001403886,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"30'496","reported_seq":523,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:42.905980+0000","last_change":"2023-05-24T03:32:42.906088+0000","last_active":"2023-05-24T03:32:42.905980+0000","last_peered":"2023-05-24T03:32:42.905980+0000","last_clean":"2023-05-24T03:32:42.905980+0000","last_became_active":"2023-05-24T03:29:48.519673+0000","last_became_peered":"2023-05-24T03:29:48.519673+0000","last_unstale":"2023-05-24T03:32:42.905980+0000","last_undegraded":"2023-05-24T03:32:42.905980+0000","last_fullsized":"2023-05-24T03:32:42.905980+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'496","last_scrub_stamp":"2023-05-24T03:32:42.905857+0000","last_deep_scrub":"30'496","last_deep_scrub_stamp":"2023-05-24T03:32:42.905857+0000","last_clean_scrub_stamp":"2023-05-24T03:32:42.905857+0000","objects_scrubbed":2,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:06:06.121614+0000","scrub_duration":0.0097576420000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:16.859220+0000","last_change":"2023-05-24T03:32:16.859267+0000","last_active":"2023-05-24T03:32:16.859220+0000","last_peered":"2023-05-24T03:32:16.859220+0000","last_clean":"2023-05-24T03:32:16.859220+0000","last_became_active":"2023-05-24T03:29:39.142949+0000","last_became_peered":"2023-05-24T03:29:39.142949+0000","last_unstale":"2023-05-24T03:32:16.859220+0000","last_undegraded":"2023-05-24T03:32:16.859220+0000","last_fullsized":"2023-05-24T03:32:16.859220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:16.859110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:16.859110+0000","last_clean_scrub_stamp":"2023-05-24T03:32:16.859110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T09:36:49.492263+0000","scrub_duration":0.0019863950000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"30'2","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:25.922071+0000","last_change":"2023-05-24T03:32:25.922120+0000","last_active":"2023-05-24T03:32:25.922071+0000","last_peered":"2023-05-24T03:32:25.922071+0000","last_clean":"2023-05-24T03:32:25.922071+0000","last_became_active":"2023-05-24T03:29:44.074374+0000","last_became_peered":"2023-05-24T03:29:44.074374+0000","last_unstale":"2023-05-24T03:32:25.922071+0000","last_undegraded":"2023-05-24T03:32:25.922071+0000","last_fullsized":"2023-05-24T03:32:25.922071+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2023-05-24T03:32:25.921971+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2023-05-24T03:32:25.921971+0000","last_clean_scrub_stamp":"2023-05-24T03:32:25.921971+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:33:52.610626+0000","scrub_duration":0.001416947,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"30'34","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:33.381296+0000","last_change":"2023-05-24T03:32:33.381351+0000","last_active":"2023-05-24T03:32:33.381296+0000","last_peered":"2023-05-24T03:32:33.381296+0000","last_clean":"2023-05-24T03:32:33.381296+0000","last_became_active":"2023-05-24T03:29:44.499768+0000","last_became_peered":"2023-05-24T03:29:44.499768+0000","last_unstale":"2023-05-24T03:32:33.381296+0000","last_undegraded":"2023-05-24T03:32:33.381296+0000","last_fullsized":"2023-05-24T03:32:33.381296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'34","last_scrub_stamp":"2023-05-24T03:32:33.381196+0000","last_deep_scrub":"30'34","last_deep_scrub_stamp":"2023-05-24T03:32:33.381196+0000","last_clean_scrub_stamp":"2023-05-24T03:32:33.381196+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:29:32.662195+0000","scrub_duration":0.00213657,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"30'483","reported_seq":510,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:33:06.244057+0000","last_change":"2023-05-24T03:33:06.244122+0000","last_active":"2023-05-24T03:33:06.244057+0000","last_peered":"2023-05-24T03:33:06.244057+0000","last_clean":"2023-05-24T03:33:06.244057+0000","last_became_active":"2023-05-24T03:29:48.530401+0000","last_became_peered":"2023-05-24T03:29:48.530401+0000","last_unstale":"2023-05-24T03:33:06.244057+0000","last_undegraded":"2023-05-24T03:33:06.244057+0000","last_fullsized":"2023-05-24T03:33:06.244057+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'483","last_scrub_stamp":"2023-05-24T03:33:06.243957+0000","last_deep_scrub":"30'483","last_deep_scrub_stamp":"2023-05-24T03:33:06.243957+0000","last_clean_scrub_stamp":"2023-05-24T03:33:06.243957+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:27:00.104082+0000","scrub_duration":0.0026812899999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"30'4","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:25.935295+0000","last_change":"2023-05-24T03:32:25.935385+0000","last_active":"2023-05-24T03:32:25.935295+0000","last_peered":"2023-05-24T03:32:25.935295+0000","last_clean":"2023-05-24T03:32:25.935295+0000","last_became_active":"2023-05-24T03:29:44.083929+0000","last_became_peered":"2023-05-24T03:29:44.083929+0000","last_unstale":"2023-05-24T03:32:25.935295+0000","last_undegraded":"2023-05-24T03:32:25.935295+0000","last_fullsized":"2023-05-24T03:32:25.935295+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2023-05-24T03:32:25.935195+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2023-05-24T03:32:25.935195+0000","last_clean_scrub_stamp":"2023-05-24T03:32:25.935195+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:24:44.851338+0000","scrub_duration":0.0036091059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:17.913709+0000","last_change":"2023-05-24T03:32:17.913792+0000","last_active":"2023-05-24T03:32:17.913709+0000","last_peered":"2023-05-24T03:32:17.913709+0000","last_clean":"2023-05-24T03:32:17.913709+0000","last_became_active":"2023-05-24T03:29:39.045543+0000","last_became_peered":"2023-05-24T03:29:39.045543+0000","last_unstale":"2023-05-24T03:32:17.913709+0000","last_undegraded":"2023-05-24T03:32:17.913709+0000","last_fullsized":"2023-05-24T03:32:17.913709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:17.913581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:17.913581+0000","last_clean_scrub_stamp":"2023-05-24T03:32:17.913581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:39:29.851131+0000","scrub_duration":0.0019810409999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"30'25","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:47.882602+0000","last_change":"2023-05-24T03:32:47.882652+0000","last_active":"2023-05-24T03:32:47.882602+0000","last_peered":"2023-05-24T03:32:47.882602+0000","last_clean":"2023-05-24T03:32:47.882602+0000","last_became_active":"2023-05-24T03:29:44.495816+0000","last_became_peered":"2023-05-24T03:29:44.495816+0000","last_unstale":"2023-05-24T03:32:47.882602+0000","last_undegraded":"2023-05-24T03:32:47.882602+0000","last_fullsized":"2023-05-24T03:32:47.882602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'25","last_scrub_stamp":"2023-05-24T03:32:47.882509+0000","last_deep_scrub":"30'25","last_deep_scrub_stamp":"2023-05-24T03:32:47.882509+0000","last_clean_scrub_stamp":"2023-05-24T03:32:47.882509+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:42:04.626514+0000","scrub_duration":0.002051588,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"30'447","reported_seq":474,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:58.922521+0000","last_change":"2023-05-24T03:32:58.922602+0000","last_active":"2023-05-24T03:32:58.922521+0000","last_peered":"2023-05-24T03:32:58.922521+0000","last_clean":"2023-05-24T03:32:58.922521+0000","last_became_active":"2023-05-24T03:29:48.527196+0000","last_became_peered":"2023-05-24T03:29:48.527196+0000","last_unstale":"2023-05-24T03:32:58.922521+0000","last_undegraded":"2023-05-24T03:32:58.922521+0000","last_fullsized":"2023-05-24T03:32:58.922521+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'447","last_scrub_stamp":"2023-05-24T03:32:58.922404+0000","last_deep_scrub":"30'447","last_deep_scrub_stamp":"2023-05-24T03:32:58.922404+0000","last_clean_scrub_stamp":"2023-05-24T03:32:58.922404+0000","objects_scrubbed":2,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:24:42.059539+0000","scrub_duration":0.010453692000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:07.895608+0000","last_change":"2023-05-24T03:32:07.895654+0000","last_active":"2023-05-24T03:32:07.895608+0000","last_peered":"2023-05-24T03:32:07.895608+0000","last_clean":"2023-05-24T03:32:07.895608+0000","last_became_active":"2023-05-24T03:29:39.046149+0000","last_became_peered":"2023-05-24T03:29:39.046149+0000","last_unstale":"2023-05-24T03:32:07.895608+0000","last_undegraded":"2023-05-24T03:32:07.895608+0000","last_fullsized":"2023-05-24T03:32:07.895608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-24T03:32:07.895507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-24T03:32:07.895507+0000","last_clean_scrub_stamp":"2023-05-24T03:32:07.895507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:19:25.177961+0000","scrub_duration":0.0013301140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"30'12","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:22.444476+0000","last_change":"2023-05-24T03:32:22.444544+0000","last_active":"2023-05-24T03:32:22.444476+0000","last_peered":"2023-05-24T03:32:22.444476+0000","last_clean":"2023-05-24T03:32:22.444476+0000","last_became_active":"2023-05-24T03:29:44.088495+0000","last_became_peered":"2023-05-24T03:29:44.088495+0000","last_unstale":"2023-05-24T03:32:22.444476+0000","last_undegraded":"2023-05-24T03:32:22.444476+0000","last_fullsized":"2023-05-24T03:32:22.444476+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'12","last_scrub_stamp":"2023-05-24T03:32:22.444366+0000","last_deep_scrub":"30'12","last_deep_scrub_stamp":"2023-05-24T03:32:22.444366+0000","last_clean_scrub_stamp":"2023-05-24T03:32:22.444366+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:33:49.133021+0000","scrub_duration":0.0019648030000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"30'21","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:33.402605+0000","last_change":"2023-05-24T03:32:33.402683+0000","last_active":"2023-05-24T03:32:33.402605+0000","last_peered":"2023-05-24T03:32:33.402605+0000","last_clean":"2023-05-24T03:32:33.402605+0000","last_became_active":"2023-05-24T03:29:44.496597+0000","last_became_peered":"2023-05-24T03:29:44.496597+0000","last_unstale":"2023-05-24T03:32:33.402605+0000","last_undegraded":"2023-05-24T03:32:33.402605+0000","last_fullsized":"2023-05-24T03:32:33.402605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'21","last_scrub_stamp":"2023-05-24T03:32:33.402506+0000","last_deep_scrub":"30'21","last_deep_scrub_stamp":"2023-05-24T03:32:33.402506+0000","last_clean_scrub_stamp":"2023-05-24T03:32:33.402506+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T14:41:50.146511+0000","scrub_duration":0.001534435,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"30'469","reported_seq":496,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:58.068864+0000","last_change":"2023-05-24T03:32:58.068954+0000","last_active":"2023-05-24T03:32:58.068864+0000","last_peered":"2023-05-24T03:32:58.068864+0000","last_clean":"2023-05-24T03:32:58.068864+0000","last_became_active":"2023-05-24T03:29:48.524170+0000","last_became_peered":"2023-05-24T03:29:48.524170+0000","last_unstale":"2023-05-24T03:32:58.068864+0000","last_undegraded":"2023-05-24T03:32:58.068864+0000","last_fullsized":"2023-05-24T03:32:58.068864+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'469","last_scrub_stamp":"2023-05-24T03:32:58.068759+0000","last_deep_scrub":"30'469","last_deep_scrub_stamp":"2023-05-24T03:32:58.068759+0000","last_clean_scrub_stamp":"2023-05-24T03:32:58.068759+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:36:48.747989+0000","scrub_duration":0.0019696819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:27.411055+0000","last_change":"2023-05-24T03:32:27.411131+0000","last_active":"2023-05-24T03:32:27.411055+0000","last_peered":"2023-05-24T03:32:27.411055+0000","last_clean":"2023-05-24T03:32:27.411055+0000","last_became_active":"2023-05-24T03:29:44.089993+0000","last_became_peered":"2023-05-24T03:29:44.089993+0000","last_unstale":"2023-05-24T03:32:27.411055+0000","last_undegraded":"2023-05-24T03:32:27.411055+0000","last_fullsized":"2023-05-24T03:32:27.411055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-05-24T03:32:27.410947+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-05-24T03:32:27.410947+0000","last_clean_scrub_stamp":"2023-05-24T03:32:27.410947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:59:28.047443+0000","scrub_duration":0.001931365,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:11.669985+0000","last_change":"2023-05-24T03:32:11.669985+0000","last_active":"2023-05-24T03:32:11.669985+0000","last_peered":"2023-05-24T03:32:11.669985+0000","last_clean":"2023-05-24T03:32:11.669985+0000","last_became_active":"2023-05-24T03:29:44.481655+0000","last_became_peered":"2023-05-24T03:29:44.481655+0000","last_unstale":"2023-05-24T03:32:11.669985+0000","last_undegraded":"2023-05-24T03:32:11.669985+0000","last_fullsized":"2023-05-24T03:32:11.669985+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-05-24T03:32:11.669801+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-05-24T03:32:11.669801+0000","last_clean_scrub_stamp":"2023-05-24T03:32:11.669801+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T13:19:28.952256+0000","scrub_duration":0.0015085610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"30'475","reported_seq":502,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:56.271520+0000","last_change":"2023-05-24T03:32:56.271624+0000","last_active":"2023-05-24T03:32:56.271520+0000","last_peered":"2023-05-24T03:32:56.271520+0000","last_clean":"2023-05-24T03:32:56.271520+0000","last_became_active":"2023-05-24T03:29:48.516366+0000","last_became_peered":"2023-05-24T03:29:48.516366+0000","last_unstale":"2023-05-24T03:32:56.271520+0000","last_undegraded":"2023-05-24T03:32:56.271520+0000","last_fullsized":"2023-05-24T03:32:56.271520+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'475","last_scrub_stamp":"2023-05-24T03:32:56.271385+0000","last_deep_scrub":"30'475","last_deep_scrub_stamp":"2023-05-24T03:32:56.271385+0000","last_clean_scrub_stamp":"2023-05-24T03:32:56.271385+0000","objects_scrubbed":1,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T03:50:27.313904+0000","scrub_duration":0.0075476670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"30'3","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:36.384834+0000","last_change":"2023-05-24T03:32:36.384884+0000","last_active":"2023-05-24T03:32:36.384834+0000","last_peered":"2023-05-24T03:32:36.384834+0000","last_clean":"2023-05-24T03:32:36.384834+0000","last_became_active":"2023-05-24T03:29:44.093909+0000","last_became_peered":"2023-05-24T03:29:44.093909+0000","last_unstale":"2023-05-24T03:32:36.384834+0000","last_undegraded":"2023-05-24T03:32:36.384834+0000","last_fullsized":"2023-05-24T03:32:36.384834+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2023-05-24T03:32:36.384751+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2023-05-24T03:32:36.384751+0000","last_clean_scrub_stamp":"2023-05-24T03:32:36.384751+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:18:56.021462+0000","scrub_duration":0.0025716570000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"30'24","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:07.504564+0000","last_change":"2023-05-24T03:32:07.504564+0000","last_active":"2023-05-24T03:32:07.504564+0000","last_peered":"2023-05-24T03:32:07.504564+0000","last_clean":"2023-05-24T03:32:07.504564+0000","last_became_active":"2023-05-24T03:29:44.496679+0000","last_became_peered":"2023-05-24T03:29:44.496679+0000","last_unstale":"2023-05-24T03:32:07.504564+0000","last_undegraded":"2023-05-24T03:32:07.504564+0000","last_fullsized":"2023-05-24T03:32:07.504564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2023-05-24T03:32:07.504421+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2023-05-24T03:32:07.504421+0000","last_clean_scrub_stamp":"2023-05-24T03:32:07.504421+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:39:43.529482+0000","scrub_duration":0.001971338,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"30'459","reported_seq":486,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:52.481655+0000","last_change":"2023-05-24T03:32:52.481725+0000","last_active":"2023-05-24T03:32:52.481655+0000","last_peered":"2023-05-24T03:32:52.481655+0000","last_clean":"2023-05-24T03:32:52.481655+0000","last_became_active":"2023-05-24T03:29:48.528862+0000","last_became_peered":"2023-05-24T03:29:48.528862+0000","last_unstale":"2023-05-24T03:32:52.481655+0000","last_undegraded":"2023-05-24T03:32:52.481655+0000","last_fullsized":"2023-05-24T03:32:52.481655+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'459","last_scrub_stamp":"2023-05-24T03:32:52.481549+0000","last_deep_scrub":"30'459","last_deep_scrub_stamp":"2023-05-24T03:32:52.481549+0000","last_clean_scrub_stamp":"2023-05-24T03:32:52.481549+0000","objects_scrubbed":1,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:16:08.476167+0000","scrub_duration":0.0069357050000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"30'4","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:23.397701+0000","last_change":"2023-05-24T03:32:23.397749+0000","last_active":"2023-05-24T03:32:23.397701+0000","last_peered":"2023-05-24T03:32:23.397701+0000","last_clean":"2023-05-24T03:32:23.397701+0000","last_became_active":"2023-05-24T03:29:44.089949+0000","last_became_peered":"2023-05-24T03:29:44.089949+0000","last_unstale":"2023-05-24T03:32:23.397701+0000","last_undegraded":"2023-05-24T03:32:23.397701+0000","last_fullsized":"2023-05-24T03:32:23.397701+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2023-05-24T03:32:23.397608+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2023-05-24T03:32:23.397608+0000","last_clean_scrub_stamp":"2023-05-24T03:32:23.397608+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:00:19.317988+0000","scrub_duration":0.002711855,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'23","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:33:04.259375+0000","last_change":"2023-05-24T03:33:04.259429+0000","last_active":"2023-05-24T03:33:04.259375+0000","last_peered":"2023-05-24T03:33:04.259375+0000","last_clean":"2023-05-24T03:33:04.259375+0000","last_became_active":"2023-05-24T03:29:44.498350+0000","last_became_peered":"2023-05-24T03:29:44.498350+0000","last_unstale":"2023-05-24T03:33:04.259375+0000","last_undegraded":"2023-05-24T03:33:04.259375+0000","last_fullsized":"2023-05-24T03:33:04.259375+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'23","last_scrub_stamp":"2023-05-24T03:33:04.259273+0000","last_deep_scrub":"30'23","last_deep_scrub_stamp":"2023-05-24T03:33:04.259273+0000","last_clean_scrub_stamp":"2023-05-24T03:33:04.259273+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:53:26.285046+0000","scrub_duration":0.002170314,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"30'482","reported_seq":509,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:33:08.287123+0000","last_change":"2023-05-24T03:33:08.287191+0000","last_active":"2023-05-24T03:33:08.287123+0000","last_peered":"2023-05-24T03:33:08.287123+0000","last_clean":"2023-05-24T03:33:08.287123+0000","last_became_active":"2023-05-24T03:29:48.522228+0000","last_became_peered":"2023-05-24T03:29:48.522228+0000","last_unstale":"2023-05-24T03:33:08.287123+0000","last_undegraded":"2023-05-24T03:33:08.287123+0000","last_fullsized":"2023-05-24T03:33:08.287123+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'482","last_scrub_stamp":"2023-05-24T03:33:08.287017+0000","last_deep_scrub":"30'482","last_deep_scrub_stamp":"2023-05-24T03:33:08.287017+0000","last_clean_scrub_stamp":"2023-05-24T03:33:08.287017+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:31:16.691181+0000","scrub_duration":0.0021879009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:34.938357+0000","last_change":"2023-05-24T03:32:34.938407+0000","last_active":"2023-05-24T03:32:34.938357+0000","last_peered":"2023-05-24T03:32:34.938357+0000","last_clean":"2023-05-24T03:32:34.938357+0000","last_became_active":"2023-05-24T03:29:44.082903+0000","last_became_peered":"2023-05-24T03:29:44.082903+0000","last_unstale":"2023-05-24T03:32:34.938357+0000","last_undegraded":"2023-05-24T03:32:34.938357+0000","last_fullsized":"2023-05-24T03:32:34.938357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-05-24T03:32:34.938251+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-05-24T03:32:34.938251+0000","last_clean_scrub_stamp":"2023-05-24T03:32:34.938251+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:18:54.574963+0000","scrub_duration":0.0018086580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:16.902284+0000","last_change":"2023-05-24T03:32:16.902340+0000","last_active":"2023-05-24T03:32:16.902284+0000","last_peered":"2023-05-24T03:32:16.902284+0000","last_clean":"2023-05-24T03:32:16.902284+0000","last_became_active":"2023-05-24T03:29:44.487925+0000","last_became_peered":"2023-05-24T03:29:44.487925+0000","last_unstale":"2023-05-24T03:32:16.902284+0000","last_undegraded":"2023-05-24T03:32:16.902284+0000","last_fullsized":"2023-05-24T03:32:16.902284+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-05-24T03:32:16.902188+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-05-24T03:32:16.902188+0000","last_clean_scrub_stamp":"2023-05-24T03:32:16.902188+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:04:45.220024+0000","scrub_duration":0.0014004639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"30'490","reported_seq":517,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:48.035103+0000","last_change":"2023-05-24T03:32:48.035172+0000","last_active":"2023-05-24T03:32:48.035103+0000","last_peered":"2023-05-24T03:32:48.035103+0000","last_clean":"2023-05-24T03:32:48.035103+0000","last_became_active":"2023-05-24T03:29:48.519517+0000","last_became_peered":"2023-05-24T03:29:48.519517+0000","last_unstale":"2023-05-24T03:32:48.035103+0000","last_undegraded":"2023-05-24T03:32:48.035103+0000","last_fullsized":"2023-05-24T03:32:48.035103+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'490","last_scrub_stamp":"2023-05-24T03:32:48.034993+0000","last_deep_scrub":"30'490","last_deep_scrub_stamp":"2023-05-24T03:32:48.034993+0000","last_clean_scrub_stamp":"2023-05-24T03:32:48.034993+0000","objects_scrubbed":2,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T07:58:07.686612+0000","scrub_duration":0.0095380369999999992,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"30'7","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:14.413355+0000","last_change":"2023-05-24T03:32:14.413441+0000","last_active":"2023-05-24T03:32:14.413355+0000","last_peered":"2023-05-24T03:32:14.413355+0000","last_clean":"2023-05-24T03:32:14.413355+0000","last_became_active":"2023-05-24T03:29:44.087891+0000","last_became_peered":"2023-05-24T03:29:44.087891+0000","last_unstale":"2023-05-24T03:32:14.413355+0000","last_undegraded":"2023-05-24T03:32:14.413355+0000","last_fullsized":"2023-05-24T03:32:14.413355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'7","last_scrub_stamp":"2023-05-24T03:32:14.413253+0000","last_deep_scrub":"30'7","last_deep_scrub_stamp":"2023-05-24T03:32:14.413253+0000","last_clean_scrub_stamp":"2023-05-24T03:32:14.413253+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T08:39:26.350804+0000","scrub_duration":0.0039696540000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"30'42","reported_seq":75,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:49.303943+0000","last_change":"2023-05-24T03:32:49.304023+0000","last_active":"2023-05-24T03:32:49.303943+0000","last_peered":"2023-05-24T03:32:49.303943+0000","last_clean":"2023-05-24T03:32:49.303943+0000","last_became_active":"2023-05-24T03:29:44.492923+0000","last_became_peered":"2023-05-24T03:29:44.492923+0000","last_unstale":"2023-05-24T03:32:49.303943+0000","last_undegraded":"2023-05-24T03:32:49.303943+0000","last_fullsized":"2023-05-24T03:32:49.303943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'42","last_scrub_stamp":"2023-05-24T03:32:49.303828+0000","last_deep_scrub":"30'42","last_deep_scrub_stamp":"2023-05-24T03:32:49.303828+0000","last_clean_scrub_stamp":"2023-05-24T03:32:49.303828+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T15:04:49.142230+0000","scrub_duration":0.0017584,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"30'50","reported_seq":83,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:33.769592+0000","last_change":"2023-05-24T03:32:33.769638+0000","last_active":"2023-05-24T03:32:33.769592+0000","last_peered":"2023-05-24T03:32:33.769592+0000","last_clean":"2023-05-24T03:32:33.769592+0000","last_became_active":"2023-05-24T03:29:44.483898+0000","last_became_peered":"2023-05-24T03:29:44.483898+0000","last_unstale":"2023-05-24T03:32:33.769592+0000","last_undegraded":"2023-05-24T03:32:33.769592+0000","last_fullsized":"2023-05-24T03:32:33.769592+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'50","last_scrub_stamp":"2023-05-24T03:32:33.769507+0000","last_deep_scrub":"30'50","last_deep_scrub_stamp":"2023-05-24T03:32:33.769507+0000","last_clean_scrub_stamp":"2023-05-24T03:32:33.769507+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T04:17:31.325426+0000","scrub_duration":0.0019421810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"30'46","reported_seq":79,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:51.879016+0000","last_change":"2023-05-24T03:32:51.879082+0000","last_active":"2023-05-24T03:32:51.879016+0000","last_peered":"2023-05-24T03:32:51.879016+0000","last_clean":"2023-05-24T03:32:51.879016+0000","last_became_active":"2023-05-24T03:29:44.494073+0000","last_became_peered":"2023-05-24T03:29:44.494073+0000","last_unstale":"2023-05-24T03:32:51.879016+0000","last_undegraded":"2023-05-24T03:32:51.879016+0000","last_fullsized":"2023-05-24T03:32:51.879016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'46","last_scrub_stamp":"2023-05-24T03:32:51.878878+0000","last_deep_scrub":"30'46","last_deep_scrub_stamp":"2023-05-24T03:32:51.878878+0000","last_clean_scrub_stamp":"2023-05-24T03:32:51.878878+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T12:16:07.873495+0000","scrub_duration":0.00149986,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"30'34","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:22.339321+0000","last_change":"2023-05-24T03:32:22.339366+0000","last_active":"2023-05-24T03:32:22.339321+0000","last_peered":"2023-05-24T03:32:22.339321+0000","last_clean":"2023-05-24T03:32:22.339321+0000","last_became_active":"2023-05-24T03:29:44.497832+0000","last_became_peered":"2023-05-24T03:29:44.497832+0000","last_unstale":"2023-05-24T03:32:22.339321+0000","last_undegraded":"2023-05-24T03:32:22.339321+0000","last_fullsized":"2023-05-24T03:32:22.339321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'34","last_scrub_stamp":"2023-05-24T03:32:22.339204+0000","last_deep_scrub":"30'34","last_deep_scrub_stamp":"2023-05-24T03:32:22.339204+0000","last_clean_scrub_stamp":"2023-05-24T03:32:22.339204+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T10:45:42.612392+0000","scrub_duration":0.0015569990000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"30'31","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:50.926941+0000","last_change":"2023-05-24T03:32:50.926988+0000","last_active":"2023-05-24T03:32:50.926941+0000","last_peered":"2023-05-24T03:32:50.926941+0000","last_clean":"2023-05-24T03:32:50.926941+0000","last_became_active":"2023-05-24T03:29:44.496197+0000","last_became_peered":"2023-05-24T03:29:44.496197+0000","last_unstale":"2023-05-24T03:32:50.926941+0000","last_undegraded":"2023-05-24T03:32:50.926941+0000","last_fullsized":"2023-05-24T03:32:50.926941+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'31","last_scrub_stamp":"2023-05-24T03:32:50.926840+0000","last_deep_scrub":"30'31","last_deep_scrub_stamp":"2023-05-24T03:32:50.926840+0000","last_clean_scrub_stamp":"2023-05-24T03:32:50.926840+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T03:50:21.969359+0000","scrub_duration":0.0021052290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"30'32","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-05-24T03:32:29.880244+0000","last_change":"2023-05-24T03:32:29.880296+0000","last_active":"2023-05-24T03:32:29.880244+0000","last_peered":"2023-05-24T03:32:29.880244+0000","last_clean":"2023-05-24T03:32:29.880244+0000","last_became_active":"2023-05-24T03:29:44.494928+0000","last_became_peered":"2023-05-24T03:29:44.494928+0000","last_unstale":"2023-05-24T03:32:29.880244+0000","last_undegraded":"2023-05-24T03:32:29.880244+0000","last_fullsized":"2023-05-24T03:32:29.880244+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'32","last_scrub_stamp":"2023-05-24T03:32:29.880155+0000","last_deep_scrub":"30'32","last_deep_scrub_stamp":"2023-05-24T03:32:29.880155+0000","last_clean_scrub_stamp":"2023-05-24T03:32:29.880155+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-25T11:00:25.800535+0000","scrub_duration":0.001768146,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":552,"num_write_kb":1154048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":201326592,"data_stored":201326592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14950,"ondisk_log_size":14950,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2060,"ondisk_log_size":2060,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1553284,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":15,"num_read_kb":19,"num_write":484,"num_write_kb":1824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3162112,"data_stored":3106568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":501,"ondisk_log_size":501,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68296,"kb_used_data":33152,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94303544,"statfs":{"total":96636764160,"available":96566829056,"internally_reserved":0,"allocated":33947648,"data_stored":33731444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:32:40 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":1.3500000000000001,"15min":0.78000000000000003},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.66800000000000004,"5min":14.757999999999999,"15min":14.757999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.52000000000000002,"5min":1.6639999999999999,"15min":0.89700000000000002},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.69699999999999995,"5min":17.954000000000001,"15min":17.954000000000001},"last":0.66200000000000003}]},{"osd":1,"last update":"Wed May 24 03:32:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":1.379,"15min":0.79800000000000004},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73799999999999999,"5min":16.939,"15min":16.939},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.53500000000000003,"5min":1.766,"15min":0.94499999999999995},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.65200000000000002,"5min":17.981999999999999,"15min":17.981999999999999},"last":0.622}]},{"osd":2,"last update":"Wed May 24 03:32:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":1.6519999999999999,"15min":0.89400000000000002},"min":{"1min":0.34300000000000003,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.292,"5min":14.720000000000001,"15min":14.720000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":1.5489999999999999,"15min":0.87},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.76100000000000001,"5min":14.814,"15min":14.814},"last":0.73599999999999999}]},{"osd":3,"last update":"Wed May 24 03:32:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":1.7110000000000001,"15min":0.93899999999999995},"min":{"1min":0.39400000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.67700000000000005,"5min":22.977,"15min":22.977},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":1.383,"15min":0.81899999999999995},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.79500000000000004,"5min":14.836,"15min":14.836},"last":0.78000000000000003}]},{"osd":4,"last update":"Wed May 24 03:32:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":1.343,"15min":0.76100000000000001},"min":{"1min":0.27400000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.69899999999999995,"5min":18.027000000000001,"15min":18.027000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.49099999999999999,"5min":1.073,"15min":0.69699999999999995},"min":{"1min":0.33700000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.68600000000000005,"5min":22.922000000000001,"15min":22.922000000000001},"last":0.58699999999999997}]},{"osd":5,"last update":"Wed May 24 03:32:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":1.151,"15min":0.76300000000000001},"min":{"1min":0.32800000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.71699999999999997,"5min":17.925999999999998,"15min":17.925999999999998},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":1.2010000000000001,"15min":0.77400000000000002},"min":{"1min":0.40300000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.748,"5min":18.004999999999999,"15min":18.004999999999999},"last":0.70999999999999996}]},{"osd":6,"last update":"Wed May 24 03:32:40 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":1.5549999999999999,"15min":0.90100000000000002},"min":{"1min":0.42499999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.753,"5min":23.933,"15min":23.933},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":1.5249999999999999,"15min":0.90300000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.73199999999999998,"5min":22.954000000000001,"15min":22.954000000000001},"last":0.67400000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574899,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48968,"kb_used_data":26944,"kb_used_omap":0,"kb_used_meta":22016,"kb_avail":94322872,"statfs":{"total":96636764160,"available":96586620928,"internally_reserved":0,"allocated":27590656,"data_stored":27401822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22544384},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:32:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":2.3769999999999998,"15min":1.427},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.68899999999999995,"5min":22.922999999999998,"15min":22.922999999999998},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":1.9330000000000001,"15min":1.0229999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.71099999999999997,"5min":28.870000000000001,"15min":28.870000000000001},"last":0.64800000000000002}]},{"osd":1,"last update":"Wed May 24 03:32:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":2.2149999999999999,"15min":1.409},"min":{"1min":0.35899999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.71999999999999997,"5min":22.984999999999999,"15min":22.984999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.54100000000000004,"5min":2.0009999999999999,"15min":1.327},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.78800000000000003,"5min":21.984999999999999,"15min":21.984999999999999},"last":0.747}]},{"osd":2,"last update":"Wed May 24 03:32:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":1.599,"15min":0.92500000000000004},"min":{"1min":0.36299999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.323,"5min":22.649999999999999,"15min":22.649999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":2.2269999999999999,"15min":1.4139999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.89500000000000002,"5min":23.035,"15min":23.035},"last":0.624}]},{"osd":3,"last update":"Wed May 24 03:32:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":1.8169999999999999,"15min":1.0589999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.248,"5min":18.056000000000001,"15min":18.056000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.59999999999999998,"5min":1.7609999999999999,"15min":1.0309999999999999},"min":{"1min":0.40799999999999997,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.2809999999999999,"5min":19.963999999999999,"15min":19.963999999999999},"last":0.69899999999999995}]},{"osd":4,"last update":"Wed May 24 03:32:38 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":1.55,"15min":0.86599999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":7.29,"5min":18.056000000000001,"15min":18.056000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.87,"5min":1.5369999999999999,"15min":0.88600000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":7.5090000000000003,"5min":21.943999999999999,"15min":21.943999999999999},"last":0.51600000000000001}]},{"osd":5,"last update":"Wed May 24 03:32:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":1.381,"15min":0.82099999999999995},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.347,"5min":11.976000000000001,"15min":11.976000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":1.8939999999999999,"15min":1.0529999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.749,"5min":23.010999999999999,"15min":23.010999999999999},"last":0.58799999999999997}]},{"osd":7,"last update":"Wed May 24 03:32:38 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":1.655,"15min":0.94799999999999995},"min":{"1min":0.432,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.393,"5min":11.989000000000001,"15min":11.989000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":1.53,"15min":0.92400000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.381,"5min":21.042000000000002,"15min":21.042000000000002},"last":0.57499999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53896,"kb_used_data":22848,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94317944,"statfs":{"total":96636764160,"available":96581574656,"internally_reserved":0,"allocated":23396352,"data_stored":23207518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":1.448,"15min":0.76900000000000002},"min":{"1min":0.23499999999999999,"5min":0.223,"15min":0.223},"max":{"1min":1.7130000000000001,"5min":18.954000000000001,"15min":18.954000000000001},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.35399999999999998,"5min":1.784,"15min":1.016},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.52400000000000002,"5min":21.981999999999999,"15min":21.981999999999999},"last":0.34300000000000003}]},{"osd":2,"last update":"Wed May 24 03:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":1.157,"15min":0.63500000000000001},"min":{"1min":0.246,"5min":0.221,"15min":0.221},"max":{"1min":1.198,"5min":15.004,"15min":15.004},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.44900000000000001,"5min":1.5669999999999999,"15min":0.82599999999999996},"min":{"1min":0.26800000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.75,"5min":21.885000000000002,"15min":21.885000000000002},"last":0.372}]},{"osd":3,"last update":"Wed May 24 03:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":1.3089999999999999,"15min":0.77100000000000002},"min":{"1min":0.32700000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.147,"5min":18.167000000000002,"15min":18.167000000000002},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.42199999999999999,"5min":1.0900000000000001,"15min":0.64000000000000001},"min":{"1min":0.29399999999999998,"5min":0.254,"15min":0.254},"max":{"1min":0.83799999999999997,"5min":11.935,"15min":11.935},"last":0.41599999999999998}]},{"osd":4,"last update":"Wed May 24 03:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":1.9359999999999999,"15min":1.022},"min":{"1min":0.435,"5min":0.316,"15min":0.316},"max":{"1min":1.0740000000000001,"5min":28.891999999999999,"15min":28.891999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.60199999999999998,"5min":2.0369999999999999,"15min":1.105},"min":{"1min":0.39900000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.177,"5min":21.954999999999998,"15min":21.954999999999998},"last":0.45700000000000002}]},{"osd":5,"last update":"Wed May 24 03:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":2.306,"15min":1.218},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.97799999999999998,"5min":21.928000000000001,"15min":21.928000000000001},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":2.069,"15min":1.135},"min":{"1min":0.42299999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.1020000000000001,"5min":19.757999999999999,"15min":19.757999999999999},"last":0.63400000000000001}]},{"osd":6,"last update":"Wed May 24 03:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":1.9059999999999999,"15min":1.0580000000000001},"min":{"1min":0.48999999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.93999999999999995,"5min":22.033999999999999,"15min":22.033999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.65900000000000003,"5min":2.0419999999999998,"15min":1.095},"min":{"1min":0.40699999999999997,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.1599999999999999,"5min":19.734999999999999,"15min":19.734999999999999},"last":0.60199999999999998}]},{"osd":7,"last update":"Wed May 24 03:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":2.2010000000000001,"15min":1.212},"min":{"1min":0.46100000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.2370000000000001,"5min":21.994,"15min":21.994},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.624,"5min":2.101,"15min":1.1419999999999999},"min":{"1min":0.47299999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.91100000000000003,"5min":21.957999999999998,"15min":21.957999999999998},"last":0.57899999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574899,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54488,"kb_used_data":23440,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94317352,"statfs":{"total":96636764160,"available":96580968448,"internally_reserved":0,"allocated":24002560,"data_stored":23806220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 24 03:32:40 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":1.538,"15min":0.77200000000000002},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":10.919,"5min":21.216000000000001,"15min":21.216000000000001},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":1.7230000000000001,"15min":0.82699999999999996},"min":{"1min":0.22800000000000001,"5min":0.185,"15min":0.185},"max":{"1min":3.0640000000000001,"5min":29.925000000000001,"15min":29.925000000000001},"last":0.41699999999999998}]},{"osd":2,"last update":"Wed May 24 03:32:40 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":1.5109999999999999,"15min":0.76800000000000002},"min":{"1min":0.29299999999999998,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":10.958,"5min":19.018999999999998,"15min":19.018999999999998},"last":0.313},{"interface":"front","average":{"1min":0.53200000000000003,"5min":1.8839999999999999,"15min":0.90600000000000003},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":3.032,"5min":21.945,"15min":21.945},"last":0.36499999999999999}]},{"osd":3,"last update":"Wed May 24 03:32:40 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.633,"15min":0.82799999999999996},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":18.431999999999999,"5min":25.381,"15min":25.381},"last":0.436},{"interface":"front","average":{"1min":1.373,"5min":2.1949999999999998,"15min":1.042},"min":{"1min":0.32400000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":19.251999999999999,"5min":21.209,"15min":21.209},"last":0.47299999999999998}]},{"osd":4,"last update":"Wed May 24 03:32:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":2.238,"15min":1.1879999999999999},"min":{"1min":0.41299999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":8.2309999999999999,"5min":22.030000000000001,"15min":22.030000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.97399999999999998,"5min":2.1789999999999998,"15min":1.1559999999999999},"min":{"1min":0.42899999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":7.2549999999999999,"5min":25.279,"15min":25.279},"last":0.60499999999999998}]},{"osd":5,"last update":"Wed May 24 03:32:40 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":1.96,"15min":1.101},"min":{"1min":0.41399999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.94799999999999995,"5min":25.329999999999998,"15min":25.329999999999998},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.746,"5min":2.0310000000000001,"15min":1.109},"min":{"1min":0.45300000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":2.2309999999999999,"5min":28.928000000000001,"15min":28.928000000000001},"last":0.626}]},{"osd":6,"last update":"Wed May 24 03:32:40 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":1.903,"15min":1.052},"min":{"1min":0.437,"5min":0.37,"15min":0.37},"max":{"1min":2.2709999999999999,"5min":21.132000000000001,"15min":21.132000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.75800000000000001,"5min":2.0840000000000001,"15min":1.103},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":3.0899999999999999,"5min":22.007000000000001,"15min":22.007000000000001},"last":0.55500000000000005}]},{"osd":7,"last update":"Wed May 24 03:32:40 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":2.3929999999999998,"15min":1.218},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":2.9710000000000001,"5min":21.983000000000001,"15min":21.983000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.626,"5min":1.931,"15min":1.079},"min":{"1min":0.44,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.93200000000000005,"5min":25.356000000000002,"15min":25.356000000000002},"last":0.53200000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46920,"kb_used_data":24896,"kb_used_omap":0,"kb_used_meta":22016,"kb_avail":94324920,"statfs":{"total":96636764160,"available":96588718080,"internally_reserved":0,"allocated":25493504,"data_stored":25304670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22544384},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.84399999999999997,"15min":0.51200000000000001},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.96199999999999997,"5min":10.821999999999999,"15min":10.821999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.379,"5min":0.93400000000000005,"15min":0.65200000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.56599999999999995,"5min":11.743,"15min":11.743},"last":0.33100000000000002}]},{"osd":1,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.81999999999999995,"15min":0.53000000000000003},"min":{"1min":0.27800000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.524,"5min":12.079000000000001,"15min":12.079000000000001},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.377,"5min":1.2,"15min":0.76400000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.55200000000000005,"5min":19.954000000000001,"15min":19.954000000000001},"last":0.41999999999999998}]},{"osd":3,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":1.204,"15min":0.65400000000000003},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.44,"5min":21.611000000000001,"15min":21.611000000000001},"last":0.373},{"interface":"front","average":{"1min":0.46400000000000002,"5min":1.04,"15min":0.63400000000000001},"min":{"1min":0.29099999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.90700000000000003,"5min":21.055,"15min":21.055},"last":0.39700000000000002}]},{"osd":4,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":1.4630000000000001,"15min":0.90200000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.4830000000000001,"5min":16.657,"15min":16.657},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":1.3979999999999999,"15min":0.96199999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85599999999999998,"5min":17.116,"15min":17.116},"last":0.57199999999999995}]},{"osd":5,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":1.5980000000000001,"15min":0.93799999999999994},"min":{"1min":0.34599999999999997,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.82799999999999996,"5min":21.655000000000001,"15min":21.655000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":1.2889999999999999,"15min":0.86299999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.93799999999999994,"5min":14.045999999999999,"15min":14.045999999999999},"last":0.58599999999999997}]},{"osd":6,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":1.556,"15min":1.038},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.78500000000000003,"5min":20.966999999999999,"15min":20.966999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":1.278,"15min":0.83999999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.83399999999999996,"5min":15.119,"15min":15.119},"last":0.61199999999999999}]},{"osd":7,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":1.649,"15min":1.079},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.089,"5min":17.035,"15min":17.035},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":1.5009999999999999,"15min":0.91200000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0680000000000001,"5min":18.611999999999998,"15min":18.611999999999998},"last":0.53900000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574898,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42828,"kb_used_data":20804,"kb_used_omap":0,"kb_used_meta":22016,"kb_avail":94329012,"statfs":{"total":96636764160,"available":96592908288,"internally_reserved":0,"allocated":21303296,"data_stored":21110456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22544384},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:32:39 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":1.6200000000000001,"15min":1.169},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":1.3080000000000001,"5min":22.969000000000001,"15min":22.969000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":1.3660000000000001,"15min":1.0469999999999999},"min":{"1min":0.24399999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.1579999999999999,"5min":15.933999999999999,"15min":15.933999999999999},"last":0.40999999999999998}]},{"osd":1,"last update":"Wed May 24 03:32:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":1.2090000000000001,"15min":0.90400000000000003},"min":{"1min":0.29499999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":2.266,"5min":19.882000000000001,"15min":19.882000000000001},"last":0.376},{"interface":"front","average":{"1min":0.41899999999999998,"5min":1.056,"15min":0.63400000000000001},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.71199999999999997,"5min":18.792000000000002,"15min":18.792000000000002},"last":0.31}]},{"osd":2,"last update":"Wed May 24 03:32:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":1.732,"15min":1.093},"min":{"1min":0.318,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":3.161,"5min":22.922999999999998,"15min":22.922999999999998},"last":0.433},{"interface":"front","average":{"1min":0.45700000000000002,"5min":2.0739999999999998,"15min":2.0379999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.038,"5min":22.919,"15min":22.919},"last":0.35799999999999998}]},{"osd":4,"last update":"Wed May 24 03:32:39 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":1.526,"15min":0.92800000000000005},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":3.2200000000000002,"5min":18.952000000000002,"15min":18.952000000000002},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.77100000000000002,"5min":2.0179999999999998,"15min":1.3080000000000001},"min":{"1min":0.38400000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":4.5220000000000002,"5min":24.933,"15min":24.933},"last":0.64800000000000002}]},{"osd":5,"last update":"Wed May 24 03:32:39 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":1.9199999999999999,"15min":1.4079999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.2629999999999999,"5min":20.056000000000001,"15min":20.056000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":1.5600000000000001,"15min":0.93799999999999994},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.877,"5min":16.013000000000002,"15min":16.013000000000002},"last":0.73499999999999999}]},{"osd":6,"last update":"Wed May 24 03:32:39 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":1.605,"15min":1.1990000000000001},"min":{"1min":0.45600000000000002,"5min":0.379,"15min":0.379},"max":{"1min":1.016,"5min":13.986000000000001,"15min":13.986000000000001},"last":0.623},{"interface":"front","average":{"1min":0.67000000000000004,"5min":1.8260000000000001,"15min":1.3799999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.3360000000000001,"5min":20.088000000000001,"15min":20.088000000000001},"last":0.71599999999999997}]},{"osd":7,"last update":"Wed May 24 03:32:39 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":1.681,"15min":0.99299999999999999},"min":{"1min":0.39900000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":3.181,"5min":21.571000000000002,"15min":21.571000000000002},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":1.661,"15min":1.2230000000000001},"min":{"1min":0.44400000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0860000000000001,"5min":13.922000000000001,"15min":13.922000000000001},"last":0.58799999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61572,"kb_used_data":26428,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94310268,"statfs":{"total":96636764160,"available":96573714432,"internally_reserved":0,"allocated":27062272,"data_stored":26857212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":1.667,"15min":0.88400000000000001},"min":{"1min":0.31900000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.78500000000000003,"5min":17.794,"15min":17.794},"last":0.624},{"interface":"front","average":{"1min":0.55500000000000005,"5min":1.4570000000000001,"15min":0.82399999999999995},"min":{"1min":0.38200000000000001,"5min":0.375,"15min":0.375},"max":{"1min":1.214,"5min":16.597999999999999,"15min":16.597999999999999},"last":0.64400000000000002}]},{"osd":1,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":1.6759999999999999,"15min":0.90100000000000002},"min":{"1min":0.42399999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.002,"5min":22.933,"15min":22.933},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":1.446,"15min":0.83799999999999997},"min":{"1min":0.33600000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.73899999999999999,"5min":16.196000000000002,"15min":16.196000000000002},"last":0.65700000000000003}]},{"osd":2,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":1.4219999999999999,"15min":0.81599999999999995},"min":{"1min":0.40899999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.94799999999999995,"5min":18.919,"15min":18.919},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.51900000000000002,"5min":1.4970000000000001,"15min":0.84899999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.77200000000000002,"5min":16.277999999999999,"15min":16.277999999999999},"last":0.56899999999999995}]},{"osd":3,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":1.351,"15min":0.77500000000000002},"min":{"1min":0.43099999999999999,"5min":0.312,"15min":0.312},"max":{"1min":2.383,"5min":18.956,"15min":18.956},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.57899999999999996,"5min":1.659,"15min":0.91400000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0649999999999999,"5min":22.960000000000001,"15min":22.960000000000001},"last":0.63500000000000001}]},{"osd":5,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":1.208,"15min":0.754},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.69199999999999995,"5min":16.231999999999999,"15min":16.231999999999999},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":1.0900000000000001,"15min":0.749},"min":{"1min":0.33100000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.91000000000000003,"5min":11.904999999999999,"15min":11.904999999999999},"last":0.42599999999999999}]},{"osd":6,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":1.4990000000000001,"15min":0.82999999999999996},"min":{"1min":0.34200000000000003,"5min":0.315,"15min":0.315},"max":{"1min":1.0329999999999999,"5min":22.983000000000001,"15min":22.983000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.497,"5min":1.097,"15min":0.74099999999999999},"min":{"1min":0.31,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.79300000000000004,"5min":12.367000000000001,"15min":12.367000000000001},"last":0.38400000000000001}]},{"osd":7,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":1.083,"15min":0.73099999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.97699999999999998,"5min":16.576000000000001,"15min":16.576000000000001},"last":0.499},{"interface":"front","average":{"1min":0.60499999999999998,"5min":1.583,"15min":0.92700000000000005},"min":{"1min":0.38100000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.0900000000000001,"5min":22.882000000000001,"15min":22.882000000000001},"last":0.53300000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574898,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46928,"kb_used_data":24904,"kb_used_omap":0,"kb_used_meta":22016,"kb_avail":94324912,"statfs":{"total":96636764160,"available":96588709888,"internally_reserved":0,"allocated":25501696,"data_stored":25305322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22544384},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":1.8300000000000001,"15min":0.95599999999999996},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.93999999999999995,"5min":20.137,"15min":20.137},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":1.865,"15min":1.1040000000000001},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.76400000000000001,"5min":25.988,"15min":25.988},"last":0.46400000000000002}]},{"osd":1,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":1.7390000000000001,"15min":0.94099999999999995},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.71699999999999997,"5min":22.765999999999998,"15min":22.765999999999998},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.53500000000000003,"5min":2.0009999999999999,"15min":1.167},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.72999999999999998,"5min":20.161999999999999,"15min":20.161999999999999},"last":0.70399999999999996}]},{"osd":2,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":1.923,"15min":1.0009999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.73799999999999999,"5min":25.946000000000002,"15min":25.946000000000002},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":1.7090000000000001,"15min":1.0860000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.0469999999999999,"5min":22.800000000000001,"15min":22.800000000000001},"last":0.64400000000000002}]},{"osd":3,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":1.8560000000000001,"15min":1.1919999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":2.0990000000000002,"5min":26.013999999999999,"15min":26.013999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.50600000000000001,"5min":1.8340000000000001,"15min":1.1559999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.749,"5min":22.687999999999999,"15min":22.687999999999999},"last":0.67500000000000004}]},{"osd":4,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":1.52,"15min":0.84099999999999997},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.77600000000000002,"5min":19.998000000000001,"15min":19.998000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.46600000000000003,"5min":1.2809999999999999,"15min":0.77900000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.629,"5min":17.628,"15min":17.628},"last":0.76800000000000002}]},{"osd":6,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":1.3280000000000001,"15min":0.80800000000000005},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.69999999999999996,"5min":19.969000000000001,"15min":19.969000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.54300000000000004,"5min":1.492,"15min":0.874},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.117,"5min":19.913,"15min":19.913},"last":0.73699999999999999}]},{"osd":7,"last update":"Wed May 24 03:32:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":1.2569999999999999,"15min":0.82799999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72899999999999998,"5min":17.731000000000002,"15min":17.731000000000002},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.54900000000000004,"5min":1.3460000000000001,"15min":0.86799999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72499999999999998,"5min":20.099,"15min":20.099},"last":0.755}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":8334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1568768,"data_stored":1552542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1568768,"data_stored":1544950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23068672,"data_stored":23068672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23068672,"data_stored":23068672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":27262976,"data_stored":27262976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":31457280,"data_stored":31457280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-24T03:33:30.084 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-05-24T03:33:30.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.201+0000 7fb97f52d700 1 Processor -- start 2023-05-24T03:33:30.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.201+0000 7fb97f52d700 1 -- start start 2023-05-24T03:33:30.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.202+0000 7fb97f52d700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb978070fe0 0x7fb9780b21c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:30.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.202+0000 7fb97f52d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb978159cd0 0x7fb97815a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:30.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.202+0000 7fb97f52d700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb97815ad80 con 0x7fb9780cdfd0 2023-05-24T03:33:30.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.202+0000 7fb97f52d700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb97815a7c0 con 0x7fb978070fe0 2023-05-24T03:33:30.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.202+0000 7fb97f52d700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb97815aaa0 con 0x7fb978159cd0 2023-05-24T03:33:30.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.202+0000 7fb97daca700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb978159cd0 0x7fb97815a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:30.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.202+0000 7fb97cac8700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb978070fe0 0x7fb9780b21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:30.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.202+0000 7fb97daca700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb978159cd0 0x7fb97815a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:53706/0 (socket says 172.21.15.146:53706) 2023-05-24T03:33:30.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.202+0000 7fb97d2c9700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fb9780cdfd0 0x7fb9780ce3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:46324/0 (socket says 172.21.15.146:46324) 2023-05-24T03:33:30.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.202+0000 7fb97daca700 1 -- 172.21.15.146:0/85310608 learned_addr learned my addr 172.21.15.146:0/85310608 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:33:30.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.203+0000 7fb97daca700 1 -- 172.21.15.146:0/85310608 >> v2:172.21.15.151:3300/0 conn(0x7fb978070fe0 msgr2=0x7fb9780b21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:33:30.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.203+0000 7fb97daca700 1 --2- 172.21.15.146:0/85310608 >> v2:172.21.15.151:3300/0 conn(0x7fb978070fe0 0x7fb9780b21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:30.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.203+0000 7fb97daca700 1 -- 172.21.15.146:0/85310608 >> v1:172.21.15.151:6789/0 conn(0x7fb9780cdfd0 legacy=0x7fb9780ce3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:30.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.203+0000 7fb97daca700 1 -- 172.21.15.146:0/85310608 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9780b19c0 con 0x7fb978159cd0 2023-05-24T03:33:30.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.203+0000 7fb97cac8700 1 --2- 172.21.15.146:0/85310608 >> v2:172.21.15.151:3300/0 conn(0x7fb978070fe0 0x7fb9780b21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-24T03:33:30.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.203+0000 7fb97daca700 1 --2- 172.21.15.146:0/85310608 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb978159cd0 0x7fb97815a150 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb97000d150 tx=0x7fb97000d460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=381e21dfa40fbec server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:33:30.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.203+0000 7fb96ffff700 1 -- 172.21.15.146:0/85310608 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb970010070 con 0x7fb978159cd0 2023-05-24T03:33:30.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.203+0000 7fb96ffff700 1 -- 172.21.15.146:0/85310608 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb97000dd10 con 0x7fb978159cd0 2023-05-24T03:33:30.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.203+0000 7fb96ffff700 1 -- 172.21.15.146:0/85310608 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb97000b310 con 0x7fb978159cd0 2023-05-24T03:33:30.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.204+0000 7fb97f52d700 1 -- 172.21.15.146:0/85310608 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb978159cd0 msgr2=0x7fb97815a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:30.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.204+0000 7fb97f52d700 1 --2- 172.21.15.146:0/85310608 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb978159cd0 0x7fb97815a150 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb97000d150 tx=0x7fb97000d460 comp rx=0 tx=0).stop 2023-05-24T03:33:30.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.204+0000 7fb97f52d700 1 -- 172.21.15.146:0/85310608 shutdown_connections 2023-05-24T03:33:30.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.204+0000 7fb97f52d700 1 --2- 172.21.15.146:0/85310608 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb978159cd0 0x7fb97815a150 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:30.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.204+0000 7fb97f52d700 1 --2- 172.21.15.146:0/85310608 >> v2:172.21.15.151:3300/0 conn(0x7fb978070fe0 0x7fb9780b21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:30.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.204+0000 7fb97f52d700 1 -- 172.21.15.146:0/85310608 >> 172.21.15.146:0/85310608 conn(0x7fb9780cfea0 msgr2=0x7fb9780d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:33:30.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.204+0000 7fb97f52d700 1 -- 172.21.15.146:0/85310608 shutdown_connections 2023-05-24T03:33:30.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.204+0000 7fb97f52d700 1 -- 172.21.15.146:0/85310608 wait complete. 2023-05-24T03:33:30.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.205+0000 7fb97f52d700 1 Processor -- start 2023-05-24T03:33:30.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.205+0000 7fb97f52d700 1 -- start start 2023-05-24T03:33:30.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.206+0000 7fb97f52d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb978070fe0 0x7fb978151550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:30.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.206+0000 7fb97f52d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9780cdfd0 0x7fb9780ae700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:30.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.206+0000 7fb97f52d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb978159cd0 0x7fb9780c79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:30.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.206+0000 7fb97f52d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb978151a90 con 0x7fb978070fe0 2023-05-24T03:33:30.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.206+0000 7fb97f52d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9780af050 con 0x7fb978159cd0 2023-05-24T03:33:30.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.206+0000 7fb97f52d700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9780af330 con 0x7fb9780cdfd0 2023-05-24T03:33:30.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.206+0000 7fb97d2c9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb978070fe0 0x7fb978151550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:30.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.206+0000 7fb97d2c9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb978070fe0 0x7fb978151550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40844/0 (socket says 172.21.15.146:40844) 2023-05-24T03:33:30.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.206+0000 7fb97d2c9700 1 -- 172.21.15.146:0/4151694787 learned_addr learned my addr 172.21.15.146:0/4151694787 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:33:30.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.206+0000 7fb97cac8700 1 --2- 172.21.15.146:0/4151694787 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9780cdfd0 0x7fb9780ae700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:30.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.206+0000 7fb97daca700 1 --2- 172.21.15.146:0/4151694787 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb978159cd0 0x7fb9780c79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:30.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.206+0000 7fb97d2c9700 1 -- 172.21.15.146:0/4151694787 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9780cdfd0 msgr2=0x7fb9780ae700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:30.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.206+0000 7fb97d2c9700 1 --2- 172.21.15.146:0/4151694787 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9780cdfd0 0x7fb9780ae700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:30.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.206+0000 7fb97d2c9700 1 -- 172.21.15.146:0/4151694787 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb978159cd0 msgr2=0x7fb9780c79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:30.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.206+0000 7fb97d2c9700 1 --2- 172.21.15.146:0/4151694787 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb978159cd0 0x7fb9780c79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:30.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.206+0000 7fb97d2c9700 1 -- 172.21.15.146:0/4151694787 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9740094a0 con 0x7fb978070fe0 2023-05-24T03:33:30.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.206+0000 7fb97d2c9700 1 --2- 172.21.15.146:0/4151694787 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb978070fe0 0x7fb978151550 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb96800c500 tx=0x7fb96800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:33:30.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.206+0000 7fb96dffb700 1 -- 172.21.15.146:0/4151694787 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb968005cb0 con 0x7fb978070fe0 2023-05-24T03:33:30.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.206+0000 7fb96dffb700 1 -- 172.21.15.146:0/4151694787 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb968005e10 con 0x7fb978070fe0 2023-05-24T03:33:30.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.206+0000 7fb96dffb700 1 -- 172.21.15.146:0/4151694787 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9680072d0 con 0x7fb978070fe0 2023-05-24T03:33:30.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.206+0000 7fb97f52d700 1 -- 172.21.15.146:0/4151694787 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb97000bd40 con 0x7fb978070fe0 2023-05-24T03:33:30.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.207+0000 7fb97f52d700 1 -- 172.21.15.146:0/4151694787 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9780b2700 con 0x7fb978070fe0 2023-05-24T03:33:30.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.208+0000 7fb97f52d700 1 -- 172.21.15.146:0/4151694787 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9780b1ca0 con 0x7fb978070fe0 2023-05-24T03:33:30.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.208+0000 7fb96dffb700 1 -- 172.21.15.146:0/4151694787 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb968007430 con 0x7fb978070fe0 2023-05-24T03:33:30.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.208+0000 7fb96dffb700 1 --2- 172.21.15.146:0/4151694787 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fb95c06ace0 0x7fb95c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:30.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.208+0000 7fb97cac8700 1 --2- 172.21.15.146:0/4151694787 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fb95c06ace0 0x7fb95c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:30.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.208+0000 7fb96dffb700 1 -- 172.21.15.146:0/4151694787 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb968088970 con 0x7fb978070fe0 2023-05-24T03:33:30.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.209+0000 7fb97cac8700 1 --2- 172.21.15.146:0/4151694787 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fb95c06ace0 0x7fb95c06d190 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb9780cc500 tx=0x7fb974009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:33:30.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.213+0000 7fb96dffb700 1 -- 172.21.15.146:0/4151694787 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fb9680537a0 con 0x7fb978070fe0 2023-05-24T03:33:30.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.401+0000 7fb97f52d700 1 -- 172.21.15.146:0/4151694787 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fb9780b2890 con 0x7fb978070fe0 2023-05-24T03:33:30.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.405+0000 7fb96dffb700 1 -- 172.21.15.146:0/4151694787 <== mon.0 v2:172.21.15.146:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb9680011d0 con 0x7fb978070fe0 2023-05-24T03:33:30.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.405+0000 7fb96dffb700 1 -- 172.21.15.146:0/4151694787 <== mon.0 v2:172.21.15.146:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7fb968056dc0 con 0x7fb978070fe0 2023-05-24T03:33:30.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.407+0000 7fb97f52d700 1 -- 172.21.15.146:0/4151694787 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fb95c06ace0 msgr2=0x7fb95c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:30.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.407+0000 7fb97f52d700 1 --2- 172.21.15.146:0/4151694787 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fb95c06ace0 0x7fb95c06d190 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb9780cc500 tx=0x7fb974009210 comp rx=0 tx=0).stop 2023-05-24T03:33:30.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.407+0000 7fb97f52d700 1 -- 172.21.15.146:0/4151694787 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb978070fe0 msgr2=0x7fb978151550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:30.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.407+0000 7fb97f52d700 1 --2- 172.21.15.146:0/4151694787 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb978070fe0 0x7fb978151550 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb96800c500 tx=0x7fb96800c810 comp rx=0 tx=0).stop 2023-05-24T03:33:30.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.407+0000 7fb97f52d700 1 -- 172.21.15.146:0/4151694787 shutdown_connections 2023-05-24T03:33:30.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.407+0000 7fb97f52d700 1 --2- 172.21.15.146:0/4151694787 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fb95c06ace0 0x7fb95c06d190 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:30.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.407+0000 7fb97f52d700 1 --2- 172.21.15.146:0/4151694787 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb978159cd0 0x7fb9780c79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:30.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.407+0000 7fb97f52d700 1 --2- 172.21.15.146:0/4151694787 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb978070fe0 0x7fb978151550 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:30.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.407+0000 7fb97f52d700 1 --2- 172.21.15.146:0/4151694787 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9780cdfd0 0x7fb9780ae700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:30.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.408+0000 7fb97f52d700 1 -- 172.21.15.146:0/4151694787 >> 172.21.15.146:0/4151694787 conn(0x7fb9780cfea0 msgr2=0x7fb97806d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:33:30.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.408+0000 7fb97f52d700 1 -- 172.21.15.146:0/4151694787 shutdown_connections 2023-05-24T03:33:30.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.408+0000 7fb97f52d700 1 -- 172.21.15.146:0/4151694787 wait complete. 2023-05-24T03:33:30.423 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-05-24T03:33:30.424 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-24T03:33:30.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.540+0000 7f0de25c6700 1 Processor -- start 2023-05-24T03:33:30.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.540+0000 7f0de25c6700 1 -- start start 2023-05-24T03:33:30.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.541+0000 7f0de25c6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0ddc15d140 0x7f0ddc15d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:30.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.541+0000 7f0de25c6700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0ddc071a10 0x7f0ddc071e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:30.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.541+0000 7f0de25c6700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ddc072370 con 0x7f0ddc1595f0 2023-05-24T03:33:30.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.541+0000 7f0de25c6700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ddc070f50 con 0x7f0ddc15d140 2023-05-24T03:33:30.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.541+0000 7f0de25c6700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ddc06db30 con 0x7f0ddc071a10 2023-05-24T03:33:30.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.541+0000 7f0ddb7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0ddc15d140 0x7f0ddc15d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:30.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.541+0000 7f0ddb7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0ddc15d140 0x7f0ddc15d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40854/0 (socket says 172.21.15.146:40854) 2023-05-24T03:33:30.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.541+0000 7f0ddb7fe700 1 -- 172.21.15.146:0/2077790111 learned_addr learned my addr 172.21.15.146:0/2077790111 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:33:30.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.541+0000 7f0de0b63700 1 --2- 172.21.15.146:0/2077790111 >> v2:172.21.15.151:3300/0 conn(0x7f0ddc071a10 0x7f0ddc071e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:30.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.541+0000 7f0ddb7fe700 1 -- 172.21.15.146:0/2077790111 >> v2:172.21.15.151:3300/0 conn(0x7f0ddc071a10 msgr2=0x7f0ddc071e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:33:30.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.541+0000 7f0ddb7fe700 1 --2- 172.21.15.146:0/2077790111 >> v2:172.21.15.151:3300/0 conn(0x7f0ddc071a10 0x7f0ddc071e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:30.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.541+0000 7f0ddb7fe700 1 -- 172.21.15.146:0/2077790111 >> v1:172.21.15.151:6789/0 conn(0x7f0ddc1595f0 legacy=0x7f0ddc0ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:33:30.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.541+0000 7f0ddb7fe700 1 -- 172.21.15.146:0/2077790111 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ddc15dc90 con 0x7f0ddc15d140 2023-05-24T03:33:30.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.542+0000 7f0ddb7fe700 1 --2- 172.21.15.146:0/2077790111 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ddc15d140 0x7f0ddc15d580 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc06d640 tx=0x7f0dcc00be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a8627e3513255b7 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:33:30.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.542+0000 7f0ddaffd700 1 -- 172.21.15.146:0/2077790111 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc00dcf0 con 0x7f0ddc15d140 2023-05-24T03:33:30.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.542+0000 7f0ddaffd700 1 -- 172.21.15.146:0/2077790111 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0dcc00de50 con 0x7f0ddc15d140 2023-05-24T03:33:30.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.542+0000 7f0ddaffd700 1 -- 172.21.15.146:0/2077790111 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc004270 con 0x7f0ddc15d140 2023-05-24T03:33:30.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.542+0000 7f0de25c6700 1 -- 172.21.15.146:0/2077790111 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ddc15d140 msgr2=0x7f0ddc15d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:30.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.542+0000 7f0de25c6700 1 --2- 172.21.15.146:0/2077790111 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ddc15d140 0x7f0ddc15d580 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc06d640 tx=0x7f0dcc00be70 comp rx=0 tx=0).stop 2023-05-24T03:33:30.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.542+0000 7f0de25c6700 1 -- 172.21.15.146:0/2077790111 shutdown_connections 2023-05-24T03:33:30.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.542+0000 7f0de25c6700 1 --2- 172.21.15.146:0/2077790111 >> v2:172.21.15.151:3300/0 conn(0x7f0ddc071a10 0x7f0ddc071e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:30.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.542+0000 7f0de25c6700 1 --2- 172.21.15.146:0/2077790111 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ddc15d140 0x7f0ddc15d580 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:30.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.542+0000 7f0de25c6700 1 -- 172.21.15.146:0/2077790111 >> 172.21.15.146:0/2077790111 conn(0x7f0ddc06ebf0 msgr2=0x7f0ddc06eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:33:30.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.542+0000 7f0de25c6700 1 -- 172.21.15.146:0/2077790111 shutdown_connections 2023-05-24T03:33:30.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.542+0000 7f0de25c6700 1 -- 172.21.15.146:0/2077790111 wait complete. 2023-05-24T03:33:30.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.543+0000 7f0de25c6700 1 Processor -- start 2023-05-24T03:33:30.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.544+0000 7f0de25c6700 1 -- start start 2023-05-24T03:33:30.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.544+0000 7f0de25c6700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ddc071a10 0x7f0ddc0c95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:30.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.544+0000 7f0de25c6700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ddc1595f0 0x7f0ddc155750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:30.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.544+0000 7f0de25c6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ddc15d140 0x7f0ddc0b2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:30.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.544+0000 7f0de25c6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc0c6ee0 con 0x7f0ddc15d140 2023-05-24T03:33:30.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.544+0000 7f0de25c6700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc0c71c0 con 0x7f0ddc071a10 2023-05-24T03:33:30.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.544+0000 7f0de25c6700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc0c74a0 con 0x7f0ddc1595f0 2023-05-24T03:33:30.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.545+0000 7f0de0b63700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ddc15d140 0x7f0ddc0b2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:30.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.545+0000 7f0de0b63700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ddc15d140 0x7f0ddc0b2cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40862/0 (socket says 172.21.15.146:40862) 2023-05-24T03:33:30.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.545+0000 7f0de0b63700 1 -- 172.21.15.146:0/3789445808 learned_addr learned my addr 172.21.15.146:0/3789445808 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:33:30.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.545+0000 7f0ddbfff700 1 --2- 172.21.15.146:0/3789445808 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ddc071a10 0x7f0ddc0c95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:30.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.545+0000 7f0ddb7fe700 1 --2- 172.21.15.146:0/3789445808 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ddc1595f0 0x7f0ddc155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:30.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.545+0000 7f0de0b63700 1 -- 172.21.15.146:0/3789445808 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ddc1595f0 msgr2=0x7f0ddc155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:30.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.545+0000 7f0de0b63700 1 --2- 172.21.15.146:0/3789445808 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ddc1595f0 0x7f0ddc155750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:30.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.545+0000 7f0de0b63700 1 -- 172.21.15.146:0/3789445808 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ddc071a10 msgr2=0x7f0ddc0c95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:30.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.545+0000 7f0de0b63700 1 --2- 172.21.15.146:0/3789445808 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ddc071a10 0x7f0ddc0c95c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:30.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.545+0000 7f0de0b63700 1 -- 172.21.15.146:0/3789445808 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dcc00b7f0 con 0x7f0ddc15d140 2023-05-24T03:33:30.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.545+0000 7f0de0b63700 1 --2- 172.21.15.146:0/3789445808 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ddc15d140 0x7f0ddc0b2cd0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f0dd4007e40 tx=0x7f0dd400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:33:30.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.545+0000 7f0dd8ff9700 1 -- 172.21.15.146:0/3789445808 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd400ed30 con 0x7f0ddc15d140 2023-05-24T03:33:30.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.545+0000 7f0dd8ff9700 1 -- 172.21.15.146:0/3789445808 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0dd4014420 con 0x7f0ddc15d140 2023-05-24T03:33:30.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.545+0000 7f0dd8ff9700 1 -- 172.21.15.146:0/3789445808 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd40147f0 con 0x7f0ddc15d140 2023-05-24T03:33:30.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.545+0000 7f0de25c6700 1 -- 172.21.15.146:0/3789445808 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ddc071210 con 0x7f0ddc15d140 2023-05-24T03:33:30.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.545+0000 7f0de25c6700 1 -- 172.21.15.146:0/3789445808 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ddc15df70 con 0x7f0ddc15d140 2023-05-24T03:33:30.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.546+0000 7f0de25c6700 1 -- 172.21.15.146:0/3789445808 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ddc0714f0 con 0x7f0ddc15d140 2023-05-24T03:33:30.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.547+0000 7f0dd8ff9700 1 -- 172.21.15.146:0/3789445808 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0dd4014950 con 0x7f0ddc15d140 2023-05-24T03:33:30.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.547+0000 7f0dd8ff9700 1 --2- 172.21.15.146:0/3789445808 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f0dc806ace0 0x7f0dc806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:30.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.547+0000 7f0dd8ff9700 1 -- 172.21.15.146:0/3789445808 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0dd4089ec0 con 0x7f0ddc15d140 2023-05-24T03:33:30.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.547+0000 7f0ddbfff700 1 --2- 172.21.15.146:0/3789445808 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f0dc806ace0 0x7f0dc806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:30.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.548+0000 7f0ddbfff700 1 --2- 172.21.15.146:0/3789445808 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f0dc806ace0 0x7f0dc806d190 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc0c8b40 tx=0x7f0dd0007ec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:33:30.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.552+0000 7f0dd8ff9700 1 -- 172.21.15.146:0/3789445808 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f0dd4054cf0 con 0x7f0ddc15d140 2023-05-24T03:33:30.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.781+0000 7f0de25c6700 1 -- 172.21.15.146:0/3789445808 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ddc04e810 con 0x7f0ddc15d140 2023-05-24T03:33:30.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.781+0000 7f0dd8ff9700 1 -- 172.21.15.146:0/3789445808 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4883 (secure 0 0 0) 0x7f0dd4058310 con 0x7f0ddc15d140 2023-05-24T03:33:30.786 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:33:30.786 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1500590330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1500590330},{"type":"v1","addr":"172.21.15.151:6835","nonce":1500590330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/3574684057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3574684057},{"type":"v1","addr":"172.21.15.146:6837","nonce":3574684057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/3420469594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3420469594},{"type":"v1","addr":"172.21.15.151:6833","nonce":3420469594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-24T03:29:44.469134+0000","modified":"2023-05-24T03:30:06.147392+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6836/4012487240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":4012487240},{"type":"v1","addr":"172.21.15.146:6836","nonce":4012487240}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-24T03:33:30.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.783+0000 7f0de25c6700 1 -- 172.21.15.146:0/3789445808 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f0dc806ace0 msgr2=0x7f0dc806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:30.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.783+0000 7f0de25c6700 1 --2- 172.21.15.146:0/3789445808 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f0dc806ace0 0x7f0dc806d190 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc0c8b40 tx=0x7f0dd0007ec0 comp rx=0 tx=0).stop 2023-05-24T03:33:30.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.783+0000 7f0de25c6700 1 -- 172.21.15.146:0/3789445808 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ddc15d140 msgr2=0x7f0ddc0b2cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:30.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.783+0000 7f0de25c6700 1 --2- 172.21.15.146:0/3789445808 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ddc15d140 0x7f0ddc0b2cd0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f0dd4007e40 tx=0x7f0dd400e3c0 comp rx=0 tx=0).stop 2023-05-24T03:33:30.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.783+0000 7f0de25c6700 1 -- 172.21.15.146:0/3789445808 shutdown_connections 2023-05-24T03:33:30.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.783+0000 7f0de25c6700 1 --2- 172.21.15.146:0/3789445808 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f0dc806ace0 0x7f0dc806d190 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:30.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.783+0000 7f0de25c6700 1 --2- 172.21.15.146:0/3789445808 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ddc15d140 0x7f0ddc0b2cd0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:30.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.783+0000 7f0de25c6700 1 --2- 172.21.15.146:0/3789445808 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ddc071a10 0x7f0ddc0c95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:30.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.783+0000 7f0de25c6700 1 --2- 172.21.15.146:0/3789445808 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ddc1595f0 0x7f0ddc155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:30.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.783+0000 7f0de25c6700 1 -- 172.21.15.146:0/3789445808 >> 172.21.15.146:0/3789445808 conn(0x7f0ddc06ebf0 msgr2=0x7f0ddc0cbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:33:30.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.783+0000 7f0de25c6700 1 -- 172.21.15.146:0/3789445808 shutdown_connections 2023-05-24T03:33:30.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.783+0000 7f0de25c6700 1 -- 172.21.15.146:0/3789445808 wait complete. 2023-05-24T03:33:30.791 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 9 2023-05-24T03:33:30.799 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-24T03:33:30.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.917+0000 7ff01d371700 1 Processor -- start 2023-05-24T03:33:30.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.917+0000 7ff01d371700 1 -- start start 2023-05-24T03:33:30.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.917+0000 7ff01d371700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff0180cb0a0 0x7ff01815e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:30.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.917+0000 7ff01d371700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0180b4dc0 con 0x7ff0180b49f0 2023-05-24T03:33:30.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.917+0000 7ff01d371700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff01806ce60 con 0x7ff0180b0b80 2023-05-24T03:33:30.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.917+0000 7ff01d371700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff01806c2e0 con 0x7ff0180cb0a0 2023-05-24T03:33:30.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.918+0000 7ff016ffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff0180b49f0 0x7ff0180710d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47318/0 (socket says 172.21.15.146:47318) 2023-05-24T03:33:30.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.918+0000 7ff016ffd700 1 -- 172.21.15.146:0/3805456542 learned_addr learned my addr 172.21.15.146:0/3805456542 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:33:30.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.918+0000 7ff0177fe700 1 --2- 172.21.15.146:0/3805456542 >> v2:172.21.15.151:3300/0 conn(0x7ff0180cb0a0 0x7ff01815e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:30.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.918+0000 7ff015ffb700 1 -- 172.21.15.146:0/3805456542 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1866781533 0 0) 0x7ff0180b4dc0 con 0x7ff0180b49f0 2023-05-24T03:33:30.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.918+0000 7ff015ffb700 1 -- 172.21.15.146:0/3805456542 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0040035b0 con 0x7ff0180b49f0 2023-05-24T03:33:30.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.918+0000 7ff015ffb700 1 -- 172.21.15.146:0/3805456542 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2684063635 0 0) 0x7ff0040035b0 con 0x7ff0180b49f0 2023-05-24T03:33:30.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.918+0000 7ff0177fe700 1 -- 172.21.15.146:0/3805456542 >> v1:172.21.15.151:6789/0 conn(0x7ff0180b0b80 legacy=0x7ff0180ca990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:30.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.918+0000 7ff0177fe700 1 -- 172.21.15.146:0/3805456542 >> v1:172.21.15.146:6789/0 conn(0x7ff0180b49f0 legacy=0x7ff0180710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:30.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.918+0000 7ff0177fe700 1 -- 172.21.15.146:0/3805456542 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff01806c5c0 con 0x7ff0180cb0a0 2023-05-24T03:33:30.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.918+0000 7ff0177fe700 1 --2- 172.21.15.146:0/3805456542 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0180cb0a0 0x7ff01815e770 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff010009dc0 tx=0x7ff01000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ebef14358a80bac server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:33:30.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.918+0000 7ff015ffb700 1 -- 172.21.15.146:0/3805456542 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01000e070 con 0x7ff0180cb0a0 2023-05-24T03:33:30.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.918+0000 7ff015ffb700 1 -- 172.21.15.146:0/3805456542 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff010003a20 con 0x7ff0180cb0a0 2023-05-24T03:33:30.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.918+0000 7ff015ffb700 1 -- 172.21.15.146:0/3805456542 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff008001670 con 0x7ff0180cb0a0 2023-05-24T03:33:30.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.919+0000 7ff01d371700 1 -- 172.21.15.146:0/3805456542 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0180cb0a0 msgr2=0x7ff01815e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:30.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.919+0000 7ff01d371700 1 --2- 172.21.15.146:0/3805456542 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0180cb0a0 0x7ff01815e770 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff010009dc0 tx=0x7ff01000b330 comp rx=0 tx=0).stop 2023-05-24T03:33:30.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.919+0000 7ff01d371700 1 -- 172.21.15.146:0/3805456542 shutdown_connections 2023-05-24T03:33:30.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.919+0000 7ff01d371700 1 --2- 172.21.15.146:0/3805456542 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0180cb0a0 0x7ff01815e770 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:30.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.919+0000 7ff01d371700 1 -- 172.21.15.146:0/3805456542 >> 172.21.15.146:0/3805456542 conn(0x7ff01806b0b0 msgr2=0x7ff0180cedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:33:30.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.919+0000 7ff01d371700 1 -- 172.21.15.146:0/3805456542 shutdown_connections 2023-05-24T03:33:30.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.919+0000 7ff01d371700 1 -- 172.21.15.146:0/3805456542 wait complete. 2023-05-24T03:33:30.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.920+0000 7ff01d371700 1 Processor -- start 2023-05-24T03:33:30.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.920+0000 7ff01d371700 1 -- start start 2023-05-24T03:33:30.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.921+0000 7ff01d371700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0180b0b80 0x7ff018158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:30.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.921+0000 7ff01d371700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0180b49f0 0x7ff0181f27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:30.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.921+0000 7ff01d371700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff0180cb0a0 0x7ff0180a84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:30.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.921+0000 7ff01d371700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0181f2380 con 0x7ff0180b49f0 2023-05-24T03:33:30.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.921+0000 7ff01d371700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0181f1700 con 0x7ff0180b0b80 2023-05-24T03:33:30.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.921+0000 7ff01d371700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0181f19e0 con 0x7ff0180cb0a0 2023-05-24T03:33:30.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.921+0000 7ff0167fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0180b49f0 0x7ff0181f27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:30.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.921+0000 7ff0167fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0180b49f0 0x7ff0181f27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40874/0 (socket says 172.21.15.146:40874) 2023-05-24T03:33:30.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.921+0000 7ff0167fc700 1 -- 172.21.15.146:0/489346540 learned_addr learned my addr 172.21.15.146:0/489346540 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:33:30.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.921+0000 7ff016ffd700 1 --2- 172.21.15.146:0/489346540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0180b0b80 0x7ff018158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:30.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.921+0000 7ff0177fe700 1 --2- 172.21.15.146:0/489346540 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff0180cb0a0 0x7ff0180a84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:30.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.922+0000 7ff0167fc700 1 -- 172.21.15.146:0/489346540 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff0180cb0a0 msgr2=0x7ff0180a84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:30.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.922+0000 7ff0167fc700 1 --2- 172.21.15.146:0/489346540 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff0180cb0a0 0x7ff0180a84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:30.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.922+0000 7ff0167fc700 1 -- 172.21.15.146:0/489346540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0180b0b80 msgr2=0x7ff018158e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:30.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.922+0000 7ff0167fc700 1 --2- 172.21.15.146:0/489346540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0180b0b80 0x7ff018158e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:30.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.922+0000 7ff0167fc700 1 -- 172.21.15.146:0/489346540 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff010009a70 con 0x7ff0180b49f0 2023-05-24T03:33:30.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.922+0000 7ff016ffd700 1 --2- 172.21.15.146:0/489346540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0180b0b80 0x7ff018158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:33:30.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.922+0000 7ff0167fc700 1 --2- 172.21.15.146:0/489346540 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0180b49f0 0x7ff0181f27a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff00000c490 tx=0x7ff00000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:33:30.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.922+0000 7ff00f7fe700 1 -- 172.21.15.146:0/489346540 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0000052d0 con 0x7ff0180b49f0 2023-05-24T03:33:30.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.922+0000 7ff00f7fe700 1 -- 172.21.15.146:0/489346540 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff000005450 con 0x7ff0180b49f0 2023-05-24T03:33:30.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.922+0000 7ff00f7fe700 1 -- 172.21.15.146:0/489346540 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff000006ac0 con 0x7ff0180b49f0 2023-05-24T03:33:30.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.922+0000 7ff01d371700 1 -- 172.21.15.146:0/489346540 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff01806cb80 con 0x7ff0180b49f0 2023-05-24T03:33:30.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.922+0000 7ff01d371700 1 -- 172.21.15.146:0/489346540 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff01806c8a0 con 0x7ff0180b49f0 2023-05-24T03:33:30.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.923+0000 7ff01d371700 1 -- 172.21.15.146:0/489346540 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff01806bf00 con 0x7ff0180b49f0 2023-05-24T03:33:30.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.923+0000 7ff00f7fe700 1 -- 172.21.15.146:0/489346540 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff000003680 con 0x7ff0180b49f0 2023-05-24T03:33:30.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.924+0000 7ff00f7fe700 1 --2- 172.21.15.146:0/489346540 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7feff806ace0 0x7feff806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:30.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.924+0000 7ff00f7fe700 1 -- 172.21.15.146:0/489346540 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff000088b90 con 0x7ff0180b49f0 2023-05-24T03:33:30.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.924+0000 7ff016ffd700 1 --2- 172.21.15.146:0/489346540 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7feff806ace0 0x7feff806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:30.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.924+0000 7ff016ffd700 1 --2- 172.21.15.146:0/489346540 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7feff806ace0 0x7feff806d190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff008007a90 tx=0x7ff008009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:33:30.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:30.928+0000 7ff00f7fe700 1 -- 172.21.15.146:0/489346540 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ff000053880 con 0x7ff0180b49f0 2023-05-24T03:33:31.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.159+0000 7ff01d371700 1 -- 172.21.15.146:0/489346540 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0181f24c0 con 0x7ff0180b49f0 2023-05-24T03:33:31.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.160+0000 7ff00f7fe700 1 -- 172.21.15.146:0/489346540 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4883 (secure 0 0 0) 0x7ff0181f24c0 con 0x7ff0180b49f0 2023-05-24T03:33:31.164 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:33:31.164 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1500590330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1500590330},{"type":"v1","addr":"172.21.15.151:6835","nonce":1500590330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/3574684057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3574684057},{"type":"v1","addr":"172.21.15.146:6837","nonce":3574684057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/3420469594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3420469594},{"type":"v1","addr":"172.21.15.151:6833","nonce":3420469594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-24T03:29:44.469134+0000","modified":"2023-05-24T03:30:06.147392+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6836/4012487240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":4012487240},{"type":"v1","addr":"172.21.15.146:6836","nonce":4012487240}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-24T03:33:31.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.162+0000 7ff01d371700 1 -- 172.21.15.146:0/489346540 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7feff806ace0 msgr2=0x7feff806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:31.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.162+0000 7ff01d371700 1 --2- 172.21.15.146:0/489346540 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7feff806ace0 0x7feff806d190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff008007a90 tx=0x7ff008009040 comp rx=0 tx=0).stop 2023-05-24T03:33:31.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.162+0000 7ff01d371700 1 -- 172.21.15.146:0/489346540 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0180b49f0 msgr2=0x7ff0181f27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:31.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.162+0000 7ff01d371700 1 --2- 172.21.15.146:0/489346540 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0180b49f0 0x7ff0181f27a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff00000c490 tx=0x7ff00000c850 comp rx=0 tx=0).stop 2023-05-24T03:33:31.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.162+0000 7ff01d371700 1 -- 172.21.15.146:0/489346540 shutdown_connections 2023-05-24T03:33:31.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.162+0000 7ff01d371700 1 --2- 172.21.15.146:0/489346540 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7feff806ace0 0x7feff806d190 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:31.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.162+0000 7ff01d371700 1 --2- 172.21.15.146:0/489346540 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff0180cb0a0 0x7ff0180a84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:31.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.162+0000 7ff01d371700 1 --2- 172.21.15.146:0/489346540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0180b0b80 0x7ff018158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:31.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.162+0000 7ff01d371700 1 --2- 172.21.15.146:0/489346540 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0180b49f0 0x7ff0181f27a0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:31.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.162+0000 7ff01d371700 1 -- 172.21.15.146:0/489346540 >> 172.21.15.146:0/489346540 conn(0x7ff01806b0b0 msgr2=0x7ff0180c5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:33:31.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.162+0000 7ff01d371700 1 -- 172.21.15.146:0/489346540 shutdown_connections 2023-05-24T03:33:31.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.162+0000 7ff01d371700 1 -- 172.21.15.146:0/489346540 wait complete. 2023-05-24T03:33:31.169 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 9 2023-05-24T03:33:31.178 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-24T03:33:31.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.295+0000 7ff0464c3700 1 Processor -- start 2023-05-24T03:33:31.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.295+0000 7ff0464c3700 1 -- start start 2023-05-24T03:33:31.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.296+0000 7ff0464c3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff04006bb40 0x7ff0400cfe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:31.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.296+0000 7ff0464c3700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0400cf9d0 con 0x7ff0400d03a0 2023-05-24T03:33:31.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.296+0000 7ff0464c3700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0400cf400 con 0x7ff0400b8a50 2023-05-24T03:33:31.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.296+0000 7ff0464c3700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0400cd790 con 0x7ff04006bb40 2023-05-24T03:33:31.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.296+0000 7ff03f7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff04006bb40 0x7ff0400cfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:31.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.296+0000 7ff044a60700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff0400d03a0 0x7ff0400b4c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47336/0 (socket says 172.21.15.146:47336) 2023-05-24T03:33:31.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.296+0000 7ff03f7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff04006bb40 0x7ff0400cfe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40882/0 (socket says 172.21.15.146:40882) 2023-05-24T03:33:31.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.296+0000 7ff044a60700 1 -- 172.21.15.146:0/969939885 learned_addr learned my addr 172.21.15.146:0/969939885 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:33:31.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.296+0000 7ff03f7fe700 1 -- 172.21.15.146:0/969939885 >> v1:172.21.15.151:6789/0 conn(0x7ff0400b8a50 legacy=0x7ff04015daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:31.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.296+0000 7ff03f7fe700 1 -- 172.21.15.146:0/969939885 >> v1:172.21.15.146:6789/0 conn(0x7ff0400d03a0 legacy=0x7ff0400b4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:31.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.297+0000 7ff03f7fe700 1 -- 172.21.15.146:0/969939885 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0400cf6a0 con 0x7ff04006bb40 2023-05-24T03:33:31.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.297+0000 7ff03effd700 1 -- 172.21.15.146:0/969939885 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1580111582 0 0) 0x7ff0400cf9d0 con 0x7ff0400d03a0 2023-05-24T03:33:31.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.297+0000 7ff03f7fe700 1 --2- 172.21.15.146:0/969939885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff04006bb40 0x7ff0400cfe60 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff030009840 tx=0x7ff030009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16a95cb3b76540ee server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:33:31.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.297+0000 7ff03effd700 1 -- 172.21.15.146:0/969939885 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff030011830 con 0x7ff04006bb40 2023-05-24T03:33:31.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.297+0000 7ff03effd700 1 -- 172.21.15.146:0/969939885 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff030011990 con 0x7ff04006bb40 2023-05-24T03:33:31.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.297+0000 7ff03effd700 1 -- 172.21.15.146:0/969939885 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff030011d40 con 0x7ff04006bb40 2023-05-24T03:33:31.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.297+0000 7ff0464c3700 1 -- 172.21.15.146:0/969939885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff04006bb40 msgr2=0x7ff0400cfe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:31.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.297+0000 7ff0464c3700 1 --2- 172.21.15.146:0/969939885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff04006bb40 0x7ff0400cfe60 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff030009840 tx=0x7ff030009b50 comp rx=0 tx=0).stop 2023-05-24T03:33:31.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.297+0000 7ff0464c3700 1 -- 172.21.15.146:0/969939885 shutdown_connections 2023-05-24T03:33:31.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.297+0000 7ff0464c3700 1 --2- 172.21.15.146:0/969939885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff04006bb40 0x7ff0400cfe60 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:31.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.297+0000 7ff0464c3700 1 -- 172.21.15.146:0/969939885 >> 172.21.15.146:0/969939885 conn(0x7ff04006af30 msgr2=0x7ff04006b330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:33:31.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.297+0000 7ff0464c3700 1 -- 172.21.15.146:0/969939885 shutdown_connections 2023-05-24T03:33:31.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.297+0000 7ff0464c3700 1 -- 172.21.15.146:0/969939885 wait complete. 2023-05-24T03:33:31.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.299+0000 7ff0464c3700 1 Processor -- start 2023-05-24T03:33:31.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.299+0000 7ff0464c3700 1 -- start start 2023-05-24T03:33:31.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.299+0000 7ff0464c3700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff04006bb40 0x7ff040150f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:31.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.299+0000 7ff0464c3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0400b8a50 0x7ff040151480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:31.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.299+0000 7ff0464c3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0400d03a0 0x7ff0400cb130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:31.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.299+0000 7ff0464c3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff040152680 con 0x7ff0400b8a50 2023-05-24T03:33:31.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.300+0000 7ff0464c3700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff040151a70 con 0x7ff0400d03a0 2023-05-24T03:33:31.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.300+0000 7ff0464c3700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff040151d50 con 0x7ff04006bb40 2023-05-24T03:33:31.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.300+0000 7ff03f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0400b8a50 0x7ff040151480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:31.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.300+0000 7ff03f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0400b8a50 0x7ff040151480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40888/0 (socket says 172.21.15.146:40888) 2023-05-24T03:33:31.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.300+0000 7ff03f7fe700 1 -- 172.21.15.146:0/3729672225 learned_addr learned my addr 172.21.15.146:0/3729672225 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:33:31.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.300+0000 7ff044a60700 1 --2- 172.21.15.146:0/3729672225 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0400d03a0 0x7ff0400cb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:31.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.300+0000 7ff03ffff700 1 --2- 172.21.15.146:0/3729672225 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff04006bb40 0x7ff040150f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:31.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.300+0000 7ff03f7fe700 1 -- 172.21.15.146:0/3729672225 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff04006bb40 msgr2=0x7ff040150f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:31.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.300+0000 7ff03f7fe700 1 --2- 172.21.15.146:0/3729672225 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff04006bb40 0x7ff040150f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:31.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.300+0000 7ff03f7fe700 1 -- 172.21.15.146:0/3729672225 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0400d03a0 msgr2=0x7ff0400cb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:31.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.300+0000 7ff03f7fe700 1 --2- 172.21.15.146:0/3729672225 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0400d03a0 0x7ff0400cb130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:31.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.300+0000 7ff03f7fe700 1 -- 172.21.15.146:0/3729672225 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0300094a0 con 0x7ff0400b8a50 2023-05-24T03:33:31.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.300+0000 7ff03f7fe700 1 --2- 172.21.15.146:0/3729672225 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0400b8a50 0x7ff040151480 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff0300090b0 tx=0x7ff030004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:33:31.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.300+0000 7ff03cff9700 1 -- 172.21.15.146:0/3729672225 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03001a7e0 con 0x7ff0400b8a50 2023-05-24T03:33:31.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.300+0000 7ff03cff9700 1 -- 172.21.15.146:0/3729672225 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff03001a940 con 0x7ff0400b8a50 2023-05-24T03:33:31.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.300+0000 7ff0464c3700 1 -- 172.21.15.146:0/3729672225 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0400cd9a0 con 0x7ff0400b8a50 2023-05-24T03:33:31.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.300+0000 7ff03cff9700 1 -- 172.21.15.146:0/3729672225 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03001acd0 con 0x7ff0400b8a50 2023-05-24T03:33:31.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.300+0000 7ff0464c3700 1 -- 172.21.15.146:0/3729672225 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0400cdf60 con 0x7ff0400b8a50 2023-05-24T03:33:31.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.301+0000 7ff0464c3700 1 -- 172.21.15.146:0/3729672225 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0400cdc80 con 0x7ff0400b8a50 2023-05-24T03:33:31.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.302+0000 7ff03cff9700 1 -- 172.21.15.146:0/3729672225 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff030022070 con 0x7ff0400b8a50 2023-05-24T03:33:31.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.302+0000 7ff03cff9700 1 --2- 172.21.15.146:0/3729672225 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7ff02006ace0 0x7ff02006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:31.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.302+0000 7ff03cff9700 1 -- 172.21.15.146:0/3729672225 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff03008a930 con 0x7ff0400b8a50 2023-05-24T03:33:31.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.302+0000 7ff03ffff700 1 --2- 172.21.15.146:0/3729672225 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7ff02006ace0 0x7ff02006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:31.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.302+0000 7ff03ffff700 1 --2- 172.21.15.146:0/3729672225 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7ff02006ace0 0x7ff02006d190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff040155d90 tx=0x7ff028009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:33:31.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.306+0000 7ff03cff9700 1 -- 172.21.15.146:0/3729672225 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ff030055620 con 0x7ff0400b8a50 2023-05-24T03:33:31.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.500+0000 7ff0464c3700 1 -- 172.21.15.146:0/3729672225 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff040072ae0 con 0x7ff0400b8a50 2023-05-24T03:33:31.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.501+0000 7ff03cff9700 1 -- 172.21.15.146:0/3729672225 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20251 (secure 0 0 0) 0x7ff030058c40 con 0x7ff0400b8a50 2023-05-24T03:33:31.505 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-05-24T03:33:31.506 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":30,"fsid":"11ca0adb-7672-4713-bde7-451e8b743ae9","created":"2023-05-24T03:29:19.113659+0000","modified":"2023-05-24T03:30:25.932188+0000","last_up_change":"2023-05-24T03:29:30.962339+0000","last_in_change":"2023-05-24T03:29:21.706540+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-24T03:29:32.749984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-24T03:29:37.719623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-24T03:29:42.165379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-24T03:29:43.431615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-24T03:29:46.503075+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f24b319b-fcc8-4385-b0cb-78138fc31417","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6801","nonce":3353593100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6803","nonce":3353593100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6807","nonce":3353593100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3353593100},{"type":"v1","addr":"172.21.15.146:6805","nonce":3353593100}]},"public_addr":"172.21.15.146:6801/3353593100","cluster_addr":"172.21.15.146:6803/3353593100","heartbeat_back_addr":"172.21.15.146:6807/3353593100","heartbeat_front_addr":"172.21.15.146:6805/3353593100","state":["exists","up"]},{"osd":1,"uuid":"c9639ea9-8f9b-498e-92c8-aa976edbf1da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6821","nonce":2537488734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6825","nonce":2537488734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6831","nonce":2537488734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6827","nonce":2537488734},{"type":"v1","addr":"172.21.15.146:6829","nonce":2537488734}]},"public_addr":"172.21.15.146:6821/2537488734","cluster_addr":"172.21.15.146:6825/2537488734","heartbeat_back_addr":"172.21.15.146:6831/2537488734","heartbeat_front_addr":"172.21.15.146:6829/2537488734","state":["exists","up"]},{"osd":2,"uuid":"7a6cfc6d-b0ca-4cb6-a66d-4001ec184657","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6809","nonce":1800242932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6811","nonce":1800242932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6815","nonce":1800242932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1800242932},{"type":"v1","addr":"172.21.15.146:6813","nonce":1800242932}]},"public_addr":"172.21.15.146:6809/1800242932","cluster_addr":"172.21.15.146:6811/1800242932","heartbeat_back_addr":"172.21.15.146:6815/1800242932","heartbeat_front_addr":"172.21.15.146:6813/1800242932","state":["exists","up"]},{"osd":3,"uuid":"401509f7-cecd-44a2-b0ae-22c81a5d93c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6817","nonce":1749783580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6820","nonce":1749783580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6828","nonce":1749783580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":1749783580},{"type":"v1","addr":"172.21.15.146:6824","nonce":1749783580}]},"public_addr":"172.21.15.146:6817/1749783580","cluster_addr":"172.21.15.146:6820/1749783580","heartbeat_back_addr":"172.21.15.146:6828/1749783580","heartbeat_front_addr":"172.21.15.146:6824/1749783580","state":["exists","up"]},{"osd":4,"uuid":"9d07f440-d125-4f99-a825-411fab894d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6811","nonce":163453435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6814","nonce":163453435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6819","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6821","nonce":163453435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":163453435},{"type":"v1","addr":"172.21.15.151:6818","nonce":163453435}]},"public_addr":"172.21.15.151:6811/163453435","cluster_addr":"172.21.15.151:6814/163453435","heartbeat_back_addr":"172.21.15.151:6821/163453435","heartbeat_front_addr":"172.21.15.151:6818/163453435","state":["exists","up"]},{"osd":5,"uuid":"9b2266e2-9e52-4f0e-96da-e703a6c23a6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6801","nonce":3283474903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6803","nonce":3283474903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6807","nonce":3283474903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3283474903},{"type":"v1","addr":"172.21.15.151:6805","nonce":3283474903}]},"public_addr":"172.21.15.151:6801/3283474903","cluster_addr":"172.21.15.151:6803/3283474903","heartbeat_back_addr":"172.21.15.151:6807/3283474903","heartbeat_front_addr":"172.21.15.151:6805/3283474903","state":["exists","up"]},{"osd":6,"uuid":"5daedf77-0a83-49e7-b497-d9ed10436972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6825","nonce":3889424178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6827","nonce":3889424178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6831","nonce":3889424178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3889424178},{"type":"v1","addr":"172.21.15.151:6829","nonce":3889424178}]},"public_addr":"172.21.15.151:6825/3889424178","cluster_addr":"172.21.15.151:6827/3889424178","heartbeat_back_addr":"172.21.15.151:6831/3889424178","heartbeat_front_addr":"172.21.15.151:6829/3889424178","state":["exists","up"]},{"osd":7,"uuid":"86ae4f7e-c01f-4c3d-a0dd-98160c209309","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6810","nonce":563291208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6815","nonce":563291208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6823","nonce":563291208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":563291208},{"type":"v1","addr":"172.21.15.151:6820","nonce":563291208}]},"public_addr":"172.21.15.151:6810/563291208","cluster_addr":"172.21.15.151:6815/563291208","heartbeat_back_addr":"172.21.15.151:6823/563291208","heartbeat_front_addr":"172.21.15.151:6820/563291208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.872472+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.937126+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.877234+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.884793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.881632+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.938293+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.857661+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-24T03:29:26.945883+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.9","mappings":[{"from":1,"to":5}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-24T03:33:31.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.503+0000 7ff0464c3700 1 -- 172.21.15.146:0/3729672225 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7ff02006ace0 msgr2=0x7ff02006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:31.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.503+0000 7ff0464c3700 1 --2- 172.21.15.146:0/3729672225 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7ff02006ace0 0x7ff02006d190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff040155d90 tx=0x7ff028009040 comp rx=0 tx=0).stop 2023-05-24T03:33:31.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.503+0000 7ff0464c3700 1 -- 172.21.15.146:0/3729672225 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0400b8a50 msgr2=0x7ff040151480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:31.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.503+0000 7ff0464c3700 1 --2- 172.21.15.146:0/3729672225 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0400b8a50 0x7ff040151480 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff0300090b0 tx=0x7ff030004750 comp rx=0 tx=0).stop 2023-05-24T03:33:31.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.503+0000 7ff0464c3700 1 -- 172.21.15.146:0/3729672225 shutdown_connections 2023-05-24T03:33:31.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.503+0000 7ff0464c3700 1 --2- 172.21.15.146:0/3729672225 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7ff02006ace0 0x7ff02006d190 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:31.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.503+0000 7ff0464c3700 1 --2- 172.21.15.146:0/3729672225 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0400d03a0 0x7ff0400cb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:31.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.503+0000 7ff0464c3700 1 --2- 172.21.15.146:0/3729672225 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff04006bb40 0x7ff040150f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:31.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.503+0000 7ff0464c3700 1 --2- 172.21.15.146:0/3729672225 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0400b8a50 0x7ff040151480 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:31.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.503+0000 7ff0464c3700 1 -- 172.21.15.146:0/3729672225 >> 172.21.15.146:0/3729672225 conn(0x7ff04006af30 msgr2=0x7ff0400b7460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:33:31.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.504+0000 7ff0464c3700 1 -- 172.21.15.146:0/3729672225 shutdown_connections 2023-05-24T03:33:31.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.504+0000 7ff0464c3700 1 -- 172.21.15.146:0/3729672225 wait complete. 2023-05-24T03:33:31.519 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-05-24T03:33:31.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.638+0000 7f74c5e6b700 1 Processor -- start 2023-05-24T03:33:31.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.638+0000 7f74c5e6b700 1 -- start start 2023-05-24T03:33:31.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.639+0000 7f74c5e6b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f74c00cc1d0 0x7f74c00b1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:31.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.639+0000 7f74c5e6b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74c00b27e0 con 0x7f74c00cbc90 2023-05-24T03:33:31.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.639+0000 7f74c5e6b700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74c00b2220 con 0x7f74c00cb8c0 2023-05-24T03:33:31.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.639+0000 7f74c5e6b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74c00b2500 con 0x7f74c00cc1d0 2023-05-24T03:33:31.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.639+0000 7f74beffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f74c00cc1d0 0x7f74c00b1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:31.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.639+0000 7f74bffff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f74c00cbc90 0x7f74c006a460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47350/0 (socket says 172.21.15.146:47350) 2023-05-24T03:33:31.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.639+0000 7f74bffff700 1 -- 172.21.15.146:0/933807501 learned_addr learned my addr 172.21.15.146:0/933807501 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:33:31.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.639+0000 7f74beffd700 1 -- 172.21.15.146:0/933807501 >> v1:172.21.15.151:6789/0 conn(0x7f74c00cb8c0 legacy=0x7f74c0161030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:33:31.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.639+0000 7f74beffd700 1 -- 172.21.15.146:0/933807501 >> v1:172.21.15.146:6789/0 conn(0x7f74c00cbc90 legacy=0x7f74c006a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:31.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.639+0000 7f74beffd700 1 -- 172.21.15.146:0/933807501 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c0160830 con 0x7f74c00cc1d0 2023-05-24T03:33:31.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.639+0000 7f74beffd700 1 --2- 172.21.15.146:0/933807501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74c00cc1d0 0x7f74c00b1920 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f74b4009840 tx=0x7f74b4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ec0c7c169f319d0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:33:31.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.639+0000 7f74be7fc700 1 -- 172.21.15.146:0/933807501 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b4004230 con 0x7f74c00cc1d0 2023-05-24T03:33:31.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.639+0000 7f74be7fc700 1 -- 172.21.15.146:0/933807501 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f74b4004390 con 0x7f74c00cc1d0 2023-05-24T03:33:31.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.639+0000 7f74be7fc700 1 -- 172.21.15.146:0/933807501 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b40036a0 con 0x7f74c00cc1d0 2023-05-24T03:33:31.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.640+0000 7f74c5e6b700 1 -- 172.21.15.146:0/933807501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74c00cc1d0 msgr2=0x7f74c00b1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:31.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.640+0000 7f74c5e6b700 1 --2- 172.21.15.146:0/933807501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74c00cc1d0 0x7f74c00b1920 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f74b4009840 tx=0x7f74b4009b50 comp rx=0 tx=0).stop 2023-05-24T03:33:31.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.640+0000 7f74c5e6b700 1 -- 172.21.15.146:0/933807501 shutdown_connections 2023-05-24T03:33:31.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.640+0000 7f74c5e6b700 1 --2- 172.21.15.146:0/933807501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74c00cc1d0 0x7f74c00b1920 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:31.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.640+0000 7f74c5e6b700 1 -- 172.21.15.146:0/933807501 >> 172.21.15.146:0/933807501 conn(0x7f74c00cfea0 msgr2=0x7f74c00d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:33:31.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.640+0000 7f74c5e6b700 1 -- 172.21.15.146:0/933807501 shutdown_connections 2023-05-24T03:33:31.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.640+0000 7f74c5e6b700 1 -- 172.21.15.146:0/933807501 wait complete. 2023-05-24T03:33:31.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.641+0000 7f74c5e6b700 1 Processor -- start 2023-05-24T03:33:31.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.641+0000 7f74c5e6b700 1 -- start start 2023-05-24T03:33:31.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.642+0000 7f74c5e6b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74c00cb8c0 0x7f74c01f1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:31.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.642+0000 7f74c5e6b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74c00cbc90 0x7f74c015d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:31.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.642+0000 7f74c5e6b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74c00cc1d0 0x7f74c015d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:31.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.642+0000 7f74c5e6b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c00c73c0 con 0x7f74c00cb8c0 2023-05-24T03:33:31.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.642+0000 7f74c5e6b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c00c76a0 con 0x7f74c00cc1d0 2023-05-24T03:33:31.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.642+0000 7f74c5e6b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74c00c7980 con 0x7f74c00cbc90 2023-05-24T03:33:31.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.642+0000 7f74bf7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74c00cb8c0 0x7f74c01f1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:31.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.642+0000 7f74bf7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74c00cb8c0 0x7f74c01f1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40900/0 (socket says 172.21.15.146:40900) 2023-05-24T03:33:31.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.642+0000 7f74bf7fe700 1 -- 172.21.15.146:0/4044178155 learned_addr learned my addr 172.21.15.146:0/4044178155 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:33:31.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.642+0000 7f74bffff700 1 --2- 172.21.15.146:0/4044178155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74c00cc1d0 0x7f74c015d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:31.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.642+0000 7f74beffd700 1 --2- 172.21.15.146:0/4044178155 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74c00cbc90 0x7f74c015d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:31.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.642+0000 7f74bf7fe700 1 -- 172.21.15.146:0/4044178155 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74c00cbc90 msgr2=0x7f74c015d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:31.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.642+0000 7f74bf7fe700 1 --2- 172.21.15.146:0/4044178155 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74c00cbc90 0x7f74c015d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:31.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.642+0000 7f74bf7fe700 1 -- 172.21.15.146:0/4044178155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74c00cc1d0 msgr2=0x7f74c015d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:31.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.642+0000 7f74bf7fe700 1 --2- 172.21.15.146:0/4044178155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74c00cc1d0 0x7f74c015d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:31.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.642+0000 7f74bf7fe700 1 -- 172.21.15.146:0/4044178155 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b40094a0 con 0x7f74c00cb8c0 2023-05-24T03:33:31.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.643+0000 7f74bf7fe700 1 --2- 172.21.15.146:0/4044178155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74c00cb8c0 0x7f74c01f1d70 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f74b000c4d0 tx=0x7f74b000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:33:31.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.643+0000 7f74a7fff700 1 -- 172.21.15.146:0/4044178155 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b0011790 con 0x7f74c00cb8c0 2023-05-24T03:33:31.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.643+0000 7f74a7fff700 1 -- 172.21.15.146:0/4044178155 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f74b00118f0 con 0x7f74c00cb8c0 2023-05-24T03:33:31.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.643+0000 7f74c5e6b700 1 -- 172.21.15.146:0/4044178155 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74c00b1e60 con 0x7f74c00cb8c0 2023-05-24T03:33:31.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.643+0000 7f74a7fff700 1 -- 172.21.15.146:0/4044178155 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b0011cc0 con 0x7f74c00cb8c0 2023-05-24T03:33:31.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.643+0000 7f74c5e6b700 1 -- 172.21.15.146:0/4044178155 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74c0160b10 con 0x7f74c00cb8c0 2023-05-24T03:33:31.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.644+0000 7f74c5e6b700 1 -- 172.21.15.146:0/4044178155 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74c00b1ff0 con 0x7f74c00cb8c0 2023-05-24T03:33:31.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.644+0000 7f74a7fff700 1 -- 172.21.15.146:0/4044178155 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f74b001c460 con 0x7f74c00cb8c0 2023-05-24T03:33:31.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.645+0000 7f74a7fff700 1 --2- 172.21.15.146:0/4044178155 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f74ac06ace0 0x7f74ac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:31.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.645+0000 7f74a7fff700 1 -- 172.21.15.146:0/4044178155 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f74b00896d0 con 0x7f74c00cb8c0 2023-05-24T03:33:31.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.645+0000 7f74beffd700 1 --2- 172.21.15.146:0/4044178155 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f74ac06ace0 0x7f74ac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:31.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.645+0000 7f74beffd700 1 --2- 172.21.15.146:0/4044178155 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f74ac06ace0 0x7f74ac06d190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f74c00cc610 tx=0x7f74b4013040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:33:31.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.649+0000 7f74a7fff700 1 -- 172.21.15.146:0/4044178155 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f74b00543c0 con 0x7f74c00cb8c0 2023-05-24T03:33:31.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.884+0000 7f74c5e6b700 1 -- 172.21.15.146:0/4044178155 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f74c004e810 con 0x7f74c00cb8c0 2023-05-24T03:33:31.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.889+0000 7f74a7fff700 1 -- 172.21.15.146:0/4044178155 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f74b00579e0 con 0x7f74c00cb8c0 2023-05-24T03:33:31.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.893+0000 7f74c5e6b700 1 -- 172.21.15.146:0/4044178155 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f74ac06ace0 msgr2=0x7f74ac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:31.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.893+0000 7f74c5e6b700 1 --2- 172.21.15.146:0/4044178155 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f74ac06ace0 0x7f74ac06d190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f74c00cc610 tx=0x7f74b4013040 comp rx=0 tx=0).stop 2023-05-24T03:33:31.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.893+0000 7f74c5e6b700 1 -- 172.21.15.146:0/4044178155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74c00cb8c0 msgr2=0x7f74c01f1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:31.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.893+0000 7f74c5e6b700 1 --2- 172.21.15.146:0/4044178155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74c00cb8c0 0x7f74c01f1d70 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f74b000c4d0 tx=0x7f74b000c890 comp rx=0 tx=0).stop 2023-05-24T03:33:31.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.893+0000 7f74c5e6b700 1 -- 172.21.15.146:0/4044178155 shutdown_connections 2023-05-24T03:33:31.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.893+0000 7f74c5e6b700 1 --2- 172.21.15.146:0/4044178155 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f74ac06ace0 0x7f74ac06d190 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:31.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.893+0000 7f74c5e6b700 1 --2- 172.21.15.146:0/4044178155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74c00cc1d0 0x7f74c015d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:31.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.893+0000 7f74c5e6b700 1 --2- 172.21.15.146:0/4044178155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74c00cb8c0 0x7f74c01f1d70 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:31.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.893+0000 7f74c5e6b700 1 --2- 172.21.15.146:0/4044178155 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74c00cbc90 0x7f74c015d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:31.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.893+0000 7f74c5e6b700 1 -- 172.21.15.146:0/4044178155 >> 172.21.15.146:0/4044178155 conn(0x7f74c00cfea0 msgr2=0x7f74c00d0270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:33:31.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.893+0000 7f74c5e6b700 1 -- 172.21.15.146:0/4044178155 shutdown_connections 2023-05-24T03:33:31.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:31.893+0000 7f74c5e6b700 1 -- 172.21.15.146:0/4044178155 wait complete. 2023-05-24T03:33:31.900 INFO:teuthology.orchestra.run.smithi146.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-05-24T03:33:31.910 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-05-24T03:33:31.932 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2023-05-24T03:33:32.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.032+0000 7f820cf39700 1 Processor -- start 2023-05-24T03:33:32.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.032+0000 7f820cf39700 1 -- start start 2023-05-24T03:33:32.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.032+0000 7f820cf39700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f820815cd90 0x7f82080cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:32.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.032+0000 7f820cf39700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f82080aefd0 0x7f8208160d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:32.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.033+0000 7f820cf39700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82080cfd00 con 0x7f820806a460 2023-05-24T03:33:32.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.033+0000 7f820cf39700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8208072350 con 0x7f82080aefd0 2023-05-24T03:33:32.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.033+0000 7f820cf39700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82080cf460 con 0x7f820815cd90 2023-05-24T03:33:32.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.033+0000 7f8206d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f82080aefd0 0x7f8208160d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:32.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.033+0000 7f820659c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f820806a460 0x7f820806a830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47372/0 (socket says 172.21.15.146:47372) 2023-05-24T03:33:32.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.033+0000 7f820659c700 1 -- 172.21.15.146:0/416484099 learned_addr learned my addr 172.21.15.146:0/416484099 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:33:32.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.033+0000 7f8205d9b700 1 --2- 172.21.15.146:0/416484099 >> v2:172.21.15.151:3300/0 conn(0x7f820815cd90 0x7f82080cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:32.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.033+0000 7f8206d9d700 1 -- 172.21.15.146:0/416484099 >> v2:172.21.15.151:3300/0 conn(0x7f820815cd90 msgr2=0x7f82080cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:33:32.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.033+0000 7f8206d9d700 1 --2- 172.21.15.146:0/416484099 >> v2:172.21.15.151:3300/0 conn(0x7f820815cd90 0x7f82080cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:32.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.033+0000 7f8206d9d700 1 -- 172.21.15.146:0/416484099 >> v1:172.21.15.146:6789/0 conn(0x7f820806a460 legacy=0x7f820806a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:32.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.033+0000 7f820559a700 1 -- 172.21.15.146:0/416484099 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 274162686 0 0) 0x7f81fc001110 con 0x7f820806a460 2023-05-24T03:33:32.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.033+0000 7f8206d9d700 1 -- 172.21.15.146:0/416484099 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82080cf740 con 0x7f82080aefd0 2023-05-24T03:33:32.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.033+0000 7f8206d9d700 1 --2- 172.21.15.146:0/416484099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82080aefd0 0x7f8208160d20 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8208074870 tx=0x7f820000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89f2084b3a371fb8 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:33:32.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.033+0000 7f820559a700 1 -- 172.21.15.146:0/416484099 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820000e070 con 0x7f82080aefd0 2023-05-24T03:33:32.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.033+0000 7f820559a700 1 -- 172.21.15.146:0/416484099 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f820000bb20 con 0x7f82080aefd0 2023-05-24T03:33:32.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.033+0000 7f820559a700 1 -- 172.21.15.146:0/416484099 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8200012430 con 0x7f82080aefd0 2023-05-24T03:33:32.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.034+0000 7f820cf39700 1 -- 172.21.15.146:0/416484099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82080aefd0 msgr2=0x7f8208160d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:32.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.034+0000 7f820cf39700 1 --2- 172.21.15.146:0/416484099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82080aefd0 0x7f8208160d20 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8208074870 tx=0x7f820000b330 comp rx=0 tx=0).stop 2023-05-24T03:33:32.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.034+0000 7f820cf39700 1 -- 172.21.15.146:0/416484099 shutdown_connections 2023-05-24T03:33:32.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.034+0000 7f820cf39700 1 --2- 172.21.15.146:0/416484099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82080aefd0 0x7f8208160d20 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:32.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.034+0000 7f820cf39700 1 --2- 172.21.15.146:0/416484099 >> v2:172.21.15.151:3300/0 conn(0x7f820815cd90 0x7f82080cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:32.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.034+0000 7f820cf39700 1 -- 172.21.15.146:0/416484099 >> 172.21.15.146:0/416484099 conn(0x7f82080cfea0 msgr2=0x7f82080d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:33:32.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.034+0000 7f820cf39700 1 -- 172.21.15.146:0/416484099 shutdown_connections 2023-05-24T03:33:32.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.034+0000 7f820cf39700 1 -- 172.21.15.146:0/416484099 wait complete. 2023-05-24T03:33:32.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.035+0000 7f820cf39700 1 Processor -- start 2023-05-24T03:33:32.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.035+0000 7f820cf39700 1 -- start start 2023-05-24T03:33:32.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.036+0000 7f820cf39700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f820806a460 0x7f8208158de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:32.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.036+0000 7f820cf39700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82080aefd0 0x7f82080c3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:32.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.036+0000 7f820cf39700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f820815cd90 0x7f8208154510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:32.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.036+0000 7f820cf39700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82080c3e80 con 0x7f820806a460 2023-05-24T03:33:32.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.036+0000 7f820cf39700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82080b09d0 con 0x7f820815cd90 2023-05-24T03:33:32.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.036+0000 7f820cf39700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82080c4070 con 0x7f82080aefd0 2023-05-24T03:33:32.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.036+0000 7f820659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f820806a460 0x7f8208158de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:32.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.036+0000 7f820659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f820806a460 0x7f8208158de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40926/0 (socket says 172.21.15.146:40926) 2023-05-24T03:33:32.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.036+0000 7f820659c700 1 -- 172.21.15.146:0/3322559116 learned_addr learned my addr 172.21.15.146:0/3322559116 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:33:32.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.036+0000 7f8206d9d700 1 --2- 172.21.15.146:0/3322559116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f820815cd90 0x7f8208154510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:32.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.036+0000 7f8205d9b700 1 --2- 172.21.15.146:0/3322559116 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82080aefd0 0x7f82080c3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:32.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.037+0000 7f820659c700 1 -- 172.21.15.146:0/3322559116 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82080aefd0 msgr2=0x7f82080c3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:32.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.037+0000 7f820659c700 1 --2- 172.21.15.146:0/3322559116 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82080aefd0 0x7f82080c3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:32.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.037+0000 7f820659c700 1 -- 172.21.15.146:0/3322559116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f820815cd90 msgr2=0x7f8208154510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:32.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.037+0000 7f820659c700 1 --2- 172.21.15.146:0/3322559116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f820815cd90 0x7f8208154510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:32.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.037+0000 7f820659c700 1 -- 172.21.15.146:0/3322559116 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8200009a70 con 0x7f820806a460 2023-05-24T03:33:32.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.037+0000 7f8206d9d700 1 --2- 172.21.15.146:0/3322559116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f820815cd90 0x7f8208154510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:33:32.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.037+0000 7f820659c700 1 --2- 172.21.15.146:0/3322559116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f820806a460 0x7f8208158de0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f81fc00c730 tx=0x7f81fc00caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:33:32.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.037+0000 7f81f6ffd700 1 -- 172.21.15.146:0/3322559116 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81fc004c80 con 0x7f820806a460 2023-05-24T03:33:32.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.037+0000 7f81f6ffd700 1 -- 172.21.15.146:0/3322559116 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f81fc004e00 con 0x7f820806a460 2023-05-24T03:33:32.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.037+0000 7f820cf39700 1 -- 172.21.15.146:0/3322559116 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8208160800 con 0x7f820806a460 2023-05-24T03:33:32.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.037+0000 7f81f6ffd700 1 -- 172.21.15.146:0/3322559116 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81fc007330 con 0x7f820806a460 2023-05-24T03:33:32.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.037+0000 7f820cf39700 1 -- 172.21.15.146:0/3322559116 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82080cfa20 con 0x7f820806a460 2023-05-24T03:33:32.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.038+0000 7f820cf39700 1 -- 172.21.15.146:0/3322559116 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82080af620 con 0x7f820806a460 2023-05-24T03:33:32.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.038+0000 7f81f6ffd700 1 -- 172.21.15.146:0/3322559116 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f81fc007490 con 0x7f820806a460 2023-05-24T03:33:32.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.039+0000 7f81f6ffd700 1 --2- 172.21.15.146:0/3322559116 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f81e806ace0 0x7f81e806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:32.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.039+0000 7f81f6ffd700 1 -- 172.21.15.146:0/3322559116 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6957+0+0 (secure 0 0 0) 0x7f81fc089460 con 0x7f820806a460 2023-05-24T03:33:32.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.039+0000 7f8205d9b700 1 --2- 172.21.15.146:0/3322559116 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f81e806ace0 0x7f81e806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:32.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.039+0000 7f8205d9b700 1 --2- 172.21.15.146:0/3322559116 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f81e806ace0 0x7f81e806d190 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f82081f6af0 tx=0x7f81f8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:33:32.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.043+0000 7f81f6ffd700 1 -- 172.21.15.146:0/3322559116 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f81fc054190 con 0x7f820806a460 2023-05-24T03:33:32.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.278+0000 7f820cf39700 1 -- 172.21.15.146:0/3322559116 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f82080cfd00 con 0x7f820806a460 2023-05-24T03:33:32.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.281+0000 7f81f6ffd700 1 -- 172.21.15.146:0/3322559116 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f82080cfd00 con 0x7f820806a460 2023-05-24T03:33:32.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.284+0000 7f820cf39700 1 -- 172.21.15.146:0/3322559116 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f81e806ace0 msgr2=0x7f81e806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:32.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.284+0000 7f820cf39700 1 --2- 172.21.15.146:0/3322559116 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f81e806ace0 0x7f81e806d190 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f82081f6af0 tx=0x7f81f8008040 comp rx=0 tx=0).stop 2023-05-24T03:33:32.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.284+0000 7f820cf39700 1 -- 172.21.15.146:0/3322559116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f820806a460 msgr2=0x7f8208158de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:32.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.284+0000 7f820cf39700 1 --2- 172.21.15.146:0/3322559116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f820806a460 0x7f8208158de0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f81fc00c730 tx=0x7f81fc00caf0 comp rx=0 tx=0).stop 2023-05-24T03:33:32.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.284+0000 7f820cf39700 1 -- 172.21.15.146:0/3322559116 shutdown_connections 2023-05-24T03:33:32.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.284+0000 7f820cf39700 1 --2- 172.21.15.146:0/3322559116 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f81e806ace0 0x7f81e806d190 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:32.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.284+0000 7f820cf39700 1 --2- 172.21.15.146:0/3322559116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f820815cd90 0x7f8208154510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:32.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.284+0000 7f820cf39700 1 --2- 172.21.15.146:0/3322559116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f820806a460 0x7f8208158de0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:32.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.284+0000 7f820cf39700 1 --2- 172.21.15.146:0/3322559116 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82080aefd0 0x7f82080c3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:32.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.284+0000 7f820cf39700 1 -- 172.21.15.146:0/3322559116 >> 172.21.15.146:0/3322559116 conn(0x7f82080cfea0 msgr2=0x7f82080b2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:33:32.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.284+0000 7f820cf39700 1 -- 172.21.15.146:0/3322559116 shutdown_connections 2023-05-24T03:33:32.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.284+0000 7f820cf39700 1 -- 172.21.15.146:0/3322559116 wait complete. 2023-05-24T03:33:32.300 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-05-24T03:33:32.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.462+0000 7faab7ef8700 1 Processor -- start 2023-05-24T03:33:32.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.462+0000 7faab7ef8700 1 -- start start 2023-05-24T03:33:32.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.462+0000 7faab7ef8700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7faab015acd0 0x7faab00ce100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:32.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.462+0000 7faab7ef8700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faab00d06d0 0x7faab00d0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:32.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.462+0000 7faab7ef8700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faab00cd940 con 0x7faab00d1060 2023-05-24T03:33:32.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.463+0000 7faab7ef8700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faab00d14e0 con 0x7faab015acd0 2023-05-24T03:33:32.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.463+0000 7faab7ef8700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faab00b33d0 con 0x7faab00d06d0 2023-05-24T03:33:32.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.463+0000 7faab6495700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7faab00d1060 0x7faab015e930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47390/0 (socket says 172.21.15.146:47390) 2023-05-24T03:33:32.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.463+0000 7faab6495700 1 -- 172.21.15.146:0/2556173902 learned_addr learned my addr 172.21.15.146:0/2556173902 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:33:32.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.463+0000 7faab5c94700 1 --2- 172.21.15.146:0/2556173902 >> v2:172.21.15.151:3300/0 conn(0x7faab015acd0 0x7faab00ce100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:32.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.463+0000 7faab5493700 1 --2- 172.21.15.146:0/2556173902 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faab00d06d0 0x7faab00d0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:32.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.463+0000 7faab4c92700 1 -- 172.21.15.146:0/2556173902 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1358406763 0 0) 0x7faab00cd940 con 0x7faab00d1060 2023-05-24T03:33:32.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.463+0000 7faab4c92700 1 -- 172.21.15.146:0/2556173902 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa9c0035b0 con 0x7faab00d1060 2023-05-24T03:33:32.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.463+0000 7faab4c92700 1 -- 172.21.15.146:0/2556173902 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1077048881 0 0) 0x7faa9c0035b0 con 0x7faab00d1060 2023-05-24T03:33:32.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.463+0000 7faab4c92700 1 -- 172.21.15.146:0/2556173902 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faab00d06d0 msgr2=0x7faab00d0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:33:32.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.463+0000 7faab4c92700 1 --2- 172.21.15.146:0/2556173902 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faab00d06d0 0x7faab00d0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:32.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.463+0000 7faab4c92700 1 -- 172.21.15.146:0/2556173902 >> v2:172.21.15.151:3300/0 conn(0x7faab015acd0 msgr2=0x7faab00ce100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:33:32.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.463+0000 7faab4c92700 1 --2- 172.21.15.146:0/2556173902 >> v2:172.21.15.151:3300/0 conn(0x7faab015acd0 0x7faab00ce100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:32.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.463+0000 7faab4c92700 1 -- 172.21.15.146:0/2556173902 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab00b3690 con 0x7faab00d1060 2023-05-24T03:33:32.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.463+0000 7faab4c92700 1 -- 172.21.15.146:0/2556173902 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1301887351 0 0) 0x7faaa80019f0 con 0x7faab00d1060 2023-05-24T03:33:32.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.463+0000 7faab4c92700 1 -- 172.21.15.146:0/2556173902 >> v1:172.21.15.146:6789/0 conn(0x7faab00d1060 legacy=0x7faab015e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:32.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.463+0000 7faab4c92700 1 --2- 172.21.15.146:0/2556173902 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa9c003a00 0x7faa9c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:32.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.463+0000 7faab4c92700 1 --2- 172.21.15.146:0/2556173902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa9c004430 0x7faa9c0048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:32.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.463+0000 7faab4c92700 1 --2- 172.21.15.146:0/2556173902 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faab00d06d0 0x7faa9c004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:32.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.463+0000 7faab4c92700 1 -- 172.21.15.146:0/2556173902 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab00d14e0 con 0x7faa9c004430 2023-05-24T03:33:32.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.463+0000 7faab4c92700 1 -- 172.21.15.146:0/2556173902 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab00b33d0 con 0x7faa9c003a00 2023-05-24T03:33:32.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.463+0000 7faab4c92700 1 -- 172.21.15.146:0/2556173902 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa9c00ba10 con 0x7faab00d06d0 2023-05-24T03:33:32.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.463+0000 7faab5493700 1 --2- 172.21.15.146:0/2556173902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa9c004430 0x7faa9c0048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:32.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.463+0000 7faab5c94700 1 --2- 172.21.15.146:0/2556173902 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa9c003a00 0x7faa9c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:32.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.464+0000 7faab6495700 1 --2- 172.21.15.146:0/2556173902 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faab00d06d0 0x7faa9c004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:32.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.464+0000 7faab5493700 1 -- 172.21.15.146:0/2556173902 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faab00d06d0 msgr2=0x7faa9c004fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:33:32.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.464+0000 7faab5493700 1 --2- 172.21.15.146:0/2556173902 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faab00d06d0 0x7faa9c004fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:32.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.464+0000 7faab5493700 1 -- 172.21.15.146:0/2556173902 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa9c003a00 msgr2=0x7faa9c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:33:32.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.464+0000 7faab5493700 1 --2- 172.21.15.146:0/2556173902 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa9c003a00 0x7faa9c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:32.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.464+0000 7faab5493700 1 -- 172.21.15.146:0/2556173902 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa9c0035b0 con 0x7faa9c004430 2023-05-24T03:33:32.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.464+0000 7faab5493700 1 --2- 172.21.15.146:0/2556173902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa9c004430 0x7faa9c0048f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7faaac009b60 tx=0x7faa9c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8c564db8baed861 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:33:32.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.464+0000 7faab4c92700 1 -- 172.21.15.146:0/2556173902 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaac00e6c0 con 0x7faa9c004430 2023-05-24T03:33:32.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.464+0000 7faab4c92700 1 -- 172.21.15.146:0/2556173902 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7faaac00e820 con 0x7faa9c004430 2023-05-24T03:33:32.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.464+0000 7faab4c92700 1 -- 172.21.15.146:0/2556173902 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaac00ebb0 con 0x7faa9c004430 2023-05-24T03:33:32.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.464+0000 7faab7ef8700 1 -- 172.21.15.146:0/2556173902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa9c004430 msgr2=0x7faa9c0048f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:32.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.464+0000 7faab7ef8700 1 --2- 172.21.15.146:0/2556173902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa9c004430 0x7faa9c0048f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7faaac009b60 tx=0x7faa9c005880 comp rx=0 tx=0).stop 2023-05-24T03:33:32.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.464+0000 7faab6495700 1 -- 172.21.15.146:0/2556173902 reap_dead start 2023-05-24T03:33:32.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.464+0000 7faab7ef8700 1 -- 172.21.15.146:0/2556173902 shutdown_connections 2023-05-24T03:33:32.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.464+0000 7faab7ef8700 1 -- 172.21.15.146:0/2556173902 >> 172.21.15.146:0/2556173902 conn(0x7faab006e2a0 msgr2=0x7faab006e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:33:32.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.465+0000 7faab7ef8700 1 -- 172.21.15.146:0/2556173902 shutdown_connections 2023-05-24T03:33:32.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.465+0000 7faab7ef8700 1 -- 172.21.15.146:0/2556173902 wait complete. 2023-05-24T03:33:32.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.466+0000 7faab7ef8700 1 Processor -- start 2023-05-24T03:33:32.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.466+0000 7faab7ef8700 1 -- start start 2023-05-24T03:33:32.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.466+0000 7faab7ef8700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa9c004430 0x7faab0159130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:32.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.466+0000 7faab7ef8700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faab00caaa0 0x7faab00caf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:32.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.466+0000 7faab7ef8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faab0151c40 0x7faab01520c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:32.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.466+0000 7faab7ef8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab0152600 con 0x7faab0151c40 2023-05-24T03:33:32.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.466+0000 7faab7ef8700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab015b480 con 0x7faab00caaa0 2023-05-24T03:33:32.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.466+0000 7faab7ef8700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faab015b760 con 0x7faa9c004430 2023-05-24T03:33:32.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.467+0000 7faab6495700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faab0151c40 0x7faab01520c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:32.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.467+0000 7faab6495700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faab0151c40 0x7faab01520c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40952/0 (socket says 172.21.15.146:40952) 2023-05-24T03:33:32.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.467+0000 7faab6495700 1 -- 172.21.15.146:0/587580213 learned_addr learned my addr 172.21.15.146:0/587580213 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:33:32.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.467+0000 7faab5493700 1 --2- 172.21.15.146:0/587580213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faab00caaa0 0x7faab00caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:32.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.467+0000 7faab5c94700 1 --2- 172.21.15.146:0/587580213 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa9c004430 0x7faab0159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:32.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.467+0000 7faab6495700 1 -- 172.21.15.146:0/587580213 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa9c004430 msgr2=0x7faab0159130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:32.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.467+0000 7faab6495700 1 --2- 172.21.15.146:0/587580213 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa9c004430 0x7faab0159130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:32.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.467+0000 7faab6495700 1 -- 172.21.15.146:0/587580213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faab00caaa0 msgr2=0x7faab00caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:32.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.467+0000 7faab6495700 1 --2- 172.21.15.146:0/587580213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faab00caaa0 0x7faab00caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:32.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.467+0000 7faab6495700 1 -- 172.21.15.146:0/587580213 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab00b3970 con 0x7faab0151c40 2023-05-24T03:33:32.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.467+0000 7faab6495700 1 --2- 172.21.15.146:0/587580213 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faab0151c40 0x7faab01520c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7faaa8001330 tx=0x7faaa8007c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:33:32.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.467+0000 7faaa67fc700 1 -- 172.21.15.146:0/587580213 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa800ebc0 con 0x7faab0151c40 2023-05-24T03:33:32.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.467+0000 7faaa67fc700 1 -- 172.21.15.146:0/587580213 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7faaa800ed40 con 0x7faab0151c40 2023-05-24T03:33:32.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.467+0000 7faaa67fc700 1 -- 172.21.15.146:0/587580213 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa8013680 con 0x7faab0151c40 2023-05-24T03:33:32.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.467+0000 7faab7ef8700 1 -- 172.21.15.146:0/587580213 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faab00cdbe0 con 0x7faab0151c40 2023-05-24T03:33:32.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.467+0000 7faab7ef8700 1 -- 172.21.15.146:0/587580213 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faab00d03b0 con 0x7faab0151c40 2023-05-24T03:33:32.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.468+0000 7faab7ef8700 1 -- 172.21.15.146:0/587580213 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faab015c090 con 0x7faab0151c40 2023-05-24T03:33:32.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.469+0000 7faaa67fc700 1 -- 172.21.15.146:0/587580213 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7faaa80137e0 con 0x7faab0151c40 2023-05-24T03:33:32.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.469+0000 7faaa67fc700 1 --2- 172.21.15.146:0/587580213 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7faa9406ace0 0x7faa9406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:32.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.469+0000 7faaa67fc700 1 -- 172.21.15.146:0/587580213 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6957+0+0 (secure 0 0 0) 0x7faaa8089ca0 con 0x7faab0151c40 2023-05-24T03:33:32.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.469+0000 7faab5c94700 1 --2- 172.21.15.146:0/587580213 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7faa9406ace0 0x7faa9406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:32.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.469+0000 7faab5c94700 1 --2- 172.21.15.146:0/587580213 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7faa9406ace0 0x7faa9406d190 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7faaa0009ce0 tx=0x7faaa0009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:33:32.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.473+0000 7faaa67fc700 1 -- 172.21.15.146:0/587580213 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7faaa8054a60 con 0x7faab0151c40 2023-05-24T03:33:32.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:32.668+0000 7faab7ef8700 1 -- 172.21.15.146:0/587580213 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7faab004e810 con 0x7faab0151c40 2023-05-24T03:33:33.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.285+0000 7faaa67fc700 1 -- 172.21.15.146:0/587580213 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v32) v1 ==== 181+0+0 (secure 0 0 0) 0x7faaa8058080 con 0x7faab0151c40 2023-05-24T03:33:33.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.290+0000 7faab7ef8700 1 -- 172.21.15.146:0/587580213 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7faa9406ace0 msgr2=0x7faa9406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:33.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.290+0000 7faab7ef8700 1 --2- 172.21.15.146:0/587580213 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7faa9406ace0 0x7faa9406d190 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7faaa0009ce0 tx=0x7faaa0009210 comp rx=0 tx=0).stop 2023-05-24T03:33:33.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.290+0000 7faab7ef8700 1 -- 172.21.15.146:0/587580213 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faab0151c40 msgr2=0x7faab01520c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:33.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.290+0000 7faab7ef8700 1 --2- 172.21.15.146:0/587580213 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faab0151c40 0x7faab01520c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7faaa8001330 tx=0x7faaa8007c90 comp rx=0 tx=0).stop 2023-05-24T03:33:33.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.290+0000 7faab7ef8700 1 -- 172.21.15.146:0/587580213 shutdown_connections 2023-05-24T03:33:33.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.290+0000 7faab7ef8700 1 --2- 172.21.15.146:0/587580213 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7faa9406ace0 0x7faa9406d190 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:33.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.290+0000 7faab7ef8700 1 --2- 172.21.15.146:0/587580213 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faab0151c40 0x7faab01520c0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:33.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.290+0000 7faab7ef8700 1 --2- 172.21.15.146:0/587580213 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa9c004430 0x7faab0159130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:33.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.290+0000 7faab7ef8700 1 --2- 172.21.15.146:0/587580213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faab00caaa0 0x7faab00caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:33.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.290+0000 7faab7ef8700 1 -- 172.21.15.146:0/587580213 >> 172.21.15.146:0/587580213 conn(0x7faab006e2a0 msgr2=0x7faab006e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:33:33.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.290+0000 7faab7ef8700 1 -- 172.21.15.146:0/587580213 shutdown_connections 2023-05-24T03:33:33.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.290+0000 7faab7ef8700 1 -- 172.21.15.146:0/587580213 wait complete. 2023-05-24T03:33:33.297 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' removed 2023-05-24T03:33:33.309 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-05-24T03:33:33.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.435+0000 7fe0e8faf700 1 Processor -- start 2023-05-24T03:33:33.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.435+0000 7fe0e8faf700 1 -- start start 2023-05-24T03:33:33.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.436+0000 7fe0e8faf700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe0e40cdf10 0x7fe0e4159c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:33.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.436+0000 7fe0e8faf700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe0e4070f50 0x7fe0e406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:33.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.436+0000 7fe0e8faf700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0e415a3c0 con 0x7fe0e415dcf0 2023-05-24T03:33:33.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.436+0000 7fe0e8faf700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0e415a1c0 con 0x7fe0e4070f50 2023-05-24T03:33:33.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.436+0000 7fe0e8faf700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0e415a6a0 con 0x7fe0e40cdf10 2023-05-24T03:33:33.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.436+0000 7fe0e2d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe0e4070f50 0x7fe0e406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:33.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.436+0000 7fe0e2d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe0e4070f50 0x7fe0e406d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40960/0 (socket says 172.21.15.146:40960) 2023-05-24T03:33:33.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.436+0000 7fe0e2d9d700 1 -- 172.21.15.146:0/4123314759 learned_addr learned my addr 172.21.15.146:0/4123314759 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:33:33.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.436+0000 7fe0e259c700 1 --2- 172.21.15.146:0/4123314759 >> v2:172.21.15.151:3300/0 conn(0x7fe0e40cdf10 0x7fe0e4159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:33.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.436+0000 7fe0e2d9d700 1 -- 172.21.15.146:0/4123314759 >> v2:172.21.15.151:3300/0 conn(0x7fe0e40cdf10 msgr2=0x7fe0e4159c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:33:33.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.436+0000 7fe0e2d9d700 1 --2- 172.21.15.146:0/4123314759 >> v2:172.21.15.151:3300/0 conn(0x7fe0e40cdf10 0x7fe0e4159c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:33.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.436+0000 7fe0e2d9d700 1 -- 172.21.15.146:0/4123314759 >> v1:172.21.15.151:6789/0 conn(0x7fe0e415dcf0 legacy=0x7fe0e40ce2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:33:33.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.436+0000 7fe0e2d9d700 1 -- 172.21.15.146:0/4123314759 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e415a980 con 0x7fe0e4070f50 2023-05-24T03:33:33.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.436+0000 7fe0e259c700 1 --2- 172.21.15.146:0/4123314759 >> v2:172.21.15.151:3300/0 conn(0x7fe0e40cdf10 0x7fe0e4159c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:33:33.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.437+0000 7fe0e2d9d700 1 --2- 172.21.15.146:0/4123314759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0e4070f50 0x7fe0e406d6b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4067440 tx=0x7fe0dc00d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=629deff6d3742e27 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:33:33.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.437+0000 7fe0e159a700 1 -- 172.21.15.146:0/4123314759 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc010070 con 0x7fe0e4070f50 2023-05-24T03:33:33.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.437+0000 7fe0e159a700 1 -- 172.21.15.146:0/4123314759 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe0dc00dd50 con 0x7fe0e4070f50 2023-05-24T03:33:33.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.437+0000 7fe0e159a700 1 -- 172.21.15.146:0/4123314759 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc00b330 con 0x7fe0e4070f50 2023-05-24T03:33:33.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.437+0000 7fe0e8faf700 1 -- 172.21.15.146:0/4123314759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0e4070f50 msgr2=0x7fe0e406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:33.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.437+0000 7fe0e8faf700 1 --2- 172.21.15.146:0/4123314759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0e4070f50 0x7fe0e406d6b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4067440 tx=0x7fe0dc00d430 comp rx=0 tx=0).stop 2023-05-24T03:33:33.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.437+0000 7fe0e8faf700 1 -- 172.21.15.146:0/4123314759 shutdown_connections 2023-05-24T03:33:33.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.437+0000 7fe0e8faf700 1 --2- 172.21.15.146:0/4123314759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0e4070f50 0x7fe0e406d6b0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:33.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.437+0000 7fe0e8faf700 1 --2- 172.21.15.146:0/4123314759 >> v2:172.21.15.151:3300/0 conn(0x7fe0e40cdf10 0x7fe0e4159c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:33.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.437+0000 7fe0e8faf700 1 -- 172.21.15.146:0/4123314759 >> 172.21.15.146:0/4123314759 conn(0x7fe0e40cfea0 msgr2=0x7fe0e40d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:33:33.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.437+0000 7fe0e8faf700 1 -- 172.21.15.146:0/4123314759 shutdown_connections 2023-05-24T03:33:33.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.437+0000 7fe0e8faf700 1 -- 172.21.15.146:0/4123314759 wait complete. 2023-05-24T03:33:33.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.439+0000 7fe0e8faf700 1 Processor -- start 2023-05-24T03:33:33.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.439+0000 7fe0e8faf700 1 -- start start 2023-05-24T03:33:33.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.439+0000 7fe0e8faf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0e4070f50 0x7fe0e41ef090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:33.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.439+0000 7fe0e8faf700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0e40cdf10 0x7fe0e4154f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:33.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.439+0000 7fe0e8faf700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0e415dcf0 0x7fe0e415b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:33.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.439+0000 7fe0e8faf700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e41f13c0 con 0x7fe0e4070f50 2023-05-24T03:33:33.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.439+0000 7fe0e8faf700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e415c860 con 0x7fe0e415dcf0 2023-05-24T03:33:33.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.439+0000 7fe0e8faf700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e40c74f0 con 0x7fe0e40cdf10 2023-05-24T03:33:33.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.439+0000 7fe0e259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0e4070f50 0x7fe0e41ef090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:33.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.440+0000 7fe0e259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0e4070f50 0x7fe0e41ef090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40964/0 (socket says 172.21.15.146:40964) 2023-05-24T03:33:33.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.440+0000 7fe0e259c700 1 -- 172.21.15.146:0/1972392696 learned_addr learned my addr 172.21.15.146:0/1972392696 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:33:33.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.440+0000 7fe0e2d9d700 1 --2- 172.21.15.146:0/1972392696 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0e415dcf0 0x7fe0e415b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:33.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.440+0000 7fe0e1d9b700 1 --2- 172.21.15.146:0/1972392696 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0e40cdf10 0x7fe0e4154f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:33.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.440+0000 7fe0e259c700 1 -- 172.21.15.146:0/1972392696 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0e40cdf10 msgr2=0x7fe0e4154f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:33.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.440+0000 7fe0e259c700 1 --2- 172.21.15.146:0/1972392696 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0e40cdf10 0x7fe0e4154f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:33.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.440+0000 7fe0e259c700 1 -- 172.21.15.146:0/1972392696 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0e415dcf0 msgr2=0x7fe0e415b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:33.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.440+0000 7fe0e259c700 1 --2- 172.21.15.146:0/1972392696 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0e415dcf0 0x7fe0e415b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:33.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.440+0000 7fe0e259c700 1 -- 172.21.15.146:0/1972392696 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0dc00bd40 con 0x7fe0e4070f50 2023-05-24T03:33:33.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.440+0000 7fe0e1d9b700 1 --2- 172.21.15.146:0/1972392696 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0e40cdf10 0x7fe0e4154f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:33:33.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.440+0000 7fe0e259c700 1 --2- 172.21.15.146:0/1972392696 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0e4070f50 0x7fe0e41ef090 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe0d800c750 tx=0x7fe0d800ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:33:33.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.440+0000 7fe0d2ffd700 1 -- 172.21.15.146:0/1972392696 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d8011800 con 0x7fe0e4070f50 2023-05-24T03:33:33.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.440+0000 7fe0d2ffd700 1 -- 172.21.15.146:0/1972392696 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe0d8011960 con 0x7fe0e4070f50 2023-05-24T03:33:33.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.440+0000 7fe0e8faf700 1 -- 172.21.15.146:0/1972392696 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0e406d190 con 0x7fe0e4070f50 2023-05-24T03:33:33.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.440+0000 7fe0d2ffd700 1 -- 172.21.15.146:0/1972392696 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d8011cf0 con 0x7fe0e4070f50 2023-05-24T03:33:33.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.440+0000 7fe0e8faf700 1 -- 172.21.15.146:0/1972392696 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0e415ac60 con 0x7fe0e4070f50 2023-05-24T03:33:33.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.441+0000 7fe0e8faf700 1 -- 172.21.15.146:0/1972392696 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0e40ca2b0 con 0x7fe0e4070f50 2023-05-24T03:33:33.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.441+0000 7fe0d2ffd700 1 -- 172.21.15.146:0/1972392696 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe0d8021350 con 0x7fe0e4070f50 2023-05-24T03:33:33.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.442+0000 7fe0d2ffd700 1 --2- 172.21.15.146:0/1972392696 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fe0c406ace0 0x7fe0c406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:33.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.442+0000 7fe0d2ffd700 1 -- 172.21.15.146:0/1972392696 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6519+0+0 (secure 0 0 0) 0x7fe0d8089600 con 0x7fe0e4070f50 2023-05-24T03:33:33.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.442+0000 7fe0e1d9b700 1 --2- 172.21.15.146:0/1972392696 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fe0c406ace0 0x7fe0c406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:33.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.442+0000 7fe0e1d9b700 1 --2- 172.21.15.146:0/1972392696 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fe0c406ace0 0x7fe0c406d190 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe0e40cb750 tx=0x7fe0d4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:33:33.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.446+0000 7fe0d2ffd700 1 -- 172.21.15.146:0/1972392696 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fe0d8057ee0 con 0x7fe0e4070f50 2023-05-24T03:33:33.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:33.633+0000 7fe0e8faf700 1 -- 172.21.15.146:0/1972392696 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe0e415e170 con 0x7fe0e4070f50 2023-05-24T03:33:34.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.293+0000 7fe0d2ffd700 1 -- 172.21.15.146:0/1972392696 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v33) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe0d8057a70 con 0x7fe0e4070f50 2023-05-24T03:33:34.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.301+0000 7fe0e8faf700 1 -- 172.21.15.146:0/1972392696 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fe0c406ace0 msgr2=0x7fe0c406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:34.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.301+0000 7fe0e8faf700 1 --2- 172.21.15.146:0/1972392696 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fe0c406ace0 0x7fe0c406d190 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe0e40cb750 tx=0x7fe0d4009040 comp rx=0 tx=0).stop 2023-05-24T03:33:34.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.301+0000 7fe0e8faf700 1 -- 172.21.15.146:0/1972392696 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0e4070f50 msgr2=0x7fe0e41ef090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:34.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.301+0000 7fe0e8faf700 1 --2- 172.21.15.146:0/1972392696 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0e4070f50 0x7fe0e41ef090 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe0d800c750 tx=0x7fe0d800ca60 comp rx=0 tx=0).stop 2023-05-24T03:33:34.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.302+0000 7fe0e8faf700 1 -- 172.21.15.146:0/1972392696 shutdown_connections 2023-05-24T03:33:34.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.302+0000 7fe0e8faf700 1 --2- 172.21.15.146:0/1972392696 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7fe0c406ace0 0x7fe0c406d190 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:34.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.302+0000 7fe0e8faf700 1 --2- 172.21.15.146:0/1972392696 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0e415dcf0 0x7fe0e415b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:34.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.302+0000 7fe0e8faf700 1 --2- 172.21.15.146:0/1972392696 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0e4070f50 0x7fe0e41ef090 secure :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe0d800c750 tx=0x7fe0d800ca60 comp rx=0 tx=0).stop 2023-05-24T03:33:34.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.302+0000 7fe0e8faf700 1 --2- 172.21.15.146:0/1972392696 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0e40cdf10 0x7fe0e4154f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:34.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.302+0000 7fe0e8faf700 1 -- 172.21.15.146:0/1972392696 >> 172.21.15.146:0/1972392696 conn(0x7fe0e40cfea0 msgr2=0x7fe0e406a460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:33:34.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.303+0000 7fe0e8faf700 1 -- 172.21.15.146:0/1972392696 shutdown_connections 2023-05-24T03:33:34.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.303+0000 7fe0e8faf700 1 -- 172.21.15.146:0/1972392696 wait complete. 2023-05-24T03:33:34.311 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' removed 2023-05-24T03:33:34.323 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-05-24T03:33:34.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.447+0000 7f7c3dcff700 1 Processor -- start 2023-05-24T03:33:34.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.447+0000 7f7c3dcff700 1 -- start start 2023-05-24T03:33:34.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.448+0000 7f7c3dcff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c380cdf10 0x7f7c38159c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:34.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.448+0000 7f7c3dcff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7c3815dcf0 0x7f7c380ce2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:34.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.448+0000 7f7c3dcff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c380ce820 con 0x7f7c38070f50 2023-05-24T03:33:34.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.448+0000 7f7c3dcff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c3815a1c0 con 0x7f7c3815dcf0 2023-05-24T03:33:34.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.448+0000 7f7c3dcff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3815a3c0 con 0x7f7c380cdf10 2023-05-24T03:33:34.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.448+0000 7f7c37fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f7c38070f50 0x7f7c3806d6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47426/0 (socket says 172.21.15.146:47426) 2023-05-24T03:33:34.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.448+0000 7f7c37fff700 1 -- 172.21.15.146:0/2840507054 learned_addr learned my addr 172.21.15.146:0/2840507054 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-05-24T03:33:34.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.448+0000 7f7c36ffd700 1 --2- 172.21.15.146:0/2840507054 >> v2:172.21.15.151:3300/0 conn(0x7f7c3815dcf0 0x7f7c380ce2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:34.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.448+0000 7f7c377fe700 1 --2- 172.21.15.146:0/2840507054 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c380cdf10 0x7f7c38159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:34.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.448+0000 7f7c367fc700 1 -- 172.21.15.146:0/2840507054 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1362207305 0 0) 0x7f7c380ce820 con 0x7f7c38070f50 2023-05-24T03:33:34.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.448+0000 7f7c367fc700 1 -- 172.21.15.146:0/2840507054 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c200035b0 con 0x7f7c38070f50 2023-05-24T03:33:34.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.449+0000 7f7c367fc700 1 -- 172.21.15.146:0/2840507054 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1101649214 0 0) 0x7f7c200035b0 con 0x7f7c38070f50 2023-05-24T03:33:34.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.449+0000 7f7c367fc700 1 -- 172.21.15.146:0/2840507054 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c380cdf10 msgr2=0x7f7c38159c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:33:34.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.449+0000 7f7c367fc700 1 --2- 172.21.15.146:0/2840507054 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c380cdf10 0x7f7c38159c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:34.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.449+0000 7f7c367fc700 1 -- 172.21.15.146:0/2840507054 >> v2:172.21.15.151:3300/0 conn(0x7f7c3815dcf0 msgr2=0x7f7c380ce2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:33:34.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.449+0000 7f7c367fc700 1 --2- 172.21.15.146:0/2840507054 >> v2:172.21.15.151:3300/0 conn(0x7f7c3815dcf0 0x7f7c380ce2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:34.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.449+0000 7f7c367fc700 1 -- 172.21.15.146:0/2840507054 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c3815a6a0 con 0x7f7c38070f50 2023-05-24T03:33:34.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.449+0000 7f7c367fc700 1 -- 172.21.15.146:0/2840507054 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1301887351 0 0) 0x7f7c300019f0 con 0x7f7c38070f50 2023-05-24T03:33:34.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.449+0000 7f7c367fc700 1 -- 172.21.15.146:0/2840507054 >> v1:172.21.15.146:6789/0 conn(0x7f7c38070f50 legacy=0x7f7c3806d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:34.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.449+0000 7f7c367fc700 1 --2- 172.21.15.146:0/2840507054 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c20003a00 0x7f7c20003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:34.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.449+0000 7f7c367fc700 1 --2- 172.21.15.146:0/2840507054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c20004430 0x7f7c200048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:34.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.449+0000 7f7c367fc700 1 --2- 172.21.15.146:0/2840507054 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c380cdf10 0x7f7c20004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:34.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.449+0000 7f7c367fc700 1 -- 172.21.15.146:0/2840507054 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3815a1c0 con 0x7f7c20004430 2023-05-24T03:33:34.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.449+0000 7f7c367fc700 1 -- 172.21.15.146:0/2840507054 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3815a3c0 con 0x7f7c20003a00 2023-05-24T03:33:34.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.449+0000 7f7c367fc700 1 -- 172.21.15.146:0/2840507054 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2000ba10 con 0x7f7c380cdf10 2023-05-24T03:33:34.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.449+0000 7f7c36ffd700 1 --2- 172.21.15.146:0/2840507054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c20004430 0x7f7c200048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:34.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.449+0000 7f7c377fe700 1 --2- 172.21.15.146:0/2840507054 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c20003a00 0x7f7c20003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:34.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.449+0000 7f7c37fff700 1 --2- 172.21.15.146:0/2840507054 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c380cdf10 0x7f7c20004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:34.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.449+0000 7f7c36ffd700 1 -- 172.21.15.146:0/2840507054 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c380cdf10 msgr2=0x7f7c20004fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:33:34.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.449+0000 7f7c36ffd700 1 --2- 172.21.15.146:0/2840507054 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c380cdf10 0x7f7c20004fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:34.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.449+0000 7f7c36ffd700 1 -- 172.21.15.146:0/2840507054 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c20003a00 msgr2=0x7f7c20003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-24T03:33:34.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.449+0000 7f7c36ffd700 1 --2- 172.21.15.146:0/2840507054 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c20003a00 0x7f7c20003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:34.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.449+0000 7f7c36ffd700 1 -- 172.21.15.146:0/2840507054 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c200035b0 con 0x7f7c20004430 2023-05-24T03:33:34.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.449+0000 7f7c37fff700 1 --2- 172.21.15.146:0/2840507054 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c380cdf10 0x7f7c20004fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-24T03:33:34.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.449+0000 7f7c36ffd700 1 --2- 172.21.15.146:0/2840507054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c20004430 0x7f7c200048f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7c28009b60 tx=0x7f7c20005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8e038eeedf63109 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:33:34.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.449+0000 7f7c367fc700 1 -- 172.21.15.146:0/2840507054 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2800e6c0 con 0x7f7c20004430 2023-05-24T03:33:34.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.449+0000 7f7c367fc700 1 -- 172.21.15.146:0/2840507054 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7c2800e820 con 0x7f7c20004430 2023-05-24T03:33:34.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.449+0000 7f7c367fc700 1 -- 172.21.15.146:0/2840507054 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2800ebb0 con 0x7f7c20004430 2023-05-24T03:33:34.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.450+0000 7f7c3dcff700 1 -- 172.21.15.146:0/2840507054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c20004430 msgr2=0x7f7c200048f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:34.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.450+0000 7f7c3dcff700 1 --2- 172.21.15.146:0/2840507054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c20004430 0x7f7c200048f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7c28009b60 tx=0x7f7c20005880 comp rx=0 tx=0).stop 2023-05-24T03:33:34.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.450+0000 7f7c37fff700 1 -- 172.21.15.146:0/2840507054 reap_dead start 2023-05-24T03:33:34.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.450+0000 7f7c3dcff700 1 -- 172.21.15.146:0/2840507054 shutdown_connections 2023-05-24T03:33:34.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.450+0000 7f7c3dcff700 1 -- 172.21.15.146:0/2840507054 >> 172.21.15.146:0/2840507054 conn(0x7f7c380cfea0 msgr2=0x7f7c380d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:33:34.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.450+0000 7f7c3dcff700 1 -- 172.21.15.146:0/2840507054 shutdown_connections 2023-05-24T03:33:34.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.450+0000 7f7c3dcff700 1 -- 172.21.15.146:0/2840507054 wait complete. 2023-05-24T03:33:34.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.451+0000 7f7c3dcff700 1 Processor -- start 2023-05-24T03:33:34.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.451+0000 7f7c3dcff700 1 -- start start 2023-05-24T03:33:34.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.452+0000 7f7c3dcff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c20004430 0x7f7c380bf690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:34.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.452+0000 7f7c3dcff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c38152820 0x7f7c380af8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:34.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.452+0000 7f7c3dcff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c38152c90 0x7f7c380afe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:34.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.452+0000 7f7c3dcff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c38146be0 con 0x7f7c38152820 2023-05-24T03:33:34.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.452+0000 7f7c3dcff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c380bfbd0 con 0x7f7c38152c90 2023-05-24T03:33:34.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.452+0000 7f7c3dcff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c380c05a0 con 0x7f7c20004430 2023-05-24T03:33:34.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.452+0000 7f7c36ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c38152820 0x7f7c380af8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:34.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.452+0000 7f7c36ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c38152820 0x7f7c380af8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40984/0 (socket says 172.21.15.146:40984) 2023-05-24T03:33:34.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.452+0000 7f7c36ffd700 1 -- 172.21.15.146:0/2579777945 learned_addr learned my addr 172.21.15.146:0/2579777945 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-05-24T03:33:34.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.452+0000 7f7c377fe700 1 --2- 172.21.15.146:0/2579777945 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c20004430 0x7f7c380bf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:34.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.452+0000 7f7c36ffd700 1 -- 172.21.15.146:0/2579777945 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c20004430 msgr2=0x7f7c380bf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:34.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.452+0000 7f7c37fff700 1 --2- 172.21.15.146:0/2579777945 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c38152c90 0x7f7c380afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:34.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.452+0000 7f7c36ffd700 1 --2- 172.21.15.146:0/2579777945 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c20004430 0x7f7c380bf690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:34.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.452+0000 7f7c36ffd700 1 -- 172.21.15.146:0/2579777945 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c38152c90 msgr2=0x7f7c380afe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:34.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.452+0000 7f7c36ffd700 1 --2- 172.21.15.146:0/2579777945 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c38152c90 0x7f7c380afe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:34.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.452+0000 7f7c36ffd700 1 -- 172.21.15.146:0/2579777945 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c3815ac60 con 0x7f7c38152820 2023-05-24T03:33:34.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.452+0000 7f7c377fe700 1 --2- 172.21.15.146:0/2579777945 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c20004430 0x7f7c380bf690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:33:34.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.452+0000 7f7c37fff700 1 --2- 172.21.15.146:0/2579777945 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c38152c90 0x7f7c380afe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-24T03:33:34.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.453+0000 7f7c36ffd700 1 --2- 172.21.15.146:0/2579777945 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c38152820 0x7f7c380af8e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7c280090b0 tx=0x7f7c280047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:33:34.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.453+0000 7f7c1ffff700 1 -- 172.21.15.146:0/2579777945 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c28021070 con 0x7f7c38152820 2023-05-24T03:33:34.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.453+0000 7f7c1ffff700 1 -- 172.21.15.146:0/2579777945 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7c28004590 con 0x7f7c38152820 2023-05-24T03:33:34.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.453+0000 7f7c1ffff700 1 -- 172.21.15.146:0/2579777945 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2800e6c0 con 0x7f7c38152820 2023-05-24T03:33:34.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.453+0000 7f7c3dcff700 1 -- 172.21.15.146:0/2579777945 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c3815a980 con 0x7f7c38152820 2023-05-24T03:33:34.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.453+0000 7f7c3dcff700 1 -- 172.21.15.146:0/2579777945 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c3806d190 con 0x7f7c38152820 2023-05-24T03:33:34.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.454+0000 7f7c3dcff700 1 -- 172.21.15.146:0/2579777945 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c380c11b0 con 0x7f7c38152820 2023-05-24T03:33:34.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.454+0000 7f7c1ffff700 1 -- 172.21.15.146:0/2579777945 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7c28025070 con 0x7f7c38152820 2023-05-24T03:33:34.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.455+0000 7f7c1ffff700 1 --2- 172.21.15.146:0/2579777945 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f7c2406ace0 0x7f7c2406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-24T03:33:34.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.455+0000 7f7c1ffff700 1 -- 172.21.15.146:0/2579777945 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f7c2808a7a0 con 0x7f7c38152820 2023-05-24T03:33:34.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.455+0000 7f7c377fe700 1 --2- 172.21.15.146:0/2579777945 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f7c2406ace0 0x7f7c2406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-24T03:33:34.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.455+0000 7f7c377fe700 1 --2- 172.21.15.146:0/2579777945 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f7c2406ace0 0x7f7c2406d190 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c009a80 tx=0x7f7c2c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-24T03:33:34.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.459+0000 7f7c1ffff700 1 -- 172.21.15.146:0/2579777945 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f7c28055a10 con 0x7f7c38152820 2023-05-24T03:33:34.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:34.645+0000 7f7c3dcff700 1 -- 172.21.15.146:0/2579777945 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7c38146bc0 con 0x7f7c38152820 2023-05-24T03:33:35.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:35.298+0000 7f7c1ffff700 1 -- 172.21.15.146:0/2579777945 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v34) v1 ==== 178+0+0 (secure 0 0 0) 0x7f7c38146bc0 con 0x7f7c38152820 2023-05-24T03:33:35.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:35.302+0000 7f7c3dcff700 1 -- 172.21.15.146:0/2579777945 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f7c2406ace0 msgr2=0x7f7c2406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:35.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:35.302+0000 7f7c3dcff700 1 --2- 172.21.15.146:0/2579777945 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f7c2406ace0 0x7f7c2406d190 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c009a80 tx=0x7f7c2c008040 comp rx=0 tx=0).stop 2023-05-24T03:33:35.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:35.302+0000 7f7c3dcff700 1 -- 172.21.15.146:0/2579777945 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c38152820 msgr2=0x7f7c380af8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-24T03:33:35.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:35.302+0000 7f7c3dcff700 1 --2- 172.21.15.146:0/2579777945 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c38152820 0x7f7c380af8e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7c280090b0 tx=0x7f7c280047c0 comp rx=0 tx=0).stop 2023-05-24T03:33:35.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:35.302+0000 7f7c3dcff700 1 -- 172.21.15.146:0/2579777945 shutdown_connections 2023-05-24T03:33:35.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:35.302+0000 7f7c3dcff700 1 --2- 172.21.15.146:0/2579777945 >> [v2:172.21.15.146:6832/1985394169,v1:172.21.15.146:6833/1985394169] conn(0x7f7c2406ace0 0x7f7c2406d190 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:35.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:35.302+0000 7f7c3dcff700 1 --2- 172.21.15.146:0/2579777945 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c38152c90 0x7f7c380afe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:35.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:35.302+0000 7f7c3dcff700 1 --2- 172.21.15.146:0/2579777945 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c20004430 0x7f7c380bf690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:35.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:35.302+0000 7f7c3dcff700 1 --2- 172.21.15.146:0/2579777945 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c38152820 0x7f7c380af8e0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-24T03:33:35.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:35.302+0000 7f7c3dcff700 1 -- 172.21.15.146:0/2579777945 >> 172.21.15.146:0/2579777945 conn(0x7f7c380cfea0 msgr2=0x7f7c380caae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-24T03:33:35.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:35.302+0000 7f7c3dcff700 1 -- 172.21.15.146:0/2579777945 shutdown_connections 2023-05-24T03:33:35.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-05-24T03:33:35.302+0000 7f7c3dcff700 1 -- 172.21.15.146:0/2579777945 wait complete. 2023-05-24T03:33:35.309 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data_ec' removed 2023-05-24T03:33:35.323 INFO:teuthology.misc:Shutting down mds daemons... 2023-05-24T03:33:35.323 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-05-24T03:33:35.323 INFO:teuthology.orchestra.run:waiting for 300 2023-05-24T03:33:35.334 INFO:tasks.ceph.mds.a:Stopped 2023-05-24T03:33:35.335 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-05-24T03:33:35.335 INFO:teuthology.orchestra.run:waiting for 300 2023-05-24T03:33:35.382 INFO:tasks.ceph.mds.c:Stopped 2023-05-24T03:33:35.382 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-05-24T03:33:35.383 INFO:teuthology.orchestra.run:waiting for 300 2023-05-24T03:33:35.393 INFO:tasks.ceph.mds.b:Stopped 2023-05-24T03:33:35.394 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-05-24T03:33:35.394 INFO:teuthology.orchestra.run:waiting for 300 2023-05-24T03:33:35.445 INFO:tasks.ceph.mds.d:Stopped 2023-05-24T03:33:35.445 INFO:teuthology.misc:Shutting down osd daemons... 2023-05-24T03:33:35.446 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-05-24T03:33:35.446 INFO:teuthology.orchestra.run:waiting for 300 2023-05-24T03:33:35.477 INFO:tasks.ceph.osd.0:Stopped 2023-05-24T03:33:35.478 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-05-24T03:33:35.479 INFO:teuthology.orchestra.run:waiting for 300 2023-05-24T03:33:35.548 INFO:tasks.ceph.osd.1:Stopped 2023-05-24T03:33:35.549 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-05-24T03:33:35.550 INFO:teuthology.orchestra.run:waiting for 300 2023-05-24T03:33:35.620 INFO:tasks.ceph.osd.2:Stopped 2023-05-24T03:33:35.621 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-05-24T03:33:35.621 INFO:teuthology.orchestra.run:waiting for 300 2023-05-24T03:33:35.692 INFO:tasks.ceph.osd.3:Stopped 2023-05-24T03:33:35.693 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-05-24T03:33:35.693 INFO:teuthology.orchestra.run:waiting for 300 2023-05-24T03:33:35.727 INFO:tasks.ceph.osd.4:Stopped 2023-05-24T03:33:35.728 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-05-24T03:33:35.729 INFO:teuthology.orchestra.run:waiting for 300 2023-05-24T03:33:35.809 INFO:tasks.ceph.osd.5:Stopped 2023-05-24T03:33:35.809 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-05-24T03:33:35.810 INFO:teuthology.orchestra.run:waiting for 300 2023-05-24T03:33:35.892 INFO:tasks.ceph.osd.6:Stopped 2023-05-24T03:33:35.893 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-05-24T03:33:35.894 INFO:teuthology.orchestra.run:waiting for 300 2023-05-24T03:33:35.967 INFO:tasks.ceph.osd.7:Stopped 2023-05-24T03:33:35.968 INFO:teuthology.misc:Shutting down mgr daemons... 2023-05-24T03:33:35.969 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-05-24T03:33:35.969 INFO:teuthology.orchestra.run:waiting for 300 2023-05-24T03:33:35.993 INFO:tasks.ceph.mgr.y:Stopped 2023-05-24T03:33:35.994 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-05-24T03:33:35.994 INFO:teuthology.orchestra.run:waiting for 300 2023-05-24T03:33:36.029 INFO:tasks.ceph.mgr.x:Stopped 2023-05-24T03:33:36.030 INFO:teuthology.misc:Shutting down mon daemons... 2023-05-24T03:33:36.030 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-05-24T03:33:36.031 INFO:teuthology.orchestra.run:waiting for 300 2023-05-24T03:33:36.044 INFO:tasks.ceph.mon.a:Stopped 2023-05-24T03:33:36.045 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-05-24T03:33:36.045 INFO:teuthology.orchestra.run:waiting for 300 2023-05-24T03:33:36.079 INFO:tasks.ceph.mon.b:Stopped 2023-05-24T03:33:36.080 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-05-24T03:33:36.080 INFO:teuthology.orchestra.run:waiting for 300 2023-05-24T03:33:36.129 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-05-24T03:33:36.129 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-05-24T03:33:36.130 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-05-24T03:33:36.130 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-05-24T03:33:36.130 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2023-05-24T03:33:36.130 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2023-05-24T03:33:36.131 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2023-05-24T03:33:36.131 INFO:tasks.ceph.mon.c:Stopped 2023-05-24T03:33:36.131 INFO:tasks.ceph:Checking cluster log for badness... 2023-05-24T03:33:36.132 DEBUG:teuthology.orchestra.run.smithi146:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-05-24T03:33:36.163 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi146.front.sepia.ceph.com 2023-05-24T03:33:36.163 DEBUG:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-05-24T03:33:36.528 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi146.front.sepia.ceph.com 2023-05-24T03:33:36.528 DEBUG:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-05-24T03:33:36.643 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi146.front.sepia.ceph.com 2023-05-24T03:33:36.643 DEBUG:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-05-24T03:33:36.738 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi146.front.sepia.ceph.com 2023-05-24T03:33:36.739 DEBUG:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-05-24T03:33:36.810 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi151.front.sepia.ceph.com 2023-05-24T03:33:36.811 DEBUG:teuthology.orchestra.run.smithi151:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-05-24T03:33:37.201 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi151.front.sepia.ceph.com 2023-05-24T03:33:37.202 DEBUG:teuthology.orchestra.run.smithi151:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-05-24T03:33:37.306 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi151.front.sepia.ceph.com 2023-05-24T03:33:37.307 DEBUG:teuthology.orchestra.run.smithi151:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-05-24T03:33:37.385 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi151.front.sepia.ceph.com 2023-05-24T03:33:37.385 DEBUG:teuthology.orchestra.run.smithi151:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-05-24T03:33:37.462 INFO:tasks.ceph:Archiving mon data... 2023-05-24T03:33:37.463 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi/7284286/data/mon.a.tgz 2023-05-24T03:33:37.464 DEBUG:teuthology.orchestra.run.smithi146:> mktemp 2023-05-24T03:33:37.482 INFO:teuthology.orchestra.run.smithi146.stdout:/tmp/tmp.WyZrRVeivx 2023-05-24T03:33:37.483 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.WyZrRVeivx 2023-05-24T03:33:37.617 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0666 /tmp/tmp.WyZrRVeivx 2023-05-24T03:33:37.704 DEBUG:teuthology.orchestra.remote:smithi146:/tmp/tmp.WyZrRVeivx is 305KB 2023-05-24T03:33:37.798 DEBUG:teuthology.orchestra.run.smithi146:> rm -fr /tmp/tmp.WyZrRVeivx 2023-05-24T03:33:37.815 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi/7284286/data/mon.b.tgz 2023-05-24T03:33:37.815 DEBUG:teuthology.orchestra.run.smithi151:> mktemp 2023-05-24T03:33:37.834 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/tmp.zYyPj76fSp 2023-05-24T03:33:37.834 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.zYyPj76fSp 2023-05-24T03:33:37.998 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0666 /tmp/tmp.zYyPj76fSp 2023-05-24T03:33:38.085 DEBUG:teuthology.orchestra.remote:smithi151:/tmp/tmp.zYyPj76fSp is 407KB 2023-05-24T03:33:38.152 DEBUG:teuthology.orchestra.run.smithi151:> rm -fr /tmp/tmp.zYyPj76fSp 2023-05-24T03:33:38.170 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi/7284286/data/mon.c.tgz 2023-05-24T03:33:38.171 DEBUG:teuthology.orchestra.run.smithi151:> mktemp 2023-05-24T03:33:38.227 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/tmp.0dD7wFqZgp 2023-05-24T03:33:38.228 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.0dD7wFqZgp 2023-05-24T03:33:38.370 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0666 /tmp/tmp.0dD7wFqZgp 2023-05-24T03:33:38.452 DEBUG:teuthology.orchestra.remote:smithi151:/tmp/tmp.0dD7wFqZgp is 407KB 2023-05-24T03:33:38.518 DEBUG:teuthology.orchestra.run.smithi151:> rm -fr /tmp/tmp.0dD7wFqZgp 2023-05-24T03:33:38.534 INFO:tasks.ceph:Cleaning ceph cluster... 2023-05-24T03:33:38.534 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-05-24T03:33:38.537 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-05-24T03:33:38.602 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-05-24T03:33:38.602 DEBUG:teuthology.orchestra.run.smithi146:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-05-24T03:33:38.605 DEBUG:teuthology.orchestra.run.smithi151:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-05-24T03:33:38.640 INFO:teuthology.orchestra.run.smithi146.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-05-24T03:33:38.684 INFO:teuthology.orchestra.run.smithi151.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-05-24T03:33:38.689 INFO:tasks.ceph:Archiving crash dumps... 2023-05-24T03:33:38.691 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi/7284286/remote/smithi146/crash 2023-05-24T03:33:38.692 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-05-24T03:33:38.720 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi/7284286/remote/smithi151/crash 2023-05-24T03:33:38.721 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-05-24T03:33:38.757 INFO:tasks.ceph:Shutting down logrotate 2023-05-24T03:33:38.758 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T03:33:38.764 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-24T03:33:38.857 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-05-24T03:33:38.884 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-05-24T03:33:38.910 INFO:tasks.ceph:Compressing logs... 2023-05-24T03:33:38.910 DEBUG:teuthology.orchestra.run.smithi146:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-05-24T03:33:38.926 DEBUG:teuthology.orchestra.run.smithi151:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-05-24T03:33:38.951 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114066.log 2023-05-24T03:33:38.951 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112988.log 2023-05-24T03:33:38.960 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105550.log 2023-05-24T03:33:38.960 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.114066.log: /var/log/ceph/ceph-client.admin.112988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116002.log 2023-05-24T03:33:38.960 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.114066.log.gz 2023-05-24T03:33:38.960 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.112988.log.gz 2023-05-24T03:33:38.961 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.105550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109958.log 2023-05-24T03:33:38.961 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.116002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115123.log 2023-05-24T03:33:38.961 INFO:teuthology.orchestra.run.smithi146.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.105550.log.gz 2023-05-24T03:33:38.962 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.109958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108118.log 2023-05-24T03:33:38.962 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.116002.log.gz 2023-05-24T03:33:38.962 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.115123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109912.log 2023-05-24T03:33:38.962 INFO:teuthology.orchestra.run.smithi146.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.109958.log.gz 2023-05-24T03:33:38.962 INFO:teuthology.orchestra.run.smithi146.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.115123.log.gz 2023-05-24T03:33:38.963 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114158.log 2023-05-24T03:33:38.963 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.108118.log: /var/log/ceph/ceph-client.admin.109912.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-05-24T03:33:38.963 INFO:teuthology.orchestra.run.smithi146.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.108118.log.gz 2023-05-24T03:33:38.964 INFO:teuthology.orchestra.run.smithi146.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.109912.log.gz 2023-05-24T03:33:38.964 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.114158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105400.log 2023-05-24T03:33:38.964 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-osd.2.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.114158.log.gz 2023-05-24T03:33:38.964 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108110.log 2023-05-24T03:33:38.965 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.105400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110824.log 2023-05-24T03:33:38.965 INFO:teuthology.orchestra.run.smithi146.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.105400.log.gz 2023-05-24T03:33:38.965 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.108110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113790.log 2023-05-24T03:33:38.965 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107729.log 2023-05-24T03:33:38.965 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.108110.log.gz 2023-05-24T03:33:38.966 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.110824.log: /var/log/ceph/ceph-client.admin.113790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107362.log 2023-05-24T03:33:38.966 INFO:teuthology.orchestra.run.smithi146.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.110824.log.gz 2023-05-24T03:33:38.966 INFO:teuthology.orchestra.run.smithi146.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.113790.log.gz 2023-05-24T03:33:38.966 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.107729.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-05-24T03:33:38.967 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.107729.log.gz 2023-05-24T03:33:38.967 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.107362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108119.log 2023-05-24T03:33:38.967 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.107362.log.gzgzip 2023-05-24T03:33:38.967 INFO:teuthology.orchestra.run.smithi146.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.105942.log 2023-05-24T03:33:38.968 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.108119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108475.log 2023-05-24T03:33:38.968 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.108119.log.gz 2023-05-24T03:33:38.969 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.105942.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.92127.log 2023-05-24T03:33:38.969 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.105942.log.gz 2023-05-24T03:33:38.969 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 /var/log/ceph/ceph-client.admin.108475.log: --verbose -- /var/log/ceph/ceph-client.admin.109155.log 2023-05-24T03:33:38.969 INFO:teuthology.orchestra.run.smithi146.stderr: 83.3% -- replaced with /var/log/ceph/ceph.log.gz 2023-05-24T03:33:38.970 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph.tmp-client.admin.92127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106975.log 2023-05-24T03:33:38.970 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.108475.log.gz 2023-05-24T03:33:38.970 INFO:teuthology.orchestra.run.smithi146.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.92127.log.gz 2023-05-24T03:33:38.970 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.109155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114893.log 2023-05-24T03:33:38.971 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.106975.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.109155.log.gz 2023-05-24T03:33:38.971 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104572.log 2023-05-24T03:33:38.971 INFO:teuthology.orchestra.run.smithi146.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.106975.log.gz 2023-05-24T03:33:38.972 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.114893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116094.log 2023-05-24T03:33:38.972 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.104572.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.114893.log.gz 2023-05-24T03:33:38.972 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115955.log 2023-05-24T03:33:38.973 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.116094.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.104572.log.gz 2023-05-24T03:33:38.973 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106883.log 2023-05-24T03:33:38.974 INFO:teuthology.orchestra.run.smithi146.stderr: 89.4%/var/log/ceph/ceph-client.admin.115955.log: -- replaced with /var/log/ceph/ceph-client.admin.116094.log.gz 2023-05-24T03:33:38.974 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107178.log 2023-05-24T03:33:38.974 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2%/var/log/ceph/ceph-client.admin.106883.log: -- replaced with /var/log/ceph/ceph-client.admin.115955.log.gz 2023-05-24T03:33:38.974 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115261.log 2023-05-24T03:33:38.975 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.107178.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.106883.log.gz 2023-05-24T03:33:38.975 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104785.log 2023-05-24T03:33:38.975 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.107178.log.gz 2023-05-24T03:33:38.976 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.115261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115215.log 2023-05-24T03:33:38.976 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.104785.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.115261.log.gz 2023-05-24T03:33:38.977 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114709.log 2023-05-24T03:33:38.977 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.115215.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.104785.log.gz 2023-05-24T03:33:38.988 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.105103.log 2023-05-24T03:33:38.988 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-05-24T03:33:38.988 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.1.105103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98772.log 2023-05-24T03:33:38.989 INFO:teuthology.orchestra.run.smithi151.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.105103.log.gz 2023-05-24T03:33:38.989 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-05-24T03:33:38.989 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-05-24T03:33:38.989 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.98772.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.105722.log 2023-05-24T03:33:38.989 INFO:teuthology.orchestra.run.smithi151.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.98772.log.gz 2023-05-24T03:33:38.990 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-05-24T03:33:38.990 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.3.105722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.105718.log 2023-05-24T03:33:38.990 INFO:teuthology.orchestra.run.smithi151.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.105722.log.gz 2023-05-24T03:33:38.990 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-05-24T03:33:38.990 INFO:teuthology.orchestra.run.smithi151.stderr: 90.8% -- replaced with /var/log/ceph/ceph.log.gz 2023-05-24T03:33:38.991 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.3.105718.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.105718.log.gz 2023-05-24T03:33:38.991 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-05-24T03:33:38.991 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98450.log 2023-05-24T03:33:38.991 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-osd.4.log: 92.5% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-05-24T03:33:38.991 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.98450.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.98450.log.gz 2023-05-24T03:33:38.992 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98682.log 2023-05-24T03:33:38.992 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98590.log 2023-05-24T03:33:38.992 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.98682.log: 93.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-05-24T03:33:38.992 INFO:teuthology.orchestra.run.smithi151.stderr: 89.0%/var/log/ceph/ceph-client.admin.98590.log: -- replaced with /var/log/ceph/ceph-client.admin.98682.log.gz 2023-05-24T03:33:38.993 INFO:teuthology.orchestra.run.smithi151.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.98590.log.gz 2023-05-24T03:33:38.993 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-05-24T03:33:38.993 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98727.log 2023-05-24T03:33:38.993 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.admin.98727.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.98727.log.gz 2023-05-24T03:33:38.993 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-05-24T03:33:38.994 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.105111.log 2023-05-24T03:33:38.994 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-mon.c.log: /var/log/ceph/ceph-client.1.105111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98637.log 2023-05-24T03:33:38.994 INFO:teuthology.orchestra.run.smithi151.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.105111.log.gz 2023-05-24T03:33:38.994 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.98637.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.98637.log.gz 2023-05-24T03:33:38.995 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-05-24T03:33:38.995 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-osd.7.log: 93.3% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-05-24T03:33:38.997 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-05-24T03:33:39.003 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98543.log 2023-05-24T03:33:39.003 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.98543.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.98543.log.gz 2023-05-24T03:33:39.004 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-05-24T03:33:39.009 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-mds.b.log: 92.5% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-05-24T03:33:39.009 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98498.log 2023-05-24T03:33:39.009 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.98498.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.98498.log.gz 2023-05-24T03:33:39.030 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-05-24T03:33:39.030 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.115215.log.gz 2023-05-24T03:33:39.031 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.114709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115891.log 2023-05-24T03:33:39.031 INFO:teuthology.orchestra.run.smithi146.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.114709.log.gz 2023-05-24T03:33:39.032 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113069.log 2023-05-24T03:33:39.032 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.115891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114020.log 2023-05-24T03:33:39.033 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.115891.log.gz 2023-05-24T03:33:39.033 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.113069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113161.log 2023-05-24T03:33:39.033 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112928.log 2023-05-24T03:33:39.034 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.114020.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.113069.log.gz 2023-05-24T03:33:39.034 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.113161.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.114020.log.gz 2023-05-24T03:33:39.035 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109682.log 2023-05-24T03:33:39.035 INFO:teuthology.orchestra.run.smithi146.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.113161.log.gz 2023-05-24T03:33:39.036 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115655.log 2023-05-24T03:33:39.036 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.112928.log: /var/log/ceph/ceph-client.admin.109682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107021.log 2023-05-24T03:33:39.037 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.112928.log.gz 2023-05-24T03:33:39.037 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.115655.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.109682.log.gz 2023-05-24T03:33:39.037 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-05-24T03:33:39.037 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105352.log 2023-05-24T03:33:39.037 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.107021.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.115655.log.gz 2023-05-24T03:33:39.038 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-mds.a.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.107021.log.gz 2023-05-24T03:33:39.038 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113564.log 2023-05-24T03:33:39.038 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109452.log 2023-05-24T03:33:39.038 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.105352.log: /var/log/ceph/ceph-client.admin.113564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115837.log 2023-05-24T03:33:39.038 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.105352.log.gz 2023-05-24T03:33:39.039 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.109452.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.113564.log.gz 2023-05-24T03:33:39.039 INFO:teuthology.orchestra.run.smithi146.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-05-24T03:33:39.039 INFO:teuthology.orchestra.run.smithi146.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.109452.log.gz 2023-05-24T03:33:39.039 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.115837.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.115837.log.gz 2023-05-24T03:33:39.039 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.111259.log 2023-05-24T03:33:39.039 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108488.log 2023-05-24T03:33:39.040 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.2.111259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105596.log 2023-05-24T03:33:39.040 INFO:teuthology.orchestra.run.smithi146.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.111259.log.gz 2023-05-24T03:33:39.040 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.108488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109314.log 2023-05-24T03:33:39.040 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.108488.log.gz 2023-05-24T03:33:39.040 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.105596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107591.log 2023-05-24T03:33:39.041 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108111.log 2023-05-24T03:33:39.041 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.105596.log.gz/var/log/ceph/ceph-client.admin.109314.log: 2023-05-24T03:33:39.041 INFO:teuthology.orchestra.run.smithi146.stderr:gzip /var/log/ceph/ceph-client.admin.107591.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.115699.log 2023-05-24T03:33:39.041 INFO:teuthology.orchestra.run.smithi146.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.109314.log.gz 2023-05-24T03:33:39.041 INFO:teuthology.orchestra.run.smithi146.stderr:gzip /var/log/ceph/ceph-client.admin.108111.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.107132.log 2023-05-24T03:33:39.042 INFO:teuthology.orchestra.run.smithi146.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.107591.log.gz 2023-05-24T03:33:39.042 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.115699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108834.log 2023-05-24T03:33:39.042 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.108111.log.gz 2023-05-24T03:33:39.042 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.107132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108830.log 2023-05-24T03:33:39.042 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.115699.log.gz 2023-05-24T03:33:39.043 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.108834.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.107132.log.gz 2023-05-24T03:33:39.043 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-05-24T03:33:39.043 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113836.log 2023-05-24T03:33:39.043 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.108830.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.108834.log.gz 2023-05-24T03:33:39.043 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-osd.3.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.108830.log.gz 2023-05-24T03:33:39.044 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113334.log 2023-05-24T03:33:39.044 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.113836.log: -- /var/log/ceph/ceph-client.admin.113744.log 2023-05-24T03:33:39.044 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.113334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107270.log 2023-05-24T03:33:39.044 INFO:teuthology.orchestra.run.smithi146.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.113836.log.gz 2023-05-24T03:33:39.044 INFO:teuthology.orchestra.run.smithi146.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.113334.log.gz 2023-05-24T03:33:39.045 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.113744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114939.log 2023-05-24T03:33:39.045 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.107270.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.113744.log.gz 2023-05-24T03:33:39.045 INFO:teuthology.orchestra.run.smithi146.stderr: 88.5%/var/log/ceph/ceph-client.admin.114939.log: -- replaced with /var/log/ceph/ceph-client.admin.107270.log.gz 2023-05-24T03:33:39.045 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.114939.log.gz--verbose 2023-05-24T03:33:39.045 INFO:teuthology.orchestra.run.smithi146.stderr:-- /var/log/ceph/ceph-client.2.111255.log 2023-05-24T03:33:39.046 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114571.log 2023-05-24T03:33:39.046 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.2.111255.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.111255.log.gz 2023-05-24T03:33:39.046 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108857.log 2023-05-24T03:33:39.046 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.114571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98678.log 2023-05-24T03:33:39.046 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.108857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105283.log 2023-05-24T03:33:39.046 INFO:teuthology.orchestra.run.smithi146.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.114571.log.gz 2023-05-24T03:33:39.047 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.108857.log.gz 2023-05-24T03:33:39.047 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.98678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105872.log 2023-05-24T03:33:39.047 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.98678.log.gz 2023-05-24T03:33:39.047 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.105283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107499.log 2023-05-24T03:33:39.047 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.105872.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.105283.log.gz 2023-05-24T03:33:39.048 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113380.log 2023-05-24T03:33:39.048 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.107499.log: /var/log/ceph/ceph-client.admin.113380.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.105872.log.gz 2023-05-24T03:33:39.048 INFO:teuthology.orchestra.run.smithi146.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.107499.log.gz 2023-05-24T03:33:39.048 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115745.log 2023-05-24T03:33:39.048 INFO:teuthology.orchestra.run.smithi146.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.113380.log.gz 2023-05-24T03:33:39.049 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106791.log 2023-05-24T03:33:39.049 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.115745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109728.log 2023-05-24T03:33:39.049 INFO:teuthology.orchestra.run.smithi146.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.115745.log.gz 2023-05-24T03:33:39.049 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.106791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115399.log 2023-05-24T03:33:39.049 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-05-24T03:33:39.050 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.109728.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.106791.log.gz 2023-05-24T03:33:39.050 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.115399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108718.log 2023-05-24T03:33:39.050 INFO:teuthology.orchestra.run.smithi146.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.109728.log.gz 2023-05-24T03:33:39.050 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-mds.c.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.115399.log.gz 2023-05-24T03:33:39.050 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109774.log 2023-05-24T03:33:39.050 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.108718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104960.log 2023-05-24T03:33:39.051 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.109774.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.108718.log.gz 2023-05-24T03:33:39.051 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113882.log 2023-05-24T03:33:39.051 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.104960.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.109774.log.gz 2023-05-24T03:33:39.051 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.113882.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.104960.log.gz 2023-05-24T03:33:39.051 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.113882.log.gz 2023-05-24T03:33:39.052 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109544.log 2023-05-24T03:33:39.052 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113698.log 2023-05-24T03:33:39.052 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.109544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115031.log 2023-05-24T03:33:39.052 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.113698.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.109544.log.gz 2023-05-24T03:33:39.052 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.115031.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.113698.log.gz 2023-05-24T03:33:39.053 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.115031.log.gz 2023-05-24T03:33:39.053 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114617.log 2023-05-24T03:33:39.053 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111527.log 2023-05-24T03:33:39.053 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.114617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108114.log 2023-05-24T03:33:39.053 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.111527.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.114617.log.gz 2023-05-24T03:33:39.054 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.108114.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.111527.log.gz 2023-05-24T03:33:39.054 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.108114.log.gz 2023-05-24T03:33:39.054 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115307.log 2023-05-24T03:33:39.054 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114479.log 2023-05-24T03:33:39.054 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.115307.log: /var/log/ceph/ceph-client.admin.114479.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.115307.log.gz 2023-05-24T03:33:39.055 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.114479.log.gz 2023-05-24T03:33:39.055 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-05-24T03:33:39.055 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105502.log 2023-05-24T03:33:39.055 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.105502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114112.log 2023-05-24T03:33:39.055 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.105502.log.gz 2023-05-24T03:33:39.056 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108485.log 2023-05-24T03:33:39.056 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-05-24T03:33:39.056 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.114112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114525.log 2023-05-24T03:33:39.056 INFO:teuthology.orchestra.run.smithi146.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.114112.log.gz 2023-05-24T03:33:39.056 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.108485.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.108485.log.gz 2023-05-24T03:33:39.057 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.114525.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.114525.log.gz 2023-05-24T03:33:39.057 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113974.log 2023-05-24T03:33:39.057 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108479.log 2023-05-24T03:33:39.057 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.113974.log: /var/log/ceph/ceph-client.admin.108479.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.113974.log.gz 2023-05-24T03:33:39.057 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.108479.log.gz 2023-05-24T03:33:39.058 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98366.log 2023-05-24T03:33:39.058 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109201.log 2023-05-24T03:33:39.058 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.98366.log: /var/log/ceph/ceph-client.admin.109201.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.98366.log.gz 2023-05-24T03:33:39.058 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.109201.log.gz 2023-05-24T03:33:39.058 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105099.log 2023-05-24T03:33:39.058 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107453.log 2023-05-24T03:33:39.059 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.105099.log: /var/log/ceph/ceph-client.admin.107453.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.105099.log.gz 2023-05-24T03:33:39.059 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.107453.log.gz 2023-05-24T03:33:39.059 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109636.log 2023-05-24T03:33:39.059 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115169.log 2023-05-24T03:33:39.059 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.109636.log: /var/log/ceph/ceph-client.admin.115169.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.109636.log.gz 2023-05-24T03:33:39.060 INFO:teuthology.orchestra.run.smithi146.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.115169.log.gz 2023-05-24T03:33:39.060 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115791.log 2023-05-24T03:33:39.060 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109406.log 2023-05-24T03:33:39.060 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.115791.log: /var/log/ceph/ceph-client.admin.109406.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.115791.log.gz 2023-05-24T03:33:39.060 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.109406.log.gz 2023-05-24T03:33:39.061 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109063.log 2023-05-24T03:33:39.061 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104676.log 2023-05-24T03:33:39.061 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.109063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116048.log 2023-05-24T03:33:39.061 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.104676.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.109063.log.gz 2023-05-24T03:33:39.061 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105688.log 2023-05-24T03:33:39.062 INFO:teuthology.orchestra.run.smithi146.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.104676.log.gz 2023-05-24T03:33:39.062 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.116048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114801.log 2023-05-24T03:33:39.062 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.105688.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.116048.log.gz 2023-05-24T03:33:39.062 INFO:teuthology.orchestra.run.smithi146.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.105688.log.gz 2023-05-24T03:33:39.062 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.114801.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.114801.log.gz 2023-05-24T03:33:39.063 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115077.log 2023-05-24T03:33:39.063 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108113.log 2023-05-24T03:33:39.063 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.115077.log: /var/log/ceph/ceph-client.admin.108113.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.115077.log.gz 2023-05-24T03:33:39.063 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.108113.log.gz 2023-05-24T03:33:39.063 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107821.log 2023-05-24T03:33:39.063 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107683.log 2023-05-24T03:33:39.064 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.107821.log: /var/log/ceph/ceph-client.admin.107683.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.107821.log.gz 2023-05-24T03:33:39.064 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.107683.log.gz 2023-05-24T03:33:39.064 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108717.log 2023-05-24T03:33:39.064 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104739.log 2023-05-24T03:33:39.064 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.108717.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-05-24T03:33:39.065 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.104739.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.108717.log.gz 2023-05-24T03:33:39.065 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-osd.1.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.104739.log.gz 2023-05-24T03:33:39.065 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113928.log 2023-05-24T03:33:39.065 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107637.log 2023-05-24T03:33:39.065 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.113928.log: 88.0%/var/log/ceph/ceph-client.admin.107637.log: -- replaced with /var/log/ceph/ceph-client.admin.113928.log.gz 2023-05-24T03:33:39.066 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.107637.log.gz 2023-05-24T03:33:39.066 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113518.log 2023-05-24T03:33:39.066 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109268.log 2023-05-24T03:33:39.066 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.113518.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.113518.log.gz 2023-05-24T03:33:39.066 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.109268.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.109268.log.gz 2023-05-24T03:33:39.067 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105191.log 2023-05-24T03:33:39.067 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105826.log 2023-05-24T03:33:39.067 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.105191.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.105191.log.gz 2023-05-24T03:33:39.067 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.105826.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.105826.log.gz 2023-05-24T03:33:39.067 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106519.log 2023-05-24T03:33:39.068 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109360.log 2023-05-24T03:33:39.068 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.106519.log: /var/log/ceph/ceph-client.admin.109360.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.109360.log.gz 2023-05-24T03:33:39.068 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105780.log 2023-05-24T03:33:39.068 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.105780.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.105780.log.gz 2023-05-24T03:33:39.068 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114985.log 2023-05-24T03:33:39.068 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.114985.log: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.106519.log.gz 2023-05-24T03:33:39.069 INFO:teuthology.orchestra.run.smithi146.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.114985.log.gz 2023-05-24T03:33:39.069 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115353.log 2023-05-24T03:33:39.069 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105454.log 2023-05-24T03:33:39.069 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.115353.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.115353.log.gz 2023-05-24T03:33:39.069 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.105454.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.105454.log.gz 2023-05-24T03:33:39.070 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108108.log 2023-05-24T03:33:39.070 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.110594.log 2023-05-24T03:33:39.070 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.108108.log: /var/log/ceph/ceph-client.0.110594.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.108108.log.gz 2023-05-24T03:33:39.070 INFO:teuthology.orchestra.run.smithi146.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.110594.log.gz 2023-05-24T03:33:39.070 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115588.log 2023-05-24T03:33:39.071 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114204.log 2023-05-24T03:33:39.071 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.115588.log: /var/log/ceph/ceph-client.admin.114204.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.115588.log.gz 2023-05-24T03:33:39.071 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107545.log 2023-05-24T03:33:39.071 INFO:teuthology.orchestra.run.smithi146.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.114204.log.gz 2023-05-24T03:33:39.071 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114755.log 2023-05-24T03:33:39.072 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.107545.log: /var/log/ceph/ceph-client.admin.114755.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.107545.log.gz 2023-05-24T03:33:39.072 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.114755.log.gz 2023-05-24T03:33:39.072 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111481.log 2023-05-24T03:33:39.072 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108476.log 2023-05-24T03:33:39.072 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.111481.log: /var/log/ceph/ceph-client.admin.108476.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.111481.log.gz 2023-05-24T03:33:39.073 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.108476.log.gz 2023-05-24T03:33:39.073 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104875.log 2023-05-24T03:33:39.073 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113472.log 2023-05-24T03:33:39.073 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.104875.log: /var/log/ceph/ceph-client.admin.113472.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.104875.log.gz 2023-05-24T03:33:39.073 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.113472.log.gz 2023-05-24T03:33:39.074 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108481.log 2023-05-24T03:33:39.074 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110142.log 2023-05-24T03:33:39.074 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.108481.log: /var/log/ceph/ceph-client.admin.110142.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.108481.log.gz 2023-05-24T03:33:39.074 INFO:teuthology.orchestra.run.smithi146.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.110142.log.gz 2023-05-24T03:33:39.074 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105145.log 2023-05-24T03:33:39.074 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113207.log 2023-05-24T03:33:39.075 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.105145.log: 87.9%/var/log/ceph/ceph-client.admin.113207.log: -- replaced with /var/log/ceph/ceph-client.admin.105145.log.gz 2023-05-24T03:33:39.075 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.113207.log.gz 2023-05-24T03:33:39.075 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108120.log 2023-05-24T03:33:39.075 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108828.log 2023-05-24T03:33:39.075 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.108120.log: /var/log/ceph/ceph-client.admin.108828.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.108120.log.gz 2023-05-24T03:33:39.076 INFO:teuthology.orchestra.run.smithi146.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.108828.log.gz 2023-05-24T03:33:39.076 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107224.log 2023-05-24T03:33:39.076 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105006.log 2023-05-24T03:33:39.076 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.107224.log: /var/log/ceph/ceph-client.admin.105006.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.107224.log.gz 2023-05-24T03:33:39.076 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114663.log 2023-05-24T03:33:39.077 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.105006.log.gz 2023-05-24T03:33:39.077 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.110602.log 2023-05-24T03:33:39.077 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.114663.log: /var/log/ceph/ceph-client.0.110602.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.114663.log.gz 2023-05-24T03:33:39.077 INFO:teuthology.orchestra.run.smithi146.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.110602.log.gz 2023-05-24T03:33:39.077 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113426.log 2023-05-24T03:33:39.078 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108486.log 2023-05-24T03:33:39.078 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.113426.log: /var/log/ceph/ceph-client.admin.108486.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.113426.log.gz 2023-05-24T03:33:39.078 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.108486.log.gz 2023-05-24T03:33:39.078 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115467.log 2023-05-24T03:33:39.078 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106837.log 2023-05-24T03:33:39.079 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.115467.log: /var/log/ceph/ceph-client.admin.106837.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.115467.log.gz 2023-05-24T03:33:39.079 INFO:teuthology.orchestra.run.smithi146.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.106837.log.gz 2023-05-24T03:33:39.079 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107775.log 2023-05-24T03:33:39.079 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106745.log 2023-05-24T03:33:39.079 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.107775.log: /var/log/ceph/ceph-client.admin.106745.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.107775.log.gz 2023-05-24T03:33:39.080 INFO:teuthology.orchestra.run.smithi146.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.106745.log.gz 2023-05-24T03:33:39.080 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105052.log 2023-05-24T03:33:39.080 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114847.log 2023-05-24T03:33:39.080 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.105052.log: 87.6%/var/log/ceph/ceph-client.admin.114847.log: -- replaced with /var/log/ceph/ceph-client.admin.105052.log.gz 2023-05-24T03:33:39.080 INFO:teuthology.orchestra.run.smithi146.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.114847.log.gz 2023-05-24T03:33:39.081 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109820.log 2023-05-24T03:33:39.081 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109866.log 2023-05-24T03:33:39.081 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.109820.log: /var/log/ceph/ceph-client.admin.109866.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.109820.log.gz 2023-05-24T03:33:39.081 INFO:teuthology.orchestra.run.smithi146.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.109866.log.gz 2023-05-24T03:33:39.081 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113610.log 2023-05-24T03:33:39.081 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107086.log 2023-05-24T03:33:39.082 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.113610.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.113610.log.gz/var/log/ceph/ceph-client.admin.107086.log: 2023-05-24T03:33:39.082 INFO:teuthology.orchestra.run.smithi146.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.107086.log.gz 2023-05-24T03:33:39.082 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114296.log 2023-05-24T03:33:39.082 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-05-24T03:33:39.082 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.114296.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.114296.log.gz 2023-05-24T03:33:39.086 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112868.log 2023-05-24T03:33:39.086 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.112868.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.112868.log.gz 2023-05-24T03:33:39.086 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107913.log 2023-05-24T03:33:39.086 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.107913.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.107913.log.gz 2023-05-24T03:33:39.087 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114250.log 2023-05-24T03:33:39.087 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106929.log 2023-05-24T03:33:39.087 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.114250.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.114250.log.gz 2023-05-24T03:33:39.087 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.106929.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.106929.log.gz 2023-05-24T03:33:39.087 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109590.log 2023-05-24T03:33:39.088 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108829.log 2023-05-24T03:33:39.088 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.109590.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.109590.log.gz 2023-05-24T03:33:39.088 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.108829.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.108829.log.gz 2023-05-24T03:33:39.088 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107316.log 2023-05-24T03:33:39.088 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.107316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105237.log 2023-05-24T03:33:39.089 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.107316.log.gz 2023-05-24T03:33:39.089 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108831.log 2023-05-24T03:33:39.089 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.105237.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.105237.log.gz 2023-05-24T03:33:39.089 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.108831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109498.log 2023-05-24T03:33:39.089 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.108831.log.gz 2023-05-24T03:33:39.090 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109109.log 2023-05-24T03:33:39.090 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.109498.log: /var/log/ceph/ceph-client.admin.109109.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.109498.log.gz 2023-05-24T03:33:39.090 INFO:teuthology.orchestra.run.smithi146.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.109109.log.gz 2023-05-24T03:33:39.090 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108480.log 2023-05-24T03:33:39.090 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.108480.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.108480.log.gz 2023-05-24T03:33:39.091 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113115.log 2023-05-24T03:33:39.091 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.113115.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.113115.log.gz 2023-05-24T03:33:39.091 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-05-24T03:33:39.091 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107867.log 2023-05-24T03:33:39.091 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.107867.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.107867.log.gz 2023-05-24T03:33:39.091 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105734.log 2023-05-24T03:33:39.092 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.105734.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.105734.log.gz 2023-05-24T03:33:39.092 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115542.log 2023-05-24T03:33:39.092 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.115542.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.115542.log.gz 2023-05-24T03:33:39.092 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105642.log 2023-05-24T03:33:39.092 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.105642.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.105642.log.gz 2023-05-24T03:33:39.093 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98795.log 2023-05-24T03:33:39.093 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.98795.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.98795.log.gz 2023-05-24T03:33:39.096 INFO:teuthology.orchestra.run.smithi151.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-05-24T03:33:39.106 INFO:teuthology.orchestra.run.smithi146.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-05-24T03:33:39.122 INFO:teuthology.orchestra.run.smithi151.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-05-24T03:33:39.331 INFO:teuthology.orchestra.run.smithi146.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-05-24T03:33:39.582 INFO:teuthology.orchestra.run.smithi146.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-05-24T03:33:41.008 INFO:teuthology.orchestra.run.smithi151.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-05-24T03:33:41.110 INFO:teuthology.orchestra.run.smithi146.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-05-24T03:33:41.132 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2023-05-24T03:33:41.132 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-05-24T03:33:41.132 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-05-24T03:33:41.133 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-05-24T03:33:41.133 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2023-05-24T03:33:41.133 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2023-05-24T03:33:41.133 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2023-05-24T03:33:41.232 INFO:teuthology.orchestra.run.smithi146.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-05-24T03:33:41.319 INFO:teuthology.orchestra.run.smithi146.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-05-24T03:33:41.555 INFO:teuthology.orchestra.run.smithi151.stderr: 92.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-05-24T03:33:41.614 INFO:teuthology.orchestra.run.smithi146.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-05-24T03:33:41.616 INFO:teuthology.orchestra.run.smithi146.stderr: 2023-05-24T03:33:41.616 INFO:teuthology.orchestra.run.smithi146.stderr:real 0m2.676s 2023-05-24T03:33:41.617 INFO:teuthology.orchestra.run.smithi146.stderr:user 0m10.069s 2023-05-24T03:33:41.617 INFO:teuthology.orchestra.run.smithi146.stderr:sys 0m0.471s 2023-05-24T03:33:41.995 INFO:teuthology.orchestra.run.smithi151.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-05-24T03:33:42.039 INFO:teuthology.orchestra.run.smithi151.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-05-24T03:33:42.041 INFO:teuthology.orchestra.run.smithi151.stderr: 2023-05-24T03:33:42.041 INFO:teuthology.orchestra.run.smithi151.stderr:real 0m3.075s 2023-05-24T03:33:42.042 INFO:teuthology.orchestra.run.smithi151.stderr:user 0m10.576s 2023-05-24T03:33:42.042 INFO:teuthology.orchestra.run.smithi151.stderr:sys 0m0.369s 2023-05-24T03:33:42.042 INFO:tasks.ceph:Archiving logs... 2023-05-24T03:33:42.043 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi/7284286/remote/smithi146/log 2023-05-24T03:33:42.043 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /var/log/ceph -- . 2023-05-24T03:33:43.489 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi/7284286/remote/smithi151/log 2023-05-24T03:33:43.490 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /var/log/ceph -- . 2023-05-24T03:33:44.718 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-05-24T03:33:44.727 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-05-24T03:33:44.727 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-05-24T03:33:44.730 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-05-24T03:33:44.828 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-05-24T03:33:44.839 INFO:teuthology.task.clock:Checking final clock skew... 2023-05-24T03:33:44.839 DEBUG:teuthology.orchestra.run.smithi146:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-05-24T03:33:44.842 DEBUG:teuthology.orchestra.run.smithi151:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-05-24T03:33:44.857 INFO:teuthology.orchestra.run.smithi151.stderr:bash: ntpq: command not found 2023-05-24T03:33:44.858 INFO:teuthology.orchestra.run.smithi146.stderr:bash: ntpq: command not found 2023-05-24T03:33:44.861 INFO:teuthology.orchestra.run.smithi151.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-05-24T03:33:44.861 INFO:teuthology.orchestra.run.smithi151.stdout:=============================================================================== 2023-05-24T03:33:44.861 INFO:teuthology.orchestra.run.smithi151.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 4 -1780us[-1790us] +/- 89ms 2023-05-24T03:33:44.862 INFO:teuthology.orchestra.run.smithi151.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 4 -841us[ -850us] +/- 96ms 2023-05-24T03:33:44.862 INFO:teuthology.orchestra.run.smithi151.stdout:^* hv03.front.sepia.ceph.com 3 6 377 2 +1967us[+1958us] +/- 70ms 2023-05-24T03:33:44.862 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-05-24T03:33:44.863 INFO:teuthology.orchestra.run.smithi146.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-05-24T03:33:44.863 INFO:teuthology.orchestra.run.smithi146.stdout:=============================================================================== 2023-05-24T03:33:44.864 INFO:teuthology.orchestra.run.smithi146.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 4 -1803us[-1803us] +/- 89ms 2023-05-24T03:33:44.864 INFO:teuthology.orchestra.run.smithi146.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 6 -868us[ -882us] +/- 96ms 2023-05-24T03:33:44.864 INFO:teuthology.orchestra.run.smithi146.stdout:^* hv03.front.sepia.ceph.com 3 6 377 5 +1957us[+1942us] +/- 70ms 2023-05-24T03:33:44.864 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-05-24T03:33:44.866 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-05-24T03:33:44.875 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-05-24T03:33:44.876 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-05-24T03:33:44.886 DEBUG:teuthology.orchestra.run.smithi146:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-05-24T03:33:45.006 DEBUG:teuthology.orchestra.run.smithi151:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-05-24T03:33:45.095 DEBUG:teuthology.orchestra.run.smithi146:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-05-24T03:33:45.129 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-24T03:33:45.129 DEBUG:teuthology.orchestra.run.smithi151:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-05-24T03:33:45.160 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-24T03:33:45.161 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-05-24T03:33:45.170 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-05-24T03:33:45.179 INFO:teuthology.task.internal:Duration was 1078.288898 seconds 2023-05-24T03:33:45.179 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-05-24T03:33:45.188 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-05-24T03:33:45.188 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-05-24T03:33:45.191 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-05-24T03:33:45.237 INFO:teuthology.orchestra.run.smithi146.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-05-24T03:33:45.245 INFO:teuthology.orchestra.run.smithi151.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-05-24T03:33:45.632 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-05-24T03:33:45.633 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi146.front.sepia.ceph.com 2023-05-24T03:33:45.633 DEBUG:teuthology.orchestra.run.smithi146:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-05-24T03:33:45.655 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi151.front.sepia.ceph.com 2023-05-24T03:33:45.656 DEBUG:teuthology.orchestra.run.smithi151:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-05-24T03:33:45.677 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-05-24T03:33:45.678 DEBUG:teuthology.orchestra.run.smithi146:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-05-24T03:33:45.697 DEBUG:teuthology.orchestra.run.smithi151:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-05-24T03:33:45.756 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-05-24T03:33:45.757 DEBUG:teuthology.orchestra.run.smithi146:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-05-24T03:33:45.781 DEBUG:teuthology.orchestra.run.smithi151:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-05-24T03:33:45.883 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-05-24T03:33:45.896 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-05-24T03:33:45.897 DEBUG:teuthology.orchestra.run.smithi146:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-05-24T03:33:45.924 DEBUG:teuthology.orchestra.run.smithi151:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-05-24T03:33:45.952 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-05-24T03:33:45.966 DEBUG:teuthology.orchestra.run.smithi146:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-05-24T03:33:45.969 DEBUG:teuthology.orchestra.run.smithi151:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-05-24T03:33:45.992 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern = core 2023-05-24T03:33:46.018 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern = core 2023-05-24T03:33:46.032 DEBUG:teuthology.orchestra.run.smithi146:> test -e /home/ubuntu/cephtest/archive/coredump 2023-05-24T03:33:46.062 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-24T03:33:46.062 DEBUG:teuthology.orchestra.run.smithi151:> test -e /home/ubuntu/cephtest/archive/coredump 2023-05-24T03:33:46.087 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-24T03:33:46.087 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-05-24T03:33:46.104 INFO:teuthology.task.internal:Transferring archived files... 2023-05-24T03:33:46.105 DEBUG:teuthology.misc:Transferring archived files from smithi146:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi/7284286/remote/smithi146 2023-05-24T03:33:46.106 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-05-24T03:33:46.144 DEBUG:teuthology.misc:Transferring archived files from smithi151:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi/7284286/remote/smithi151 2023-05-24T03:33:46.144 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-05-24T03:33:46.178 INFO:teuthology.task.internal:Removing archive directory... 2023-05-24T03:33:46.179 DEBUG:teuthology.orchestra.run.smithi146:> rm -rf -- /home/ubuntu/cephtest/archive 2023-05-24T03:33:46.181 DEBUG:teuthology.orchestra.run.smithi151:> rm -rf -- /home/ubuntu/cephtest/archive 2023-05-24T03:33:46.230 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-05-24T03:33:46.240 INFO:teuthology.task.internal:Not uploading archives. 2023-05-24T03:33:46.241 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-05-24T03:33:46.251 INFO:teuthology.task.internal:Tidying up after the test... 2023-05-24T03:33:46.252 DEBUG:teuthology.orchestra.run.smithi146:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-05-24T03:33:46.254 DEBUG:teuthology.orchestra.run.smithi151:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-05-24T03:33:46.268 INFO:teuthology.orchestra.run.smithi146.stdout: 262307 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 24 03:33 /home/ubuntu/cephtest 2023-05-24T03:33:46.285 INFO:teuthology.orchestra.run.smithi151.stdout: 262320 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 24 03:33 /home/ubuntu/cephtest 2023-05-24T03:33:46.286 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-05-24T03:33:46.297 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-05-24T03:33:46.319 INFO:teuthology.nuke:Checking targets against current locks 2023-05-24T03:33:46.348 DEBUG:teuthology.nuke:shortname: smithi146 2023-05-24T03:33:46.349 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-05-24T03:33:46.375 DEBUG:teuthology.nuke:shortname: smithi151 2023-05-24T03:33:46.375 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-05-24T03:33:46.378 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi146.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi/7284286', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-05-24 03:10:03.809855', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-05-24T03:33:46.405 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi151.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-05-23_18:20:18-fs-wip-pdonnell-testing-20230523.134409-distro-default-smithi/7284286', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-05-24 03:10:03.811407', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-05-24T03:33:46.439 INFO:teuthology.orchestra.console:Power off smithi146 2023-05-24T03:33:46.440 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-05-24T03:33:46.464 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-05-24T03:33:46.482 INFO:teuthology.orchestra.console:Power off smithi151 2023-05-24T03:33:46.483 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-05-24T03:33:46.510 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-05-24T03:33:50.497 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-05-24T03:33:50.533 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-05-24T03:33:54.612 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-05-24T03:33:54.647 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-05-24T03:33:54.825 INFO:teuthology.orchestra.console:Power off for smithi146 completed 2023-05-24T03:33:58.764 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-05-24T03:33:58.977 INFO:teuthology.orchestra.console:Power off for smithi151 completed 2023-05-24T03:33:59.084 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/workunit/quota} duration: 1078.2888984680176 failure_reason: 'Command failed (workunit test fs/quota/quota.sh) on smithi146 with status 1: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fa0e62c4a1d8e4a737d9cbe50224f70009b79b28 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/quota/quota.sh''' flavor: default owner: scheduled_pdonnell@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=97380c88b43d4f2e8a0b59a016aa9727 status: fail success: false 2023-05-24T03:33:59.085 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-05-24T03:33:59.171 INFO:teuthology.run:FAIL